Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Development of Neural Network for X-59 Air Data Probe Calibration

Two wind tunnel tests were conducted in the NASA Glenn Research Center (GRC) 8- by 6-Foot Supersonic Wind Tunnel to calibrate the nose-mounted air data probe for the X-59. The probe will be the primary instrument for the flight test of the X-59 for determining angle of attack, angle of sideslip, airspeed, and pressure altitude of the aircraft in flight. This paper documents the development of several neural net algorithms that can be used to relate air data probe port pressures from those tests to relevant X-59 flight parameters, such as angle of attack, angle of sideslip, mach number, and static and dynamic pressure. These calibration algorithms address accuracy effects for significant real-world conditions, such as initial sensor measurement uncertainties, assumed parameter constraints on NN modelling errors, and malfunctioning or plugged ports. Resultant integrated uncertainties are provided for each algorithm; these uncertainties are then used to estimate the effects on relevant X-59 mission parameters.

Kurtis Roy Long↗

Maneuver Design Implementation and Verification for the Mars 2020 Mission

On February 18, 2021, the Perseverance rover landed in Jezero Crater on Mars, transported by the Mars 2020 spacecraft on a nearly seven-month journey to the Red Planet. The execution of three propulsive maneuvers during the interplanetary cruise phase was required to remove the launch-injection bias and deliver the spacecraft to the Mars atmospheric entry point. This paper focuses on the maneuver implementation and verification process between the navigation and spacecraft teams. Additionally, this paper discusses the execution error models that were used to determine maneuver performance and delivery accuracy at the atmospheric entry interface point.

Kruizinga, Gerhard↗

Probabalistic Risk Analysis and Thermal Margin Process for an Inflatable Aeroshell

Uncertainties always exist in atmospheric entry aeroheating environments and the thermal response of thermal protection system (TPS) material. These uncertainties are mitigated in the design by ap-plying margin and factors of safety to the TPS. Entry vehicle TPS is often conservatively over-sized for the heat loads that are experienced along the entry trajectory by stacking worst-case scenarios together. Additionally, the current TPS design and margin process used by NASA offers very little insight into the risk of over-temperature during flight and the reliability of the heat shield performance [1,3]. A probabilistic margin process can be used to calculate the amount of TPS margin necessary to survive a given entry heat load at a specified level of risk [2,3,4]. The vehicle’s initial entry state (entry velocity, flight path angle, and entry mass) determines the expected atmospheric entry environmental conditions and resulting heat load that the entry vehicle will experience. If there is flexibility in the entry state, then this process can be used to select an appropriate combination of entry state parameters and TPS size to target a desired reentry reliability. This probabilistic margin process allows engineers to make informed aeroshell design, entry-trajectory design, and TPS performance risk trades while preventing excessive TPS margin from being applied. The probabilistic TPS margin process has been performed to determine TPS thickness and entry heating constraints given an acceptable risk level for the Low Earth Orbit Flight Experiment of an Inflatable Decelerator (LOFTID) flight project. The process is used in a manner to size the entry heat load for a given flexible TPS (FTPS) thickness so that it meets project reliability standards while allowing the FTPS and the underlying inflatable structure (IS) to be pushed to adequately high temperatures. Since the LOFTID project is an experimental flight demonstration, it is de-sired to drive the FTPS and IS to temperatures that cover a large range of their thermal response models’ applicability. This will allow the thermal response models to be better improved and validated post-flight using LOFTID’s extensive instrumentation embedded within the aeroshell. The presentation demonstrates how uncertainty analysis is carried out using an end-to-end Monte Carlo process where three separate Monte Carlo simulations are run in sequence. The first Monte Carlo simulation operates on the entry trajectory model to generate trajectory parameter dispersions that are fed into the second Monte Carlo simulation. The second Monte Carlo simulation operates on the aerothermodynamics model to generate aeroheating parameter dispersions that are fed into the third Monte Carlo simulation. The third Monte Carlo simulation operates on the FTPS material thermal response model to generate the final FTPS/IS thermal response dispersions. The end-to-end Monte Carlo simulation propagates the uncertainties of each model into the next to quantify the resulting uncertainty of the FTPS/IS thermal response. The fractional contributions of the uncertain parameters in the trajectory, aerothermal, and thermal response models to the variance in the FTPS/IS thermal response is determined as a byproduct of the Monte Carlo analysis. The structural uncertainty of the FTPS thermal response model is evaluated by flight relevant ground testing and model error analysis using test measurements. This probabilistic TPS margin process had never been applied to an entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven A. Tobin↗

Can Remotely Sensed Snow Disappearance Explain Seasonal Water Supply?

Understanding the relationship between remotely sensed snow disappearance and seasonal water supply may become vital in coming years to supplement limited ground based, in situ measurements of snow in a changing climate. For the period 2001–2019, we investigated the relationship between satellite derived Day of Snow Disappearance (DSD)—the date at which snow has completely disappeared—and the seasonal water supply, i.e., the April—July total streamflow volume, for 15 snow dominated basins across the western U.S. A Monte Carlo framework was applied, using linear regression models to evaluate the predictive skill—defined here as a model’s ability to accurately predict seasonal flow volumes—of varied predictors, including DSD and in situ snow water equivalent (SWE), across a range of spring forecast dates. In all basins there is a statistically significant relationship between mean DSD and seasonal water supply (p ≤ 0.05), with mean DSD explaining roughly half of the variance. Satellite-based model skill improves later in the forecast season, surpassing the skill of in-situ-based (SWE) models in skill in 10 of the 15 basins by the latest forecast date. We found little to no correlation between model error and basin characteristics such as elevation and the ratio of snow water equivalent to total precipitation. Despite a relatively short data record, this exploratory analysis shows promise for improving seasonal water supply prediction, in particular for snow dominated basins lacking in situ observations.

snow remote sensing↗

Adiabatic Gravitational Waveform Model for Compact Objects Undergoing Quasi-Circular Inspirals Into Rotating Massive Black Holes

We present bhpwave: a new python-based, open-source tool for generating the gravitational waveforms of stellar-mass compact objects undergoing quasicircular inspirals into rotating massive black holes. These binaries, known as extreme-mass-ratio inspirals (EMRIs), are exciting mHz gravitational wave sources for future space-based detectors such as the Laser Interferometer Space Antenna (LISA). Relativistic models of EMRI gravitational wave signals are necessary to unlock the full scientific potential of mHz detectors, yet few open-source EMRI waveform models exist. Thus we built bhpwave, which uses the adiabatic approximation from black hole perturbation theory to rapidly construct gravitational waveforms based on the leading-order inspiral dynamics of the binary. In this work, we present the theoretical and numerical foundations underpinning bhpwave. We also demonstrate how bhpwave can be used to assess the impact of EMRI modeling errors on LISA gravitational wave data analysis. In particular, we find that for retrograde orbits and slowly spinning black holes we can mismodel the gravitational wave phasing by as much as ∼10 radians without significantly biasing EMRI parameter estimation.

Zachary Nasipak↗

Pre-Launch Calibration and Validation of the Airborne Hyper-Angular Rainbow Polarimeter (AirHARP) Instrument

The Airborne Hyper-Angular Rainbow Polarimeter (AirHARP) is a new imaging polarimeter instrument capable of sampling a single Earth target from up to 120 viewing angles, in four spectral channels, and in three linear polarization states across a 114° field of view (FOV). AirHARP is telecentric in the image space and simultaneously images three linear polarization states with no moving parts. These two aspects of the design allow for a simple and efficient quantitative calibration. Using coefficients derived at the center of the lens and the detector flatfields, we can calibrate the entire AirHARP sensor in a variety of laboratory, field, and space environments. We show that this telecentric calibration technique yields a 1σ absolute uncertainty of 0.25 % in degree of linear polarization (DOLP) in the laboratory for all channels and for pixels around the optical axis. To validate across the FOV, we compare our multi-angle reflectance and polarization data with the Research Scanning Polarimeter (RSP) over targets sampled during the NASA Aerosol Characterization from Polarimeter and Lidar (ACEPOL) campaign. We use the error-normalized difference technique to estimate how well the instruments compare relative to their error models. We find that AirHARP and the RSP reasonably agree for reflectance and DOLP within 2 standard deviations of their mutual uncertainty at 550, 670, and 870 nm and over a limited set of ocean and desert scenes. This calibration technique makes the Hyper-Angular Rainbow Polarimeter (HARP) design attractive for new spaceborne climate missions: HARP CubeSat (2020–2022), HARP2 (2024–) on the NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE), and beyond.

Airborne Hyper-Angular Rainbow Polarimeter↗

Sensitivity of Simulated Radiative Emission from Nitrogen Flows to Chemical Parameters

Numerical models of hypersonic flows rely on chemistry data inferred from experiments and quantum calculations. Experiments from NASA's Electric Arc Shock Tube (EAST) measure the spectral emission of strong shocks in pure nitrogen flows. These spectral profiles are only approximately captured by numerical simulations. To address these discrepancies, one wishes to calibrate some of the chemical parameters to better match experiment. Because there are hundreds of parameters in the numerical model, a sensitivity analysis was carried out on the entire chemistry database to determine which parameters are most important to analyze in the future. In order to perform this work it was necessary to generate a consistent chemical database that interfaced with both the CFD and line-by-line radiation solver. Using Monte Carlo methods, the total Sobol index was calculated for important parameters. Twenty parameters were identified as important across the nitrogen system. However, it was noted that in some spectral regions, the parametric uncertainty was unable to bound EAST measurements. Further improvements could be made by increasing the parameter uncertainties or addressing other sources of modeling error.

Kaelan B Hansson↗

Sensitivity of Simulated Radiative Emission from Nitrogen Flows to Chemical Parameters

Numerical models of hypersonic flows rely on chemistry data inferred from experiments and quantum calculations. Experiments from NASA's Electric Arc Shock Tube (EAST) measure the spectral emission of strong shocks in pure nitrogen flows. These spectral profiles are only approximately captured by numerical simulations. To address these discrepancies, one wishes to calibrate some of the chemical parameters to better match experiment. Because there are hundreds of parameters in the numerical model, a sensitivity analysis was carried out on the entire chemistry database to determine which parameters are most important to analyze in the future. In order to perform this work it was necessary to generate a consistent chemical database that interfaced with both the CFD and line-by-line radiation solver. Using Monte Carlo methods, the total Sobol index was calculated for important parameters. Twenty parameters were identified as important across the nitrogen system. However, it was noted that in some spectral regions, the parametric uncertainty was unable to bound EAST measurements. Further improvements could be made by increasing the parameter uncertainties or addressing other sources of modeling error.

Kaelan Hansson↗

Using complex resistivity imaging to infer biogeochemical processes associated with bioremediation of a uranium-contaminated aquifer

Experiments at the Department of Energy's Rifle Integrated Field Research Challenge (IFRC) site near Rifle, Colorado (USA) have demonstrated the ability to remove uranium from groundwater by stimulating the growth and activity of Geobacter species through acetate amendment. Prolonging the activity of these strains in order to optimize uranium bioremediation has prompted the development of minimally-invasive and spatially-extensive monitoring methods diagnostic of their in situ activity and the end products of their metabolism. Here we demonstrate the use of complex resistivity imaging for monitoring biogeochemical changes accompanying stimulation of indigenous aquifer microorganisms during and after a prolonged period (100+ days) of acetate injection. A thorough raw-data statistical analysis of discrepancies between normal and reciprocal measurements and incorporation of a new power-law phase-error model in the inversion were used to significantly improve the quality of the resistivity phase images over those obtained during previous monitoring experiments at the Rifle IRFC site. The imaging results reveal spatiotemporal changes in the phase response of aquifer sediments, which correlate with increases in Fe(II) and precipitation of metal sulfides (e.g., FeS) following the iterative stimulation of iron and sulfate reducing microorganism. Only modest changes in resistivity magnitude were observed over the monitoring period. The largest phase anomalies (>40 mrad) were observed hundreds of days after halting acetate injection, in conjunction with accumulation of Fe(II) in the presence of residual FeS minerals, reflecting preservation of geochemically reduced conditions in the aquifer - a prerequisite for ensuring the long-term stability of immobilized, redox-sensitive contaminants, such as uranium.

54 ENVIRONMENTAL SCIENCES↗

RELIABILITY BASED DESIGN OF FIXED FOUNDATION WIND TURBINES

Recent analysis of offshore wind turbine foundations using both applicable API and IEC standards show that the total load demand from wind and waves is greatest in wave driven storms. Further, analysis of overturning moment loads (OTM) reveal that impact forces exerted by breaking waves are the largest contributor to OTM in big storms at wind speeds above the operating range of 25 m/s. Currently, no codes or standards for offshore wind power generators have been adopted by the Bureau of Ocean Energy Management Regulation and Enforcement (BOEMRE) for use on the Outer Continental Shelf (OCS). Current design methods based on allowable stress design (ASD) incorporate the uncertainty in the variation of loads transferred to the foundation and geotechnical capacity of the soil and rock to support the loads is incorporated into a factor of safety. Sources of uncertainty include spatial and temporal variation of engineering properties, reliability of property measurements applicability and sufficiency of sampling and testing methods, modeling errors, and variability of estimated load predictions. In ASD these sources of variability are generally given qualitative rather than quantitative consideration. The IEC 61400‐3 design standard for offshore wind turbines is based on ASD methods. Load and resistance factor design (LRFD) methods are being increasingly used in the design of structures. Uncertainties such as those listed above can be included quantitatively into the LRFD process. In LRFD load factors and resistance factors are statistically based. This type of analysis recognizes that there is always some probability of failure and enables the probability of failure to be quantified. This paper presents an integrated approach consisting of field observations and numerical simulation to establish the distribution of loads from breaking waves to support the LRFD of fixed offshore foundations.

17 WIND ENERGY↗

Estimating Power System Dynamic States Using Extended Kalman Filter

Abstract—The state estimation tools which are currently deployed in power system control rooms are based on a steady state assumption. As a result, the suite of operational tools that rely on state estimation results as inputs do not have dynamic information available and their accuracy is compromised. This paper investigates the application of Extended Kalman Filtering techniques for estimating dynamic states in the state estimation process. The new formulated “dynamic state estimation” includes true system dynamics reflected in differential equations, not like previously proposed “dynamic state estimation” which only considers the time-variant snapshots based on steady state modeling. This new dynamic state estimation using Extended Kalman Filter has been successfully tested on a multi-machine system. Sensitivity studies with respect to noise levels, sampling rates, model errors, and parameter errors are presented as well to illustrate the robust performance of the developed dynamic state estimation process.

Huang, Zhenyu↗

Bayesian calibration of reactor neutron flux spectrum using activation detectors measurements: Application to CALIBAN reactor

In this paper, we present calibration methods in order to estimate reactor neutron flux spectrum and its uncertainties by using integral activation measurements. These techniques are performed using Bayesian and MCMC framework. These methods are applied to integral activation experiments in the cavity of the CALIBAN reactor. We estimate the neutron flux and its related uncertainties. The originality of this work is that these uncertainties take into account measurements uncertainties, cross-sections uncertainties and model error. In particular, our results give a very good approximation of the total flux and indicate that neutron flux from MCNP simulation for energies above about 5 MeV seems to overestimate the 'real flux'. (authors)

97 MATHEMATICS AND COMPUTING↗

\texttt{qec\_code\_sim}: An open-source Python framework for estimating the effectiveness of quantum-error correcting codes on superconducting qubits

Quantum computers are highly susceptible to errors due to unintended interactions with their environment. It is crucial to correct these errors without gaining information about the quantum state, which would result in its destruction through back-action. Quantum Error Correction (QEC) provides information about occurred errors without compromising the quantum state of the system. However, the implementation of QEC has proven to be challenging due to the current performance levels of qubits -- break-even requires fabrication and operation quality that is beyond the state-of-the-art. Understanding how qubit performance factors into the success of a QEC code is a valuable exercise for tracking progress towards fault-tolerant quantum computing. Here we present \texttt{qec\_code\_sim}, an open-source, lightweight Python framework for studying the performance of small quantum error correcting codes under the influence of a realistic error model appropriate for superconducting transmon qubits, with the goal of enabling useful hardware studies and experiments. \texttt{qec\_code\_sim} requires minimal software dependencies and prioritizes ease of use, ease of change, and pedagogy over execution speed. As such, it is a tool well-suited to small teams studying systems on the order of one dozen qubits.

Lopez, Santiago↗

DUNE-PRISM – A New Method to Measure Neutrino Oscillations

The Deep Underground Neutrino Experiment (DUNE) is a next-generation long baseline neutrino oscillation experiment designed to make precision measurements in a 1.2 2.4 MW neutrino beam, which is directed 1285 km from the Fermi National Accelerator Laboratory (Fermilab) to the Sandford Underground Research Facility (SURF) in South Dakota. Neutrinos are measured at two detector facilities: a near detector located at Fermilab close where the beam is produced and a far detector at SURF. The neutrino beam can be configured to be composed primarily of either muon or anti-muon neutrinos. DUNE measures the disappearance of muon and anti-muon neutrinos and appearance electron and anti-electron neutrinos in the neutrino beam. Measuring these neutrino flavour transitions provides DUNE with sensitivity to the neutrino mass ordering, $\delta_{CP}$, $\theta_{13}$, $\theta_{23}$ and the magnitude of $\Delta m^2_{23}$. The DUNE Precision Reaction Independent Spectrum Measurement (DUNE-PRISM) concept presents a novel way to perform a neutrino oscillation analysis, which has the potential to significantly reduce the impact of large systematic uncertainties in the neutrino interaction model. The PRISM method linearly combines measurements of off-axis neutrino interactions at the DUNE near detector to produce data-driven predictions of the oscillated neutrino event rate spectrum at the far detector. By building an oscillated far detector prediction directly from data, any unknown or poorly modelled neutrino interaction effects will be naturally incorporated into the measurement of the parameters of the neutrino oscillation model. This thesis presents the first complete neutrino oscillation analysis for DUNE using the PRISM method. Details of the methodology are fully explained and the prospects for further improvements to the techniques described are highlighted. The expected impact and relative importance of the neutrino flux, cross section and detector systematic uncertainties are described in detail. Finally, this thesis demonstrates that the PRISM method is capable of performing a measurement of the oscillation parameters that is robust against neutrino interaction modelling errors.

Hasnip, Ciaran↗

Using computer-extracted image features for modeling of error-making patterns in detection of mammographic masses among radiology residents

Purpose: Mammography is the most widely accepted and utilized screening modality for early breast cancer detection. Providing high quality mammography education to radiology trainees is essential, since excellent interpretation skills are needed to ensure the highest benefit of screening mammography for patients. The authors have previously proposed a computer-aided education system based on trainee models. Those models relate human-assessed image characteristics to trainee error. In this study, the authors propose to build trainee models that utilize features automatically extracted from images using computer vision algorithms to predict likelihood of missing each mass by the trainee. This computer vision-based approach to trainee modeling will allow for automatically searching large databases of mammograms in order to identify challenging cases for each trainee. Methods: The authors’ algorithm for predicting the likelihood of missing a mass consists of three steps. First, a mammogram is segmented into air, pectoral muscle, fatty tissue, dense tissue, and mass using automated segmentation algorithms. Second, 43 features are extracted using computer vision algorithms for each abnormality identified by experts. Third, error-making models (classifiers) are applied to predict the likelihood of trainees missing the abnormality based on the extracted features. The models are developed individually for each trainee using his/her previous reading data. The authors evaluated the predictive performance of the proposed algorithm using data from a reader study in which 10 subjects (7 residents and 3 novices) and 3 experts read 100 mammographic cases. Receiver operating characteristic (ROC) methodology was applied for the evaluation. Results: The average area under the ROC curve (AUC) of the error-making models for the task of predicting which masses will be detected and which will be missed was 0.607 (95% CI,0.564-0.650). This value was statistically significantly different from 0.5 (p < 0.0001). For the 7 residents only, the AUC performance of the models was 0.590 (95% CI,0.537-0.642) and was also significantly higher than 0.5 (p = 0.0009). Therefore, generally the authors’ models were able to predict which masses were detected and which were missed better than chance. Conclusions: The authors proposed an algorithm that was able to predict which masses will be detected and which will be missed by each individual trainee. This confirms existence of error-making patterns in the detection of masses among radiology trainees. Furthermore, the proposed methodology will allow for the optimized selection of difficult cases for the trainees in an automatic and efficient manner.

60 APPLIED LIFE SCIENCES↗

MO-C-17A-04: Forecasting Longitudinal Changes in Oropharyngeal Tumor Morphology Throughout the Course of Head and Neck Radiation Therapy

Purpose: To generate, evaluate, and compare models that predict longitudinal changes in tumor morphology throughout the course of radiation therapy. Methods: Two morphology feature vectors were used to describe the size, shape, and position of 35 oropharyngeal GTVs at each treatment fraction during intensity-modulated radiation therapy. The feature vectors comprised the coordinates of the GTV centroids and one of two shape descriptors. One shape descriptor was based on radial distances between the GTV centroid and 614 GTV surface landmarks. The other was based on a spherical harmonic decomposition of these distances. Feature vectors over the course of therapy were described using static, linear, and mean models. The error of these models in forecasting GTV morphology was evaluated with leave-one-out cross-validation, and their accuracy was compared using Wilcoxon signed-rank tests. The effect of adjusting model parameters at 1, 2, 3, or 5 time points (adjustment points) was also evaluated. Results: The addition of a single adjustment point to the static model decreased the median error in forecasting the position of GTV surface landmarks by 1.2 mm (p<0.001). Additional adjustment points further decreased forecast error by about 0.4 mm each. The linear model decreased forecast error compared to the static model for feature vectors based on both shape descriptors (0.2 mm), while the mean model did so only for those based on the inter-landmark distances (0.2 mm). The decrease in forecast error due to adding adjustment points was greater than that due to model selection. Both effects diminished with subsequent adjustment points. Conclusion: Models of tumor morphology that include information from prior patients and/or prior treatment fractions are able to predict the tumor surface at each treatment fraction during radiation therapy. The predicted tumor morphology can be compared with patient anatomy or dose distributions, opening the possibility of anticipatory re-planning. American Legion Auxiliary Fellowship; The University of Texas Graduate School of Biomedical Sciences at Houston.

60 APPLIED LIFE SCIENCES↗

The Role of Model and Initial Condition Error in Numerical Weather Forecasting Investigated with an Observing System Simulation Experiment

A series of experiments that explore the roles of model and initial condition error in numerical weather prediction are performed using an observing system simulation experiment (OSSE) framework developed at the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO). The use of an OSSE allows the analysis and forecast errors to be explicitly calculated, and different hypothetical observing networks can be tested with ease. In these experiments, both a full global OSSE framework and an 'identical twin' OSSE setup are utilized to compare the behavior of the data assimilation system and evolution of forecast skill with and without model error. The initial condition error is manipulated by varying the distribution and quality of the observing network and the magnitude of observation errors. The results show that model error has a strong impact on both the quality of the analysis field and the evolution of forecast skill, including both systematic and unsystematic model error components. With a realistic observing network, the analysis state retains a significant quantity of error due to systematic model error. If errors of the analysis state are minimized, model error acts to rapidly degrade forecast skill during the first 24-48 hours of forward integration. In the presence of model error, the impact of observation errors on forecast skill is small, but in the absence of model error, observation errors cause a substantial degradation of the skill of medium range forecasts.

Model Error↗

Modeling human tracking error in several different anti-tank systems

An optimal control model for generating time histories of human tracking errors in antitank systems is outlined. Monte Carlo simulations of human operator responses for three Army antitank systems are compared. System/manipulator dependent data comparisons reflecting human operator limitations in perceiving displayed quantities and executing intended control motions are presented. Motor noise parameters are also discussed.

Kleinman, D. L.↗