Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data and model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Uncertainties in estimates of the risks of late effects from space radiation

Methods used to project risks in low-Earth orbit are of questionable merit for exploration missions because of the limited radiobiology data and knowledge of galactic cosmic ray (GCR) heavy ions, which causes estimates of the risk of late effects to be highly uncertain. Risk projections involve a product of many biological and physical factors, each of which has a differential range of uncertainty due to lack of data and knowledge. Using the linear-additivity model for radiation risks, we use Monte-Carlo sampling from subjective uncertainty distributions in each factor to obtain an estimate of the overall uncertainty in risk projections. The resulting methodology is applied to several human space exploration mission scenarios including a deep space outpost and Mars missions of duration of 360, 660, and 1000 days. The major results are the quantification of the uncertainties in current risk estimates, the identification of factors that dominate risk projection uncertainties, and the development of a method to quantify candidate approaches to reduce uncertainties or mitigate risks. The large uncertainties in GCR risk projections lead to probability distributions of risk that mask any potential risk reduction using the "optimization" of shielding materials or configurations. In contrast, the design of shielding optimization approaches for solar particle events and trapped protons can be made at this time and promising technologies can be shown to have merit using our approach. The methods used also make it possible to express risk management objectives in terms of quantitative metrics, e.g., the number of days in space without exceeding a given risk level within well-defined confidence limits. Published by Elsevier Ltd on behalf of COSPAR.

Non-NASA Center↗

Evaluation of Arctic Warming in Mid-Pliocene Climate Simulations

Palaeoclimate simulations improve our understanding of the climate, inform us about the performance of climate models in a different climate scenario, and help to identify robust features of the climate system. Here, we analyse Arctic warming in an ensemble of 16 simulations of the mid-Pliocene Warm Period (mPWP), derived from the Pliocene Model Intercomparison Project Phase 2 (PlioMIP2). The PlioMIP2 ensemble simulates Arctic (60–90∘ N) annual mean surface air temperature (SAT) increases of 3.7 to 11.6 ∘C compared to the pre-industrial period, with a multi-model mean (MMM) increase of 7.2 ∘C. The Arctic warming amplification ratio relative to global SAT anomalies in the ensemble ranges from 1.8 to 3.1 (MMM is 2.3). Sea ice extent anomalies range from −3.0 to −10.4×106 km2, with a MMM anomaly of −5.6×106 km2, which constitutes a decrease of 53 % compared to the pre-industrial period. The majority (11 out of 16) of models simulate summer sea-ice-free conditions (≤1×106 km2) in their mPWP simulation. The ensemble tends to underestimate SAT in the Arctic when compared to available reconstructions, although the degree of underestimation varies strongly between the simulations. The simulations with the highest Arctic SAT anomalies tend to match the proxy dataset in its current form better. The ensemble shows some agreement with reconstructions of sea ice, particularly with regard to seasonal sea ice. Large uncertainties limit the confidence that can be placed in the findings and the compatibility of the different proxy datasets. We show that while reducing uncertainties in the reconstructions could decrease the SAT data–model discord substantially, further improvements are likely to be found in enhanced boundary conditions or model physics. Lastly, we compare the Arctic warming in the mPWP to projections of future Arctic warming and find that the PlioMIP2 ensemble simulates greater Arctic amplification than CMIP5 future climate simulations and an increase instead of a decrease in Atlantic Meridional Overturning Circulation (AMOC) strength compared to pre-industrial period. The results highlight the importance of slow feedbacks in equilibrium climate simulations, and that caution must be taken when using simulations of the mPWP as an analogue for future climate change.

Palaeoclimate simulations↗

A Statistics-Based Material Property Analysis to Support TPS Characterization

Accurate characterization of entry capsule heat shield material properties is a critical component in modeling and simulating Thermal Protection System (TPS) response in a prescribed aerothermal environment. The thermal decomposition of the TPS material during the pyrolysis and charring processes is poorly characterized and typically results in large uncertainties in material properties as inputs for ablation models. These material property uncertainties contribute to large design margins on flight systems and cloud re- construction efforts for data collected during flight and ground testing, making revision to existing models for entry systems more challenging. The analysis presented in this work quantifies how material property uncertainties propagate through an ablation model and guides an experimental test regimen aimed at reducing these uncertainties and characterizing the dependencies between properties in the virgin and charred states for a Phenolic Impregnated Carbon Ablator (PICA) based TPS. A sensitivity analysis identifies how the high-fidelity model behaves in the expected flight environment, while a Monte Carlo based uncertainty propagation strategy is used to quantify the expected spread in the in-depth temperature response of the TPS. An examination of how perturbations to the input probability density functions affect output temperature statistics is accomplished using a Kriging response surface of the high-fidelity model. Simulations are based on capsule configuration and aerothermal environments expected during the Mars Science Laboratory (MSL) entry sequence. We identify and rank primary sources of uncertainty from material properties in a flight-relevant environment, show the dependence on spatial orientation and in-depth location on those uncertainty contributors, and quantify how sensitive the expected results are.

Copeland, Sean R.↗

A detailed description of the uncertainty analysis for High Area Ratio Rocket Nozzle tests at the NASA Lewis Research Center

A preliminary uncertainty analysis has been performed for the High Area Ratio Rocket Nozzle test program which took place at the altitude test capsule of the Rocket Engine Test Facility at the NASA Lewis Research Center. Results from the study establish the uncertainty of measured and calculated parameters required for the calculation of rocket engine specific impulse. A generalized description of the uncertainty methodology used is provided. Specific equations and a detailed description of the analysis are presented. Verification of the uncertainty analysis model was performed by comparison with results from the experimental program's data reduction code. Final results include an uncertainty for specific impulse of 1.30 percent. The largest contributors to this uncertainty were calibration errors from the test capsule pressure and thrust measurement devices.

Kenneth J. Davidian↗

A detailed description of the uncertainty analysis for high area ratio rocket nozzle tests at the NASA Lewis Research Center

A preliminary uncertainty analysis was performed for the High Area Ratio Rocket Nozzle test program which took place at the altitude test capsule of the Rocket Engine Test Facility at the NASA Lewis Research Center. Results from the study establish the uncertainty of measured and calculated parameters required for the calculation of rocket engine specific impulse. A generalized description of the uncertainty methodology used is provided. Specific equations and a detailed description of the analysis is presented. Verification of the uncertainty analysis model was performed by comparison with results from the experimental program's data reduction code. Final results include an uncertainty for specific impulse of 1.30 percent. The largest contributors to this uncertainty were calibration errors from the test capsule pressure and thrust measurement devices.

Davidian, Kenneth J.↗

Derivation of Integrated Load Distributions from Resampled Computational Data

Principal component analysis (PCA) has been the center of many surrogate models used to characterize fluid flows in recent years. However, little work has been done to character- ize the uncertainty in the PCA transform itself and its effect on derived surrogate models. To explore the uncertainty, a typical interpolated surrogate model is constructed for a represen- tative aerodynamic body from computational data. The computational data is then resampled to explore the robustness of the PCA transformation. The variations of the model predictions during this resampling are analyzed to get a measure of confidence in the PCA transformation, which is then applied to the interpolated surrogate model to get uncertainty on integrated force predictions. An initial test case has been explored with promising results.

Principal Component Analysis↗

Derivation of Integrated Load Distributions from Resampled Computational Data

Principal component analysis (PCA) has been the center of many surrogate models used to characterize fluid flows in recent years. However, little work has been done to character- ize the uncertainty in the PCA transform itself and its effect on derived surrogate models. To explore the uncertainty, a typical interpolated surrogate model is constructed for a represen- tative aerodynamic body from computational data. The computational data is then resampled to explore the robustness of the PCA transformation. The variations of the model predictions during this resampling are analyzed to get a measure of confidence in the PCA transformation, which is then applied to the interpolated surrogate model to get uncertainty on integrated force predictions. An initial test case has been explored with promising results.

Computational Fluid Dynamics↗

An improved error assessment for the GEM-T1 gravitational model

Several tests have been designed to estimate the correct error variances for the GEM-T1 gravitational solution that was derived exclusively from satellite tracking data. The basic method uses both independent and dependent subset data solutions and produces a coefficient-by-coefficient estimate of the model uncertainties. The GEM-T1 errors have been further analyzed using a method based on eigenvalue-eigenvector analysis, which calibrates the entire covariance matrix. Dependent satellite data sets and independent altimetric, resonant satellite, and surface gravity data sets all confirm essentially the same error assessment. The calibration test results yield very stable calibration factors, which vary only by approximately 10 percent over the range of tests performed. Based on these calibrated error estimates, GEM-T1 is a significantly improved solution, which to degree and order 8 is twice as accurate as earlier satellite derived models like GEM-L2. Also, by being complete to degree and order 36, GEM-T1 is more complete and has significantly reduced aliasing effects that were present in previous models.

Lerch, F. J.↗

Use of A-Train Aerosol Observations to Constrain Direct Aerosol Radiative Effects (DARE) Comparisons with Aerocom Models and Uncertainty Assessments

We describe a technique for combining multiple A-Train aerosol data sets, namely MODIS spectral AOD (aerosol optical depth), OMI AAOD (absorption aerosol optical depth) and CALIOP aerosol backscatter retrievals (hereafter referred to as MOC retrievals) to estimate full spectral sets of aerosol radiative properties, and ultimately to calculate the 3-D distribution of direct aerosol radiative effects (DARE). We present MOC results using almost two years of data collected in 2007 and 2008, and show comparisons of the aerosol radiative property estimates to collocated AERONET retrievals. Use of the MODIS Collection 6 AOD data derived with the dark target and deep blue algorithms has extended the coverage of the MOC retrievals towards higher latitudes. The MOC aerosol retrievals agree better with AERONET in terms of the single scattering albedo (ssa) at 441 nm than ssa calculated from OMI and MODIS data alone, indicating that CALIOP aerosol backscatter data contains information on aerosol absorption. We compare the spatio-temporal distribution of the MOC retrievals and MOC-based calculations of seasonal clear-sky DARE to values derived from four models that participated in the Phase II AeroCom model intercomparison initiative. Overall, the MOC-based calculations of clear-sky DARE at TOA over land are smaller (less negative) than previous model or observational estimates due to the inclusion of more absorbing aerosol retrievals over brighter surfaces, not previously available for observationally-based estimates of DARE. MOC-based DARE estimates at the surface over land and total (land and ocean) DARE estimates at TOA are in between previous model and observational results. Comparisons of seasonal aerosol property to AeroCom Phase II results show generally good agreement best agreement with forcing results at TOA is found with GMI-MerraV3. We discuss sampling issues that affect the comparisons and the major challenges in extending our clear-sky DARE results to all-sky conditions. We present estimates of clear-sky and all-sky DARE and show uncertainties that stem from the assumptions in the spatial extrapolation and accuracy of aerosol and cloud properties, in the diurnal evolution of these properties, and in the radiative transfer calculations.

aerosol↗

Remote Sensing of Aerosol in the Terrestrial Atmosphere from Space: New Missions

The distribution and properties of atmospheric aerosols on a global scale are not well known in terms of determination of their effects on climate. This mostly is due to extreme variability of aerosol concentrations, properties, sources, and types. Aerosol climate impact is comparable to the effect of greenhouse gases, but its influence is more difficult to measure, especially with respect to aerosol microphysical properties and the evaluation of anthropogenic aerosol effect. There are many satellite missions studying aerosol distribution in the terrestrial atmosphere, such as MISR/Terra, OMI/Aura, AVHHR, MODIS/Terra and Aqua, CALIOP/CALIPSO. To improve the quality of data and climate models, and to reduce aerosol climate forcing uncertainties, several new missions are planned. The gap in orbital instruments for studying aerosol microphysics has arisen after the Glory mission failed during launch in 2011. In this review paper, we describe several planned aerosol space missions, including the Ukrainian project Aerosol-UA that obtains data using a multi-channel scanning polarimeter and wide-angle polarimetric camera. The project is designed for remote sensing of the aerosol microphysics and cloud properties on a global scale.

Aerosol↗

Aerodynamics of a Uranus Aerocapture System Using a Mars-Heritage Entry Vehicle

Aerodynamic characteristics of an aerocapture system intended to deliver a flagship-class orbiter and probe planetary science mission to Uranus are presented. The aeroshell of the Mars Science Laboratory and Mars 2020 entry vehicles is proposed as a baseline for this system to reduce the amount of necessary technology development. Direct Simulation Monte Carlo and Navier-Stokes computational fluid dynamics solutions are used to characterize the aerodynamic performance of the Mars-heritage vehicle for aerocapture flight at Uranus. These results are incorporated into an aerodatabase for use in six degree-of-freedom trajectory studies and mission design. Updates are made to the Mars-heritage aerodynamic uncertainty model based on observations in the Uranus-specific computational data to ensure the model is conservatively bounding for the proposed flight space. Necessary modifications to the aeroshell for system packaging are found to have minimal effect on aerodynamic performance. The resulting aerodatabase and uncertainty model are used to show the existing Mars-heritage entry vehicles have sufficient aerodynamic performance to achieve required control margin for Uranus aerocapture.

Eli R Shellabarger↗

Aerodynamics of a Uranus Aerocapture System Using a Mars-Heritage Entry Vehicle

Aerodynamic characteristics of an aerocapture system intended to deliver a flagship-class orbiter and probe planetary science mission to Uranus are presented. The aeroshell of the Mars Science Laboratory and Mars 2020 entry vehicles is proposed as a baseline for this system to reduce the amount of necessary technology development. Direct Simulation Monte Carlo and Navier-Stokes computational fluid dynamics solutions are used to characterize the aerodynamic performance of the Mars-heritage vehicle for aerocapture flight at Uranus. These results are incorporated into an aerodatabase for use in six degree-of-freedom trajectory studies and mission design. Updates are made to the Mars-heritage aerodynamic uncertainty model based on observations in the Uranus-specific computational data to ensure the model is conservatively bounding for the proposed flight space. Necessary modifications to the aeroshell for system packaging are found to have minimal effect on aerodynamic performance. The resulting aerodatabase and uncertainty model are used to show the existing Mars-heritage entry vehicles have sufficient aerodynamic performance to achieve required control margin for Uranus aerocapture.

Eli Shellabarger↗

An improved error assessment for the GEM-T1 gravitational model

Several tests were designed to determine the correct error variances for the Goddard Earth Model (GEM)-T1 gravitational solution which was derived exclusively from satellite tracking data. The basic method employs both wholly independent and dependent subset data solutions and produces a full field coefficient estimate of the model uncertainties. The GEM-T1 errors were further analyzed using a method based upon eigenvalue-eigenvector analysis which calibrates the entire covariance matrix. Dependent satellite and independent altimetric and surface gravity data sets, as well as independent satellite deep resonance information, confirm essentially the same error assessment. These calibrations (utilizing each of the major data subsets within the solution) yield very stable calibration factors which vary by approximately 10 percent over the range of tests employed. Measurements of gravity anomalies obtained from altimetry were also used directly as observations to show that GEM-T1 is calibrated. The mathematical representation of the covariance error in the presence of unmodeled systematic error effects in the data is analyzed and an optimum weighting technique is developed for these conditions. This technique yields an internal self-calibration of the error model, a process which GEM-T1 is shown to approximate.

Lerch, F. J.↗

A Probabilistic Approach of Incorporating Safety and Reliability in System Designs for a Manned Mission to Mars

Conceptual stages in mission design often lack the input of quantitative safety and reliability assessments, simply because failure rates or other data are not yet available for systems that have not yet been designed. Absence of such data should not, however, prevent the development of a quantitative risk models with placeholders for missing data. Functions (that is, actions the systems must perform) in mission design will eventually require system probabilities of success, and there could be much learned from surrogate data, adequately bounded in uncertainty, used in a large event tree model of a complex mission.

Railsback, Jan W.↗

A review of dynamic inflow and its effect on experimental correlations

A review is given of the relationship between experimental data and the development of modern dynamic-inflow theory. Some of the most interesting data, first presented 10 years ago at the Dynamic Specialist's Meeting, is now reviewed in light of the newer theories. These pure blade-flapping data correlate very well with analyses that include the new dynamic inflow theory, thus verifying the theory. Experimental data are also presented for damping with coupled inplane and body motions. Although inclusion of dynamic inflow is often required to correlate this coupled data, the data cannot be used to verify any particular dynamic inflow theory due to the uncertainties in modeling the inplane degree of freedom. For verification, pure flapping is required. However, the coupled data do show that inflow is often important in such computations.

Gaonkar, G. H.↗

The International Heat Stress Genotype Experiment for Modeling Wheat Response to Heat: Field Experiments and AgMIP-Wheat Multi-Model Simulations

The data set contains a portion of the International Heat Stress Genotype Experiment (IHSGE) data used in the AgMIP-Wheat project to analyze the uncertainty of 30 wheat crop models and quantify the impact of heat on global wheat yield productivity. It includes two spring wheat cultivars grown during two consecutive winter cropping cycles at hot, irrigated, and low latitude sites in Mexico (Ciudad Obregon and Tlaltizapan), Egypt (Aswan), India (Dharwar), the Sudan (Wad Medani), and Bangladesh (Dinajpur). Experiments in Mexico included normal (November-December) and late (January-March) sowing dates. Data include local daily weather data, soil characteristics and initial soil conditions, crop measurements (anthesis and maturity dates, anthesis and final total above ground biomass, final grain yields and yields components), and cultivar information. Simulations include both daily in-season and end-of-season results from 30 wheat models.

Wheat; Field Experimental Data; Heat Stress; Simul↗

Assessment of Response Surface Models using Independent Confirmation Point Analysis

This paper highlights various advantages that confirmation-point residuals have over conventional model design-point residuals in assessing the adequacy of a response surface model fitted by regression techniques to a sample of experimental data. Particular advantages are highlighted for the case of design matrices that may be ill-conditioned for a given sample of data. The impact of both aleatory and epistemological uncertainty in response model adequacy assessments is considered.

DeLoach, Richard↗

NASA Earth Systems Digital Twins (ESDT)

"Similarly to artificial intelligence, which is now revolutionizing many aspects of our daily lives, Earth system digital twin technologies have the potential to revolutionize the way Earth Science research will be conducted in the future, and how results and knowledge from this research will provide information to support decision making and yield impactful societal benefits. An Earth System Digital Twin or ESDT is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system as accurately and timely as possible; second, allows for computing forecasts of future states under nominal assumptions and based on the current replica; and third, offers the capability to investigate many hypothetical scenarios under varying impact assumptions. In other words, an ESDT provides the integrated What-Now, What-Next, and What-If pictures of the Earth or Earth system, by continuously ingesting newly observed data and by leveraging multiple interconnected models, machine learning as well advanced computing and visualization capabilities. Digital twins have been developed in engineering since 2002, but the interest in digital twins for the Earth domain is more recent and stems from the convergence of several developments: - The huge amount of diverse data that has now been collected continuously for more than 50 years, and that is becoming more and more difficult to access, understand, and utilize. - At the same time, because of climate change and its impacts the information produced by all of this data is becoming of interest to many new non-traditional users for analyzing and predicting various phenomena. - Because of advances in computational and visualization capabilities and the parallel unprecedented development of machine learning (ML), extracting relevant information from these large amounts of data and running complex models faster has become possible. As a result, it is becoming necessary and possible to build intuitive and interactive frameworks that will enable users with various skill levels and/or organizational hierarchy levels to easily access large amounts of targeted information along with the relevant tools and models (Earth system and human activity models), to support them in analyzing and visualizing this information, to help them understand interactions among models, to visualize the potential outcomes of various impacts, and to support decision or policy making. The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. With all these interests at stake, the challenges of building optimal digital twins are many and complex. The first challenge is to determine if a Digital Twin should be global or local, and multi-domain or thematic. For example, some domains such as Climate or Weather will require a global Digital Twin or Digital Twin capabilities while science areas such as Biodiversity might be more local. We can also envision that multiple thematic ESDTs, e.g., Air Quality, Wildfires, Hydrology could be federated or provide input to other ESDTs, either on a regional level or to a more global ESDT. Overall, we can imagine a future “web” of Digital Twins co-existing in a hierarchy or in a network, and capable of being connected or federated depending on the needs. This last point brings up the very important challenge of interoperability, including standards and protocols that will need to be built into these systems from the beginning. Each individual digital twin would have full flexibility in internal construction but would need standards-based interfaces (input and output) or hooks to make it compatible with others. Another challenge when building digital twins will be to decide how to organize each digital replica. Based on the applications targeted by the DT under implementation, various amounts and types of raw data, Analysis Ready Data (ARD) and information will need to be incorporated. Depending on the required latencies and needs of the users, various solutions can be considered, including Data Cubes, Data Lakes, pointers, or computing information on demand. We envision that each ESDT will choose a solution adapted to its specific objectives. Another important challenge is the type(s) of visualization that will be used, as well as the level of interactivity and refresh rate that will be required. Again, this will depend on the objectives of the ESDT, but also on the various users’ needs. In most cases, several types of visualizations and human interfaces will need to be offered depending on the projected users of that system. In parallel to the challenges highlighted above, there are also many tools and technologies that will need to be developed or improved for all types of digital twins. Among those are improved machine learning technologies, for example providing explainability, but also ML techniques for causality and providing a better integration of physics models. Additionally, reliable uncertainty quantification methods will be needed for all ESDT components, from validating data fusion and assimilation to assessing the accuracy of ML models and weighing the values of decisions supported by those systems. This presentation introduces the ESDT concept, presents several ESDT use cases, and a proposed ESDT architecture framework, as well as various technologies being developed by the Advanced Information Systems Technology (AIST) Program."

Earth Science Remote Sensing; Information Systems↗