Search NASA⌕ Search

SEARCH · Search NASA

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

A decentralized linear quadratic control design method for flexible structures

A decentralized suboptimal linear quadratic control design procedure which combines substructural synthesis, model reduction, decentralized control design, subcontroller synthesis, and controller reduction is proposed for the design of reduced-order controllers for flexible structures. The procedure starts with a definition of the continuum structure to be controlled. An evaluation model of finite dimension is obtained by the finite element method. Then, the finite element model is decomposed into several substructures by using a natural decomposition called substructuring decomposition. Each substructure, at this point, still has too large a dimension and must be reduced to a size that is Riccati-solvable. Model reduction of each substructure can be performed by using any existing model reduction method, e.g., modal truncation, balanced reduction, Krylov model reduction, or mixed-mode method. Then, based on the reduced substructure model, a subcontroller is designed by an LQ optimal control method for each substructure independently. After all subcontrollers are designed, a controller synthesis method called substructural controller synthesis is employed to synthesize all subcontrollers into a global controller. The assembling scheme used is the same as that employed for the structure matrices. Finally, a controller reduction scheme, called the equivalent impulse response energy controller (EIREC) reduction algorithm, is used to reduce the global controller to a reasonable size for implementation. The EIREC reduced controller preserves the impulse response energy of the full-order controller and has the property of matching low-frequency moments and low-frequency power moments. An advantage of the substructural controller synthesis method is that it relieves the computational burden associated with dimensionality. Besides that, the SCS design scheme is also a highly adaptable controller synthesis method for structures with varying configuration, or varying mass and stiffness properties.

Su, Tzu-Jeng↗

Integrated Model Reduction and Control of Aircraft with Flexible Wings

This paper presents an integrated approach to the modeling and control of aircraft with exible wings. The coupled aircraft rigid body dynamics with a high-order elastic wing model can be represented in a nite dimensional state-space form. Given a set of desired output covariance, a model reduction process is performed by using the weighted Modal Cost Analysis (MCA). A dynamic output feedback controller, which is designed based on the reduced-order model, is developed by utilizing output covariance constraint (OCC) algorithm, and the resulting OCC design weighting matrix is used for the next iteration of the weighted cost analysis. This controller is then validated for full-order evaluation model to ensure that the aircraft's handling qualities are met and the uttering motion of the wings suppressed. An iterative algorithm is developed in CONDUIT environment to realize the integration of model reduction and controller design. The proposed integrated approach is applied to NASA Generic Transport Model (GTM) for demonstration.

AEROELASTIC↗

Retrieving the global distribution of the threshold of wind erosion from satellite data and implementing it into the Geophysical Fluid Dynamics Laboratory land–atmosphere model (GFDL AM4.0/LM4.0)

Dust emission is initiated when surface wind velocities exceed the threshold of wind erosion. Many dust models used constant threshold values globally. Here we use satellite products to characterize the frequency of dust events and land surface properties. By matching this frequency derived from Moderate Resolution Imaging Spectroradiometer (MODIS) Deep Blue aerosol products with surface winds, we are able to retrieve a climatological monthly global distribution of the wind erosion threshold (V(threshold)) over dry and sparsely vegetated surfaces. This monthly two-dimensional threshold velocity is then implemented into the Geophysical Fluid Dynamics Laboratory coupled land–atmosphere model (AM4.0/LM4.0). It is found that the climatology of dust optical depth (DOD) and total aerosol optical depth, surface PM10 dust concentrations, and the seasonal cycle of DOD are better captured over the “dust belt” (i.e., northern Africa and the Middle East) by simulations with the new wind erosion threshold than those using the default globally constant threshold. The most significant improvement is the frequency distribution of dust events, which is generally ignored in model evaluation. By using monthly rather than annual mean V(threshold), all comparisons with observations are further improved. The monthly global threshold of wind erosion can be retrieved under different spatial resolutions to match the resolution of dust models and thus can help improve the simulations of dust climatology and seasonal cycles as well as dust forecasting.

Bing Pu↗

Statistical uncertainty of eddy covariance CO 2 fluxes inferred using a residual bootstrap approach

High-frequency eddy-covariance measurements of net ecosystem CO 2 exchange (NEE) with the atmosphere are valuable resources for model parameterization, calibration, and validation. However, uncertainties in measured data, i.e., data gaps and inherent random errors, create problems for researchers attempting to quantify uncertainties in model projections of terrestrial ecosystem carbon cycling. Here, we demonstrate that a model-data fusion method (residual bootstrap) produces defensible annual NEE sums, through mimicking the behavior of random errors, filling missing values, and simulating gap-filling biases. This study estimated annual NEE sums for 53 site-years based on nine eddy-covariance tower sites in the USA, and found that our annual estimates were, in most cases, comparable in magnitude with those obtained from AmeriFlux gap-filled data. Additionally, compared to the AmeriFlux standardized gap-filling, our approach provides better NEE estimates for moderate to longer, and more frequent, data gaps. Annual accumulated uncertainties in NEE at the 95% confidence level were ±30gCm -2 year -1 for evergreen needleleaf forests; ±60gCm -2 year -1 for deciduous broadleaf forests; and ±80gCm -2 year -1 for croplands. The residual bootstrap performed worst when gap length was greater than one month or data exclusion greater than 90% during the growing season, common to other gap-filling techniques. However, this study produced robust results for most site years when monthly data coverage during the growing season is not extremely low. We therefore suggest that the inclusion of NEE uncertainty estimates and better estimation for moderate to longer, and more frequent, data gaps as provided by the residual bootstrap approach can be beneficial for ecosystem model evaluation.

54 ENVIRONMENTAL SCIENCES↗

Probabilistic Methods for Cyclical and Coupled Systems with Changing Failure Rates

Advancements in nuclear system designs with automated control features provide many benefits, but can lead to complex coupled systems and dynamic failure scenarios. This is especially true for microreactor designs where components are not expected to be replaced during the reactor’s lifetime. Hence, the life of the system, in addition to the safety, needs to be evaluated. Modeling these sequences of time-dependent events requires addressing cyclical processes and changing failure rates in ways that represent the actual system dynamics in contrast to a single sampling for a component’s time to failure. This research presents two distinct analytical methods for several failure distributions that evaluate a final time to failure used for different scenarios where the time to failure must be sampled multiple times. The first method is used when evaluating a component whose failure rate increases due to an outside event after the initial sampling but before the initially sampled time to failure. The second method is used when evaluating multiple identical components or a component that has been replaced with a new identical version before the second sampling. The two methods were implemented in a few representative case studies developed in the dynamic probabilistic risk assessment tool Event Modeling Risk Assessment using Linked Diagrams. Overall, this paper provides guidelines on how these approaches give a more realistic and accurate dynamic probabilistic risk assessment of complex systems.

97 MATHEMATICS AND COMPUTING↗

Evaluation of reliability modeling tools for advanced fault tolerant systems

The Computer Aided Reliability Estimation (CARE III) and Automated Reliability Interactice Estimation System (ARIES 82) reliability tools for application to advanced fault tolerance aerospace systems were evaluated. To determine reliability modeling requirements, the evaluation focused on the Draper Laboratories' Advanced Information Processing System (AIPS) architecture as an example architecture for fault tolerance aerospace systems. Advantages and limitations were identified for each reliability evaluation tool. The CARE III program was designed primarily for analyzing ultrareliable flight control systems. The ARIES 82 program's primary use was to support university research and teaching. Both CARE III and ARIES 82 were not suited for determining the reliability of complex nodal networks of the type used to interconnect processing sites in the AIPS architecture. It was concluded that ARIES was not suitable for modeling advanced fault tolerant systems. It was further concluded that subject to some limitations (the difficulty in modeling systems with unpowered spare modules, systems where equipment maintenance must be considered, systems where failure depends on the sequence in which faults occurred, and systems where multiple faults greater than a double near coincident faults must be considered), CARE III is best suited for evaluating the reliability of advanced tolerant systems for air transport.

Baker, Robert↗

Evaluating indoor exposure modeling alternatives for LCA: A case study in the vehicle repair industry

We evaluated three exposure models with data obtained from measurements among workers who use"aerosol" solvent products in the vehicle repair industry and with field experiments using these products to simulate the same exposure conditions. The three exposure models were the: 1) homogeneously-mixed-one-box model, 2) multi-zone model, and 3) eddy-diffusion model. Temporally differentiated real-time breathing zone volatile organic compound (VOC) concentration measurements, integrated far-field area samples, and simulated experiments were used in estimating parameters, such as emission rates, diffusivity, and near-field dimensions. We assessed differences in model input requirements and their efficacy for predictive modeling. The One-box model was not able to resemble the temporal profile of exposure concentrations, but it performed well concerning time-weighted exposure over extended time periods. However, this model required an adjustment for spatial concentration gradients. Multi-zone models and diffusion-models may solve this problem. However, we found that the reliable use of both these models requires extensive field data to appropriately define pivotal parameters such as diffusivity or near-field dimensions. We conclude that it is difficult to apply these models for predicting VOC exposures in the workplace. However, for comparative exposure scenarios in life-cycle assessment they may be useful.

54 ENVIRONMENTAL SCIENCES↗

Validation of FSP Reactor Design with Sensitivity Studies of Beryllium-Reflected Critical Assemblies

The baseline design for space nuclear power is a fission surface power (FSP) system: sodium-potassium (NaK) cooled, fast spectrum reactor with highly-enriched-uranium (HEU)-O 2 fuel, stainless steel (SS) cladding, and beryllium reflectors with B4C control drums. Previous studies were performed to evaluate modeling capabilities and quantify uncertainties and biases associated with analysis methods and nuclear data. Comparison of Zero Power Plutonium Reactor (ZPPR)-20 benchmark experiments with the FSP design indicated that further reduction of the total design model uncertainty requires the reduction in uncertainties pertaining to beryllium and uranium cross-section data. Further comparison with three beryllium-reflected HEU-metal benchmark experiments performed at the Oak Ridge Critical Experiments Facility (ORCEF) concluded the requirement that experimental validation data have similar cross section sensitivities to those found in the FSP design. A series of critical experiments was performed at ORCEF in the 1960s to support the Medium Power Reactor Experiment (MPRE) space reactor design. The small, compact critical assembly (SCCA) experiments were graphite- or beryllium-reflected assemblies of SS-clad, HEU-O 2 fuel on a vertical lift machine. All five configurations were evaluated as benchmarks. Two of the five configurations were beryllium reflected, and further evaluated using the sensitivity and uncertainty analysis capabilities of SCALE 6.1. Validation of the example FSP design model was successful in reducing the primary uncertainty constituent, the Be(n,n) reaction, from 0.28 %$\delta$k/k to 0.0004 %$\delta$k/k. Further assessment of additional reactor physics measurements performed on the SCCA experiments may serve to further validate FSP design and operation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

SU-E-T-128: Dosimetric Evaluation of MLC Modeling in Pinnacle V9.2 for Varian TrueBeam STx

Purpose: To evaluate the effects of MLC modeling after commissioning the Varian TrueBeam LINAC in Pinnacle version 9.2. Methods: Stepand-shoot IMRT QAs were investigated when we observed our measured absolute dose results using ion chamber (Capintec PR-05P) were uncharacteristically low; about 4–5% compared to doses calculated by Pinnacle{sup 3} (Phillips, Madison, WI). This problem was predominant for large and highly modulated head and neck (HN) treatments. Intuitively we knew this had to be related to shortcomings in the MLC modeling in Pinnacle. Using film QA we were able to iteratively adjust the MLC parameters. We confirmed results by re-testing five failed IMRT QA patients; and ion chamber measurements were verified in Quasar anthropomorphic phantom. Results: After commissioning the LINAC in Pinnacle version 9.2, the MLC transmission for 6X, 10X and 15X were 2.0%, 1.7% and 2.0%, respectively, and additional Interleaf leakage for all three energies was 0.5%. These parameters were obtained from profiles scanned with an Edge detector (Sun Nuclear, Melbourne, FL) during machine commissioning. A Verification testing with radiographic EDR2 film (Kodak, Rochester, NY) measurement was performed by creating a closed MLC leaf pattern and analyzing using RIT software (RIT, Colorado Springs, CO). This reduced MLC transmission for 6X, 10X and 15X to 0.7%, 0.9% and 0.9%, respectively; while increasing additional Interleaf leakage for all three energies to 1.0%. Conclusion: Radiographic film measurements were used to correct MLC transmission values for step and shoot IMRT fields used in Pinnacle version 9.2. After adjusting the MLC parameters to correlate with the film QA, there was still very good agreement between the Pinnacle model and commissioning data. Using the same QA methodology, we were also able to improve the beam models for the Varian C-series linacs, Novalis-Tx, and TrueBeam M-120 linacs.

07 ISOTOPE AND RADIATION SOURCES↗

Ozone Climatology

The primary role of models in the assessment process is to predict changes to ozone. It is crucial therefore that the ability of the models to reproduce the actual distribution of ozone be tested. Historically, maps of the ozone column (latitude by month) have been used for this purpose. In MM I a climatology was developed for the vertical distribution of ozone for 15-60 km, based on SBUV data for 1979-80. SBUV profiles are reported with vertical resolution of approx. 5 km, but the true resolution is lower, approx. 8 km above the ozone maximum and approx. 15 km for 10-25 km. The climatology was considered valid to about 20-30% at 20 km and to 50% at 15 km. Comparisons were made with models in mixing ratio (ppm), which emphasizes the middle and upper stratosphere. A new ozone climatology was developed for the vertical distribution of ozone for MM II. Our goal was to develop a product that could be used to evaluate models in the lower stratosphere, the region where most of the ozone column resides and where most of the ozone loss is occurring, as well as the middle and upper stratosphere.

Logan, Jennifer A.↗

A Recursive Multi-step Machine Learning Approach for Airport Configuration Prediction

Airport configuration selection is a complex decision-making process that involves several operational and human factors. In this paper we propose a novel recursive multi-step machine learning (ML) approach to predict airport configuration. The multi-step approach guarantees stability of the predicted configuration by taking as input the configuration predicted at the previous time step. The features of the proposed model include weather data, future arrival and departure counts and current configuration. Due to the importance of arrival and departure counts in predicting the airport configuration, arrival counts are calculated using landing time predictions selected from physics-based landing time predictions available in FAA System Wide Information Management data feeds for each flight. The selection rules were developed and refined to select the most accurate time for different phases of flight. The proposed model predicts the airport configurations up to 6 hours ahead. In this paper we show the predictive performance of the proposed model for six major US airports, including Charlotte Douglas International Airport (CLT), Dallas/Fort Worth International Airport (DFW), John F. Kennedy International Airport (JFK), Newark Liberty International Airport (EWR), LaGuardia Airport (LGA) and Dallas Love Field Airport (DAL). We trained and evaluated models on 2019 and 2020 data in order to study the effect of the pandemic and how changes in traffic patterns affected the performance of the proposed model. Results are compared with a baseline assuming no airport configuration changes. In our results for DFW, we obtained a prediction accuracy of 89.3% for 3 hours ahead prediction, and 82.8% for 6 hours ahead when applied on 2019 data.

machine learning↗

A Recursive Multi-step Machine Learning Approach for Airport Configuration Prediction

Airport configuration selection is a complex decision-making process that involves several operational and human factors. In this paper we propose a novel recursive multi-step machine learning (ML) approach to predict airport configuration. The multi-step approach guarantees stability of the predicted configuration by taking as input the configuration predicted at the previous time step. The features of the proposed model include weather data, future arrival and departure counts and current configuration. Due to the importance of arrival and departure counts in predicting the airport configuration, arrival counts are calculated using landing time predictions selected from physics-based landing time predictions available in FAA System Wide Information Management data feeds for each flight. The selection rules were developed and refined to select the most accurate time for different phases of flight. The proposed model predicts the airport configurations up to 6 hours ahead. In this paper we show the predictive performance of the proposed model for six major US airports, including Charlotte Douglas International Airport (CLT), Dallas/Fort Worth International Airport (DFW), John F. Kennedy International Airport (JFK), Newark Liberty International Airport (EWR), LaGuardia Airport (LGA) and Dallas Love Field Airport (DAL). We trained and evaluated models on 2019 and 2020 data in order to study the effect of the pandemic and how changes in traffic patterns affected the performance of the proposed model. Results are compared with a baseline assuming no airport configuration changes. In our results for DFW, we obtained a prediction accuracy of 89.3% for 3 hours ahead prediction, and 82.8% for 6 hours ahead when applied on 2019 data.

machine learning↗

A multiscale approach to modeling carbon cycling within a high-elevation watershed (Final Report)

This report is to summarize the technical work completed during the project entitled "A Multiscale Approach to Modeling Carbon and Nitrogen Cycling within a High Elevation Watershed" (Award: DE-SC0014556). The report covers work completed between 08/01/2015 and 07/31/2018. The overarching objective of the work was to conduct a multi-scale reactive transport investigation of C and N in a high-elevation catchment in Colorado for the purposes of evaluating modeling approaches for describing net fluxes of C and N and their relationship to measurable hydrologic parameters. To accomplish this objective, we developed two microcatchment observatories where we have characterized the inventories of carbon and nitrogen and the fluxes of carbon into and out of the soil zone in tandem with environmental parameters, including soil moisture and temperature. We further evaluated watershed-scale carbon fluxes using measured concentration-discharge observations. To characterize the inventories of carbon and nitrogen, we developed a new approach for molecular characterization of soil organic carbon functional group abundance (SOC-fga) and applied this approach to bulk soil and density fractions from 4 profiles across the catchments. The speciation data was paired with radiocarbon and NMR measurements. To characterize fluxes, soil gas concentrations and carbon dioxide flux measurements were made throughout three growing seasons (2016, 2017, 2018) and combined with ground-based and remote sensing estimates of plant phenology. Paired laboratory studies investigated the response of microbial respiration to changing soil moisture as a function of soil depth and landscape position. Two modeling approaches have been developed. The first approach uses a diffusion-reaction approach to calculate the depth profile of carbon dioxide production rates based on measured profiles and surface efflux rates. The second modeling approach, a dormancy-enabled microbial model describes the microbial response to soil moisture by accounting for two distinct microbial strategists.

54 ENVIRONMENTAL SCIENCES↗

Deep-learning-enabled Bayesian inference of fuel magnetization in magnetized liner inertial fusion

Fuel magnetization in magneto-inertial fusion (MIF) experiments improves charged burn product confinement, reducing requirements on fuel areal density and pressure to achieve self-heating. By elongating the path length of 1.01 MeV tritons produced in a pure deuterium fusion plasma, magnetization enhances the probability for deuterium–tritium reactions producing 11.8-17.1 MeV neutrons. Nuclear diagnostics thus enable a sensitive probe of magnetization. Characterization of magnetization, including uncertainty quantification, is crucial for understanding the physics governing target performance in MIF platforms, such as magnetized liner inertial fusion (MagLIF) experiments conducted at Sandia National Laboratories, Z-facility. We demonstrate a deep-learned surrogate of a physics-based model of nuclear measurements. A single model evaluation is reduced from O ( 10 – 100 ) (10–100) CPU hours on a high-performance computing cluster down to O ( 10 – 100 ) (10) ms on a laptop. This enables a Bayesian inference of magnetization, rigorously accounting for uncertainties from surrogate modeling and noisy nuclear measurements. The approach is validated by testing on synthetic data and comparing with a previous study. We analyze a series of MagLIF experiments systematically varying preheat, resulting in the first ever systematic experimental study of magnetic confinement properties of the fuel plasma as a function of fundamental inputs on any neutron-producing MIF platform. We demonstrate that magnetization decreases from B R ∼ 0.2 ~0.5 to B R ∼ 0.2 ~0.2 MG cm as laser preheat energy deposited increases from E preheat ∼ 460 ~460 J to E preheat ∼ 460 ~1.4 kJ. This trend is consistent with 2D LASNEX simulations showing Nernst advection of the magnetic field out of the hot fuel and diffusion into the target liner.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Understanding GPU Power. A Survey of Profiling, Modeling, and Simulation Methods

Modern graphics processing units (GPUs) have complex architectures that admit exceptional performance and energy efficiency for high throughput applications.Though GPUs consume large amounts of power, their use for high throughput applications facilitate state-of-the-art energy efficiency and performance. Consequently, continued development relies on understanding their power consumption. Our work is a survey of GPU power modeling and profiling methods with increased detail on noteworthy efforts. Moreover, as direct measurement of GPU power is necessary for model evaluation and parameter initiation, internal and external power sensors are discussed. Hardware counters, which are low-level tallies of hardware events, share strong correlation to power use and performance. Statistical correlation between power and performance counters has yielded worthwhile GPU power models, yet the complexity inherent to GPU architectures presents new hurdles for power modeling. Developments and challenges of counter-based GPU power modeling is discussed. Often building on the counter-based models, research efforts for GPU power simulation, which make power predictions from input code and hardware knowledge, provide opportunities for optimization in programming or architectural design. Noteworthy strides in power simulations for GPUs are included along with their performance or functional simulator counterparts when appropriate. Lastly, possible directions for future research are discussed.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Quantifying Diurnal Cloud Radiative Effects by Cloud Type in the Tropical Western Pacific

Cloud radiative effects are examined using long-term datasets collected at the three Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facilities in the tropical western Pacific. We quantify the surface radiation budget, cloud populations, and cloud radiative effects by partitioning the data by cloud type, time of day, and as a function of large scale modes of variability such as El Niño Southern Oscillation (ENSO) phase and wet/dry seasons at Darwin. The novel facet of our analysis is that we break aggregate cloud radiative effects down by cloud type across the diurnal cycle. The Nauru cloud populations and subsequently the surface radiation budget are strongly impacted by ENSO variability whereas the cloud populations over Manus only shift slightly in response to changes in ENSO phase. The Darwin site exhibits large seasonal monsoon related variations. We show that while deeper convective clouds have a strong conditional influence on the radiation reaching the surface, their limited frequency reduces their aggregate radiative impact. The largest source of shortwave cloud radiative effects at all three sites comes from low clouds. We use the observations to demonstrate that potential model biases in the amplitude of the diurnal cycle and mean cloud frequency would lead to larger errors in the surface energy budget compared to biases in the timing of the diurnal cycle of cloud frequency. Our results provide solid benchmarks to evaluate model simulations of cloud radiative effects in the tropics.

54 ENVIRONMENTAL SCIENCES↗

Understanding Ice Supersaturation, Particle Growth, and Number Concentration in Cirrus Clouds

Many factors control the ice supersaturation and microphysical properties in cirrus clouds. We explore the effects of dynamic forcing, ice nucleation mechanisms, and ice crystal growth rate on the evolution and distribution of water vapor and cloud properties in nighttime cirrus clouds using a one-dimensional cloud model with bin microphysics and remote sensing measurements obtained at the Department of Energy's Atmospheric Radiation Measurement (ARM) Climate Research Facility located near Lamont, OK. We forced the model using both large-scale vertical ascent and, for the first time, mean mesoscale velocity derived from radar Doppler velocity measurements. Both heterogeneous and homogeneous nucleation processes are explored, where a classical theory heterogeneous scheme is compared with empirical representations. We evaluated model simulations by examining both bulk cloud properties and distributions of measured radar reflectivity, lidar extinction, and water vapor profiles, as well as retrieved cloud microphysical properties. Our results suggest that mesoscale variability is the primary mechanism needed to reproduce observed quantities. Model sensitivity to the ice growth rate is also investigated. The most realistic simulations as compared with observations are forced using mesoscale waves, include fast ice crystal growth, and initiate ice by either homogeneous or heterogeneous nucleation. Simulated ice crystal number concentrations (tens to hundreds particles per liter) are typically two orders of magnitude smaller than previously published results based on aircraft measurements in cirrus clouds, although higher concentrations are possible in isolated pockets within the nucleation zone.

Comstock, Jennifer M.↗