Search NASA⌕ Search

SEARCH · Search NASA

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Introduction to the Special Section on Fast Physics in Climate Models: Parameterization, Evaluation and Observation

Many physical processes that influence Earth’s climate occur at scales of space and time that are too small to be resolved by typical global climate models (GCMS). These processes – e.g., aerosol/cloud physics, convection, boundary layer processes, turbulence, radiation, and land-atmosphere interactions–must be parameterized in GCMs, and are collectively called fast physics or fast processes for convenience.

54 ENVIRONMENTAL SCIENCES↗

Final Technical Report of ASR project entitled “ARM Observations for the Development and Evaluation of Models and Parameterizations of Cloudy Boundary Layers” (DE-SC0000825)

This project aims to elucidate the processes governing boundary layer clouds and improve the treatment of cloud processes in Global Climate Models (GCMs). Specifically, we have made research effort in following areas: (1) Developing novel numerical approach of using multiple scale Weather Research & Forecasting (WRF) model simulations for boundary layer cloud research; (2) Addressing issues of PDF schemes for parameterizing sub-grid scale cloud radiative properties; (3) Investigating the impact of mesoscale cloud organizations on the evolution of boundary layer clouds; (4) Evaluating parameterizations of the cumulus induced vertical transport; (5) Limited area model (LAM) intercomparison study of TWP-ICE convective case; (6) Investigating convective invigoration processes at shallow cumulus cold poll boundaries; and (7) Investigating vertical transport processes in moist convection.

54 ENVIRONMENTAL SCIENCES↗

Reduction of a detailed soot model for simulations of pyrolysing solid fuels

Here, we introduce a computationally inexpensive soot formation model for use in simulating large solid-complex fuel systems. The proposed model evaluates three variables: number density of tars, bulk mass density of soot particles, and particle number density. Each of these variables are influenced by soot formation phenomena, and this model evaluates the most common of these phenomena: soot nucleation, surface reactions, and coagulation. Two separate simulations were carried out using this model and results were compared against simulations using a more detailed and computationally expensive model. Findings are promising and show a meaningful reduction in model complexity and computational cost while still giving comparable results.

58 GEOSCIENCES↗

An economic model for evaluating high-speed aircraft designs

A Class 1 method for determining whether further development of a new aircraft design is desirable from all viewpoints is presented. For the manufacturer the model gives an estimate of the total cost of research and development from the preliminary design to the first production aircraft. Using Wright's law of production, one can derive the average cost per aircraft produced for a given break-even number. The model will also provide the airline with a good estimate of the direct and indirect operating costs. From the viewpoint of the passenger, the model proposes a tradeoff between ticket price and cruise speed. Finally all of these viewpoints are combined in a Comparative Aircraft Seat-kilometer Economic Index.

Vandervelden, Alexander J. M.↗

Detailed Modeling and Evaluation of a Scalable Multilevel Checkpointing System

High-performance computing (HPC) systems are growing more powerful by utilizing more components. As the system mean time before failure correspondingly drops, applications must checkpoint frequently to make progress. But, at scale, the cost of checkpointing becomes prohibitive. A solution to this problem is multilevel checkpointing, which employs multiple types of checkpoints in a single run. Moreover, lightweight checkpoints can handle the most common failure modes, while more expensive checkpoints can handle severe failures. We designed a multilevel checkpointing library, the Scalable Checkpoint/Restart (SCR) library, that writes lightweight checkpoints to node-local storage in addition to the parallel file system. We present probabilistic Markov models of SCR's performance. We show that on future large-scale systems, SCR can lead to a gain in machine efficiency of up to 35 percent, and reduce the load on the parallel file system by a factor of two. In addition, we predict that checkpoint scavenging, or only writing checkpoints to the parallel file system on application termination, can reduce the load on the parallel file system by 20 × on today's systems and still maintain high application efficiency.

97 MATHEMATICS AND COMPUTING↗

Integrated analytical method to demonstrate 10 CFR 50.46c compliance

Large break loss-of-coolant accident (LOCA) evaluation models (EMs) have historically been focused on fresh fuel at or near beginning-of-life in water cooled reactors. However, these evaluation models did not account for fuel thermal conductivity degradation (TCD). With the explicit modeling of fuel TCD, it is possible that the limiting LOCA conditions could occur for higher burnup fuel. NRC-sponsored research conducted by ANL as part of the 10 CFR 50.46c rulemaking identified mechanisms for cladding embrittlement that exist in higher burnup fuel which were not previously well understood. Additionally, the explicit consideration of fuel pellet thermal conductivity degradation results in more severe fuel rod / assembly considerations for higher burnup fuel in the large break LOCA scenario. In aggregate, these embrittlement mechanisms and phenomena necessitate the consideration of all fuel in the core which undergoes a postulated LOCA, as the limiting fuel cannot be determined a priori for each of the analysis acceptance criteria. The Full Spectrum LOCA EM accounts for all assemblies in the core at the time of a postulated LOCA by defining representative hot assemblies which combine the limiting elements of the fuel assemblies which they represent. By doing so, it is ensured that the LOCA analysis result represents the more limiting assembly in the core for each criterion. Changes in the LOCA boundary conditions (fuel rod initialization, axial power distributions, etc.) that occur during a cycle of operation are also appropriately accounted for in the FSLOCA EM by integrating fuel rod design and nuclear design methods into the LOCA EM. As such, the FSLOCA EM is well-positioned to show compliance with the 10 CFR 50.46c rulemaking as the rule package is nearing completion.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Hybrid model to evaluate the frequency-dependent leakage inductance of partially-filled transformers

The leakage inductance of a transformer designed for a power electronic converter can drop significantly as the switching frequency is increased due to skin and proximity effects. Although the magnetic image method-based double-2-D model can predict the low-frequency leakage inductance of a partially-filled transformer with sufficient accuracy, it is inherently a frequency-independent model. While Dowell’s 1-D model uses frequency-dependent relations to account for both skin and proximity effects, its accuracy is severely affected by the assumed winding geometry. In this paper, a semianalytical hybrid model is proposed that uses superposition to combine a modified Dowell’s model with the double-2-D model to predict the true leakage inductance of partially-filled transformers at any given frequency. All three conductor types—round, foil, and litz wire—are modeled and analyzed. The quasi-2-D model is further investigated on a variable inductance transformer (VIT) whose winding geometry can be modified mechanically to vary its leakage inductance. With less than 5 % error throughout, the semi-analytically evaluated leakage inductances are in excellent agreement with the finite element method (FEM) simulated and experimentally measured leakage inductances.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Future directions for LDEF ionizing radiation modeling and assessments

A calculational program utilizing data from radiation dosimetry measurements aboard the Long Duration Exposure Facility (LDEF) satellite to reduce the uncertainties in current models defining the ionizing radiation environment is in progress. Most of the effort to date has been on using LDEF radiation dose measurements to evaluate models defining the geomagnetically trapped radiation, which has provided results applicable to radiation design assessments being performed for Space Station Freedom. Plans for future data comparisons, model evaluations, and assessments using additional LDEF data sets (LET spectra, induced radioactivity, and particle spectra) are discussed.

Armstrong, T. W.↗

The Use of a Vehicle Acceleration Exposure Limit Model and a Finite Element Crash Test Dummy Model to Evaluate the Risk of Injuries During Orion Crew Module Landings

A review of astronaut whole body impact tolerance is discussed for land or water landings of the next generation manned space capsule named Orion. LS-DYNA simulations of Orion capsule landings are performed to produce a low, moderate, and high probability of injury. The paper evaluates finite element (FE) seat and occupant simulations for assessing injury risk for the Orion crew and compares these simulations to whole body injury models commonly referred to as the Brinkley criteria. The FE seat and crash dummy models allow for varying the occupant restraint systems, cushion materials, side constraints, flailing of limbs, and detailed seat/occupant interactions to minimize landing injuries to the crew. The FE crash test dummies used in conjunction with the Brinkley criteria provides a useful set of tools for predicting potential crew injuries during vehicle landings.

Lawrence, Charles↗

A Mixed Fracture-Matrix Model for Evaluating Well Orientation and Completion Options for the Utah FORGE Site

Orientation and completion for well pairs that have been subjected to multi-zonal stimulation play a critical role in the long-term performance of an Enhanced Geothermal Reservoir. Here we present the development of a methodology to rapidly and efficiently numerically simulate mixed fracture-matrix flow systems for evaluation of well design and completion options. An example evaluation based on a small fracture network representative of FORGE Well 16(A and B)-78(32) follows a discussion of the theory and model validation.

58 GEOSCIENCES↗

A Mixed Fracture-Matrix Model for Evaluating Well Orientation and Completion Options for the Utah FORGE Site

Orientation and completion for well pairs that have been subjected to multi-zonal stimulation play a critical role in the long-term performance of an Enhanced Geothermal Reservoir. Here we present the development of a methodology to rapidly and efficiently numerically simulate mixed fracture-matrix flow systems for evaluation of well design and completion options. An example evaluation based on a small fracture network representative of FORGE Well 16(A and B)-78(32) follows a discussion of the theory and model validation.

15 GEOTHERMAL ENERGY↗

Methodology for urban rail and construction technology research and development planning

A series of transit system visits, organized by the American Public Transit Association (APTA), was conducted in which the system operators identified the most pressing development needs. These varied by property and were reformulated into a series of potential projects. To assist in the evaluation, a data base useful for estimating the present capital and operating costs of various transit system elements was generated from published data. An evaluation model was developed which considered the rate of deployment of the research and development project, potential benefits, development time and cost. An outline of an evaluation methodology that considered benefits other than capital and operating cost savings was also presented. During the course of the study, five candidate projects were selected for detailed investigation; (1) air comfort systems; (2) solid state auxiliary power conditioners; (3) door systems; (4) escalators; and (5) fare collection systems. Application of the evaluation model to these five examples showed the usefulness of modeling deployment rates and indicated a need to increase the scope of the model to quantitatively consider reliability impacts.

Rubenstein, L. D.↗

A system-level mathematical model for evaluation of power train performance of load-leveled electric-vehicles

The power train performance of load leveled electric vehicles can be compared with that of nonload leveled systems by use of a simple mathematical model. This method of measurement involves a number of parameters including the degree of load leveling and regeneration, the flywheel mechanical to electrical energy fraction, and efficiencies of the motor, generator, flywheel, and transmission. Basic efficiency terms are defined and representative comparisons of a variety of systems are presented. Results of the study indicate that mechanical transfer of energy into and out of the flywheel is more advantageous than electrical transfer. An optimum degree of load leveling may be achieved in terms of the driving cycle, battery characteristics, mode of mechanization, and the efficiency of the components. For state of the art mechanically coupled flyheel systems, load leveling losses can be held to a reasonable 10%; electrically coupled systems can have losses that are up to six times larger. Propulsion system efficiencies for mechanically coupled flywheel systems are predicted to be approximately the 60% achieved on conventional nonload leveled systems.

Purohit, G. P.↗

Internal consistency and diversity scenario development: A comparative framework to evaluate energy model scenarios

Energy modeling frameworks and scenario analysis help us explore the potential impact of our actions and uncertainties in future energy systems. Despite their importance, there is no systematic procedure for evaluating the scenario development process. In a literature review, we identify two core elements of the scenario development process: internal consistency and diversity which are oftentimes missing from scenarios. Here, to address this gap, we create the Internal consistency and Diversity Scenario Development (IDSD) comparative framework which aims to assess the feasibility and diversity of scenarios for a given energy model. With this framework, we review commonly used energy models and demonstrate our framework on their scenarios. The IDSD comparative framework can serve several purposes absent from previous scenario development work by aiding energy modelers and report writers in crafting high-quality scenarios. First, the IDSD is a reflective tool which can improve the quality of the scenario development process, enabling a comparative assessment of energy models and scenarios. Second, the IDSD can provide guidance to modeling frameworks with existing scenarios and those still in development; this feedback will enable modelers to improve the development and the communication of the limitations of their scenarios. Third, this study has highlighted areas for improvement in the scenario development of some commonly used energy model frameworks. Finally, there is a complete lack of explanation regarding the stakeholder selection process. Addressing these identified items could increase opportunities for advanced energy technology uptake and improve our options for achieving a more resilient energy system.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

CoCoMET v1.0: a unified open-source toolkit for atmospheric object tracking and analysis

Advances in performance and analysis capabilities have accelerated the development of object tracking algorithms for atmospheric research. This has resulted in a growing number of studies using Lagrangian tracking techniques to analyze the evolution of atmospheric phenomena and the underlying processes. However, the increasing complexity and variety of tracking algorithms present a steep learning curve for new users and make it difficult for existing users to compare algorithm performance. We introduce CoCoMET (Community Cloud Model Evaluation Toolkit), an open-source toolkit that addresses these issues. CoCoMET simplifies the process of running multiple tracking algorithms simultaneously and analyzing objects in both model and observational datasets by specifying parameters in a single configuration file. It standardizes input data from different sources into a consistent format and unifies the tracking output across algorithms. CoCoMET enhances the functionality of existing tracking methods by calculating additional properties such as cell growth and dissipation rates, perimeter, surface area, convexity, and irregularity. In addition, CoCoMET includes a novel method for identifying mergers and splits in 2D and 3D tracks and supports the integration of Eulerian/stationary datasets external to the tracking data for process studies. Its potential utility is demonstrated through examples of model intercomparison, model evaluation against observations, and comparisons between tracking algorithms. Designed for open-source environments, CoCoMET will continue to expand with future releases, incorporating more input data types and tracking algorithms.

54 ENVIRONMENTAL SCIENCES↗

Evaluation and modeling of autonomous attitude thrust control for the Geostation Operational Environmental Satellite (GOES)-8 orbit determination

The Geostationary Operational Environmental Satellite (GOES)-8 experienced a series of orbital perturbations from autonomous attitude control thrusting before perigee raising maneuvers. These perturbations influenced differential correction orbital state solutions determined by the Goddard Space Flight Center (GSFC) Goddard Trajectory Determination System (GTDS). The maneuvers induced significant variations in the converged state vector for solutions using increasingly longer tracking data spans. These solutions were used for planning perigee maneuvers as well as initial estimates for orbit solutions used to evaluate the effectiveness of the perigee raising maneuvers. This paper discusses models for the incorporation of attitude thrust effects into the orbit determination process. Results from definitive attitude solutions are modeled as impulsive thrusts in orbit determination solutions created for GOES-8 mission support. Due to the attitude orientation of GOES-8, analysis results are presented that attempt to absorb the effects of attitude thrusting by including a solution for the coefficient of reflectivity, C(R). Models to represent the attitude maneuvers are tested against orbit determination solutions generated during real-time support of the GOES-8 mission. The modeling techniques discussed in this investigation offer benefits to the remaining missions in the GOES NEXT series. Similar missions with large autonomous attitude control thrusting, such as the Solar and Heliospheric Observatory (SOHO) spacecraft and the INTELSAT series, may also benefit from these results.

Forcey, W.↗

Assessment of Microreactor Safety Analysis Challenges and Recommendations for Utilization of the Comprehensive Reactor Analysis Bundle

To enable the broad deployment of microreactors in fundamentally new application regimes (i.e., mobile and autonomous operations), their safety must be indisputable in terms of possessing inherent resistance to severe offsite dose consequences. Therefore, mechanistic beyond-design-basis event source term calculations that demonstrate a sufficiently large margin of safety will be required to accommodate these new application regimes, which have no history of commercial regulation. Even for traditional reactor operation configurations, safety analysis expertise and familiarity with accident phenomena and conditions in microreactors—specifically those with heat pipe primary cooling arrangements—are lacking compared with other advanced reactor concepts and small modular reactors. Recently, modeling and simulation tools to account for unique heat pipe design aspects have been developed by Sandia National Laboratories with MELCOR and by the US Department of Energy’s (DOE’s) Office of Nuclear Energy Advanced Modeling and Simulation Program with BlueCRAB. However, further demonstration and assessment of potential knowledge gaps are needed to support these codes’ broad usage by the microreactor community. Through the DOE Microreactor Program, an initial assessment of these two tools and guidance on how an evaluation model could be constructed was performed and is reported herein. Moreover, a proposed approach for demonstrating an evaluation model using these two tools is outlined.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Characterizing the Relative Importance Assigned to Physical Variables by Climate Scientists when Assessing Atmospheric Climate Model Fidelity

Evaluating a climate model’s fidelity (ability to simulate observed climate) is a critical step in establishing confidence in the model’s suitability for future climate projections, and in tuning climate model parameters. Model developers use their judgement in determining which trade-offs between different aspects of model fidelity are acceptable. However, little is known about the degree of consensus in these evaluations, and whether experts use the same criteria when different scientific objectives are defined. Here, we report on results from a broad community survey studying expert assessments of the relative importance of different output variables when evaluating a global atmospheric model’s mean climate. We find that experts adjust their ratings of variable importance in response to the scientific objective, for instance, scientists rate surface wind stress as significantly more important for Southern Ocean climate than for the water cycle in the Asian watershed. There is greater consensus on the importance of certain variables (e.g., shortwave cloud forcing) than others (e.g., aerosol optical depth). We find few differences in expert consensus between respondents with greater or less climate modeling experience, and no statistically significant differences between the responses of climate model developers and users. In conclusion, the concise variable lists and community ratings reported here provide baseline descriptive data on current expert understanding of certain aspects of model evaluation, and can serve as a starting point for further investigation, as well as developing more sophisticated evaluation and scoring criteria with respect to specific scientific objectives.

54 ENVIRONMENTAL SCIENCES↗