Search NASA⌕ Search

SEARCH · Search NASA

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Preliminary Results of a U.S. Deep South Warm Season Deep Convective Initiation Modeling Experiment using NASA SPoRT Initialization Datasets for Operational National Weather Service Local Model Runs

The initiation of deep convection during the warm season is a forecast challenge in the relative high instability and low wind shear environment of the U.S. Deep South. Despite improved knowledge of the character of well known mesoscale features such as local sea-, bay- and land-breezes, observations show the evolution of these features fall well short in fully describing the location of first initiates. A joint collaborative modeling effort among the NWS offices in Mobile, AL, and Houston, TX, and NASA s Short-term Prediction Research and Transition (SPoRT) Center was undertaken during the 2012 warm season to examine the impact of certain NASA produced products on the Weather Research and Forecasting Environmental Modeling System. The NASA products were: a 4-km Land Information System data, a 1-km sea surface temperature analysis, and a 4-km greenness vegetation fraction analysis. Similar domains were established over the southeast Texas and Alabama coastlines, each with a 9 km outer grid spacing and a 3 km inner nest spacing. The model was run at each NWS office once per day out to 24 hours from 0600 UTC, using the NCEP Global Forecast System for initial and boundary conditions. Control runs without the NASA products were made at the NASA SPoRT Center. The NCAR Model Evaluation Tools verification package was used to evaluate both the forecast timing and location of the first initiates, with a focus on the impacts of the NASA products on the model forecasts. Select case studies will be presented to highlight the influence of the products.

Medlin, Jeffrey M.↗

Efficient Distance-based Global Sensitivity Analysis for Terrestrial Ecosystem Modeling

Sensitivity analysis in terrestrial ecosystem modeling is important for understanding controlling processes, guiding model development, and targeting new observations to reduce parameter and prediction uncertainty. Complex and computationally expensive terrestrial ecosystem models (TEM) limit the number of ensemble simulations, requiring sophisticated and efficient methods to analyze sensitivities of multiple model responses to different types of parameter uncertainties. In this study, we propose a distance-based global sensitivity analysis (DGSA) method. DGSA first classifies model response samples into a small set of discrete classes and then calculates the distance between parameter frequency distributions in different classes to measure the parameter sensitivity. The principle is that, if the parameter distribution is the same in each class, then the model response is insensitive to the parameter, while a large difference in the distributions indicates the parameter is influential to the response. Built on this idea, DGSA can be applied to analyze sensitivity of a single and a group of responses to different kinds of parameter uncertainties including continuous, discrete and even stochastic. Besides the main-effect sensitivity from a single parameter, DGSA can also quantify the sensitivity from parameter interactions. Additionally, DGSA is computationally efficient which can use a small number of model evaluations to obtain an accurate and statistically significant result. We applied DGSA to two TEMs, one having eight parameters and three kinds of model responses, and the other having 47 parameters and a long-period response. We demonstrated that DGSA can be used for sensitivity problems with multiple responses and high-dimensional parameters efficiently.

Lu, Dan↗

Performance of Low Dissipative High Order Shock-Capturing Schemes for Shock-Turbulence Interactions

Accurate and efficient direct numerical simulation of turbulence in the presence of shock waves represents a significant challenge for numerical methods. The objective of this paper is to evaluate the performance of high order compact and non-compact central spatial differencing employing total variation diminishing (TVD) shock-capturing dissipations as characteristic based filters for two model problems combining shock wave and shear layer phenomena. A vortex pairing model evaluates the ability of the schemes to cope with shear layer instability and eddy shock waves, while a shock wave impingement on a spatially-evolving mixing layer model studies the accuracy of computation of vortices passing through a sequence of shock and expansion waves. A drastic increase in accuracy is observed if a suitable artificial compression formulation is applied to the TVD dissipations. With this modification to the filter step the fourth-order non-compact scheme shows improved results in comparison to second-order methods, while retaining the good shock resolution of the basic TVD scheme. For this characteristic based filter approach, however, the benefits of compact schemes or schemes with higher than fourth order are not sufficient to justify the higher complexity near the boundary and/or the additional computational cost.

Sandham, N. D.↗

Performance of Low Dissipative High Order Shock-Capturing Schemes for Shock-Turbulence Interactions

Abstract Accurate and efficient direct numerical simulation of turbulence in the presence of shock waves represents a significant challenge for numerical methods. The objective of this paper is to evaluate the performance of high order compact and non-compact central spatial differencing employing total variation diminishing (TVD) shock-capturing dissipations as characteristic based filters for two model problems combining shock wave and shear layer phenomena. A vortex pairing model evaluates the ability of the schemes to cope with shear layer instability and eddy shock waves, while a shock wave impingement on a spatially-evolving mixing layer model studies the accuracy of computation of vortices passing through a sequence of shock and expansion waves. A drastic increase in accuracy is observed if a suitable artificial compression formulation is applied to the TVD dissipations. With this modification to the filter step the fourth-order non-compact scheme shows improved results in comparison to second-order methods, while retaining the good shock resolution of the basic TVD scheme. For this characteristic based filter approach, however, the benefits of compact schemes or schemes with higher than fourth order are not sufficient to justify the higher complexity near the boundary and/or the additional computational cost.

Sandham, N. D.↗

Development of a molecularly informed biogeochemical framework for reactive transport modeling of subsurface carbon inventories, transformations and fluxes (Final Report)

The overall objective of the project was to combine new molecular-level characterization strategies with soil carbon flux measurements to develop and evaluate model representations of subsurface carbon cycling. We expanded on existing studies in the East River watershed, Colorado, in collaboration with the Berkeley Lab Watershed Function Scientific Focus Area (SFA), SLAC Groundwater Quality SFA, and Rocky Mountain Biological Laboratory (RMBL) to develop an elevation and vegetation gradient that is now the subject of long-term monitoring by the USGS. To achieve the overall objective, we combined field studies of soil respiration with laboratory analyses, ranging from spectroscopy to incubation studies. This combination of techniques enabled us to develop a new understanding of the drivers of high-elevation soil respiration. In the process, we developed three new modeling approaches that improve our ability to conceptualize and ultimately to represent soil respiration in numerical models. The first approach is a plot-scale transient inverse model that can be used to determine in situ CO 2 production rates from measured concentration profiles and surface fluxes. Application of this method revealed the importance of plant phenology and deep CO 2 production in moderating CO 2 fluxes to the atmosphere. The second modeling approach is a molecular-scale tool that enables spectroscopic and elemental data for carbon speciation to be transformed into functional group abundances, or the ‘SOC-fga model’. This method uniquely enables carbon speciation to be tracked within a reactive transport framework to partition carbon among different pathways and storage zones within the soil. The third modeling tool builds strongly on the previous approaches and captures the microbial processes driving heterotrophic respiration. This ‘dormancy model’ allows the native soil microbial population to respond transiently to the presence or absence of water in order to catalyze carbon respiration. This approach was also compared to the simpler and more widely used first-order model using two experimental datasets with different temporal and spatial resolutions. Our results illustrate that the simpler first order model provides a robust and efficient representation of deep (>1 meter) soil respiration, but that shallow soils, where most respiration occurs, require explicit representation of moisture-dependent activation and dormancy rates. By assessing soil organic carbon turnover at multiple scales, we see a complex array of controls emerge. Atte scale of a hillslope, spatial heterogeneity in soil respiration rates dominates and is uncorrelated with instantaneous soil moisture and plant community. At the profile scale, the balance between plant inputs and water availability is the dominant control. At the microbial to molecular scale, physiological processes associated with carbon use and carbon speciation are important controls. These scale-dependent controls emphasize the need for new modeling approaches that examine their interactions and hierarchies.

54 ENVIRONMENTAL SCIENCES↗

Evaluating wind speed and power forecasts for wind energy applications using an open-source and systematic validation framework

Building on the verification and validation work developed under the Second Wind Forecast Improvement Project, this work exhibits the value of a consistent procedure to evaluate wind power forecasts. We established an open-source Python code base tailored for wind speed and wind power forecast validation, WE-Validate. The code base can evaluate model forecasts with observations in a coherent manner. To demonstrate the systematic validation framework of WE-Validate, we designed and hosted a forecast evaluation benchmark exercise. We invited forecast providers in industry and academia to participate and submit forecasts for two case studies. We then evaluated the submissions with WE-Validate. Our findings suggest that ensemble means have reasonable skills in time series forecasting, whereas they are often inferior to single ensemble members in wind ramp forecasting. Adopting a voting scheme in ramp forecasting that allows ensemble members to detect ramps independently leads to satisfactory skill scores. Throughout this document, we also emphasize the importance of using statistically robust and resistant metrics as well as equitable skill scores in forecast evaluation.

17 WIND ENERGY↗

Exploring the Feasibility of INCONEL® ALLOY 740H® for Power Plant Headers: Integrating Machine Learning with Computational Fluid Dynamics (CFD)

This keynote presentation explores the behavior of headers—essential components of pipeline systems—using ANSYS simulation software and machine learning techniques. The study aims to predict the thermal and mechanical performance of headers under diverse conditions through both steady-state and transient simulations. We investigate critical parameters such as heat transfer coefficient, fluid velocity, and temperature to optimize header design. Conducted as part of a DOE project led by NCAT in collaboration with UNC Charlotte, this research encompasses multiple key topics. The initial section focuses on the behavior of header systems under steady-state conditions using ANSYS simulation. It underscores the importance of headers in industrial infrastructure, especially in the energy sector, and examines the implications of material selection and flow direction on heat transfer dynamics. Methodologically, we employ Computational Fluid Dynamics (CFD) analysis through ANSYS, detailing the development of models, material properties, geometry specifications, boundary conditions, and meshing strategies. Our simulations explore various operational parameters, including temperature and mass flow rates, crucial for predicting heat transfer coefficients and enhancing header design. Results from the study include parametric investigations into mesh sensitivity, viscosity model evaluations, and the effects of heat transfer locations, all validated against theoretical calculations. We conclude with insights on mesh optimization, the suitability of viscosity models, and recommendations for future research aimed at improving header system efficiency and sustainability in industrial applications.

20 FOSSIL-FUELED POWER PLANTS↗

WSTF Pyrovalve Test Program Status: 2000

Extensive propulsion and pyrotechnic testing has been in progress at NASA/JSC White Sands Test Facility (WSTF) since 1995, starting with the Mars Observer Propulsion and Pyrotechnics Corrective Action Test Program (MOCATP). The MOCATP has been concluded, but extensive pyrovalve testing plus research and development continues at WSTF. Our capability to accurately characterize pyrovalve combustion product blow-by into propellant systems, evaluate hydrazine and monomethylhydrazine (MMH) thermal decomposition initiated by blow-by, and characterize valve actuation operation, continues to be used and refined. Data from this and several low blow-by pyrovalves manufactured by Conax and other corporations continues to be evaluated as a potential corrective measure for blow-by induced propellant explosions. Additionally, new measurement techniques are being developed, advanced pyrovalve development is under-way, and nondestructive examination (NDE) methods are being developed to help ensure pyrovalve safety. Starting in 2000 these data are being formatted into a pyrovalve application and testing handbook. Near-term testing includes evaluation of 3/8-in. Conax pyrovalves and other commercially available valves; development of advanced pyrovalve subcomponent technology; investigation of NDE techniques to evaluate pyrovalve ram seals and real-time measurement of housing deformation; and investigation of pyrotechnically induced explosive hydrazine decomposition both through testing and modeling. Evaluation of 3/8-in. Conax valves is to include operational margin testing to be accomplished at the NASA Langley Research Center.

Saulsberry, Regor L.↗

Reducing uncertainty about carbon dioxide as a climate driver

The lack of an adequate ancient analogue for future climates means that we ultimately must use and trust climate models, evaluated against modern observation and our best geologic records of warm and cold climates of the past. Armed with an elevated confidence in the models, we will then be able to make reliable predictions of the Earth's response to our risky experiment with the climate system.

Climate↗

Overview of the Subscale RAVEN Flight Controls and Modeling Testbed

The Research Aircraft for eVTOL Enabling TechNologies (RAVEN) Subscale Wind-Tunnel and Flight Test (SWFT) model is a subscale aircraft built for flight dynamics and controls research demonstrated in wind-tunnel and flight-test experiments. The intent of this paper is to provide a summary of past, current, and future efforts being pursued by the RAVEN-SWFT project. Initially, vehicle development guidelines were crafted by a multidisciplinary team to ensure that the RAVEN-SWFT vehicle was well suited for research in multiple areas, including aero-propulsive modeling, flight controls, and autonomy, among others. The vehicle has been used to obtain extensive wind-tunnel data, enabling aero-propulsive model development across the transition flight envelope and validation of computational tools. The vehicle will be used to conduct flight testing in order to evaluate modeling strategies and flight control logic. The RAVEN-SWFT model also serves as a risk reduction activity for a conceptual, full-scale vehicle in the 1000-lb class. The next steps in the project are to successfully demonstrate free flight in hover, transition, forward flight, and the reverse thereof, utilizing custom control laws integrated onto the RAVEN-SWFT avionics hardware. The project intends to publicize all of the geometry, data, and methods in future reports.

eVTOL↗

Estimating electric field enhancement factors on an aircraft utilizing a small scale model: A method evaluation

A method for obtaining field enhancement factors at specific points on an aircraft utilizing a small scale model was evaluated by measuring several canonical shapes. Comparison of the form factors obtained by analytical means with measurements indicate that the experimental method has serious flaws. Errors of 200 to 300 percent were found between analytical values and measured values. As a result of the study, the analytical method is not recommended for calibration of field meters located on aircraft, and should not be relied upon in any application where the local spatial derivatives of the electric field on the model are large over the dimensions of the sensing probe.

Easterbrook, Calvin C.↗

Dynamic-Phasor Model of Transformer Inrush Simulation for Unbalanced Distribution System

Abstract— Power system stability is a critical concern, with respect to the increasing distributed energy resources, microgrids, and emphasis on enhancing resiliency. For stability analysis and evaluation, modeling and simulation capabilities are important. In this paper, the authors’ previous work on modeling transformer inrush dynamics is improved with a new formulation of the key equation that converts the dynamic-phasor into real-time value. Simulation results in an electromechanical time-scale are compared with PSCAD results in an electromagnetic time-scale to demonstrate the improvement. The impact of simulation step size is discussed. A bug in PSCAD transformer setting that leads to incorrect magnetizing flux and current under Delta winding type is identified and reported. In addition, explanations and analysis are provided on two modeling techniques utilized since the previous work. This work is being incorporated into the next release of GridLAB-D. The improved transformer inrush calculation enables more accurate predictions of current amplitudes for analyzing the dynamics of distribution operation and control.

power transformers, power system simulation, satur↗

Quantifying leaf symptoms of sorghum charcoal rot in images of field‐grown plants using deep neural networks

Abstract Charcoal rot of sorghum (CRS) is a significant disease affecting sorghum crops, with limited genetic resistance available. The causative agent, Macrophomina phaseolina (Tassi) Goid, is a highly destructive fungal pathogen that targets over 500 plant species globally, including essential staple crops. Utilizing field image data for precise detection and quantification of CRS could greatly assist in the prompt identification and management of affected fields and thereby reduce yield losses. The objective of this work was to implement various machine learning algorithms to evaluate their ability to accurately detect and quantify CRS in red‐green‐blue images of sorghum plants exhibiting symptoms of infection. EfficientNet‐B3 and a fully convolutional network emerged as the top‐performing models for image classification and segmentation tasks, respectively. Among the classification models evaluated, EfficientNet‐B3 demonstrated superior performance, achieving an accuracy of 86.97%, a recall rate of 0.71, and an F1 score of 0.73. Of the segmentation models tested, FCN proved to be the most effective, exhibiting a validation accuracy of 97.76%, a recall rate of 0.68, and an F1 score of 0.66. As the size of the image patches increased, both models’ validation scores increased linearly, and their inference time decreased exponentially. This trend could be attributed to larger patches containing more information, improving model performance, and fewer patches reducing the computational load, thus decreasing inference time. The models, in addition to being immediately useful for breeders and growers of sorghum, advance the domain of automated plant phenotyping and may serve as a foundation for drone‐based or other automated field phenotyping efforts. Additionally, the models presented herein can be accessed through a web‐based application where users can easily analyze their own images.

Gonzalez, Emmanuel M.↗

2022 GETEM Geothermal Drilling Cost Curve Update

The Geothermal Electricity Technology Evaluation Model (GETEM) is an essential tool for the U.S. Department of Energy's (DOE) Geothermal Technologies Office (GTO) to understand the performance and cost of technologies it is seeking to improve. This detailed model is used for supply curve analyses, assessing the current economic feasibility and levelized cost of energy (LCOE) of hydrothermal geothermal systems and enhanced geothermal systems (EGS), and evaluating the potential impact of advanced geothermal technologies. GETEM can be used to estimate the performance and costs of currently available U.S. geothermal power systems. It is also used to estimate the costs of technologies 5 to 20 years in the future, given the direction of potential research, development, and demonstration (RD&D) projects. The model is intended to help GTO determine which proposed RD&D programs and projects might offer the most efficient improvement when using taxpayer funding. The model requires annual updates as well as revisions to reflect the current state of the art. Drilling costs are a significant portion of total geothermal development costs. The current GETEM drilling cost inputs rely on drilling data from 2009 and require an updated analysis of more recent data to ensure they remain representative of current technologies. An updated, more accurate understanding of costs could help the geothermal industry secure project development financing and investment funding and better allow the oil and gas (O&G) industry (both operators and service companies) to weigh potential geothermal market participation and customization. This report details recent drilling improvements from the Utah Frontier Observatory for Research in Geothermal Energy (FORGE) and the O&G sector, comparing drilling performance and costs with values in GETEM, particularly the baseline drilling cost curves. Although drilling performance at FORGE has improved significantly, we did not find associated cost decreases that would justify lowering the GETEM baseline cost curves at this time.

API↗

The impact of including spatially longitudinal heterogeneities of vessel oxygen content and vascular fraction in 3D tumor oxygenation models on predicted radiation sensitivity

Purpose: Oxygen distribution models have been used to analyze the influences of oxygen tensions on tissue response after radiotherapy. These distributions are often generated assuming constant oxygen tension in the blood vessels. However, as red blood cells progress through the vessels, oxygen is continuously released into the plasma and the surrounding tissue, resulting in longitudinally varying oxygen levels in the blood vessels. In the present study, the authors investigated whether a tumor oxygenation model that incorporated longitudinally varying oxygen levels would provide different predictions of necrotic fractions and radiosensitivity compared to commonly used models with a constant oxygen pressure. Methods: Our models simulated oxygen diffusion based on a Green's function approach and oxygen consumption according to the Michaelis-Menten equation. The authors constructed tumor models with different vascular fractions (VFs), from which they generated depth oxygenation curves and a look-up table of oxygen pressure gradients. The authors evaluated models of spherical tumors of various sizes, from 1 to 10{sup 4} mg. The authors compared the results from a model with constant vessel oxygen (CVO) pressure to those from models with longitudinal variations in oxygen saturation and either a constant VF (CVF) or variable VF (VVF) within the tumor tissue. The authors monitored the necrotic fractions, defined as tumor regions with an oxygen pressure below 1 mmHg. Tumor radiation sensitivity was expressed as D{sub 99,} the homogeneous radiation dose required for a tumor control probability of 0.99. Results: In the CVO saturation model, no necrosis was observed, and decreasing the VF could only decrease the D{sub 99} by up to 10%. Furthermore, the D{sub 99} vs VF dependence was similar for different tumor masses. Compared to the CVO model, the extended CVF and VVF models provided clearly different results, including pronounced effects of VF and tumor size on the necrotic fraction and D{sub 99}, necrotic fractions ranging from 0% to 97%, and a maximal D{sub 99} increment of 57%. Only minor differences were observed between different vessel architectures, i.e., CVF vs VVF. In the smallest tumor with a low necrotic fraction, the D{sub 99} strictly decreased with increasing blood velocity. Increasing blood velocity also decreased the necrotic fraction in all tumor sizes. VF had the most profound influence on both the necrotic fraction and on D{sub 99}. Conclusions: Our present analysis of necrotic formation and the impact of tumor oxygenation on D{sub 99} demonstrated the importance of including longitudinal variations in vessel oxygen content in tumor models. For small tumors, radiosensitivity was particularly dependent on VF and slightly dependent on the blood velocity and vessel arrangement. These dependences decreased with increasing tumor size, because the necrotic fraction also increased, thereby decreasing the number of viable tumor cells that required sterilization. The authors anticipate that the present model will be useful for estimating tumor oxygenation and radiation response in future detailed studies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Modeling transport kinetics in clinoptilolite-phosphate rock systems

Nutrient release in clinoptilolite-phosphate rock (Cp-PR) systems occurs through dissolution and cation-exchange reactions. Investigating the kinetics of these reactions expands our understanding of nutrient release processes. Research was conducted to model transport kinetics of nutrient release in Cp-PR systems. The objectives were to identify empirical models that best describe NH4, K, and P release and define diffusion-controlling processes. Materials included a Texas clinoptilolite (Cp) and North Carolina phosphate rock (PR). A continuous-flow thin-disk technique was used. Models evaluated included zero order, first order, second order, parabolic diffusion, simplified Elovich, Elovich, and power function. The power-function, Elovich, and parabolic-diffusion models adequately described NH4, K, and P release. The power-function model was preferred because of its simplicity. Models indicated nutrient release was diffusion controlled. Primary transport processes controlling nutrient release for the time span observed were probably the result of a combination of several interacting transport mechanisms.

NASA Center JSC↗

Uncertainty Aware Structural Topology Optimization Via a Stochastic Reduced Order Model Approach

This work presents a stochastic reduced order modeling strategy for the quantification and propagation of uncertainties in topology optimization. Uncertainty aware optimization problems can be computationally complex due to the substantial number of model evaluations that are necessary to accurately quantify and propagate uncertainties. This computational complexity is greatly magnified if a high-fidelity, physics-based numerical model is used for the topology optimization calculations. Stochastic reduced order model (SROM) methods are applied here to effectively 1) alleviate the prohibitive computational cost associated with an uncertainty aware topology optimization problem; and 2) quantify and propagate the inherent uncertainties due to design imperfections. A generic SROM framework that transforms the uncertainty aware, stochastic topology optimization problem into a deterministic optimization problem that relies only on independent calls to a deterministic numerical model is presented. This approach facilitates the use of existing optimization and modeling tools to accurately solve the uncertainty aware topology optimization problems in a fraction of the computational demand required by Monte Carlo methods. Finally, an example in structural topology optimization is presented to demonstrate the effectiveness of the proposed uncertainty aware structural topology optimization approach.

Aguilo, Miguel A.↗

Optimal design and control strategies for novel combined heat and power (CHP) fuel cell systems. Part I of II, datum design conditions and approach.

Energy network optimization (ENO) models identify new strategies for designing, installing, and controlling stationary combined heat and power (CHP) fuel cell systems (FCSs) with the goals of (1) minimizing electricity and heating costs for building owners and (2) reducing emissions of the primary greenhouse gas (GHG) - carbon dioxide (CO{sub 2}). A goal of this work is to employ relatively inexpensive simulation studies to discover more financially and environmentally effective approaches for installing CHP FCSs. ENO models quantify the impact of different choices made by power generation operators, FCS manufacturers, building owners, and governments with respect to two primary goals - energy cost savings for building owners and CO{sub 2} emission reductions. These types of models are crucial for identifying cost and CO{sub 2} optima for particular installations. Optimal strategies change with varying economic and environmental conditions, FCS performance, the characteristics of building demand for electricity and heat, and many other factors. ENO models evaluate both 'business-as-usual' and novel FCS operating strategies. For the scenarios examined here, relative to a base case of no FCSs installed, model results indicate that novel strategies could reduce building energy costs by 25% and CO{sub 2} emissions by 80%. Part I of II articles discusses model assumptions and methodology. Part II of II articles illustrates model results for a university campus town and generalizes these results for diverse communities.

30 DIRECT ENERGY CONVERSION↗