Search NASA⌕ Search

SEARCH · Search NASA

Results for “model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

An Overview of Mesoscale Aerosol Processes, Comparisons, and Validation Studies from DRAGON Networks

Over the past 24 years, the AErosol RObotic NETwork (AERONET) program has provided highly accurate remote-sensing characterization of aerosol optical and physical properties for an increasingly extensive geographic distribution including all continents and many oceanic island and coastal sites. The measurements and retrievals from the AERONET global network have addressed satellite and model validation needs very well, but there have been challenges in making comparisons to similar parameters from in situ surface and airborne measurements. Additionally, with improved spatial and temporal satellite remote sensing of aerosols, there is a need for higher spatial-resolution ground-based remote-sensing networks. An effort to address these needs resulted in a number of field campaign networks called Distributed Regional Aerosol Gridded Observation Networks (DRAGONs) that were designed to provide a database for in situ and remote-sensing comparison and analysis of local to mesoscale variability in aerosol properties. This paper describes the DRAGON deployments that will continue to contribute to the growing body of research related to meso- and microscale aerosol features and processes. The research presented in this special issue illustrates the diversity of topics that has resulted from the application of data from these networks.

Holben, Brent N.↗

Machine Learning Framework for Characterizing Processing–Structure Relationship in Block Copolymer Thin Films

The morphology of block copolymers (BCPs) critically influences material properties and applications. This work introduces a machine learning (ML)-enabled, high-throughput framework for analyzing grazing incidence small-angle X-ray scattering (GISAXS) data and atomic force microscopy (AFM) images to characterize BCP thin film morphology. A convolutional neural network was trained to classify AFM images by surface features, achieving 97% testing accuracy. Classified images were then analyzed to extract 2D grain size measurements from the samples in a high-throughput manner. ML models were trained to predict domain orientation based on processing parameters such as solvent ratio, additive type, and additive ratio. GISAXS-based properties were predicted with strong performances (R 2 > 0.75), while AFM-based property predictions were less accurate (R 2 < 0.60), likely due to the localized nature of AFM measurements compared to the bulk information captured by GISAXS. Beyond model performance, interpretability was addressed using SHapley Additive exPlanations (SHAP). SHAP analysis revealed that the additive ratio had the largest impact on morphological predictions, where additive provides the BCP chains with increased volume to rearrange into thermodynamically favorable morphologies. This interpretability helps validate model predictions and offers insight into parameter importance. Altogether, the presented framework combining high-throughput characterization and interpretable ML offers an approach to exploring and optimizing BCP thin film morphology across a broad processing landscape.

36 MATERIALS SCIENCE↗

Benchtop Autonomous Electrochemical Characterization System for Combinatorial Thin-Film Solid Oxide Electrodes

The design of materials for electrochemical energy conversion is complicated by a vast search space of candidate materials and multifaceted property requirements: multicarrier conductivity, stability, and catalytic activity are all necessary but rarely intersect. Although self-driving laboratories are rapidly rising to address such material optimization problems, the required infrastructure for integrated, large-scale robotic facilities can be cost-prohibitive. Here we develop and evaluate a closed-loop measurement system for efficient screening of proton-conducting oxide electrodes for ceramic fuel cells and electrolyzers, building on top of an existing benchtop instrument and integrating techniques for rapid impedance measurement and automated analysis. This system exemplifies a “minimum viable” self-driving implementation that can deliver substantial benefits with relatively simple infrastructure. Combinatorial thin-film microelectrode libraries are characterized with a recently developed joint time-domain and frequency-domain impedance measurement technique, which provides an order-of-magnitude acceleration relative to conventional impedance spectroscopy. The distribution of relaxation times is extracted from impedance data and analyzed without human intervention. These results feed an active learning and Bayesian optimization process that learns to predict electrochemical impedance as a function of material composition, measurement temperature, oxygen partial pressure, and electrical bias, which further reduces the screening time by tenfold with optimized experimental sequences. We apply this system to Ba⁡(Co,Fe,Zr,Y)⁢O 3−𝛿 combinatorial libraries and evaluate its effectiveness for learning material property trends and optimizing expensive-to-evaluate properties such as activation energy. This offers insights into key methodological aspects of practical autonomous experimentation, including surrogate model validation, cost-aware acquisition functions, and high-throughput data interpretation. Our results demonstrate the efficacy of the system for rapidly gathering information, but also highlight real-world experimental challenges of thin-film degradation and numerical instability in surrogate models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Rapid estimation of photosynthetic leaf traits of tropical plants in diverse environmental conditions using reflectance spectroscopy

Tropical forests are one of the main carbon sinks on Earth, but the magnitude of CO 2 absorbed by tropical vegetation remains uncertain. Terrestrial biosphere models (TBMs) are commonly used to estimate the CO 2 absorbed by forests, but their performance is highly sensitive to the parameterization of processes that control leaf-level CO 2 exchange. Direct measurements of leaf respiratory and photosynthetic traits that determine vegetation CO 2 fluxes are critical, but traditional approaches are time-consuming. Reflectance spectroscopy can be a viable alternative for the estimation of these traits and, because data collection is markedly quicker than traditional gas exchange, the approach can enable the rapid assembly of large datasets. However, the application of spectroscopy to estimate photosynthetic traits across a wide range of tropical species, leaf ages and light environments has not been extensively studied. Here, we used leaf reflectance spectroscopy together with partial least-squares regression (PLSR) modeling to estimate leaf respiration ( R dark25 ), the maximum rate of carboxylation by the enzyme Rubisco ( V cmax25 ), the maximum rate of electron transport ( J max25 ), and the triose phosphate utilization rate ( T p25 ), all normalized to 25°C. We collected data from three tropical forest sites and included leaves from fifty-three species sampled at different leaf phenological stages and different leaf light environments. Our resulting spectra-trait models validated on randomly sampled data showed good predictive performance for V cmax25 , J max25 , T p25 and R dark25 (RMSE of 13, 20, 1.5 and 0.3 μmol m -2 s -1 , and R 2 of 0.74, 0.73, 0.64 and 0.58, respectively). The models showed similar performance when applied to leaves of species not included in the training dataset, illustrating that the approach is robust for capturing the main axes of trait variation in tropical species. We discuss the utility of the spectra-trait and traditional gas exchange approaches for enhancing tropical plant trait studies and improving the parameterization of TBMs.

54 ENVIRONMENTAL SCIENCES↗

Evolution of Precipitation Particle Size Distributions within MC3E Systems and its Impact on Aerosol-Cloud-Precipitation Interactions: Final Report

This is a multi-institutional, collaborative project using observations and modeling to study the evolution (e.g. formation and growth) of hydrometeors in continental convective clouds. Our contribution was in data analysis for the generation of high-value cloud and precipitation products and derive cloud statistics for model validation. There are two areas in data analysis that we contributed: i) the development of novel, state-of-the-art dual-wavelength radar algorithms for the retrieval of cloud microphysical properties and ii) the evaluation of large domain, high-resolution models using comprehensive multi-sensor observations. Our research group developed statistical summaries from numerous sensors and developed retrievals of vertical air motion in deep convection.

54 ENVIRONMENTAL SCIENCES↗

Optimization of a Remote Sensing Energy Balance Method over Different Canopy Applied at Global Scale

Parameterization methods which calculate turbulent heat and water fluxes with thermal remote sensing data were evaluated in the revised remote sensing surface energy balance system (SEBS) model (Chen et al., 2013). The model calculates sensible heat (H) based on the Monin-Obukhov similarity theory (MOST) and determines latent heat (LE) as the residual of energy balance. We examined the uncertainties of H and LE in the SEBS model due to five key parameters at the local station point scale. Observations at 27 flux towers located in seven land cover types (needle-leaf forest, broad leaf forest, shrub, savanna, grassland, cropland, and sparsely vegetated land) and an artificial intelligence particle swarm optimization (PSO) algorithm was combined to calibrate the five parameters (leaf drag coefficient, leaf heat transfer coefficients, roughness length for soil, and two parameters for ground heat calculation) in the SEBS model. The root-mean-square error at the site scale was reduced by 9 W/sq.m for H, and 92 W/sq.m for LE, and their correlation coefficients were increased by 0.07 (H) and 0.11 (LE) after using the calibrated parameters. The updated model validation was further conducted globally for the remotely sensed evapotranspiration (ET) calculations. Overestimation of SEBS global ET was significantly improved by using the optimized values of the parameters. The results suggested PSO was able to consistently locate the global optimum of the SEBS model, and appears to be capable of solving the ET model optimization problem.

Chen, Xuelong↗

Remote Sensing of Above Cloud Aerosols

The direct and indirect radiative effects of aerosols suspended in the atmosphere above clouds (ACA) are a highly uncertain component of both regional and global climate. Much of this uncertainty is observational in nature most orbital remote sensing algorithms were not designed to simultaneously retrieve aerosol and cloud optical properties in the same vertical column. Thus the climate modeling community has limited data to inform model development efforts, which encapsulate the current understanding of climate. Furthermore, field measurements have identified regions with consistent ACA, and regional simulations show that the radiative forcing may be significant. For this reason, there has been a recent push to develop the ability to determine ACA distribution, optical properties and cloud interactions, while also providing a means to validate models. Several algorithms have been created that utilize existing instruments for these purposes. However, the observational data sources, algorithm characteristics, geophysical assumptions and retrieved products from these methods are highly variable. This chapter is a review of these techniques, their uncertainties, and the associated validation efforts. We will also discuss the future of ACA remote sensing, both with regards to new instruments and the potential for new algorithms.

Aerosols↗

Educational and Scientific Applications of Climate Model Diagnostic Analyzer

Climate Model Diagnostic Analyzer (CMDA) is a web-based information system designed for the climate modeling and model analysis community to analyze climate data from models and observations. CMDA provides tools to diagnostically analyze climate data for model validation and improvement, and to systematically manage analysis provenance for sharing results with other investigators. CMDA utilizes cloud computing resources, multi-threading computing, machine-learning algorithms, web service technologies, and provenance-supporting technologies to address technical challenges that the Earth science modeling and model analysis community faces in evaluating and diagnosing climate models. As CMDA technology and infrastructure have matured, we have developed the educational and scientific applications of CMDA. Educationally, CMDA supported the summer school of the JPL Center for Climate Sciences in 2014, 2015, and 2016. In the summer school, the students work on group research projects where CMDA provide datasets, analysis tools, and provenance support utility tools. Each student is assigned to a virtual machine with CMDA installed in Amazon Web Services. Scientifically, we have developed several science use cases of CMDA covering various topics, datasets, and analysis types. Each of the science use cases is described in terms of a scientific goal, datasets used, the analysis tools used, scientific results discovered, an analysis result such as output plots and data files, and a link to the corresponding analysis service call with all the input arguments filled.

Bao, Qihao↗

SAM Process Heat Model Development and Validation: Liquid-HTF Trough and Direct Steam Generation Linear Focus Systems

Two new solar industrial process heat (SIPH) models have been added to the System Advisor Model (SAM) energy simulation tool. The two process heat models were: i) liquid-heat transfer fluid (HTF) parabolic troughs; and ii) direct steam generation (DSG) linear-focus collectors. The DSG model can simulate either DSG parabolic troughs (PT) or DSG Linear Fresnel (LF) fields, based on the optical characteristics supplied. These models help to meet the need for independent, validated tools that reliably simulate the effects of adding a solar field to provide heat for potential IPH applications. During the pre-validation of the liquid-HTF model, operational data was provided and preprocessed by SPF and evaluated at ZAE Bayern. The beta liquid-HTF model provided excellent agreement between the simulations and the operational data for the solar thermal yield generation on a yearly and monthly basis (4.4% difference). The final liquid-HTF process heat model has been further optimized with test users such as ZAE Bayern and SPF. Key improvements in the SIPH models to better model SIPH fields include the use of smaller piping systems and heat capacities, a single collector field, and a higher time-step resolution than for electricity generation (down to 10 minutes). Both the final liquid-HTF and DSG models were successfully validated against operational data for respective solar fields, and showed less than 5% deviation to actual results. A brief application where the liquid-HTF process heat model is used for a brewery in California and the value of reliably simulating a potential SIPH solar field are highlighted.

14 SOLAR ENERGY↗

Radius and equation of state constraints from massive neutron stars and GW190814

Motivated by the unknown nature of the 2.50–2.67M⊙ compact object in the binary merger event GW190814, we study the maximum neutron star mass based on constraints from low-energy nuclear physics, neutron star tidal deformabilities from GW170817, and simultaneous mass-radius measurements of PSR J0030+045 from NICER. Our prior distribution is based on a combination of nuclear modeling valid in the vicinity of normal nuclear densities together with the assumption of a maximally stiff equation of state at high densities, a choice that enables us to probe the connection between observed heavy neutron stars and the transition density at which conventional nuclear physics models must break down. Here we demonstrate that a modification of the highly uncertain suprasaturation density equation of state beyond 2.64 times normal nuclear density is required in order for chiral effective field theory models to be consistent with current neutron star observations and the existence of 2.6M⊙ neutron stars. We also show that the existence of very massive neutron stars strongly impacts the radii of ≈ 2.0M⊙ neutron stars (but not necessarily the radii of 1.4 M⊙ neutron stars), which further motivates future NICER radius measurements of PSR J1614 – 2230 and PSR J0740+6620.

79 ASTRONOMY AND ASTROPHYSICS↗

Prediction of Aluminum to Steel RSW Joint Failure (CRADA 405)

General Motors, LLC has developed a resistance spot welding process to join aluminum sheet to steel for body-in-white manufacturing. Efforts to develop the process for any one joint configuration (combination of alloy and thicknesses) is intensive. To aid in process understanding and eventual reduction in process development efforts, an initiative was created to develop an finite element model of the various destructive test configurations (lap shear, cross-tension, and coach peel) to help predict the failure mode and load displacement curves under tensile testing. This report describes the finite element modeling approach, the means by which local material properties were determined, as well as model validation and refinement efforts.

36 MATERIALS SCIENCE↗

Validation of a Scalable Solar Sailcraft

The NASA In-Space Propulsion (ISP) program sponsored intensive solar sail technology and systems design, development, and hardware demonstration activities over the past 3 years. Efforts to validate a scalable solar sail system by functional demonstration in relevant environments, together with test-analysis correlation activities on a scalable solar sail system have recently been successfully completed. A review of the program, with descriptions of the design, results of testing, and analytical model validations of component and assembly functional, strength, stiffness, shape, and dynamic behavior are discussed. The scaled performance of the validated system is projected to demonstrate the applicability to flight demonstration and important NASA road-map missions.

Murphy, D. M.↗

CSP-Plant Modeling Guidelines and Compliance of the System Advisor Model (SAM): Preprint

Accurately modeling risks, costs, and electricity output is essential to the financing and advancement of concentrating solar power projects. To address this need, a group of CSP experts created a guideline document, titled SolarPACES Guideline for Bankable STE Yield Assessment (1). To make this information more accessible and allow stakeholders to test specific models against the recommendations, the guidelines have been condensed into a spreadsheet-based checklist. The checklist was applied to NREL's System Advisory Model (SAM) CSP modeling software, providing useful feedback to both the checklist group and the SAM development team. This study showed a strong agreement between SAM and the guidelines, demonstrated the use of the guidelines in model validation, and resulted in several recommended improvements to SAM.

14 SOLAR ENERGY↗

The Invasive Species Forecasting System (ISFS): An iRODS-Based, Cloud-Enabled Decision Support System for Invasive Species Habitat Suitability Modeling

The Invasive Species Forecasting System (ISFS) is an online decision support system that allows users to load point occurrence field sample data for a plant species of interest and quickly generate habitat suitability maps for geographic regions of interest, such as a national park, monument, forest, or refuge. Target customers for ISFS are natural resource managers and decision makers who have a need for scientifically valid, model- based predictions of the habitat suitability of plant species of management concern. In a joint project involving NASA and the Maryland Department of Natural Resources, ISFS has been used to model the potential distribution of Wavyleaf Basketgrass in Maryland's Chesapeake Bay Watershed. Maximum entropy techniques are used to generate predictive maps using predictor datasets derived from remotely sensed data and climate simulation outputs. The workflow to run a model is implemented in an iRODS microservice using a custom ISFS file driver that clips and re-projects data to geographic regions of interest, then shells out to perform MaxEnt processing on the input data. When the model completes, all output files and maps from the model run are registered in iRODS and made accessible to the user. The ISFS user interface is a web browser that uses the iRODS PHP client to interact with the ISFS/iRODS- server. ISFS is designed to reside in a VMware virtual machine running SLES 11 and iRODS 3.0. The ISFS virtual machine is hosted in a VMware vSphere private cloud infrastructure to deliver the online service.

Gill, Roger↗

Test-Anchored Vibration Response Predictions for an Acoustically Energized Curved Orthogrid Panel with Mounted Components

rich body of vibroacoustic test data was recently generated at Marshall Space Flight Center for component-loaded curved orthogrid panels typical of launch vehicle skin structures. The test data were used to anchor computational predictions of a variety of spatially distributed responses including acceleration, strain and component interface force. Transfer functions relating the responses to the input pressure field were generated from finite element based modal solutions and test-derived damping estimates. A diffuse acoustic field model was applied to correlate the measured input sound pressures across the energized panel. This application quantifies the ability to quickly and accurately predict a variety of responses to acoustically energized skin panels with mounted components. Favorable comparisons between the measured and predicted responses were established. The validated models were used to examine vibration response sensitivities to relevant modeling parameters such as pressure patch density, mesh density, weight of the mounted component and model form. Convergence metrics include spectral densities and cumulative root-mean squared (RMS) functions for acceleration, velocity, displacement, strain and interface force. Minimum frequencies for response convergence were established as well as recommendations for modeling techniques, particularly in the early stages of a component design when accurate structural vibration requirements are needed relatively quickly. The results were compared with long-established guidelines for modeling accuracy of component-loaded panels. A theoretical basis for the Response/Pressure Transfer Function (RPTF) approach provides insight into trends observed in the response predictions and confirmed in the test data. The software developed for the RPTF method allows easy replacement of the diffuse acoustic field with other pressure fields such as a turbulent boundary layer (TBL) model suitable for vehicle ascent. Structural responses using a TBL model were demonstrated, and wind tunnel tests have been proposed to anchor the predictions and provide new insight into modeling approaches for this environment. Finally, design load factors were developed from the measured and predicted responses and compared with those derived from traditional techniques such as historical Mass Acceleration Curves and Barrett scaling methods for acreage and component-loaded panels.

Frady, Gregory P.↗

Design of High-deflection Foils for Marine Hydrokinetic Applications (Final Report)

This project used model-scale tank testing and fluid-structure-interaction (FSI) simulations to investigate the behavior of foils with large deflections and the effect of these deflections on crossflow turbine performance with the goal of determining the maximum allowable deflections consonant with efficiency and a robust, durable structure. A validated modeling and simulation approach was used in the design of an Ocean Renewable Power Company (ORPC) full-scale turbine. The methodology is applicable to the design of other marine hydrokinetic (MHK) devices, and to hydrokinetic turbines which experience significant deflections during operation.

16 TIDAL AND WAVE POWER↗

Effects of model deficiencies on parameter estimation

Reliable structural dynamic models will be required as a basis for deriving the reduced-order plant models used in control systems for large space structures. Ground vibration testing and model verification will play an important role in the development of these models; however, fundamental differences between the space environment and earth environment, as well as variations in structural properties due to as-built conditions, will make on-orbit identification essential. The efficiency, and perhaps even the success, of on-orbit identification will depend on having a valid model of the structure. It is envisioned that the identification process will primarily involve parametric methods. Given a correct model, a variety of estimation algorithms may be used to estimate parameter values. This paper explores the effects of modeling errors and model deficiencies on parameter estimation by reviewing previous case histories. The effects depend at least to some extent on the estimation algorithm being used. Bayesian estimation was used in the case histories presented here. It is therefore conceivable that the behavior of an estimation algorithm might be useful in detecting and possibly even diagnosing deficiencies. In practice, the task is complicated by the presence of systematic errors in experimental procedures and data processing and in the use of the estimation procedures themselves.

Hasselman, T. K.↗

ACCESS - A Science and Engineering Assessment of Space Coronagraph Concepts for the Direct Imaging and Spectroscopy of Exoplanetary Systems

Topics include and overview, science objectives, study objectives, coronagraph types, metrics, ACCESS observatory, laboratory validations, and summary. Individual slides examine ACCESS engineering approach, ACCESS gamut of coronagraph types, coronagraph metrics, ACCESS Discovery Space, coronagraph optical layout, wavefront control on the "level playing field", deformable mirror development for HCIT, laboratory testbed demonstrations, high contract imaging with the HCIT, laboratory coronagraph contrast and stability, model validation and performance predictions, HCIT coronagraph optical layout, Lyot coronagraph on the HCIT, pupil mapping (PIAA), shaped pupils, and vortex phase mask experiments on the HCIT.

exoplanets↗