Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Evaluation of Mesoscale Convective Systems in Climate Simulations: Methodological Development and Results from MPAS-CAM over the U.S.

In this study, a process-oriented approach is developed to evaluate warm-season mesoscale convective system (MCS) precipitation and their favorable large-scale meteorological patterns (FLSMPs) over the U.S. This approach features a novel observation-driven MCS-tracking algorithm using infrared brightness temperature and precipitation feature at 12, 25 and 50 km resolution and metrics to evaluate the model large-scale environment favorable for MCS initiation. The tracking algorithm successfully reproduces the observed MCS statistics from a reference 4-km radar MCS database. To demonstrate the utility of the new methodologies in evaluating MCS in climate simulations with mesoscale resolution, the process-oriented approach is applied to two climate simulations produced by the Variable-Resolution Model for Prediction Across Scales coupled to the Community Atmosphere Model physics, with refined horizontal grid spacing at 50 km and 25 km over North America. With the tracking algorithm applied to simulations and observations at equivalent resolutions, the simulated number of MCS and associated precipitation amount, frequency and intensity are found to be consistently underestimated in the Central U.S., particularly from May to August. The simulated MCS precipitation shows little diurnal variation and lasts too long, while MCS precipitation area is too large and intensity is too weak. The model is able to simulate four types of observed FLSMP associated with frontal systems and low-level jets (LLJ) in spring, but the frequencies are underestimated because of low-level dry bias and weaker LLJ. Precipitation simulated under different FLSMPs peak during daytime, in contrast to the observed nocturnal peak. Implications of these findings for future model development and diagnostics are discussed.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Skyshine from an Accelerator Facility: Dependence on Distance and Angle

Neutron skyshine from Linac Coherent Light Source II 4 GeV electron beam operation at SLAC National Accelerator Laboratory can contribute to prompt radiation exposure to the public at distances far beyond the accelerator tunnel housing. One of the shielding design requirements at SLAC is that the annual dose to a member of the public is no more than 0.05 mSv y -1 . Our work uses Monte Carlo code FLUKA to simulate the generation of neutrons from 4 GeVelectron beam losses on a thick copper target inside a generalized geometry of the Linac Coherent Light Source II Beam Transport Hall accelerator tunnel section. The effective dose from neutron skyshine was characterized as a function of both distance from the tunnel wall (up to 1 km away) and angle relative to the beam direction (between 0° and 180°). Furthermore, this new methodology for evaluating neutron skyshine dose is applicable to high-energy GeV-range electron accelerator facilities both at SLAC and elsewhere.

43 PARTICLE ACCELERATORS↗

Flexible Foam Protection Materials for Constellation Space Suit Element Portable Life Support Subsystem Packaging Study

This paper discusses the effort in evaluating and selecting a light weight impact protection material for the Constellation Space Suit Element (CSSE) Portable Life Support Subsystem (PLSS) conceptual packaging study. A light weight material capable of holding and protecting the components inside the PLSS is required to demonstrate the viability of the flexible PLSS packaging concept. The material needs to distribute, dissipate, and absorb the impact energy of the PLSS falling on the lunar surface. It must also be very robust and function in the extreme lunar thermal vacuum environment for up to one hundred Extravehicular Activity (EVA) missions. This paper documents the performance requirements for selecting a foam protection material, and the methodologies for evaluating commercial off-the-shelf (COTS) foam protection materials. It also presents the materials properties test results and impact drop test results of the various foam materials evaluated in the study. The findings from this study suggest that a foam based flexible protection system is a viable solution for PLSS packaging. However, additional works are needed to optimize COTS foam properties or to develop a composite foam system that will meet all the performance requirements for the CSSE PLSS flexible packaging.

Tang, Henry H.↗

Development of a test protocol for evaluating EVA glove performance

Testing gloved hand performance involves work from several disciplines. Evaluations performed in the course of reenabling a disabled hand, designing a robotic end effector or master controller, or hard-suit design have all yielded relevant information, and, in most cases, produced performance test methods. Most times, these test methods have been primarily oriented toward their parent discipline. For space operations, a comparative test which would provide a way to quantify pressure glove and end effector performance would be useful in dividing tasks between humans and robots. Such a test would have to rely heavily on sensored measurement, as opposed to questionnaires, to produce relevant data. However, at some point human preference would have to be taken into account. This paper presents a methodology for evaluating gloved hand performance which attempts to respond to these issues. Glove testing of a prototype glove design using this method is described.

Hinman, Elaine M.↗

“One Table to Rule Them All”: How a Single Table can Enable Extensive Insights, Analytics and Assessment on Human Mobility Data

While much research has been conducted in Human Mobility Science, most studies on the analytics/insights part generally focus on one of the following: processing and analytics on human stop-trip behavior, design of individual mobility metrics (often in silos), calculation and characterization of only a handful (typically 5-6) of human mobility metrics on geospatial-temporal human mobility data of interest. Although human mobility research offers a vast and diverse array of available metrics, most individual studies typically compute only a small subset of five or six metrics at a time when analyzing trajectory datasets of human mobility across different areas of interest. This paper is motivated by the critical need to repeatedly compute an extensive array of human mobility metrics across several trajectory datasets and perform individual metric-level benchmarking to establish a new, standardized Test and Evaluation (T&E) suite for the field of Human Mobility Science. We first present our findings on the minimal yet sufficient pre-processing required to reliably and efficiently compute a wide range of human mobility metrics. The key findings are specifically related to the proposed Composite Stop Locations table, which serves as a core pre-processing data layer. Subsequently, we present a case study demonstrating how the Composite Stop Locations table facilitates computation of at least 14 distinct human mobility metrics (unlike 5-6 different set of metrics used for studies in the literature) using the popular and open-source OpenPFLOW dataset. Finally, we have also presented an example of our benchmarking methodology to evaluate the quality and performance of the trajectory dataset of interest, assessed across multiple human mobility metrics.

De, Debraj [ORNL] (ORCID:0000000233630020)↗

Component Identification of Solid Biomass Fuels Using Reflected Light Microscopy: Interlaboratory Study 2

As nations transition toward sustainable energy systems, biomass has become a vital component of global energy portfolios. Derived from organic materials such as wood, agricultural residues, forestry byproducts, and organic waste, biomass is a renewable energy source with significant environmental and economic benefits. Responsible biomass energy production can improve waste management, reduce emissions of greenhouse gases, and mitigate environmental pollution. However, as the diversity of biomass-derived fuels increases, robust quality assessment methods are essential to ensure their efficiency, safety, and minimal environmental impact. Reflected light microscopy (RLM) is one such technique with the potential to complement conventional physico-chemical analyses by enabling a rapid identification of material constituents and impurities. To refine this methodology and evaluate the reproducibility of solid biomass component identification using RLM, an interlaboratory study (ILS) was conducted. The study involved the recognition of 58 components across 45 photomicrographs, with the participation of 65 scientists and students from 25 countries. The participants faced high difficulty identifying some of the marked components, and as a result, the percentage of correct answers ranged from 19.0 % to 98.3 %, with an average correct identification rate of 62.7 %. The most challenging aspects of the identification process included distinguishing between woody and non-woody (agro) biomass, accurately identifying petroleum-derived materials, and differentiating agro biomass from inorganic matter. The results suggest that while RLM is an important tool for characterizing solid biomass, further development of methodology guidelines and training are necessary to enhance its effectiveness. Future research should prioritize preparing detailed, image-rich, microscopic morphological descriptions of biomass fuel components, which could improve the accuracy and reliability of using RLM in biomass fuel characterization.

09 BIOMASS FUELS↗

Evaluation and Application of Remotely Sensed Soil Moisture Products

Whereas in-situ measurements of soil moisture are very accurate, achieving accurate regional soil moisture estimates derived solely from point measurements is difficult because of the dependence upon the density of the gauge network and the proper upkeep of these instruments, which can be costly. Microwave remote sensing is the only technology capable of providing timely direct measurements of regional soil moisture in areas that are lacking in-situ networks. Soil moisture remote sensing technology is well established has been successfully applied in many fashions to Earth Science applications. Since the microwave emission from the soil surface has such a high dependency upon the moisture content within the soil, we can take advantage of this relationship and combined with physically-based models of the land surface, derive accurate regional estimates of the soil column water content from the microwave brightness temperature observed from satellite-based remote sensing instruments. However, there still remain many questions regarding the most efficient methodology for evaluating and applying satellite-based soil moisture estimates. As discussed below, we to use satellite-based estimates of soil moisture dynamics to improve the predictive capability of an optimized hydrologic model giving more accurate root-zone soil moisture estimates.

Bolten, J.↗

Passive cooling designs to improve heat resilience of homes in underserved and vulnerable communities

Disadvantaged communities face a growing threat to staying safe during heat waves, especially during coincident power outages. This study develops a methodology to evaluate the effectiveness of passive cooling measures (those that operate without power) to improve residential building heat resilience. Building performance is simulated for representative homes and on district scales in two disadvantaged communities in Fresno, California. Eleven passive measures are evaluated using four heat resilience metrics with and without grid power. Results show performance of the mitigation measures varies by building characteristics, surrounding environment, and power scenario. The two most effective measures were installing solar-control window films and adding roof insulation. For pre-1978 single-family homes, these two measures can reduce unmet degree-hours (UDH) indoors by 12% and 11% respectively without grid power, or 28% and 37% with grid power. Their respective UDH reductions at district scale typically range 8% — 20% and 4% — 12% without grid power, or 14% — 44% and 8% — 51% with grid power. Top floors have higher overheating risk than lower floors during extreme heat events with coincident power outages. Natural ventilation can help, reducing UDH by 21% — 26%. The methodology and findings from this study can help cities, communities, and utilities develop effective and targeted strategies to promote greater residential heat resilience.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Quantitative Non-Destructive Evaluation of Fatigue Damage Based on Multi-Sensor Fusion

Based on sensor fusion and machine learning, this project developed a novel non-destructive evaluation (NDE) methodology, which consists of a remaining useful life (RUL) prediction framework and regression models for predicting residual stress and full width at half maximum (FWHM). A series of fatigue testing experiments were conducted using 5052-H32 aluminum alloy specimens. All specimens were measured using linear ultrasonic (LU) and nonlinear ultrasonic (NLU) testing methods non-destructively. Machine learning models were developed to use LU and NLU measurements to predict loading condition, fatigue level, residual stress, and FWHM. It was demonstrated that the developed methodology could distinguish new and fatigue specimens with an accuracy of 97.53%. Also, the prediction errors for residual stress and FWHM were as low as 4.73% and 1.62%, respectively. An interactive database was created to publicly share the data generated from the project. It is envisioned that the developed NDE technology will equip manufacturers with a responsive screening system for incoming used metallic components, and potentially lead to a significant increase in using used metallic components for remanufacturing.

42 ENGINEERING↗

Design and Performance of an InAs Quantum Dot Scintillator with Integrated Photodetector

A new scintillation material composed of InAs quantum dots (QDs) hosted within a GaAs matrix was developed, and its performance with different types of radiation is evaluated. A methodology for designing an integrated photodetector (PD) with a low defect density and that is optically matched to the QD’s emission spectrum is introduced, utilizing an engineered epitaxial InAlGaAs metamorphic buffer layer. The photoluminescence (PL) collection efficiency of the integrated PD is examined using two-dimensional scanning laser excitation. The detector response to 5.5 MeV α-particles and 122 keV photons is presented. Yields of 13 electrons/keV for α-particles and 30–60 electrons/keV for photons were observed. The energy resolution of 12% observed with α-particles was mainly limited by noise- and geometry-related optical losses. The radiation hardness of an InAs QDs hosted within GaAs and a wider band gap AlGaAs ternary alloy was studied under a 1 MeV proton implantation up to a 10 14 cm –2 dose. The integrated PL responses were compared to evaluate PL quenching due to non-radiative defects. The QDs embedded in the AlGaAs demonstrated improved radiation hardness compared to QDs in the GaAs matrix and in the InGaAs quantum wells.

36 MATERIALS SCIENCE↗

Derisking Superhot Geothermal Plays with Value of Information: Utilizing Play Fairway Analysis, Geophysics and Technoeconomics

This paper describes a methodology for evaluating how the play fairways analysis (e.g., favorability) can improve our chances of making geothermal development decisions. We make statistical resource assessments and couple them with technoeconomic analysis utilizing previous favorability work performed for the Newberry Volcano. We demonstrate how the favorability can be used in a decision analysis framework because the Newberry favorability also estimated an associated uncertainty. The specific decision considered is how large of a power plant to build, which is difficult given the uncertainty about the resource size. Our results focus on two resource types, hydrothermal and enhanced geothermal systems, and they demonstrate how estimates of the minimum, most likely, and maximum estimates of the geothermal resource (denoted as the P10, P50, and P90, respectively) can be used in a decision analysis framework. Lastly, the value of information results explore using favorability with and without the magnetotelluric and gravity data from the Newberry Volcano. As expected, the favorability is more reliable, according to our methodology, at indicating the resource size when it includes the two geophysical models.

enhanced geothermal system↗

Assessment of Psychophysiological Responses During Motion Sickness Testing

The purpose of this investigation is to evaluate a methodology designed to accurately trace the temporal progression of motion sickness and space motion sickness symptoms. With this method, subjects continuously monitor their own motion sickness symptoms during exposure to a provocative stimulus as symptoms occur, in contrast to previous methods during which subjects report symptoms verbally at discrete time intervals. This method not only is comparable to previous methods in the type of symptoms that subjects report, but subjects report symptoms more frequently. Frequent reporting of motion sickness symptoms allows researchers to detail the waxing and waning of motion sickness symptoms for each individual. Previous research has shown that physiological responses to motion sickness stimuli are characterized by unique individual differences in response patterns. By improving our assessment of motion sickness symptoms with continuous monitoring of symptoms, the relationship between specific physiological responses and sickness levels can be more accurately determined for each individual. Results from this study show significant positive relationships between skin conductance levels and symptom levels for ten individuals; a significant positive relationship between temperature and symptom levels for 5 of 10 individuals; and both positive and negative relationships between respiration, heart rate, blood volume pulse and symptom levels. Continuous monitoring of motion sickness symptoms can be used to more accurately assess motion sickness to aid in the evaluation of countermeasures. In addition, recognition of the onset of symptoms that are strongly related to specific physiological responses could be used as cues to initiate procedures (e.g., Autogenic Feedback Training) to prevent the development of severe motion sickness symptoms.

Stoud, Cynthia S.↗

Prioritizing Countries by Concern Regarding Access to Weapons of Mass Destruction Materials

This article presents a global prioritization methodology that evaluates the relative risks of non-state actor acquisition of materials that could be used in chemical, biological, radiological, nuclear and high explosive Weapons of Mass Destruction (WMD) from the country’s relevant infrastructure. Prioritization is based on three domains: 1. Assessing relative scale of materials in each country, 2. The country’s corresponding security posture, and 3. The presence of threat actors. The output is a list of countries prioritized from greatest risk to least. Rather than providing an overall 1 to N ranking, however, the results are placed into tiers based upon their natural groupings within the three domains. The countries in the highest tiers are flagged as potential US national security concern; those scoring in the middle and at the bottom are flagged as posing lower US national security concern. A systematic approach assesses each country by leveraging many disciplines, such as risk and decision analysis, as well as expert judgement. A quantitative value model based on Multi-Attribute Value Theory (MAVT) organizes the objectives scoring criteria into a value tree using lessons learned from previous studies, published literature, and expert judgement. The article presents the prioritization categories and corresponding value model scoring criteria to include measurement type, weight, range, and value preference. Country names and data are notional in order to share the details on the underlying methodology and model without identification of actual security risks. A deliberative process addresses factors external to the model and scrutinizes inputs, methodology, model, and results.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Advanced Rotorcraft Transmission (ART) program status

This paper presents the current status of the ART program for the Future Attack Airvehicle. Consideration is given to the general configuration, the weights methodology, the reliability methodology, the noise evaluation, and materials analyses. It is shown that the methodologies developed for weights analysis and reliability will be useful in future design concept evaluations and that the noise prediction methodology under development can provide an indication of noise levels during the design process.

Bossler, Robert↗

Assessing Low-Temperature Geothermal Play Types: Relevant Data and Play Fairway Analysis Methods

The U.S. Department of Energy (DOE) Geothermal Technologies Office (GTO) is supporting the Geothermal Heating and Cooling Geospatial Datasets and Analysis project conducted by the National Renewable Energy Laboratory (NREL) as part of a broader effort to demonstrate the multi-faceted value of integrating geothermal power and geothermal heating and cooling (GHC) technologies into national decarbonization plans and community energy plans. Currently, there is a need to establish baseline low-temperature geothermal resource datasets and evaluate methods for deploying these technologies to provide the basis for supporting private sector investment. This project is focused on collecting baseline datasets, updating conceptual models, and creating Play Fairway Analysis (PFA) workflows for low-temperature (<150 degrees Celsius) geothermal resources of different geothermal play types (i.e., sedimentary basin, orogenic belts, and radiogenic geothermal play types) that could be used for geothermal heating and cooling (GHC), combined heat and power (CHP), and other geothermal direct uses (GDU) applications. Low-temperature geothermal resources are defined as reservoirs - natural or engineered - with temperatures <150 degrees Celsius. While the focus in the NREL effort is on GHC, resources at the upper end of this temperature range can also be used for small-scale power generation. This project does not include Ground Source Heat Pumps (GSHPs) technologies because they can be effectively developed almost anywhere. Low-temperature geothermal resources have not been studied as extensively as higher- to medium-temperature geothermal resources, but there is recent interest in improving understanding of these types of resources with an uptick of interest in geothermal technologies for decarbonizing heating and cooling systems. In addition, Enhanced Geothermal Systems (EGS) and other emerging technologies for exploiting petrothermal resources have opened the possibility of utilizing deep sedimentary basin systems, where porous media provide permeability and high temperatures can be reached at great depths. This project takes the approach of classifying low- temperature geothermal resources by geothermal play type (GPT). We defined and characterized three major classes of low-temperature GPT: sedimentary basins, orogenic systems, and radiogenic systems. We develop methodologies for evaluating and analyzing the potential for these resources building off the PFA approach to de-risking geothermal exploration and characterization. The proposed PFA approach for low-temperature geothermal resources includes: 1) identifying relevant data (e.g., datasets such bottom-hole temperatures from oil and gas wells, heat flow data, Quaternary faults and stress field data, geophysical data, etc.); 2) grouping and weighting of relevant datasets into PFA criteria (e.g., geological, risk, and economic criteria); 3) uncertainty quantification; 4) developing favorability or common risk maps for low-temperature geothermal resources to identify potential locations for more focused data collection; and 5) estimating electric power generation and heating potential at those locations using the GeoRePORT Resource Size Assessment Tool (RSAT). This project should facilitate future deployment of GHC, CHP, and GDU by providing data, tools, and a workflow applicable to low-temperature geothermal resources. Increased deployment of GHC and GDU will help achieve national and local decarbonization goals.

15 GEOTHERMAL ENERGY↗

Efficient Probabilistic Prediction and Uncertainty Quantification of Tropical Cyclone–Driven Storm Tides and Inundation

Abstract This study proposes and assesses a methodology to obtain high-quality probabilistic predictions and uncertainty information of near-landfall tropical cyclone–driven (TC-driven) storm tide and inundation with limited time and resources. Forecasts of TC track, intensity, and size are perturbed according to quasi-random Korobov sequences of historical forecast errors with assumed Gaussian and uniform statistical distributions. These perturbations are run in an ensemble of hydrodynamic storm tide model simulations. The resulting set of maximum water surface elevations are dimensionality reduced using Karhunen–Loève expansions and then used as a training set to develop a polynomial chaos (PC) surrogate model from which global sensitivities and probabilistic predictions can be extracted. The maximum water surface elevation is extrapolated over dry points incorporating energy head loss with distance to properly train the surrogate for predicting inundation. We find that the surrogate constructed with third-order PCs using elastic net penalized regression with leave-one-out cross validation provides the most robust fit across training and test sets. Probabilistic predictions of maximum water surface elevation and inundation area by the surrogate model at 48-h lead time for three past U.S. landfalling hurricanes (Irma in 2017, Florence in 2018, and Laura in 2020) are found to be reliable when compared to best track hindcast simulation results, even when trained with as few as 19 samples. The maximum water surface elevation is most sensitive to perpendicular track-offset errors for all three storms. Laura is also highly sensitive to storm size and has the least reliable prediction. Significance Statement The purpose of this study is to develop and evaluate a methodology that can be used to provide high-quality probabilistic predictions of hurricane-induced storm tide and inundation with limited time and resources. This is important for emergency management purposes during or after the landfall of hurricanes. Our results show that sampling forecast errors using quasi-random sequences combined with machine learning techniques that fit polynomial functions to the data are well suited to this task. The polynomial functions also have the benefit of producing exact sensitivity indices of storm tide and inundation to the forecasted hurricane properties such as path, intensity, and size, which can be used for uncertainty estimation. The code implementing the presented methodology is publicly available on GitHub.

54 ENVIRONMENTAL SCIENCES↗

Quantifying market volume sensitivity to material property modifications in polyhydroxybutyrate: A parametric analysis approach

Polyhydroxybutyrate (PHB), a biodegradable biopolymer, represents a promising alternative to petroleum-based thermoplastics. However, despite consistent market growth, PHB faces persistent commercialization challenges that limit widespread adoption. Existing research has focused predominantly on optimizing PHB production processes, leaving a critical gap in understanding which material property modifications would most effectively enhance market competitiveness. This study addresses this gap by systematically analyzing the relationship between polymer material properties and market performance using U.S. market data from 2008 to 2021 for 21 thermoplastic polymers across 19 material properties. We employed principal component regression to identify property modifications that could maximize market volume while reducing CO 2 emissions. Our parametric analysis revealed that two specific material properties – Hardness Shore A and Sheet Extrusion Temperature – significantly influence PHB marketability across different price points. Market simulations demonstrated that a 10% increase in Hardness Shore A could increase PHB market volume by 431.5 million kg while reducing emissions by 188.7 kg CO 2 . A similar 10% increase to Sheet Extrusion Temperature could yield a 297.5 million kg volume increase and a 99.2 kg CO 2 reduction in emissions. Critically, this approach is agnostic to the specific methods required to achieve these property changes, instead providing material scientists with quantitative, data-driven targets for R&D prioritization. Here, this framework offers a novel methodology for evaluating biopolymer competitiveness and supporting strategic decisions to accelerate PHB market adoption and contribute to decarbonization of the plastics industry.

09 BIOMASS FUELS↗

Scanning Electrochemical Microscopy for Kinetic Investigations in Viscous Deep Eutectic Solvents: Identifying Practical Approach Curves and Deviations from Electron Transfer Models

Determining heterogeneous electrochemical electron transfer (ET) kinetics in electrolytes with a wide range of physical properties is of great interest for achieving high-performance redox flow batteries. Among such electrolytes, concentrated hydrogen-bonded electrolytes (CoHBEs), including deep eutectic solvents (DESs), have recently garnered significant attention. Unfortunately, traditional Tafel analysis using macroelectrodes often encounters issues with mass transfer limitations in CoHBEs with high viscosities, thereby restricting kinetic analysis to a narrow potential window. Here, in this work, we introduce a methodology for evaluating ET kinetics in viscous DES using the scanning electrochemical microscopy (SECM). We first determined practical solutions to SECM tip positioning in ethaline DES, which yield pseudopositive feedback responses. Lattice Boltzmann method (LBM) simulations helped us rationalize the impact of the fluid and concentration fields, as well as tip geometry, tip approach velocity v, and the solvent viscosity ηs, on the shape of the approach curves. In addition to successfully recreating approach curves over a variety of conditions, we found that approaching a conductor ensured a practical point where the normalized tip response (Ni T = 2) converged at L = 0.7 within ∼10% error regardless of tip velocity. With positioning capabilities at hand, we investigated the kinetics of Fe 3+ /Fe 2+ redox couple in aqueous and the ethaline media. The experimental kinetic results were interpreted using the Butler–Volmer (BV) and Marcus–Hush–Chidsey (MHC) models. For ethaline, a nonideal kinetic behavior was observed, potentially attributed to solvent dynamics within DESs or to the interplay of chloride anions in the charge transfer process.

electrodes↗