Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Statistical Analysis of CFD Solutions From the Fifth AIAA Drag Prediction Workshop

A graphical framework is used for statistical analysis of the results from an extensive N-version test of a collection of Reynolds-averaged Navier-Stokes computational fluid dynamics codes. The solutions were obtained by code developers and users from North America, Europe, Asia, and South America using a common grid sequence and multiple turbulence models for the June 2012 fifth Drag Prediction Workshop sponsored by the AIAA Applied Aerodynamics Technical Committee. The aerodynamic configuration for this workshop was the Common Research Model subsonic transport wing-body previously used for the 4th Drag Prediction Workshop. This work continues the statistical analysis begun in the earlier workshops and compares the results from the grid convergence study of the most recent workshop with previous workshops.

Statistical analysis↗
NASA NTRS2009

Automated Targeting for the MER Rovers

The Autonomous Exploration for Gathering Increased Science System (AEGIS) will soon provide automated targeting for remote sensing instruments on the Mars Exploration Rover (MER) mission, which currently which currently has two rovers exploring the surface of Mars. Currently, targets for rover remote-sensing instruments, especially narrow field-of-view instruments (such as the MER Mini- TES spectrometer or the 2011 Mars Science Laboratory (MSL) Mission ChemCam Spectrometer), must be selected manually based on imagery already on the ground with the operations team. AEGIS enables the rover flight software to analyze imagery onboard in order to autonomously select and sequence targeted remote-sensing observations in an opportunistic fashion. In this paper, we first provide some background information on the larger autonomous science framework in which AEGIS was developed. We then describe how AEGIS was specifically developed and tested on the JPL FIDO rover. Finally we discuss how AEGIS will be uploaded and used on the Mars Exploration Rover (MER) mission in early 2009.

rover autonomy↗
NASA NTRS2017

Statistical Analysis of CFD Solutions from the 6th AIAA CFD Drag Prediction Workshop

A graphical framework is used for statistical analysis of the results from an extensive N-version test of a collection of Reynolds-averaged Navier-Stokes computational fluid dynamics codes. The solutions were obtained by code developers and users from North America, Europe, Asia, and South America using both common and custom grid sequences as well as multiple turbulence models for the June 2016 6th AIAA CFD Drag Prediction Workshop sponsored by the AIAA Applied Aerodynamics Technical Committee. The aerodynamic configuration for this workshop was the Common Research Model subsonic transport wing-body previously used for both the 4th and 5th Drag Prediction Workshops. This work continues the statistical analysis begun in the earlier workshops and compares the results from the grid convergence study of the most recent workshop with previous workshops.

Statistical analysis↗
DOE OSTI2024

Developing IEEE Std 2800-Compliant Algorithms for Transmission-Connected Inverter-Based Resources: Preprint

This study addresses the compliance of Inverter-based Resources (IBRs) with the IEEE Std 2800, a leading standard that defines interconnection and interoperability requirements for IBRs integrated into transmission systems. Focusing on abnormal grid scenarios, the research evaluates the specific demands on IBRs, proposing a comprehensive controller development framework. This framework caters to maintaining ride-trhough operation or implementing strategic disconnections in line with IEEE Std 2800, alongside managing currents during voltage ride-through scenarios. The effectiveness of this proposed controller framework is rigorously validated through case studies, employing a MATLAB/Simulink model of an IBR to test its performance under diverse grid fault conditions, ensuring the IBRs' alignment with standard requirements and their robust performance in enhancing grid reliability.

IEEE Std 2800↗
DOE OSTI2024

Developing IEEE Std 2800-Compliant Algorithms for Transmission-Connected Inverter-Based Resources

This study addresses the compliance of Inverter-based Resources (IBRs) with IEEE Standard 2800, a leading standard that defines interconnection and interoperability requirements for IBRs integrated into transmission systems. Focusing on abnormal grid scenarios, the research evaluates the specific demands on IBRs, proposing a controller development framework for abnormal grid conditions. This framework caters to maintaining ride-through operation in line with IEEE Std 2800, alongside managing currents during voltage ride-through scenarios. The effectiveness of this proposed controller framework is rigorously validated through case studies, employing a MATLAB/Simulink model of an IBR to test its performance under diverse grid fault conditions, ensuring the IBRs' alignment with standard requirements and their robust performance in enhancing grid reliability.

grid↗
DOE OSTI2024

Question-answering system extracts information on injection drug use from clinical notes

Background. Injection drug use (IDU) can increase mortality and morbidity. Therefore, identifying IDU early and initiating harm reduction interventions can benefit individuals at risk. However, extracting IDU behaviors from patients’ electronic health records (EHR) is difficult because there is no other structured data available, such as International Classification of Disease (ICD) codes, and IDU is most often documented in unstructured free-text clinical notes. Although natural language processing can efficiently extract this information from unstructured data, there are no validated tools. Methods. Here, to address this gap in clinical information, we design a question-answering (QA) framework to extract information on IDU from clinical notes for use in clinical operations. Our framework involves two main steps: (1) generating a gold-standard QA dataset and (2) developing and testing the QA model. We use 2323 clinical notes of 1145 patients curated from the US Department of Veterans Affairs (VA) Corporate Data Warehouse to construct the gold-standard dataset for developing and evaluating the QA model. We also demonstrate the QA model’s ability to extract IDU-related information from temporally out-of-distribution data. Results. Here, we show that for a strict match between gold-standard and predicted answers, the QA model achieves a 51.65% F1 score. For a relaxed match between the gold-standard and predicted answers, the QA model obtains a 78.03% F1 score, along with 85.38% Precision and 79.02% Recall scores. Moreover, the QA model demonstrates consistent performance when subjected to temporally out-of-distribution data. Conclusions. Our study introduces a QA framework designed to extract IDU information from clinical notes, aiming to enhance the accurate and efficient detection of people who inject drugs, extract relevant information, and ultimately facilitate informed patient care.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Advancing stream temperature prediction with a generalizable large-sample framework across CONUS river reaches

Accurately predicting stream temperature in ungauged basins remains a critical challenge for water resource management, thermoelectric power plant cooling, and ecosystem conservation. Large-sample machine learning models trained on hundreds of well-monitored river basins have shown remarkable performance; however, such models have yet to be developed solely using forcing data that can be readily extracted to simulate stream temperatures anywhere in the contiguous United States (CONUS). In this study, we present a scalable, large-sample deep learning framework using Long Short-Term Memory (LSTM) networks to simulate daily stream temperatures in ungauged basins across the CONUS. The framework leverages both modeled reanalysis of meteorological and streamflow inputs as well as static attributes available for all 2.7 million CONUS river reaches in the National Hydrography Dataset Plus (NHDPlusV2). By generating dynamical inputs from predefined thermally relevant upstream contributing areas, rather than the entire upstream basin, the model also offers improvements in very large basins where full-basin averaging can dilute the most important influences on stream temperature. Evaluated across 300 basins, the model achieves a median Mean Absolute Error (MAE) of 1.1 °C and a Nash-Sutcliffe Efficiency (NSE) of 0.95 on temporally and spatially distinct test folds—comparable to models trained exclusively using meteorological and streamflow observational data. The flexible, high-performing framework generalizes to any unmonitored river reach without significant regulation or unnatural thermal input immediately upstream, substantially expanding predictive capabilities in data-scarce regions.

Hydrology↗
NASA NTRS2010

A Framework for Integrated Component and System Analyses of Instabilities

Instabilities associated with fluid handling and operation in liquid rocket propulsion systems and test facilities usually manifest themselves as structural vibrations or some form of structural damage. While the source of the instability is directly related to the performance of a component such as a turbopump, valve or a flow control element, the associated pressure fluctuations as they propagate through the system have the potential to amplify and resonate with natural modes of the structural elements and components of the system. In this paper, the authors have developed an innovative multi-level approach that involves analysis at the component and systems level. The primary source of the unsteadiness is modeled with a high-fidelity hybrid RANS/LES based CFD methodology that has been previously used to study instabilities in feed systems. This high fidelity approach is used to quantify the instability and understand the physics associated with the instability. System response to the driving instability is determined through a transfer matrix approach wherein the incoming and outgoing pressure and velocity fluctuations are related through a transfer (or transmission) matrix. The coefficients of the transfer matrix for each component (i.e. valve, pipe, orifice etc.) are individually derived from the flow physics associated with the component. A demonstration case representing a test loop/test facility comprised of a network of elements is constructed with the transfer matrix approach and the amplification of modes analyzed as the instability propagates through the test loop.

Ahuja, Vineet↗
DOE OSTI2025

Butterfly valve performance factors using the multiphysics object oriented simulation environment

Butterfly valves are typically used in nuclear reactors to control incompressible fluid flow with high inlet velocities. Performance factors for butterfly valves include the pressure drop across the valve and the loss coefficient from which hydrodynamic torque and flow coefficients can be computed. This work explores a computational fluid dynamics approach for butterfly valve performance factors using the open-source Multiphysics Object Oriented Simulation Environment (MOOSE) framework. While MOOSE is often used in the nuclear energy modeling and simulation community for simulations ranging from fuel characterization to heat pipe simulation, this work employs the MOOSE open-source Navier–Stokes solver capability for simulating butterfly valve performance factors and compares those to experimentally measured results from the Advanced Test Reactor at Idaho National Laboratory at Reynolds numbers in the order of 10 6 for the partially opened configuration. The MOOSE framework results are compared against experimentally measured butterfly valve performance factors across five valve opening angles using meshes with order 10 4 – 10 5 elements. This validation serves to enable MOOSE-based multiphysics simulations incorporating the open-source Navier–Stokes module.

97 - MATHEMATICS AND COMPUTING↗
NASA NTRS2014

The Messy Aerosol Submodel MADE3 (v2.0b): Description and a Box Model Test

We introduce MADE3 (Modal Aerosol Dynamics model for Europe, adapted for global applications, 3rd generation), an aerosol dynamics submodel for application within the MESSy framework (Modular Earth Submodel System). MADE3 builds on the predecessor aerosol submodels MADE and MADE-in. Its main new features are the explicit representation of coarse particle interactions both with other particles and with condensable gases, and the inclusion of hydrochloric acid (HCl)chloride (Cl) partitioning between the gas and condensed phases. The aerosol size distribution is represented in the new submodel as a superposition of nine lognormal modes: one for fully soluble particles, one for insoluble particles, and one for mixed particles in each of three size ranges (Aitken, accumulation, and coarse mode size ranges). In order to assess the performance of MADE3 we compare it to its predecessor MADE and to the much more detailed particle-resolved aerosol model PartMC-MOSAIC in a box model simulation of an idealized marine boundary layer test case. MADE3 and MADE results are very similar, except in the coarse mode, where the aerosol is dominated by sea spray particles. Cl is reduced in MADE3 with respect to MADE due to the HClCl partitioning that leads to Cl removal from the sea spray aerosol in our test case. Additionally, aerosol nitrate concentration is higher in MADE3 due to the condensation of nitric acid on coarse particles. MADE3 and PartMC- MOSAIC show substantial differences in the fine particle size distributions (sizes about 2 micrometers) that could be relevant when simulating climate effects on a global scale. Nevertheless, the agreement between MADE3 and PartMC-MOSAIC is very good when it comes to coarse particle size distribution, and also in terms of aerosol composition. Considering these results and the well-established ability of MADE in reproducing observed aerosol loadings and composition, MADE3 seems suitable for application within a global model.

Mixing state↗
NASA NTRS2011

Integration Process for the Habitat Demonstration Unit

The Habitat Demonstration Unit (HDU) is an experimental exploration habitat technology and architecture test platform designed for analog demonstration activities. The HDU previously served as a test bed for testing technologies and sub-systems in a terrestrial surface environment. in 2010 in the Pressurized Excursion Module (PEM) configuration. Due to the amount of work involved to make the HDU project successful, the HDU project has required a team to integrate a variety of contributions from NASA centers and outside collaborators The size of the team and number of systems involved With the HDU makes Integration a complicated process. However, because the HDU shell manufacturing is complete, the team has a head start on FY--11 integration activities and can focus on integrating upgrades to existing systems as well as integrating new additions. To complete the development of the FY-11 HDU from conception to rollout for operations in July 2011, a cohesive integration strategy has been developed to integrate the various systems of HDU and the payloads. The highlighted HDU work for FY-11 will focus on performing upgrades to the PEM configuration, adding the X-Hab as a second level, adding a new porch providing the astronauts a larger work area outside the HDU for EVA preparations, and adding a Hygiene module. Together these upgrades result in a prototype configuration of the Deep Space Habitat (DSH), an element under evaluation by NASA's Human Exploration Framework Team (HEFT) Scheduled activates include early fit-checks and the utilization of a Habitat avionics test bed prior to installation into HDU. A coordinated effort to utilize modeling and simulation systems has aided in design and integration concept development. Modeling tools have been effective in hardware systems layout, cable routing, sub-system interface length estimation and human factors analysis. Decision processes on integration and use of all new subsystems will be defined early in the project to maximize the efficiency of both integration and field operations. In addition a series of tailored design reviews are utilized to quickly define the systems and their integration into the DSH configuration. These processes are necessary to ensure activities, such as partially reversing integration of the X-Hab second story of the HDU and deploying and stowing the new work porch for transportation to the JSC Rock Yard and to the Arizona Black Point Lava Flow Site are performed with minimal or no complications. In addition, incremental test operations leading up to an Integrated systems test allows for an orderly systems test program. For FY-11 activities, the HDU DSH will act as a laboratory utilizing a new X-Hab inflatable second floor with crew habitation features. In addition to the day to day operations involving maintenance of the HDU and exploring the surrounding terrain, testing and optimizing the use of the new X-Hab, work porch, Hygiene Module, and other sub-system enhancements will be the focus of the FY-11 test objectives. The HDU team requires a successful integration strategy using a variety of tools and approaches to prepare the DSH for these test objectives. In a challenging environment where the prototyping influences the system design, as well as Vice versa, results of the HDU DSH field tests will influence future designs of habitat systems.

Gill, Tracy↗
DOE OSTI2026

Performance Modeling of Tandem Photovoltaics: A Yearlong Outdoor Degradation Analysis of a Ga⁢As//Si Minimodule

We present a performance modeling and degradation analysis framework for tandem photovoltaic modules, building upon established procedures for crystalline silicon devices and adapting them to account for the spectral sensitivity of multijunction technologies. The methodology employs filter criteria to select outdoor measurements close to standard test conditions (STC) under stable spectral and ambient conditions, followed by normalization of power production data with corrections for temperature, irradiance, and precipitable water vapor. We demonstrate this framework using a mechanically stacked four-terminal gallium arsenide (Ga⁢As) // silicon (Si) tandem solar minimodule deployed outdoors from October 2019 to January 2021 in Golden, Colorado, USA. We determined degradation rates of −4.1 ±0.2%/year for the Ga⁢As subcell and −2.5 ±0.9%/year for the Si subcell, with analysis of individual performance metrics indicating that packaging degradation, particularly delamination, was the dominant failure mode. Simulations using PVcircuit, an open-source equivalent-circuit solver, confirmed these findings. The presented methodology provides a reproducible foundation for performance modeling and degradation analysis of emerging tandem technologies.

14 SOLAR ENERGY↗
DOE OSTI2026

Large Language Model for Validation, Optical Calibration, and Learning (VOCAL) Distributed Temperature Sensing Interface

Distributed temperature sensing (DTS) using fiber optic sensors (FOS) offers a promising method for temperature measurements in advanced reactors, such as sodium fast reactors and molten salt cooled reactors. To support the calibration and validation of DTS measurements, Argonne National Laboratory developed the Validation, Optical Calibration, and Learning (VOCAL) software package. This report describes the integration of a local large language model (LLM) with a retrieval-augmented generation (RAG) system into the VOCAL interface to serve as an interactive user assistant. The LLM framework enhances the VOCAL platform’s accessibility to users by explaining interface components, clarifying inputs and outputs, and answering user queries dynamically in real-time. The accuracy of the LLM assistant performance was evaluated with 20 queries regarding the interface and its parameters using experimental data from the Thermal Hydraulic Experimental Test Article (THETA) facility. Results demonstrate that the LLM achieved a 95% accuracy rate, with a BERTScore of 0.8816 and SBERT value of 0.7417. Furthermore, validation of the RAG system within the LLM framework showed optimal accuracy with k-values between 1 and 2 using the k-refinement convergence test. The prompt perturbation analysis demonstrated good initial consistency for the RAG system, exhibiting the highest accuracy under punctuation variations and the greatest sensitivity under query reordering. Notably, the model’s errors were limited to data retrieval failures rather than factual hallucinations, reinforcing its baseline reliability. The integration of LLM provides a highly accurate, userfriendly enhancement to the VOCAL platform without disrupting its core computational capabilities for FOS calibration and validation.

Hong, Evan↗
NASA NTRS1988

A modified Lorentz theory as a test theory of special relativity

Attention has been given recently to a modified Lorentz theory (MLT) that is based on the generalized Galilean transformation. Some explicit formulas within the framework of MLT, dealing with the one-way velocity of light, slow-clock transport, and the Doppler effect are derived. A number of typical experiments are analyzed on this basis. Results indicate that the empirical equivalence between MLT and special relativity is still maintained to second order terms. The results of previous works that predict that the MLT might be distinguished from special relativity at the third order by Doppler centrifuge tests capable of a fractional frequency detection threshold of 10 to the -15th are confirmed.

Chang, T.↗
DOE OSTI2025

Thoroughly testing and integrating hundreds of Pull Requests per month: ROOT’s new Cost-efficient and Feature Rich GitHub-based CI

ROOT is an open source framework, freely available on GitHub, at the heart of data acquisition, processing and analysis of HE(N)P experiments, and beyond. It is developed collaboratively: contributions are not authored only by ROOT team members, but also by the user community at large: developers and scientists from universities, labs as well as the private sector. More than 1500 GitHub Pull Requests are merged on average per year. It is in this context that code integration acquires a primary role. The review of code contributions isn’t enough: not only they need to be thoroughly reviewed, they also need to be thoroughly tested through a powerful CI infrastructure on several different platforms to comply with the high code quality standards of the project. Since the end of 2023, ROOT moved its continuous integration system from Jenkins to GitHub Actions. In this contribution, we characterise the transition to the GitHub CI, focussing on our strategy, its implementation and the lessons learned, as well as the advantages the new system offers with respect to the previous one. Particular emphasis will be given to the evaluation of the cost-benefit ratio for Jenkins and GitHub Actions for the ROOT project. We also describe how we manage to run in less than one hour thousands of unit, integration, functional and end-to-end tests on different flavours of Windows, four versions of macOS, as well as about ten of the most used Linux distributions, taking advantage of the CERN computing infrastructure.

Piparo, Danilo [CERN]↗
DOE OSTI2025

Mapping Local Dissipation and Entropy Production in Complex and Active Fluids

While global entropy production provides a measure of irreversibility, its partitioning into contributions from local regions is key to understanding the mechanisms underlying time-reversal symmetry breaking in complex systems and active matter. Here, by analyzing local heat flows and fluxes, we propose a framework that enables the mapping of local dissipation and entropy production in a nonequilibrium system. We test this approach in simulations of fluids driven through complex environments and active systems. We connect the results across the local and global scales by showing that local dissipation and entropy production satisfy a local version of the usual (global) fluctuation theorem, which accounts for the correlations between the local region and its surroundings. Interestingly, in the case of the active fluid, our analysis reveals that these correlations are of opposite signs for the active (stochastic) and passive (deterministic) contributions to local dissipation.

Entropy↗
DOE OSTI2024

Attributing human mortality from fire PM 2.5 to climate change

Climate change intensifies fire smoke, emitting hazardous air pollutants that impact human health. However, the global influence of climate change on fire-induced health impacts remains unquantified. Here, in this study, we used three well-tested fire-vegetation models in combination with a chemical transport model and health risk assessment framework to attribute global human mortality from fire fine particulate matter (PM 2.5 ) emissions to climate change. Of the 46401 (1960s) –to 98748 (2010s) annual fire PM 2.5 mortalities, 669 (1.2%, 1960s) –to 12566 (12.8%, 2010s) were attributed to climate change. The most substantial influence of climate change on fire mortality occurred in South America, Australia, and Europe, coinciding with decreased relative humidity, and in boreal forests with increased air temperature. Increasing relative humidity lowered fire mortality in other regions, like South Asia. Our study highlights the role of climate change in fire mortality, aiding public health authorities in spatial targeting adaptation measures for sensitive fire-prone areas.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Artificial correlation heating in PIC simulations

The Particle-in-Cell (PIC) method, a cornerstone in plasma modeling, is widely employed for its ability to simulate kinetic phenomena in device-scale domains. Part of what makes this possible is that computational macroparticles represent many physical particles. It converges under certain constraints, including a grid spacing that resolves the Debye length and a time step small enough to respect the Courant–Friedrichs–Lewy condition and plasma frequency stability limit. Here, we introduce a new constraint necessary to avoid Artificial Correlation Heating (ACH). This requires that the macroparticle coupling strength be smaller than one, Γ ω < 1, where Γ ω ≡ Γω 2/3 ⁠, Γ = Z 2 e 2 /(4πε 0 ak B T) is the physical coupling strength, and w is the macroparticle weight. This is particularly relevant to 3D simulations of dense plasmas, which are becoming common with modern computing power. If this condition is violated, the finite macroparticle weight artificially enhances the coupling strength and causes the plasma to heat until the macroparticle coupling strength is near unity, depending on the grid resolution. A comprehensive model of ACH is developed that incorporates electron density, temperature, macroparticle weight, and grid resolution. It is then tested using PIC simulations, delineating the boundaries of the method's applicability and offering a predictive framework for ACH. Moreover, the research explores a runaway heating process induced by ACH in the presence of ionization, which can lead to numerical instability. A conclusion of this study is that the onset of ACH can impose a more stringent constraint on the macroparticle weight and average number of macroparticles per cell than what is typically expected, particularly in 3D simulations of dense plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗