Search NASA⌕ Search

SEARCH · Search NASA

Results for “test frameworks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

FIDES-II/P2M Simulation Exercise on AN3 and AN10 bump tests: main results

This paper presents simulations of bump tests conducted as part of the P2M (Power to Melt and Maneuverability) project within the OECD/NEA FIDES-II framework (Framework for Irradiation Experiments). To prepare fuel performance codes for analyzing the P2M experiments, an international Simulation Exercise (SE) was initiated under the P2M project. The objective of this exercise was to model the AN3 and AN10 bump tests carried out in the 1980s at the DR3 reactor (3rd RISØ Fission Gas Project), during which instrumented fuel rodlets (equipped with thermocouples and pressure sensors) were subjected to prolonged power transients and power dips. The ongoing simulation exercise involves seven organizations from industry, research, and regulatory bodies, each using different fuel performance codes. This paper provides detailed descriptions of the test cases and simulation results from six fuel performance codes (ALCYONE, BISON, FAST, FEMAXI, FRAPCON, and TRANSURANUS), with a particular focus on fission gas release kinetics.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Simulation Framework to Estimate the Performance of CO2 and O2 Sensing from Space and Airborne Platforms for the ASCENDS Mission Requirements Analysis

The Active Sensing of CO2 Emissions over Nights Days and Seasons (ASCENDS) mission recommended by the NRC Decadal Survey has a desired accuracy of 0.3% in carbon dioxide mixing ratio (XCO2) retrievals requiring careful selection and optimization of the instrument parameters. NASA Langley Research Center (LaRC) is investigating 1.57 micron carbon dioxide as well as the 1.26-1.27 micron oxygen bands for our proposed ASCENDS mission requirements investigation. Simulation studies are underway for these bands to select optimum instrument parameters. The simulations are based on a multi-wavelength lidar modeling framework being developed at NASA LaRC to predict the performance of CO2 and O2 sensing from space and airborne platforms. The modeling framework consists of a lidar simulation module and a line-by-line calculation component with interchangeable lineshape routines to test the performance of alternative lineshape models in the simulations. As an option the line-by-line radiative transfer model (LBLRTM) program may also be used for line-by-line calculations. The modeling framework is being used to perform error analysis, establish optimum measurement wavelengths as well as to identify the best lineshape models to be used in CO2 and O2 retrievals. Several additional programs for HITRAN database management and related simulations are planned to be included in the framework. The description of the modeling framework with selected results of the simulation studies for CO2 and O2 sensing is presented in this paper.

Plitau, Denis↗

Testing high-current superconducting subscale dipole coils with superconducting transformer

Several sub-scale superconducting dipole coils are being developed at Fermilab in the framework of the U.S. Magnet Development Program. These coils are made of high-current LTS and HTS cables with maximum currents of up to 10 kA. A superconducting current transformer with a maximum DC current up to ~25 kA previously developed at Fermilab for Nb3Sn Rutherford cable testing was modified and adapted for small dipole coil testing. This paper describes its commissioning using a NbTi dipole magnet impregnated with TELENE. This magnet was wound out of 6/1 NbTi cable.

Barzi, Emanuela↗

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six total institutions performing testing. The outcomes of this internship contribute to Fermilab s mission to advance high-energy physics and support the DOE s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [William Rainey Harper Coll.]↗

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos—tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab’s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE’s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six institutions performing testing. The outcomes of this internship contribute to Fermilab’s mission to advance high-energy physics and support the DOE’s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [Fermilab]↗

A cell-centered AMR-ALE framework for 3D multi-material hydrodynamics. Part I: Lagrangian and indirect Euler AMR algorithms

Many applications of physics and engineering involve wide ranges of time and spatial scales. The numerical simulation of localized small scales such as shock waves and material interfaces requires a large number of computational cells in these regions. For these applications, Lagrangian and Arbitrary-Lagrangian-Eulerian (ALE) related methods are engaging since the moving mesh feature naturally brings mesh cells on shock discontinuities and material interfaces are carefully captured. In addition, Adaptive-Mesh-Refinement (AMR) strategies aim to optimize computational resources by concentrating finer mesh cells only in areas of interest while using coarser cells elsewhere. A key but challenging AMR requirement consists in efficiently distributing the computational effort to achieve high accuracy without the prohibitive computational costs associated with uniformly fine grids. Here, in this document, the coupling of the p4est AMR library with a cell-centered Lagrangian scheme is presented with the goal to perform reliable 3D Lagrangian-AMR and indirect Euler-AMR multi-material simulations. In particular, it is shown that starting from a 3D indirect ALE code, the memory management and load balancing requirements can be delegated to an external library (here the p4est library) to unlock ALE-AMR capabilities. First, we present a strategy to transcribe the octant-based connectivity of the 3D AMR framework with that of an unstructured mesh of polygonal cells used in Lagrangian hydrodynamics. Then, we show how refinement and coarsening operations must be adapted to the particular Lagrangian framework to ensure the conservation of volume during those steps. Finally, several numerical test cases are presented that demonstrate the capabilities of the Lagrangian-AMR and indirect Euler-AMR algorithms.

3D cell-centered Lagrangian numerical scheme↗

From Cell to System: Accelerated hpc Simulations of BESS Aging under Frequency Regulation and Arbitrage use cases

Lithium-ion battery energy storage systems (BESS) packs have emerged as a leading solution for grid-scale energy storage, enhancing resiliency and balancing load fluctuations. Yet, experimental characterization of large-format LIB packs-particularly to assess performance and degradation over hundreds of cycles - demands substantial hardware investment and multi-year testing campaigns. In this work, we couple a hierarchical, physics-based modeling framework agnostic to electrode chemistries with high-performance computing to accelerate systems level evaluation by upto two orders of magnitude. Building on the open-source liionpack platform, we implement cell, module, and pack-scale electrochemical models enriched with mechanistic aging mechanisms and deploy them on an HPC cluster to simulate 150−200kWh systems over 500 - 1,000 cycles with in days. We subject these virtual B ESS to both constant-current cycling and realistic grid service profiles spanning frequency regulation, ramp-rate support, and energy arbitrage-and quantify the resulting degradation patterns. Our results reveal that localized cell aging can induce substantial nonuniformity at module and pack levels, with service-specific cycling protocols driving distinct aging modes. This rapid, multiscale modeling approach provides a powerful design-space exploration tool for optimizing electrical architecture, control strategies, and operational schedules to prolong pack lifetime and lower total cost of ownership.

Ayalasomayajula, Surya [ORNL] (ORCID:0009000860788↗

Model-based software process improvement

The activities of a field test site for the Software Engineering Institute's software process definition project are discussed. Products tested included the improvement model itself, descriptive modeling techniques, the CMM level 2 framework document, and the use of process definition guidelines and templates. The software process improvement model represents a five stage cyclic approach for organizational process improvement. The cycles consist of the initiating, diagnosing, establishing, acting, and leveraging phases.

Zettervall, Brenda T.↗

Crew Roles and Interactions in Scientific Space Exploration

Future piloted space exploration missions will focus more on science than engineering, a change which will challenge existing concepts for flight crew tasking and demand that participants with contrasting skills, values, and backgrounds learn to cooperate as equals. In terrestrial space flight analogs such as Desert Research And Technology Studies, engineers, pilots, and scientists can practice working together, taking advantage of the full breadth of all team members training to produce harmonious, effective missions that maximize the time and attention the crew can devote to science. This paper presents, in a format usable as a reference by participants in the field, a successfully tested crew interaction model for such missions. The model builds upon the basic framework of a scientific field expedition by adding proven concepts from aviation and human spaceflight, including expeditionary behavior and cockpit resource management, cooperative crew tasking and adaptive leadership and followership, formal techniques for radio communication, and increased attention to operational considerations. The crews of future spaceflight analogs can use this model to demonstrate effective techniques, learn from each other, develop positive working relationships, and make their expeditions more successful, even if they have limited time to train together beforehand. This model can also inform the preparation and execution of actual future spaceflights.

Love, Stanley G.↗

Soil Dust Aerosols and Wind as Predictors of Seasonal Meningitis Incidence in Niger

Background: Epidemics of meningococcal meningitis are concentrated in sub-Saharan Africa during the dry season, a period when the region is affected by the Harmattan, a dry and dusty northeasterly trade wind blowing from the Sahara into the Gulf of Guinea.Objectives: We examined the potential of climate-based statistical forecasting models to predict seasonal incidence of meningitis in Niger at both the national and district levels.Data and methods: We used time series of meningitis incidence from 1986 through 2006 for 38 districts in Niger. We tested models based on data that would be readily available in an operational framework, such as climate and dust, population, and the incidence of early cases before the onset of the meningitis season in January-May. Incidence was used as a proxy for immunological state.

Soil dust↗

Adaptive IV&V for Increasingly Complex Software Systems

As NASA software systems continue to innovate, becoming more complex and nondeterministic, the need for the NASA IV&V Program to become systemically adaptive to ensure mission success is paramount. To ensure adaptability within resource constraints, IV&V has developed an agile, risk-based approach to identify, characterize, scope, focus, and prioritize mission assurance activities. This risk based adaptive framework has been applied to trends such as increased reliance on data driven algorithms for safety and mission critical software behavior, use of MBSE in system design, and application of agile principles to embedded software development. The framework is enabled by continuous innovation of new approaches such as software only test beds, assurance design tools, and initiatives that augment IV&V assurance methods with artificial intelligence and machine learning techniques. This presentation will highlight the trends the NASA IV&V Program is seeing, the innovative steps it is taking to address those challenges, and how it is postured to address evolving risk and constantly changing and new technologies.

Wesley W Deadrick↗

Thermal Data-driven Model Reduction for Enhanced Battery Health Monitoring

Electric aviation faces a major challenge of avoiding potentially catastrophic consequences of the battery’s thermal runaway while keeping the weight of the battery low. Detection of early warning signals of battery failures requires accurate monitoring of the battery’s health throughout its lifespan. However, identifying the parameters of the battery from field data is notoriously difficult. We investigate this problem within the framework of modeling the temperature dynamics of a Li-ion cell during tests simulating loading in electric aircraft flights. It is found that the parameters of a higher-fidelity physics-based thermal model cannot be identified from the simulated flight data. To resolve this issue, we reduce the higher-fidelity thermal model to a model with fewer parameters. The resulting reduced-order model can predict temperature dynamics accurately and is identifiable throughout the cell’s lifespan which allows using the model’s parameters to monitor the state-of-health of the aging cell and detect anomalies in thermal behavior.

Li ion batteries↗

SCITUNE: Aligning Large Language Models with Human-Curated Scientific Multimodal Instructions

Instruction finetuning is a popular paradigm to align large language models (LLM) with human intent. Despite its popularity, this idea is less explored in improving the LLMs to align existing foundation models with scientific disciplines, concepts and goals. In this work, we present SciTune as a tuning framework to improve the ability of LLMs to follow scientific multimodal instructions. To test our methodology, we use a human-generated scientific instruction tuning dataset and train a large multimodal model LLaMA-SciTune that connects a vision encoder and LLM for science-focused visual and language understanding. LLaMA-SciTune significantly outperforms the state-of-the-art models in the generated figure types and captions in multiple scientific multimodal benchmarks. In comparison to the models that are fine-tuned with machine generated data only, LLaMA-SciTune surpasses human performance on average and in many sub-categories on the ScienceQA benchmark.

• Artificial intelligence (AI) / machine learning ↗

Evaluation of Seismic Artificial Intelligence with Uncertainty

Artificial intelligence has transformed the seismic community with deep learning models (DLMs) that are trained to complete specific tasks within workflows. However, there is still a lack of robust evaluation frameworks for evaluating and comparing DLMs. Here, we address this gap by designing an evaluation framework that jointly incorporates two crucial aspects: performance uncertainty and learning efficiency. To target these aspects, we meticulously construct the training, validation, and test splits using a clustering method tailored to seismic data and enact an expansive training design to segregate performance uncertainty arising from stochastic training processes and random data sampling. The framework’s ability to guard against misleading declarations of model superiority is demonstrated through the evaluation of PhaseNet (Zhu and Beroza, 2018), a popular seismic phase picking DLM, under three training approaches. Our framework helps practitioners choose the best model for their problem and set performance expectations by explicitly analyzing model performance with uncertainty at varying budgets of training data.

58 GEOSCIENCES↗

A Bayesian framework to investigate radiation reaction in strong fields

Recent experiments aiming to measure phenomena predicted by strong-field quantum electrodynamics (SFQED) have done so by colliding relativistic electron beams and high-power lasers. In such experiments, measurements of collision parameters are not always feasible. However, precise knowledge of these parameters is required to accurately test SFQED. Here, we present a novel Bayesian inference procedure that infers collision parameters that could not be measured on-shot. This procedure is applicable to all-optical non-linear Compton scattering experiments investigating radiation reaction. The framework allows multiple diagnostics to be combined self-consistently and facilitates the inclusion of known information pertaining to the collision parameters. Using this Bayesian analysis, the relative validity of the classical, quantum-continuous and quantum-stochastic models of radiation reaction was compared for several test cases, which demonstrates the accuracy and model selection capability of the framework and highlight its robustness if the experimental values of fixed parameters differ from their values in the models.

47 OTHER INSTRUMENTATION↗

Specificity and Transfer in Learning How to Follow Navigation Instructions

We report a series of experiments that use a navigation task in which instructions for navigating in a space displayed as grids on a computer screen are given to subjects who then attempt to follow them by mouse clicking on the grids. The navigation task was broken down into component dimensions (e.g., presentation mode of the instructions, length of the instructions, characteristics of the display, size of the grids, response type). For each task dimension, one condition was used at training and the same or another condition was used at test. Each task dimension was examined in terms of two measures. One measure provided an index of transfer (i.e., better performance at test than at training when test and training involved different conditions), and the other provided an index of specificity (i.e., better performance at test when training and test conditions were the same than when training and test conditions were different). By and large, these two indices were complementary, so there was evidence of either transfer or specificity but not both. For one dimension transfer but no specificity was evident, and for another dimension specificity but no transfer was evident. For the remaining dimensions, however, there was asymmetrical transfer, with transfer evident for some conditions and specificity evident for others. The findings are interpreted within the procedural reinstatement framework. They have practical implications concerning how to optimize training and how much fidelity to the testing situation is necessary when training.

Healy, Alice F.↗

Database Design Strategies for Coordinated Simulation and Testing in Additive Manufacturing

The qualification and certification (Q&C) process presents a significant challenge for widespread adoption of additive manufacturing (AM) materials and processes for aerospace applications. A relational database framework will be presented as a tool for data curation of coordinated experimental and computational materials modeling research activities. A comparison of relational and hierarchical data structures in this domain will be emphasized through the evolution of a database design strategy. This framework’s mission is to support the advancement of computational materials-informed Q&C by providing the necessary data infrastructure to trace reliability and reproducibility measures through unified AM materials simulation and experimental testing. FAIR (findable, accessible, interoperable, and reusable) data will be highlighted as a necessary precursor for automation of specific actions, which ultimately reduces the time and expense burden for Q&C. The discussion will be mostly limited to back-end design elements, though a few front-end user experience examples will also be shared.

Qualification↗