Search NASA⌕ Search

SEARCH · Search NASA

Results for “test frameworks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Hardware-in-the-Loop Evaluation for Potential High Limit Estimation-Based PV Plant Active Control

This paper validates the efficacy of an artificial intelligence (AI)-based photovoltaic (PV) plant control and optimization approach in enabling PV plants as accountable grid reliability service providers. The validation is performed in a realistic laboratory controller-hardware-in-the-loop environment, leveraging accurate PV plant modeling and standard industrial communication protocols. Through simulations that account for diverse weather conditions and active control scenarios, the results highlight the superior performance of the AI-based solution in comparison to a state-of-the-art reference-control grouping-based approach. Such a finding contributes to mitigating the risk of overcurtailment and uninstructed deviations of active PV plant controls, and offers practical guidance for its field deployment. Furthermore, it establishes a standardized testing framework for comparing various PV active control strategies.

hardware-in-the-loop↗
DOE OSTI2026

PVDeg: Enhancing Usability and AI-Driven Multi-Mechanism Degradation Modeling

PVDeg version 0.7.0, released in December 2025, introduced major enhancements to improve usability and performance. This update reorganized tutorials and tool notebooks to create a more intuitive experience, enabling users to easily follow and adapt workflows for their specific analyses. In addition to structural improvements, both the notebooks and core logic underwent significant optimization for efficiency, robustness, and style. These refinements were supported by new testing frameworks built on nbval and pytest, adherence to PEP8 standards, and extensive code refactoring, which collectively simplify onboarding for new developers. Looking ahead, version 0.8.0 will deliver advanced AI-driven capabilities. The primary focus is to further develop and automate the degradation workflow, designed to analyze PV module degradation across diverse locations and system configurations. By integrating large language models (LLMs) to scan literature and compile a comprehensive database of materials and degradation rates, this feature will enable modeling of multiple materials and mechanisms within a single, streamlined workflow. Users will be able to evaluate degradation impacts on different system architectures under varying environmental conditions, facilitating informed decisions on bill-of-materials optimization for specific deployment scenarios. These advancements position PVDeg as a powerful, user-friendly tool for accelerating PV reliability research and system design.

14 SOLAR ENERGY↗
NASA NTRS1987

Post-game analysis: An initial experiment for heuristic-based resource management in concurrent systems

In concurrent systems, a major responsibility of the resource management system is to decide how the application program is to be mapped onto the multi-processor. Instead of using abstract program and machine models, a generate-and-test framework known as 'post-game analysis' that is based on data gathered during program execution is proposed. Each iteration consists of (1) (a simulation of) an execution of the program; (2) analysis of the data gathered; and (3) the proposal of a new mapping that would have a smaller execution time. These heuristics are applied to predict execution time changes in response to small perturbations applied to the current mapping. An initial experiment was carried out using simple strategies on 'pipeline-like' applications. The results obtained from four simple strategies demonstrated that for this kind of application, even simple strategies can produce acceptable speed-up with a small number of iterations.

Yan, Jerry C.↗
NASA NTRS2014

Three-Dimensional Imaging and Numerical Reconstruction of Graphite/Epoxy Composite Microstructure Based on Ultra-High Resolution X-Ray Computed Tomography

A combined experimental and computational study aimed at high-resolution 3D imaging, visualization, and numerical reconstruction of fiber-reinforced polymer microstructures at the fiber length scale is presented. To this end, a sample of graphite/epoxy composite was imaged at sub-micron resolution using a 3D X-ray computed tomography microscope. Next, a novel segmentation algorithm was developed, based on concepts adopted from computer vision and multi-target tracking, to detect and estimate, with high accuracy, the position of individual fibers in a volume of the imaged composite. In the current implementation, the segmentation algorithm was based on Global Nearest Neighbor data-association architecture, a Kalman filter estimator, and several novel algorithms for virtualfiber stitching, smoothing, and overlap removal. The segmentation algorithm was used on a sub-volume of the imaged composite, detecting 508 individual fibers. The segmentation data were qualitatively compared to the tomographic data, demonstrating high accuracy of the numerical reconstruction. Moreover, the data were used to quantify a) the relative distribution of individual-fiber cross sections within the imaged sub-volume, and b) the local fiber misorientation relative to the global fiber axis. Finally, the segmentation data were converted using commercially available finite element (FE) software to generate a detailed FE mesh of the composite volume. The methodology described herein demonstrates the feasibility of realizing an FE-based, virtual-testing framework for graphite/fiber composites at the constituent level.

Czabaj, M. W.↗
NASA NTRS2018

CA Risk Assessment Approaches

Current single-Pc approach work well when subtended by appropriate hypothesis-testing framework. Reframing construct in terms of miss distance distribution would confer certain advantages such as reducing to same import as Pc, but still convey some additional information. Methods to incorporate known uncertainties in covariances and HBR should be pursued that can also be framed in terms of miss distance distribution. We present Plausibilistic II and Possibilistic constructs, to determine their adequacy and viable recommendation.

Conjunction↗
NASA NTRS2019

Testing a Neural Network Accelerator on a High-Altitude Balloon

The cognitive communications project has been working to re d machine learning approaches to support their deployment and sustained use in space environments. It has historically been difficult to implement such techniques on space platforms, however, due to the computational requirements they levy onto general-purpose avionics hardware. While technologies exist to accelerate the computation of aspects of neural networks, such platforms have not historically been deployed in space environments. Given that testing payloads in such environments can be both cost- and time-prohibitive, high-altitude balloons can be used as a way to approximate a space environment at a much lower cost, thus providing a cost-effective way in which to test newer approaches to hardware acceleration for artificial intelligence which may be deployed onto spacecraft more directly. This paper describes a successful test of a commercial off- the-shelf neural network accelerator on a high-altitude balloon. It begins by explaining our selection criteria when evaluating different commercial neural network acceleration techniques: primary considerations include size, weight, and power (SWaP) as well as ease of integration. Next, the paper describes the development and implementation of an experimental flight test platform: flight and ground components are discussed. Afterward, the paper discusses the experimental payload itself: this includes the experimental procedure as well as the specific image and method used for testing. Finally, the paper concludes with an evaluation of both the experimental device tested at altitude as well as the flight test framework itself, identifying how the existing platform can be used to continue tes g commercial off-the-shelf (COTS) solutions for acceleration.

Clark, Gilbert↗
NASA NTRS2018

Modeling with Scala

The activities and the associated formalisms for modeling and programming have many commonalities. In this paper we emphasize this point of view by modeling two examples in the programming language Scala, which have previously been modeled in the VDM specification language, and the Promela modeling language of the SPIN model checker respectively. The latter Scala model uses an internal DSL for hierarchical state machines, and a simple randomized testing framework exposing the same errors as found with SPIN. We believe, as the examples illustrate, that this use of a modern programming language for modeling is promising, especially if utilizing internal DSLs.

Joshi, Rajeev↗
NASA NTRSDate not supplied

The Core Flight System (cFS): NASA Quality Flight Software to Power Science and Exploration Available to the World

The presentation is planned to be a continuation of two previous discussions completed at the FSW Workshop regarding the cFS Test Framework (CTF) and Engineering Data Sheets (EDS). The presentation will also cover the latest advancements in cFS, including: 1. Quick into to cFS 2. An overview of our software release process + Git repo 3. Release of EDS files for the cFE + open-source apps 4. Overview of how to independently verify EDS files using CTF + what they can be used for. 5. Future plans for cFS. This presentation complements the talk on configuration management of distributed cFS repos, to be presented by Tam Ngo from Johnson Space Center.

Dan Knutsen↗
DOE OSTI2026

An Accelerated Testing and Analysis Framework for Qualification of Battery Materials Part I: A Case Study with LFP Cathodes

The growing demand for batteries used within automotive, aviation, and grid applications has exacerbated the need to supplement critical battery material feedstocks, such as those for anode and cathode active materials. New or supplementary material sources, however, universally comprise unique properties that can affect the lifetime and performance of resultant batteries. Even minor differences between new sources and established supplies can delay qualification, making it difficult for new suppliers to commercialize and resulting in a less resilient supply chain. Accordingly, the influence of composition, microstructure, and morphology on electrochemical performance should be characterized quickly and accurately to accelerate commercialization of new sources. This work introduces a tiered framework to assess new material viability and understand the influence of physicochemical properties on battery performance. The Tier 1 testing described here is rapid and low-effort to recognize materials with fundamental flaws and potentially disqualify them. Later testing would require more effort but provide higher-fidelity information with a goal of application-based validation. A case study examining commercial sources of LiFePO4 (LFP) is presented, using Tier 1 of the protocol to identify rapid electrochemical and physicochemical signals that correlate with performance and provide early go/no-go decisions for LFP materials without requiring long-term cycling.

25 ENERGY STORAGE↗
DOE OSTI2026

An Accelerated Testing and Analysis Framework for Qualification of Battery Materials

The continuously growing demand for batteries used within automotive, aviation, and grid applications has exacerbated the need to supplement critical battery material feedstocks, such as those for anode and cathode active materials. New or supplementary material sources, however, universally comprise unique material properties that can significantly affect the lifetime and performance of resultant batteries. As such, the influence of composition, microstructure, and morphology on electrochemical performance should be characterized quickly and accurately to accelerate commercialization of new material sources. This work introduces a tiered framework to quickly assess new material viability and understand the influence of physicochemical properties on battery performance. The Tier 1 testing described here is rapid and lower-effort to quickly recognize materials with fundamental flaws and potentially disqualify them. Later testing would require more time and effort but provide higher fidelity information with a goal of validating materials for specific applications. A case study examining various commercial sources of LiFePO4 (LFP) is presented, using Tier 1 of the protocol to identify rapid electrochemical and physicochemical signals that correlate with performance and to provide early go/no-go decisions on LFP materials without the need for long-term cycling data.

25 - ENERGY STORAGE↗
NASA NTRS2009

Towards a Framework for Generating Tests to Satisfy Complex Code Coverage in Java Pathfinder

We present work on a prototype tool based on the JavaPathfinder (JPF) model checker for automatically generating tests satisfying the MC/DC code coverage criterion. Using the Eclipse IDE, developers and testers can quickly instrument Java source code with JPF annotations covering all MC/DC coverage obligations, and JPF can then be used to automatically generate tests that satisfy these obligations. The prototype extension to JPF enables various tasks useful in automatic test generation to be performed, such as test suite reduction and execution of generated tests.

Staats, Matt↗
NASA NTRS2019

A Distributed Hierarchical Framework for Autonomous Spacecraft Control

Future human space missions for exploring beyond low Earth orbit are in the conceptual design stage. One such mission describes a habitat in cis-lunar orbit that is visited by crew periodically, others describe missions to Mars. These missions have one important thing in common: the need for autonomy on the spacecraft. This need stems from the latency and bandwidth constraints on communications between the vehicle and ground control. A variable amount of autonomy may be necessary whether the spacecraft has crew on board or not. Spacecraft are complex systems that are engineered as a collection of subsystems. These subsystems work together to control the overall state of the spacecraft. As such, solutions that increase the autonomy of the spacecraft (called autonomous functions) should respect both the independence and interconnectedness of the spacecraft subsystems. This distributed and hierarchical approach to system monitoring and control is a key idea in the Modular Autonomous Systems Technology (MAST) framework. The MAST framework enables a component-based architecture that provides interfaces and structure to developing autonomous technologies. The framework enforces a distributed, hierarchical architecture for autonomous control systems across subsystems, systems, elements, and vehicles. An example autonomous system was implemented in this framework and tested using realistic spacecraft software and hardware simulations. This paper will discuss the framework, tests conducted, results, and future work.

Badger, Julia M.↗
NASA NTRS1972

Einstein on the firing line.

A theoretical framework for testing theories of gravitation is considered. This framework separates theories into those that are viable and those that are nonviable by sending each through a series of tests. Most of these tests compare the theory's predictions with the results of experiment, but one test judges each theory's completeness, self-consistency and agreement with Newtonian physics at lowest order. Only a few theories, including general relativity, are currently viable, that is, pass all five tests in the framework. Einstein's 1912 theory is also ruled out because it predicts only half the observed time-delay effect. Future tests proposed include improvements of old experiments and a number of new experiments.

Will, C. M.↗
NASA NTRS2003

A Framework for Intelligent Rocket Test Facilities with Smart Sensors

A long-term center goal at the John C. Stennis Space Center (SSC) is the formulation and implementation of a framework for an Intelligent Rocket Test Facility (IRTF), which incorporates distributed smart sensor elements. The IRTF is to provide reliable, high-confident measurements. Specific objectives include: 1. Definition of a framework and architecture that supports implementation of highly autonomous methodologies founded on basic physical principles and embedded knowledge. 2. Modeling of autonomous sensors and processes as self-sufficient, evolutionary elements. 3. Development of appropriate communications protocols to enable the complex interactions that must take place to allow timely and high-quality flow of of information among all the autonomous elements of the system. 4. Development of lab-scale prototypes of key system elements. Though our application is next-generation rocket test facilities, applications for the approach are much wider and include monitoring of shuttle launch operations, air and spacecraft operations and health monitoring, and other large-scale industrial system operations such as found in processing and manufacturing plans. Elements of prototype IRTF have been implemented in preparation for advanced development and validation using rocket test stand facilities as SSC. This work has identified issues that are important to further development of complex network and should be of interest to other working with sensor networks.

Figueroa, Fernando↗
NASA NTRS2012

Nemesis Autonomous Test System

A generalized framework has been developed for systems validation that can be applied to both traditional and autonomous systems. The framework consists of an automated test case generation and execution system called Nemesis that rapidly and thoroughly identifies flaws or vulnerabilities within a system. By applying genetic optimization and goal-seeking algorithms on the test equipment side, a "war game" is conducted between a system and its complementary nemesis. The end result of the war games is a collection of scenarios that reveals any undesirable behaviors of the system under test. The software provides a reusable framework to evolve test scenarios using genetic algorithms using an operation model of the system under test. It can automatically generate and execute test cases that reveal flaws in behaviorally complex systems. Genetic algorithms focus the exploration of tests on the set of test cases that most effectively reveals the flaws and vulnerabilities of the system under test. It leverages advances in state- and model-based engineering, which are essential in defining the behavior of autonomous systems. It also uses goal networks to describe test scenarios.

Barltrop, Kevin J.↗
NASA NTRS2022

Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

Flight testing has been the historical standard for determining aircraft airworthiness - however, increases in the cost of flight testing and the accuracy of inexpensive CFD promote certification by analysis to reduce or replace flight testing. A framework is introduced to predict the performance in the special case of a modification to an existing, previously certified aircraft. This framework uses a combination of existing flight test or high fidelity data of the original aircraft as well as lower fidelity data of the original and modified configurations. Two methods are presented which estimate the model form uncertainty of the modified configuration, which is then used to conduct non-deterministic simulations. The framework is applied to an example aircraft system with simulated flight test data to demonstrate the ability to predict the performance and associated uncertainty of modified aircraft configurations. However, it is important that the models and methods used are applicable and accurate throughout the intended use domain. The factors and limitations of the framework are explored to determine the range of applicability of the framework. The effects of these factors on the performance and uncertainty results are demonstrated using the example aircraft system. The framework is then applied to NASA’s X-57 Maxwell and each of its modifications. The estimated performance and associated uncertainties are then compared to the airworthiness criteria to evaluate the potential of the framework as a component to the certification by analysis process.

Uncertainty Quantification↗
NASA NTRS2022

Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

Flight testing has been the historical standard for determining aircraft airworthiness. However, increases in the cost of flight testing and the accuracy of inexpensive CFD encourage the adoption of certification by analysis to reduce or replace flight testing. A framework is introduced to predict the performance in the special case of a modification to an existing, previously certified aircraft. This framework uses a combination of existing flight tests or high fidelity data of the original aircraft as well as lower fidelity data from CFD or wind tunnel testing of the original and modified configurations to create 6-DOF flight dynamics models. Two methods are presented which generate an updated flight dynamics model and estimate the model form uncertainty for the modified aircraft configuration using knowledge of the original aircraft. This updated dynamics model and uncertainty estimate are then used to conduct non-deterministic simulations with wind turbulence included. The framework is applied to an example aircraft system to demonstrate the ability to predict the performance and associated model from the uncertainty of modified aircraft configurations.

uncertainty quantification↗