Search NASA⌕ Search

SEARCH · Search NASA

Results for “test frameworks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Thixotropic spectra and Ashby-style charts for thixotropy

There is no universal model for thixotropy, and comparing thixotropic effects between different fluids is a subtle yet challenging problem. We introduce a generalized (model-insensitive) framework for comparing thixotropic properties based on thixotropic spectra. A superposition of exponential stress modes distributed over thixotropic time scales is used to quantify buildup and breakdown times and mode strengths in response to step-change input. This mathematical framework is tested with several experimental step-shear rate data on colloidal suspensions. Low-dimensional metrics based on moments of the distribution reveal characteristic average thixotropic properties, which are visualized on Ashby-style diagrams. This method outlines a framework for describing thixotropy across a diverse range of microstructures, supporting scientific studies as well as material selection for engineering design applications.

Mechanics↗
NASA NTRS2008

Random Testing and Model Checking: Building a Common Framework for Nondeterministic Exploration

Two popular forms of dynamic analysis, random testing and explicit-state software model checking, are perhaps best viewed as search strategies for exploring the state spaces introduced by nondeterminism in program inputs. We present an approach that enables this nondeterminism to be expressed in the SPIN model checker's PROMELA language, and then lets users generate either model checkers or random testers from a single harness for a tested C program. Our approach makes it easy to compare model checking and random testing for models with precisely the same input ranges and probabilities and allows us to mix random testing with model checking's exhaustive exploration of non-determinism. The PROMELA language, as intended in its design, serves as a convenient notation for expressing nondeterminism and mixing random choices with nondeterministic choices. We present and discuss a comparison of random testing and model checking. The results derive from using our framework to test a C program with an effectively infinite state space, a module in JPL's next Mars rover mission. More generally, we show how the ability of the SPIN model checker to call C code can be used to extend SPIN's features, and hope to inspire others to use the same methods to implement dynamic analyses that can make use of efficient state storage, matching, and backtracking.

dynamic analysis↗
DOE OSTI2022

Decentralized Distribution System Restoration with Grid-Forming/Following Inverter-Based Resources

The high penetration of distributed energy resources (DERs) in active distribution systems has posed challenges to the centralized distribution system restoration (DSR) strategies in current practice. On the other hand, the advancement in smart inverter technologies enables the bottom-up restoration capability. This paper is motivated to develop a 3-layered hierarchical framework for decentralized DSR, based on the grid-forming (GFM) and grid-following (GFL) grid-edge inverters. The first layer presents the tertiary control, which determines the load pickup schedule and generation dispatch of DERs, using the alternating direction method of the multipliers algorithm. The second layer consists of two control functions: GFM control, which regulates voltage and frequency, establishing a stable grid for GFL inverters to follow; and GFL control, which regulates the real and reactive power. In the third layer, the primary control is proposed to regulate the inverter voltage and current, which is developed based on the virtual oscillator control (VOC). Furthermore, the developed framework is tested in the modified IEEE 13-node test feeder. Two scenarios of grid-connected and islanded operating modes are designed, and simulation results demonstrate the effectiveness of decentralized DSR strategies for controlling grid-edge inverters to enhance the distribution system resilience.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Virtual Framework for Development and Testing of Federation Software Stack

Softwarization of networked infrastructures combined with containerization of codes promises unprecedented computing capabilities distributed across the federations of computing systems and physical instruments. The development and testing of a software stack that implements these capabilities over an expensive physical production infrastructure is not cost-effective, and in the early stages, may potentially cause service disruptions. To address these aspects, we develop the Virtual Federated Science Instrument Environment (VFSIE), a digital twin of the physical infrastructure that emulates a multi-site federation. Each federated site is emulated using containers and virtual hosts that are connected over local-area networks, and the sites, in turn, are connected over an emulated wide-area network. We describe the framework design and implementation details. We also illustrate its application by emulating a federation of four laboratories that use Jupyter Notebook for computations and the EPICS software system for instrument control.

Al Najjar, Anees↗
DOE OSTI2016

Testing the suitability of geologic frameworks for extrapolating hydraulic properties across regional scales

The suitability of geologic frameworks for extrapolating hydraulic conductivity (K) to length scales commensurate with hydraulic data is difficult to assess. A novel method is presented for evaluating assumed relations between K and geologic interpretations for regional-scale groundwater modeling. The approach relies on simultaneous interpretation of multiple aquifer tests using alternative geologic frameworks of variable complexity, where each framework is incorporated as prior information that assumes homogeneous K within each model unit. This approach is tested at Pahute Mesa within the Nevada National Security Site (USA), where observed drawdowns from eight aquifer tests in complex, highly faulted volcanic rocks provide the necessary hydraulic constraints. The investigated volume encompasses 40 mi3 (167 km3) where drawdowns traversed major fault structures and were detected more than 2 mi (3.2 km) from pumping wells. Complexity of the five frameworks assessed ranges from an undifferentiated mass of rock with a single unit to 14 distinct geologic units. Results show that only four geologic units can be justified as hydraulically unique for this location. The approach qualitatively evaluates the consistency of hydraulic property estimates within extents of investigation and effects of geologic frameworks on extrapolation. Distributions of transmissivity are similar within the investigated extents irrespective of the geologic framework. In contrast, the extrapolation of hydraulic properties beyond the volume investigated with interfering aquifer tests is strongly affected by the complexity of a given framework. As a result, testing at Pahute Mesa illustrates how this method can be employed to determine the appropriate level of geologic complexity for large-scale groundwater modeling.

58 GEOSCIENCES↗
DOE OSTI2019

Computational screening, synthesis and testing of metal–organic frameworks with a bithiazole linker for carbon dioxide capture and its green conversion into cyclic carbonates

Computational crystal construction algorithms were used to create twelve metal–organic frameworks containing a newly synthesized [2,2'-bithiazole]-5,5'-dicarboxylic acid (H 2 TzTz) spacer and assorted transition metal nodes. Among the twelve structures, the zirconium-based MOF of general formula [Zr 6 O 4 (OH) 4 (TzTz) 6 ] (1) was found to be the best candidate for carbon dioxide uptake, as judged from the results of the grand canonical Monte Carlo (GCMC) simulations of CO 2 adsorption isotherms. Guided by the simulation results, 1 was synthesized in the laboratory and thoroughly characterized. 1 is isoreticular to its bithiophene and bis(benzene) (UiO-67) analogues; it crystallizes in the cubic Pn$\bar{3}$ with combining macron] space group with fcu topology, and it features octahedral [Zr 6 ] nodes connected by twelve carboxylate groups from six bridging TzTz 2- spacers. It is a predominantly microporous material (micropore volume = 84% of the total pore volume), with a BET area of 840 m 2 g -1 and a maximum CO 2 uptake at ambient pressure of 2.3 mmol g -1 (10.0 wt%) or 1.7 mmol g -1 (7.5 wt%) at 273 or 298 K, respectively. The CO 2 affinity (isosteric heat of adsorption Qst = 18.7 kJ mol -1 ; CO 2 /N 2 Henry selectivity = 10; CO 2 /N 2 IAST selectivity = 8.4) is similar to that of its bithiophene analogue. After partial removal of solvent (activation), 1 was tested as a heterogeneous catalyst in the reaction of CO 2 with epoxides bearing a –CH 2 X pendant arm (X = Cl: epichlorohydrin; X = Br: epibromohydrin) to give the corresponding cyclic carbonates at T = 393 K and p CO 2 = 1 bar under green (solvent- and co-catalyst-free) conditions. A good conversion of 74% and a turnover frequency of 12.3 mmol (cyclic carbonate) per mmol Zr per h have been recorded with epibromohydrin as a substrate.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Testing Lorentz invariance of dark matter with satellite galaxies

We develop the framework for testing Lorentz invariance in the dark matter sector using galactic dynamics. We consider a Lorentz violating (LV) vector field acting on the dark matter component of a satellite galaxy orbiting in a host halo. We introduce a numerical model for the dynamics of satellites in a galactic halo and for a galaxy in a rich cluster to explore observational consequences of such an LV field. The orbital motion of a satellite excites a time dependent LV force which greatly affects its internal dynamics. Our analysis points out key observational signatures which serve as probes of LV forces. These include modifications to the line of sight velocity dispersion, mass profiles and shapes of satellites. With future data and a more detailed modeling these signatures can be exploited to constrain a new region of the parameter space describing the LV in the dark matter sector.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

On assurance testing for repairable systems

In this work, we consider assurance testing for repairable systems when supplementary information is available in addition to the data collected in the assurance test. The supplementary information is incorporated using a Bayesian inferential framework. Assurance testing is considered for both a homogeneous Poisson process and a nonhomogenous Poisson process and is illustrated with examples.

42 ENGINEERING↗
DOE OSTI2020

Modelling Framework For Fire And Smoke Detection In Imagery

This framework was developed to ingest images/video images to train and test artificial neural network structures for image-based detection of fire and smoke. The code includes data preprocessing, model development, and testing. The framework is designed to work with RGB video imagery.

Griffel, LloydM.↗
DOE OSTI2023

Assessing the National Off-Cycle Benefits of 2-Layer HVAC Technology Using Dynamometer Testing and a National Simulation Framework

Some CO2-reducing technologies have real-world benefits not captured by regulatory testing methods. This paper documents a two-layer heating, ventilation, and air-conditioning (HVAC) system that facilitates faster engine warmup through strategic increased air recirculation. The performance of this technology was assessed on a 2020 Hyundai Sonata. Empirical performance of the technology was obtained through dynamometer tests at Argonne National Laboratory. Performance of the vehicle across multiple cycles and cell ambient temperatures with the two-layer technology active and inactive indicated fuel consumption reduction in nearly all cases. A thermally sensitive powertrain model, the National Renewable Energy Laboratory's FASTSim Hot, was calibrated and validated against vehicle testing data. The developed model included the engine, cabin, and HVAC system controls. Validation of component thermal models and engine efficiency ensured accurate thermal dynamics, fuel consumption, and two-layer benefit. The real-world benefit of the two-layer technology was calculated by simulating the validated powertrain model across a representative test matrix comparing performance with and without the two-layer system. Simulation across the test matrix revealed a real-world representative benefit of 0.0835%. Analysis of test matrix results at the regional level revealed the most benefit in cold climates and rural regions. Mean results across cycle length sensitivity simulations revealed a larger real-world benefit of 0.0872%. These benefit values can be considered a more accurate assessment of real-world technology performance. Future work is planned to explore the requisite number of drive cycles to ensure the full technology benefit is captured.

2-layer↗
DOE OSTI2022

Mycorrhizal nutrient acquisition strategies shape tree competition and coexistence dynamics

Mycorrhizal fungi with different nutrient acquisition strategies influence plant species performance and physiology, thereby defining their trophic niche. This might drive resource competition dynamics that cumulatively impact tree species coexistence, but few manipulative experiments have directly tested this. Combining surveys and experiments in a modern coexistence theory framework, we tested how variation in mycorrhizal strategies and nutrient conditions affects plant competitive outcomes. We focused on two genera of co-occurring tree species with different mycorrhizal states: Acer (arbuscular mycorrhizal, AM) and Populus (dual mycorrhizal, but often considered predominantly ectomycorrhizal, EM). The EM and AM fungal responsiveness in Populus species varied with latitude and nitrogen (N) limitation. Host-specific soil microbiome conditioning and inorganic N fertilization combined to qualitatively affect coexistence outcomes. Lower N conditions favoured Populus over Acer trees, and N fertilization reversed this outcome for southern species, aligning with regional-scale forest mycorrhizal transitions. Results from the coexistence experiment also predict competitive exclusion between the tree species pairs, which could arise, in part, from their mycorrhizal differences and is consistent with alternative stable states in dominant forest mycorrhizal strategies. Such bistability appears in natural systems as a bimodal distribution of Populus vs. Acer tree species dominance using long-term forest inventory data. Synthesis: The magnitude and outcome of microbially mediated competition between Populus and Acer depends on soil nutrient availability, which likely relates to their mycorrhizal differentiation. These findings support the importance of mycorrhizal symbioses for contributing to large-scale biogeographical patterns of tree species trophic niche separation across soil resource gradients and bistability in forest mycorrhizal structure.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Utilizing Reinforcement Learning to Continuously Improve a Primitive-Based Motion Planner

We report in this paper describes how the performance of motion primitive-based planning algorithms can be improved using reinforcement learning. Specifically, we describe and evaluate a framework that autonomously improves the performance of a primitive-based motion planner. The improvement process consists of three phases: exploration, extraction, and reward updates. This process can be iterated continuously to provide successive improvement. The exploration step generates new trajectories, and the extraction step identifies new primitives from these trajectories. These primitives are then used to update rewards for continued exploration. This framework required novel shaping rewards, development of a primitive extraction algorithm, and modification of the Hybrid A* algorithm. The framework is tested on a navigation task using a nonlinear F-16 model. The framework autonomously added 91 motion primitives to the primitive library and reduced average path cost by 21.6 seconds, or 35.75% of the original cost. The learned primitives are applied to an obstacle field navigation task, which was not used in training, and reduced path cost by 16.3 seconds, or 24.1%. Additionally, two heuristics for the modified Hybrid A* algorithm are designed to improve effective branching factor.

42 ENGINEERING↗
NASA NTRS2009

Multi-Disciplinary Analysis and Optimization Frameworks

Since July 2008, the Multidisciplinary Analysis & Optimization Working Group (MDAO WG) of the Systems Analysis Design & Optimization (SAD&O) discipline in the Fundamental Aeronautics Program s Subsonic Fixed Wing (SFW) project completed one major milestone, Define Architecture & Interfaces for Next Generation Open Source MDAO Framework Milestone (9/30/08), and is completing the Generation 1 Framework validation milestone, which is due December 2008. Included in the presentation are: details of progress on developing the Open MDAO framework, modeling and testing the Generation 1 Framework, progress toward establishing partnerships with external parties, and discussion of additional potential collaborations

Naiman, Cynthia Gutierrez↗
NASA NTRS2011

Mars Science Laboratory Flight Software Boot Robustness Testing Project Report

On the surface of Mars, the Mars Science Laboratory will boot up its flight computers every morning, having charged the batteries through the night. This boot process is complicated, critical, and affected by numerous hardware states that can be difficult to test. The hardware test beds do not facilitate testing a long duration of back-to-back unmanned automated tests, and although the software simulation has provided the necessary functionality and fidelity for this boot testing, there has not been support for the full flexibility necessary for this task. Therefore to perform this testing a framework has been build around the software simulation that supports running automated tests loading a variety of starting configurations for software and hardware states. This implementation has been tested against the nominal cases to validate the methodology, and support for configuring off-nominal cases is ongoing. The implication of this testing is that the introduction of input configurations that have yet proved difficult to test may reveal boot scenarios worth higher fidelity investigation, and in other cases increase confidence in the robustness of the flight software boot process.

Mars Science Laboratory (MSL)↗
NASA NTRS2016

Automation of Flight Software Regression Testing

NASA is developing the Space Launch System (SLS) to be a heavy lift launch vehicle supporting human and scientific exploration beyond earth orbit. SLS will have a common core stage, an upper stage, and different permutations of boosters and fairings to perform various crewed or cargo missions. Marshall Space Flight Center (MSFC) is writing the Flight Software (FSW) that will operate the SLS launch vehicle. The FSW is developed in an incremental manner based on "Agile" software techniques. As the FSW is incrementally developed, testing the functionality of the code needs to be performed continually to ensure that the integrity of the software is maintained. Manually testing the functionality on an ever-growing set of requirements and features is not an efficient solution and therefore needs to be done automatically to ensure testing is comprehensive. To support test automation, a framework for a regression test harness has been developed and used on SLS FSW. The test harness provides a modular design approach that can compile or read in the required information specified by the developer of the test. The modularity provides independence between groups of tests and the ability to add and remove tests without disturbing others. This provides the SLS FSW team a time saving feature that is essential to meeting SLS Program technical and programmatic requirements. During development of SLS FSW, this technique has proved to be a useful tool to ensure all requirements have been tested, and that desired functionality is maintained, as changes occur. It also provides a mechanism for developers to check functionality of the code that they have developed. With this system, automation of regression testing is accomplished through a scheduling tool and/or commit hooks. Key advantages of this test harness capability includes execution support for multiple independent test cases, the ability for developers to specify precisely what they are testing and how, the ability to add automation, and the ability of the harness and cases to be executed continually. This test concept is an approach that can be adapted to support other projects.

Tashakkor, Scott B.↗