Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Robots and Robots and More

Over the course of this year I worked on several projects across different departments, from physical robots at Swamp Works, to automated robots running functional tests on launch critical Graphical User Interfaces (GUIs). My overarching project this year was designing a new automated testing framework. It began with becoming familiar with the existing automated testing framework, which used image matching to perform programmatic GUI testing. After writing a few dozen tests with the existing framework, I was able to identify the strengths and weaknesses of the system and begin the search for another tool to replace it. I ended up selecting an open source library, which I modified to fit both National Aeronautics and Space Administration (NASA) requirements and those of the specific Computer Software Configuration Item (CSCI) I worked on. After the new framework was feature-rich enough to meet the team requirements, I helped roll out the changes, managed the transition to the new framework, and directed continuing automation work in regards to the library. The result was a comprehensive new way of efficiently testing the GUI that was robust enough to handle small changes to the GUI itself. Additionally, for approximately six weeks I worked on rebuilding, repairing, and updating the software of four "Swarmie" robots for a NASA event. By the close of the six weeks, the four robots were operational and had improved obstacle detection software that solved a faulty stop signal issue that the robots were experiencing.

Siegel, Alex↗
NASA NTRS2009

A Test Generation Framework for Distributed Fault-Tolerant Algorithms

Heavyweight formal methods such as theorem proving have been successfully applied to the analysis of safety critical fault-tolerant systems. Typically, the models and proofs performed during such analysis do not inform the testing process of actual implementations. We propose a framework for generating test vectors from specifications written in the Prototype Verification System (PVS). The methodology uses a translator to produce a Java prototype from a PVS specification. Symbolic (Java) PathFinder is then employed to generate a collection of test cases. A small example is employed to illustrate how the framework can be used in practice.

Goodloe, Alwyn↗
NASA NTRS2012

Test Driven Development of Scientific Models

Test-Driven Development (TDD) is a software development process that promises many advantages for developer productivity and has become widely accepted among professional software engineers. As the name suggests, TDD practitioners alternate between writing short automated tests and producing code that passes those tests. Although this overly simplified description will undoubtedly sound prohibitively burdensome to many uninitiated developers, the advent of powerful unit-testing frameworks greatly reduces the effort required to produce and routinely execute suites of tests. By testimony, many developers find TDD to be addicting after only a few days of exposure, and find it unthinkable to return to previous practices. Of course, scientific/technical software differs from other software categories in a number of important respects, but I nonetheless believe that TDD is quite applicable to the development of such software and has the potential to significantly improve programmer productivity and code quality within the scientific community. After a detailed introduction to TDD, I will present the experience within the Software Systems Support Office (SSSO) in applying the technique to various scientific applications. This discussion will emphasize the various direct and indirect benefits as well as some of the difficulties and limitations of the methodology. I will conclude with a brief description of pFUnit, a unit testing framework I co-developed to support test-driven development of parallel Fortran applications.

Clune, Thomas L.↗
DOE OSTI2024

An Entropy-Based Test and Development Framework for Uncertainty Modeling in Level-Set Visualizations

We present a simple comparative framework for testing and developing uncertainty modeling in uncertain marching cubes implementations. The selection of a model to represent the probability distribution of uncertain values directly influences the memory use, run time, and accuracy of an uncertainty visualization algorithm. We use an entropy calculation directly on ensemble data to establish an expected result and then compare the entropy from various probability models, including uniform, Gaussian, histogram, and quantile models. Our results verify that models matching the distribution of the ensemble indeed match the entropy. We further show that fewer bins in nonparametric histogram models are more effective whereas large numbers of bins in quantile models approach data accuracy.

Sisneros, Robert↗
NASA NTRS2003

Use of the SCIRun PSE for Coupled Fluid-Structure Analysis

The objective of this paper is to investigate the use of Problem Solving Environments (PSE) for tightly coupled fluid-structure control analysis of aerospace vehicles. The topics include: 1) Background; 2) The SCIRun PSE; 3) Projects Done with SCIRun; 4) Research Procedures; 5) Installtion; 6) Installation Problems on NAS; 7) Module Development; 8) Module Testing Framework; 9) Time Testing of SCIRun; and 10) Time Test Results. This paper is in viewgraph form.

Cheung, Christopher↗
NASA NTRS2017

ExEP Yield Modeling Tool and Validation Test Results

EXOSIMS is an open-source simulation tool for parametric modeling of the detection yield and characterization of exoplanets. EXOSIMS has been adopted by the Exoplanet Exploration Programs Standards De nition and Evaluation Team (ExSDET) as a common mechanism for comparison of exoplanet mission concept studies. To ensure trustworthiness of the tool, we developed a validation test plan that leverages the Python-language unit-test framework, utilizes integration tests for selected module interactions, and performs end-to-end cross- validation with other yield tools. This paper presents the test methods and results, with the physics-based tests such as photometry and integration time calculation treated in detail and the functional tests treated summarily. The test case utilized a 4m unobscured telescope with an idealized coronagraph and an exoplanet population from the IPAC radial velocity (RV) exoplanet catalog. The known RV planets were set at quadrature to allow deterministic validation of the calculation of physical parameters, such as working angle, photon counts and integration time. The observing keepout region was tested by generating plots and movies of the targets and the keepout zone over a year. Although the keepout integration test required the interpretation of a user, the test revealed problems in the L2 halo orbit and the parameterization of keepout applied to some solar system bodies, which the development team was able to address. The validation testing of EXOSIMS was performed iteratively with the developers of EXOSIMS and resulted in a more robust, stable, and trustworthy tool that the exoplanet community can use to simulate exoplanet direct-detection missions from probe class, to WFIRST, up to large mission concepts such as HabEx and LUVOIR.

Nunez, Paul↗
NASA NTRS1971

Theoretical frameworks for testing relativistic gravity: A review

Metric theories of gravity are presented, including the definition of metric theory, evidence for its existence, and response of matter to gravity with test body trajectories, gravitational red shift, and stressed matter responses. Parametrized post-Newtonian framework and interpretations are reviewed. Gamma, beta and gamma, and varied other parameters were measured. Deflection of electromagnetic waves, radar time delay, geodetic gyroscope precession, perihelion shifts, and periodic effects in orbits are among various studies carried out for metric theory experimentation.

Thorne, K. S.↗
DOE OSTI2025

A framework for testing soil carbon dynamics post land-use transition in a multisector dynamics model

Soil carbon plays a crucial role in the global carbon cycle. Changes in land use can determine whether carbon is stored or is emitted into the atmosphere as carbon dioxide, which has broad implications for the human and Earth systems. These feedbacks to the carbon cycle and their socio-economic drivers are modelled by many global multisector dynamics models to project future possibilities for the human-Earth system. One notable model of this class is the Global Change Analysis Model (GCAM), which uses a simplified process to model soil organic carbon (SOC) content after land-use transition across 384 land units. While the current GCAM soil carbon framework is based on scientific principles, it has not been tested against experimental data. This work examines rates of SOC change from GCAM input data. Specifically, first order rate constants derived from model inputs were compared to values from two syntheses to assess GCAM’s accuracy. Welch’s t-tests and linear models were used to determine if rate constants were consistent across all tested geographical areas and land-use transition types. While we found that there was general agreement on the direction and magnitude (i.e., rate) of SOC change, the rate constant derived from GCAM and empirical values differed strongly in a subset of specific instances. These results indicate that GCAM’s current SOC dynamics during land use transition successfully capture broad patterns of change in this critical carbon pool, but should be interpreted with caution at finer spatial scales. One potential cause of these discrepancies is our highly aggregated variable, soil timescale, which could be made more granular to improve accuracy. When using economically rooted multisector dynamics models, such as GCAM, it is critical to understand such model limitations for representing specific Earth system processes.

carbon↗
NASA NTRS1972

Theoretical frameworks for testing relativistic gravity. IV - A compendium of metric theories of gravity and their post-Newtonian limits.

Metric theories of gravity are compiled and classified according to the types of gravitational fields they contain, and the modes of interaction among those fields. The gravitation theories considered are classified as (1) general relativity, (2) scalar-tensor theories, (3) conformally flat theories, and (4) stratified theories with conformally flat space slices. The post-Newtonian limit of each theory is constructed and its Parametrized Post-Newtonian (PPN) values are obtained by comparing it with Will's version of the formalism. Results obtained here, when combined with experimental data and with recent work by Nordtvedt and Will and by Ni, show that, of all theories thus far examined by our group, the only currently viable ones are general relativity, the Bergmann-Wagoner scalar-tensor theory and its special cases (Nordtvedt; Brans-Dicke-Jordan), and a recent, new vector-tensor theory by Nordtvedt, Hellings, and Will.

Ni, W.-T.↗
NASA NTRS1974

Theoretical frameworks for testing relativistic gravity. 5: Post-Newtonian limit of Rosen's theory

The post-Newtonian limit of Rosen's theory of gravity is evaluated and is shown to be identical to that of general relativity, except for the PPN parameter alpha sub 2, which is related to the difference in propagation speeds for gravitational and electromagnetic waves. Both the value of alpha sub 2 and the value of the Newtonian gravitational constant depend on the present cosmological structure of the Universe. If the cosmological structure has a specific but presumably special form, the Newtonian gravitational constant assumes its current value, alpha sub 2 is zero, the post-Newtonian limit of Rosen's theory is identical to that of general relativity--and standard solar system experiments cannot distinguish between the two theories.

Lee, D. L.↗
NASA NTRS1976

Theoretical frameworks for testing relativistic gravity. V - Post-Newtonian limit of Rosen's theory

The post-Newtonian limit of Rosen's theory of gravity is evaluated and is shown to be identical to that of general relativity, except for the post-Newtonian parameter alpha sub 2 (which is related to the difference in propagation speeds for gravitational and electromagnetic waves). Both the value of alpha sub 2 and the value of the Newtonian gravitational constant depend on the present cosmological structure of the Universe. If the cosmological structure has a specific (but presumably special) form, the Newtonian gravitational constant assumes its current value, alpha sub 2 is zero, the post-Newtonian limit of Rosen's theory is identical to that of general relativity - and standard solar system experiments cannot distinguish between the two theories.

Lee, D. L.↗
NASA NTRS2011

A Framework for Testing Automated Detection, Diagnosis, and Remediation Systems on the Smart Grid

America's electrical grid is currently undergoing a multi-billion dollar modernization effort aimed at producing a highly reliable critical national infrastructure for power - a Smart Grid. While the goals for the Smart Grid include upgrades to accommodate large quantities of clean, but transient, renewable energy and upgrades to provide customers with real-time pricing information, perhaps the most important objective is to create an electrical grid with a greatly increased robustness.

autonomous detection, diagnosis, and remediation (↗
NASA NTRSDate not supplied

Advanced Supersonic Parachute Inflation Research Experiment-2 (ASPIRE2) Parachute Modeling and Flight Mechanics Performance

The Advanced Supersonic Parachute Inflation Research Experiment-2 (ASPIRE2) program is designed to test and qualify the supersonic parachute for the Mars entry, descent, and landing stage of the Mars Sample Return campaign. The ASPIRE2 test was planned for early 2026 and would have involved testing the parachute at deployments of Mach 2.1 and higher load conditions than previous Mars missions. The ASPIRE2 simulation builds upon a previous test framework from the ASPIRE tests in 2017-2018 used to qualify the Mars 2020 parachute, but due to new requirements, the modeling and simulation for ASPIRE2 has needed development and characterization of different sensitivities. This paper looks at the mission design as of mid-2024 and presents the trade space for qualifying the parachute in a dynamic environment.

Evan Roelke↗
NASA NTRSDate not supplied

Advanced Supersonic Parachute Inflation Research Experiment-2 (ASPIRE2) Parachute Modeling and Flight Mechanics Performance

The Advanced Supersonic Parachute Inflation Research Experiment-2 (ASPIRE2) program is designed to test and qualify the supersonic parachute for the Mars entry, descent, and landing stage of the Mars Sample Return campaign. The ASPIRE2 test was planned for early 2026 and would have involved testing the parachute at deployments of Mach 2.1 and higher load conditions than previous Mars missions. The ASPIRE2 simulation builds upon a previous test framework from the ASPIRE tests in 2017-2018 used to qualify the Mars 2020 parachute, but due to new requirements, the modeling and simulation for ASPIRE2 has needed development and characterization of different sensitivities. This paper looks at the mission design as of mid-2024 and presents the trade space for qualifying the parachute in a dynamic environment.

Evan Roelke↗
NASA NTRS2020

Command and Control System Automated Testing

To support the National Aeronautics and Space Administration’s (NASA) Space Launch System (SLS) rocket and the Orion capsule, designed to take humans back to the moon in 2024, Kennedy Space Center (KSC) has developed the Spaceport Command and Control System (SCCS) to monitor and control the launch. Within SCCS, the Launch Control System (LCS) is designed to allow console engineers to control and monitor the status of the launch and flight hardware, as well as issue commands to ground control systems and launch vehicles. The messaging software of LCS is responsible for handling the various data types that can be sent between the hardware and software components of the LCS. Since this system is interacting with numerous devices, controllers, and viewports in real time, the distribution of data across the system must be fast, but also reliable and accurate. To verify the accuracy and reliability of the system, developers on the project have created a set of tests to be performed that covers all operations allowed by the system. Given the extensive Application Programming Interface(API) provided by the messaging software, these unit tests are rather time-consuming and costly (in terms of man-hours) to perform. Therefore, an automated testing framework is used to perform supplemental tests automatically when updates are made to the code base.

Rebecca McFadden↗
NASA NTRS2014

pFUnit 3.0 Tutorial Advanced

This tutorial will introduce Fortran developers to unit-testing and test-driven development (TDD) using pFUnit. As with other unit-testing frameworks, pFUnit, simplifies the process of writing, collecting, and executing tests while providing clear diagnostic messages for failing tests. pFUnit specifically targets the development of scientific-technical software written in Fortran and includes customized features such as: assertions for multi-dimensional arrays, distributed (MPI) and thread-based (OpenMP) parallellism, and flexible parameterized tests.These sessions will include numerous examples and hands-on exercises that gradually build in complexity. Attendees are expected to have working knowledge of F90, but familiarity with object-oriented syntax in F2003 and MPI will be of benefit for the more advanced examples. By the end of the tutorial the audience should feel comfortable in applying pFUnit within their own development environment.

Test Driven using pFUnit↗