Search NASA⌕ Search

SEARCH · Search NASA

Results for “test frameworks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Port scanner and Testing Suite

This project addresses the challenge of identifying and managing open network ports across physical and virtual hosts. The current form of verifying ports in use required manually searching individual ports - a process that was both time- consuming and a potential bottleneck for deployment timelines. To resolve this, an automated port scanning tool was developed in Python. The tool supports simultaneous multiple port scans. To ensure functionality and long-term maintainability, a comprehensive testing suite was implemented using Python’s unittest framework. Edge cases, including valid port numbers, reversed ranges, and closed ports, were explicitly tested to ensure robust handling of real-world scenarios. The resulting tool reduces the time required to verify port security across a network, supporting both targeted and host checks and broader Classless Inter-Domain Routing (CIDR) -based network scans. This work demonstrates the value of automation and test-driven development in strengthening network security practices, and provides a foundation for future enhancements.

Rivera, Linda [Fermilab]↗

Desert Research and Technology Studies (DRATS) 2010 Science Operations: Operational Approaches and Lessons Learned for Managing Science during Human Planetary Surface Missions

Desert Research and Technology Studies (Desert RATS) is a multi-year series of hardware and operations tests carried out annually in the high desert of Arizona on the San Francisco Volcanic Field. These activities are designed to exercise planetary surface hardware and operations in conditions where long-distance, multi-day roving is achievable, and they allow NASA to evaluate different mission concepts and approaches in an environment less costly and more forgiving than space.The results from the RATS tests allows election of potential operational approaches to planetary surface exploration prior to making commitments to specific flight and mission hardware development. In previous RATS operations, the Science Support Room has operated largely in an advisory role, an approach that was driven by the need to provide a loose science mission framework that would underpin the engineering tests. However, the extensive nature of the traverse operations for 2010 expanded the role of the science operations and tested specific operational approaches. Science mission operations approaches from the Apollo and Mars-Phoenix missions were merged to become the baseline for this test. Six days of traverse operations were conducted during each week of the 2-week test, with three traverse days each week conducted with voice and data communications continuously available, and three traverse days conducted with only two 1-hour communications periods per day. Within this framework, the team evaluated integrated science operations management using real-time, tactical science operations to oversee daily crew activities, and strategic level evaluations of science data and daily traverse results during a post-traverse planning shift. During continuous communications, both tactical and strategic teams were employed. On days when communications were reduced to only two communications periods per day, only a strategic team was employed. The Science Operations Team found that, if communications are good and down-linking of science data is ensured, high quality science returns is possible regardless of communications. What is absent from reduced communications is the scientific interaction between the crew on the planet and the scientists on the ground. These scientific interactions were a critical part of the science process and significantly improved mission science return over reduced communications conditions. The test also showed that the quality of science return is not measurable by simple numerical quantities but is, in fact, based on strongly non-quantifiable factors, such as the interactions between the crew and the Science Operations Teams. Although the metric evaluation data suggested some trends, there was not sufficient granularity in the data or specificity in the metrics to allow those trends to be understood on numerical data alone.

Eppler, Dean↗

Automated qualification data tool for high temperature metallic materials

This report describes a framework for storing, processing, and displaying qualification data for high temperature mechanical properties. The framework automates the process of generating design data from mechanical test results, for example for a data qualification report for the ASME Boiler \& Pressure Vessel Code. The framework has three parts: a data storage model with common formats for several types of typical mechanical property tests, a backend based on the \pycreep Python library for correlating and extrapolating the data to generate design material properties and allowable stresses, and a demonstration user interface for displaying, sorting, and filtering the data and exploring different options for modeling the design mechanical properties. The report discusses the options available for data processing, with illustrations from real test data on Alloy 617, Alloy 709, Alloy 740H, and Laser-Powder Bed Fusion 316H. The framework is complete for ASME type data analysis and will be used to store test data generated by the Department of Energy, Office of Nuclear Energy, Advanced Materials and Manufacturing Technologies sponsored qualification programs. Future work could extend the tool to other types of material properties and/or expand the demo user interface to make it accessible across the AMMT program.

36 MATERIALS SCIENCE↗

A Framework for Successful Research Experiences in the Classroom: Combining the Power of Technology and Mentors

Authentic research opportunities in the classroom are most impactful when they are student-driven and inquiry-based. These experiences are even more powerful when they involve technology and meaningful connections with scientists. In today's classrooms, activities are driven by state required skills, education standards, and state mandated testing. Therefore, programs that incorporate authentic research must address the needs of teachers. NASA's Expedition Earth and Beyond (EEAB) Program has developed a framework that addresses teacher needs and incorporates the use of technology and access to mentors to promote and enhance authentic research in the classroom. EEAB is a student involvement program that facilitates student investigations of Earth or planetary comparisons using NASA data. To promote student-led research, EEAB provides standards-aligned, inquiry-based curricular resources, an implementation structure to facilitate research, educator professional development, and ongoing support. This framework also provides teachers with the option to incorporate the use of technology and connect students with a mentor, both of which can enrich student research experiences. The framework is structured by a modeled 9-step process of science which helps students organize their research. With more schools gaining increased access to technology, EEAB has created an option to help schools take advantage of students' interest and comfort with technology by leveraging the use of available technologies to enhance student research. The use of technology not only allows students to collaborate and share their research, it also provides a mechanism for them to work with a mentor. This framework was tested during the 2010/2011 school year. Team workspaces hosted on Wikispaces for Educators allow students to initiate their research and refine their research question initially without external input. This allows teams to work independently and rely on the skills and interests of team members. Once teams finalize their research question, they are assigned a mentor. The mentor introduces himself/herself, acknowledges the initial work the team has conducted, and asks a focused question to help open the lines of communication. Students continue to communicate with their mentor throughout their research. As research is completed, teams can share their investigation during a virtual presentation. These live presentations allow students to share their research with their mentor, other scientists, other students, parents, and school administrators. After the initial year of testing this authentic research process, EEAB is working to address the many lessons learned. This will allow the program to refine and improve the overall process in an effort to maximize the benefits. Combined, these powerful strategies provide a successful framework to help teachers enhance the skills and motivation of their students, preparing them to become the next generation of scientists, explorers, and STEM-literate citizens of our nation.

Graff, Paige Valderrama↗

Water Sorption Study of Various Polymers and Polymeric Composites

In the formulations of many composite materials, polymeric materials are often used as binder materials to enhance processability, functionality, and safety during manufacturing. For instance, poly(ester urethane), such as Estane® 5703, is used in the formulation of PBX 9501, and vinyl copolymer elastomer (VCE) is used in the formulation of VCE/filler compos ites. The stability of these binders directly impacts the overall stability and performance of their composites. Estane and VCE are prone to hydrolytic degradation, with water sorption behavior playing a significant role in their long-term stability and aging behavior. Hence, it is critical to study their water sorption behavior under various humidity and tempera ture conditions. To improve the accuracy and reduce labor-intensive work involved in water sorption experiments, an automated Dynamic Vapor Sorption (DVS) system was employed, which can generate large datasets. To efficiently process and analyze these datasets, Python scripts were developed. These scripts not only streamlined data processing, but also accu rately derived the Arrhenius parameters related to water diffusion and sorption properties for the tested materials. This approach offers a robust framework for evaluating water trans port and sorption processes in polymeric materials and adds valuable capabilities to future water sorption testing efforts.

36 MATERIALS SCIENCE↗

Analysis of Flame Deflector Spray Nozzles in Rocket Engine Test Stands

The development of a unified tightly coupled multi-phase computational framework is described for the analysis and design of cooling spray nozzle configurations on the flame deflector in rocket engine test stands. An Eulerian formulation is used to model the disperse phase and is coupled to the gas-phase equations through momentum and heat transfer as well as phase change. The phase change formulation is modeled according to a modified form of the Hertz-Knudsen equation. Various simple test cases are presented to verify the validity of the numerical framework. The ability of the methodology to accurately predict the temperature load on the flame deflector is demonstrated though application to an actual sub-scale test facility. The CFD simulation was able to reproduce the result of the test-firing, showing that the spray nozzle configuration provided insufficient amount of cooling.

Sachdev, Jai S.↗

Protocol for Atomic Oxygen Testing of Materials in Ground-Based Facilities

A second version of standard guidelines is proposed for improving materials testing in ground-based atomic oxygen environments for the purpose of predicting the durability of the tested materials in low Earth orbit (LEO). Accompanying these guidelines are background information and notes about testing. Both the guidelines and the additional information are intended to aid users who wish to evaluate the potential hazard of atomic oxygen in LEO to a candidate space component without actually flying the component in space, and to provide a framework for more consistent atomic oxygen testing in the future.

Minton, Timothy K.↗

Development of a Computational Framework for the Design of Resilient Space Structures

Cyber-physical testing provides a unique platform to enable the design of resilient space structures. This hybrid approach requires the development of a structural model that accounts for various hazards (e.g., micrometeorite and debris impact) and interacts with physical tests and other sub-system models (e.g., thermal) of the space habitat. A two-dimensional finite element analysis code was developed in MATLAB to facilitate the evaluation of potential designs under operating and unexpected loads and prepare the computational framework for eventually performing cyber-physical testing. The code’s efficiency was enhanced by using an object-oriented programming approach that reduced data transfer between functions. In this study, the code is implemented to predict the response of a dome-style structure made of regolith concrete to impact loading and identify the force magnitude that will cause the tensile strength to be exceeded in domes with different thicknesses.

Tensile strength↗

The OSSE Framework at the NASA Global Modeling and Assimilation Office (GMAO)

The Global Modeling and Assimilation Office (GMAO) has been developing an Observing System Simulation Experiment (OSSE) framework. The OSSE system is currently based on the Nature Run (NR) developed by GMAO called G5NR. The G5NR is currently being tested for use in the GMAO OSSE framework. Synthetic observations have been generated based on the G5NR fields, including conventional observations, GPS, and satellite radiances. These synthetic observations are ingested using the Gridpoint Statistical Interpolation data assimilation system, with forecasts performed by the GEOS-5 model at 55 km/72L.

OSSE Framework↗

SAVY-4000 Finite-Element Drop Test Analysis

PFE Auxiliary Systems conducted drop testing on SAVY-4000 containers to evaluate structural response under 12-foot drop conditions. In support of that effort, a finite-element modeling capability was developed to simulate drop response across multiple container sizes and impact orientations. The purpose of this work was to provide a consistent analysis framework that could support interpretation of testing, compare response trends across multiple configurations, and generate quantities of interest for later comparison with experimental data. More broadly, the analysis and testing were intended to assess whether the containers continued to perform their primary function after a 12-foot drop, namely maintaining structural integrity and containment of the contents. The modeling approach combined an implicit preload analysis with an explicit drop simulation so that each drop event began from a mechanically realistic assembled condition, including compression of the silicone O-ring. Separate models were developed for 2-quart, 5-quart, 12-quart, and 10-gallon containers. The results were evaluated in terms of strain-gauge response, collar-lid gap behavior, and accumulated plastic strain. In addition, parametric studies were performed on the 2-quart container to assess sensitivity to O-ring stiffness, friction, canister thickness, geometry tolerance, and mesh density. The simulations showed that predicted drop responses depended strongly on both container size and drop orientation. Gap metrics identified cases in which the predicted collar-lid opening exceeded the nominal O-ring cross-section threshold, while plastic strain metrics identified localized regions of elevated permanent deformation. Parametric studies showed that the predicted response was especially sensitive to the assumed O-ring stiffness and contact friction, while the geometry tolerance study produced smaller changes in the cases examined. The main value of this work was that it established a repeatable modeling and simulation workflow to support drop-test implementation, evaluate effects of future configuration changes, and understand modeling assumptions that most influenced predicted response. At the current stage, the results were viewed as preliminary model predictions rather than validated predictions. The next step would be to compare drop-test data to the model so that predictive values of the workflow could be refined and used with greater confidence to assess whether the containers maintained structural integrity and containment of the contents after a 12-foot drop.

42 ENGINEERING↗

ATM TestBed 2021 Simulating & Testing for the Future of Flight

TestBed is a NASA facility that not only connects geographically distributed tools without having to worry about obsolescence, but it is also a comprehensive one-stop-access simulation framework that allows researchers to develop and test solutions to current and future challenges more quickly by addressing development pain points, while also facilitating the connection of simulators and new tools to a variety of organizations, allowing for faster testing and development. Specifically, TestBed enables one to better characterize the impact of a new technology under development and to communicate its impact to stakeholders.

Air Traffic Management↗

A two-stage optical fusion framework for wildfire severity mapping across the conterminous United States

Accurate wildfire severity mapping (WSM) is essential for post-fire recovery planning, erosion risk assessment, ecosystem monitoring, and disaster risk reduction. Although Landsat and Sentinel optical imagery have been widely used for burn severity assessment, the added value of fusing multiple optical sensors has not been sufficiently quantified across diverse fire events, particularly since the launch of Landsat-9. This study evaluates whether multisensor optical fusion improves wildfire severity mapping relative to single-sensor baselines using Sentinel-2, Landsat-8, and Landsat-9 imagery across 40 wildfire events in the conterminous United States. We tested a two-stage fusion framework that combines feature-level fusion with pixel-level dimensionality reduction. First, feature-level fused datasets were created through early fusion by combining standardized post-fire bands from each sensor into a single predictor stack. Both raw reflectance bands and pairwise spectral transforms were retained to capture within- and cross-sensor spectral interactions. Second, Linear Discriminant Analysis was applied to both single-sensor and fused datasets to produce comparable low-dimensional feature spaces. Six machine-learning classifiers were then used to benchmark model performance with repeated spatially buffered train–test splits. Results show that Landsat-9 was the strongest single-sensor baseline. Among the fusion strategies, Sentinel-2 + Landsat-9 produced the most consistent improvement and reduced performance variability. Landscape-condition analysis further showed that this fusion was most beneficial in shrubland-dominated and high-terrain fires, where it achieved the highest overall mean accuracy and the fewest failures. In contrast, its benefits were less reliable in evergreen forests, mixed vegetation, and low- to moderate-elevation terrain. In operational settings, the Sentinel-2 + Landsat-9 configuration offers a practical solution for post-fire recovery planning, erosion-risk assessment, watershed management, and ecological monitoring when field observations are available and timely satellite-based information is needed.

Landsat↗

National Partnership for Aeronautical Ground Testing - Overview and NASA Perspective

The National Partnership for Aeronautical Testing is a cooperative agreement between NASA and the DoD which serves as a framework for cooperation on individual projects related to aeronautical test facilities, particularly wind tunnels and engine test facilities. The Aeronautics Evaluation and Test Capability is a NASA portfolio which provides resources and coordination for the large wind tunnels and engine test cells at NASA Ames, Glenn, and Langley. This presentation describes the history, organization, and activities of the NPAT, as well as the AETC.

Air Force↗

FY2023 NSTTF Annual Report

The National Solar Thermal Test Facility (NSTTF) is a DOE Core Capability and Technology Deployment Center located in Albuquerque, NM. It is operated by Sandia National Laboratories (Sandia) for the U.S. Department of Energy (DOE). The NSTTF is the only multi-mission, multi-use, multi-story test facility of its type in the United States. The NSTTF was founded in 1978 and began testing with high heat flux that same year. Over the past 45 years, the NSTTF has been at the forefront of the research, design, fabrication, and testing of many of the critical Concentrating Solar Power (CSP) technologies. These technologies have allowed costs to be dramatically reduced from over $\$ $0.40 /kWh to $\$$0.12 /kWh since the conception of this renewable energy technology. The NSTTF has worked to make the Solar Energy Generating Systems (SEGS) parabolic trough plants successful, while also working with the Solar One and Solar Two facilities for successful implementation. Over the four decades since its founding, the mission of the NSTTF has grown to include new receiver technologies, like our generation 3 falling particle system (G3P3 Tower), optical metrology techniques like SOFAST, molten salt testing, thermal energy storage, solar thermal chemistry, and more. We continue to expand our capabilities in pursuit of the DOE SETO mission and the DOE SunShot 2030 goals: unsubsidized LCOE of $\$$0.05/kWh for CSP that includes 12 or more hours of thermal energy storage. To support both the DOE SETO mission and support the CSP sector as a whole, we are working to develop our operations and maintenance framework to provide a world class testing facility in support of our technological achievements. To accomplish both of these missions, the NSTTF draws on the decades of experience and expertise of our staff along with the world-class facilities at Sandia National Laboratories to further the science of concentrated solar thermal technologies in diverse applications. We remain a trusted partner for high-quality and impactful research in both fundamental and applied arenas. We are able to provide our partners with both one-of-a-kind testing platforms as well as world-class analytics.

14 SOLAR ENERGY↗

Practical robustness measures in multivariable control system analysis

The robustness of the stability of multivariable linear time invariant feedback control systems with respect to model uncertainty is considered using frequency domain criteria. Available robustness tests are unified under a common framework based on the nature and structure of model errors. These results are derived using a multivariable version of Nyquist's stability theorem in which the minimum singular value of the return difference transfer matrix is shown to be the multivariable generalization of the distance to the critical point on a single input, single output Nyquist diagram. Using the return difference transfer matrix, a very general robustness theorem is presented from which all of the robustness tests dealing with specific model errors may be derived. The robustness tests that explicitly utilized model error structure are able to guarantee feedback system stability in the face of model errors of larger magnitude than those robustness tests that do not. The robustness of linear quadratic Gaussian control systems are analyzed.

Lehtomaki, N. A.↗

Development of a Ground Test and Analysis Protocol for NASA's NextSTEP Phase 2 Habitation Concepts

The NASA Next Space Technologies for Exploration Partnerships (NextSTEP) program is a public-private partnership model that seeks commercial development of deep space exploration capabilities to support human spaceflight missions around and beyond cislunar space. NASA first issued the Phase 1 NextSTEP Broad Agency Announcement to U.S. industries in 2014, which called for innovative cislunar habitation concepts that leveraged commercialization plans for low-Earth orbit. These habitats will be part of the Deep Space Gateway (DSG), the cislunar space station planned by NASA for construction in the 2020s. In 2016, Phase 2 of the NextSTEP program selected five commercial partners to develop ground prototypes. A team of NASA research engineers and subject matter experts (SMEs) have been tasked with developing the ground-test protocol that will serve as the primary means by which these Phase 2 prototypes will be evaluated. Since 2008, this core test team has successfully conducted multiple spaceflight analog mission evaluations utilizing a consistent set of operational tools, methods, and metrics to enable the iterative development, testing, analysis, and validation of evolving exploration architectures, operations concepts, and vehicle designs. The purpose of implementing a similar evaluation process for the Phase 2 Habitation Concepts is to consistently evaluate different commercial partner ground prototypes to provide data-driven, actionable recommendations for Phase 3. This paper describes the process by which the ground test protocol was developed and the objectives, methods, and metrics by which the NextSTEP Phase 2 Habitation Concepts will be rigorously and systematically evaluated. The protocol has been developed using both a top-down and bottom-up approach. Top-down development began with the Human Exploration and Operations Mission Directorate (HEOMD) exploration objectives and ISS Exploration Capability Study Team (IECST) candidate flight objectives. Strategic questions and associated rationales, derived from these candidate architectural objectives, provide the framework by which the ground-test protocol will address the DSG stack elements and configurations, systems and subsystems, and habitation, science, and EVA functions. From these strategic questions, high-level functional requirements for the DSG were drafted and associated ground-test objectives and analysis protocols were established. Bottom-up development incorporated objectives from NASA SMEs in autonomy, avionics and software, communication, environmental control and life support systems, exercise, extravehicular activity, exploration medical operations, guidance navigation and control, human factors and behavioral performance, human factors and habitability, logistics, Mission Control Center operations, power, radiation, robotics, safety and mission assurance, science, simulation, structures, thermal, trash management, and vehicle health. Top-down and bottom-up objectives were integrated to form overall functional requirements - ground-test objectives and analysis mapping. From this mapping, ground-test objectives were organized into those that will be evaluated through inspection, demonstration, analysis, subsystem standalone testing, and human-in-the-loop (HITL) testing. For the HITL tests, mission-like timelines, procedures, and flight rules have been developed to directly meet ground test objectives and evaluate specific functional requirements. Data collected from these assessments will be analyzed to determine the acceptability of habitation element configurations and the combinations of capabilities that will result in the best habitation platform to be recommended by the test team for Phase 3.

Gernhardt, Michael L.↗

MS25: Materials Science-Focused Benchmark Data Set for Machine Learning Interatomic Potentials

Here, we present MS25, a benchmark data set for evaluating machine learning interatomic potentials (MLIPs) across diverse materials-relevant systems including MgO surfaces, liquid water, zeolites, a catalytic Pt surface reaction, high-entropy alloys (HEAs), and disordered Zr-oxides. Five MLIP architectures (MACE, NequIP, Allegro, MTP, and Torch-ANI) are trained and tested, focusing not only on traditional metrics (energies, forces, and stresses) but also explicitly validating derived physical observables such as lattice constants, volumes, and reaction barriers. We find that most models reach comparable accuracy on standard error metrics across the simple systems, although equivariant MLIPs offer 1.5–2× improvements over nonequivariant MLIPs in energy and force error for structurally complex or compositionally disordered environments such as HEAs and Zr–O systems. Our analysis highlights that low errors in energy and force predictions do not guarantee reliable observables, emphasizing the necessity of explicit validation. We demonstrate limitations in cross-framework transferability, as models trained on one zeolite framework (CHA) fail to reliably generalize to predictions of structurally distinct frameworks (e.g., MFI). Size-extensive tests show some dependence on system size for MgO, resulting from forced periodicity. The HEA and Zr–O data sets are identified as challenging tests for future benchmarks and MLIP model architecture developments as they show significant differentiation in error between MLIP architectures and are still relatively difficult at 1000 training images. Moving forward, we recommend that benchmarking efforts shift their focus from marginal accuracy improvements in energy and force errors toward identifying and understanding model failure modes, rigorously assessing transferability, and evaluating how their errors affect observable predictions. For researchers looking to choose an MLIP architecture, we suggest selecting equivariant MLIP architectures if the complexity of the system is a challenge. For simple materials problems, auxiliary features such as integration with molecular dynamics engines, trade-offs between computational data set generation cost vs MLIP inference speed, and framework integration may play a more important decision factor than small differences in error metrics that are unlikely to matter for production-level research.

chemical structure↗

Practical Formal Verification of Diagnosability of Large Models via Symbolic Model Checking

This document reports on the activities carried out during a four-week visit of Roberto Cavada at the NASA Ames Research Center. The main goal was to test the practical applicability of the framework proposed, where a diagnosability problem is reduced to a Symbolic Model Checking problem. Section 2 contains a brief explanation of major techniques currently used in Symbolic Model Checking, and how these techniques can be tuned in order to obtain good performances when using Model Checking tools. Diagnosability is performed on large and structured models of real plants. Section 3 describes how these plants are modeled, and how models can be simplified to improve the performance of Symbolic Model Checkers. Section 4 reports scalability results. Three test cases are briefly presented, and several parameters and techniques have been applied on those test cases in order to produce comparison tables. Furthermore, comparison between several Model Checkers is reported. Section 5 summarizes the application of diagnosability verification to a real application. Several properties have been tested, and results have been highlighted. Finally, section 6 draws some conclusions, and outlines future lines of research.

Cavada, Roberto↗