Search NASA⌕ Search

SEARCH · Search NASA

Results for “software metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
NASA NTRS2026

PROTECT: Production and Reuse of Thermally Efficient Ceramic Thermal Protection Systems

PROTECT (Production and Reuse Of Thermally Efficient Ceramic TPS) is a NASA Early Career Initiative focused on developing the next generation of reusable ceramic thermal protection systems (TPS). This project addresses key challenges in TPS design, including temperature capability, thermal stability, and refurbishment time, by integrating novel material development with predictive modeling. Leveraging enhanced capabilities in NASA’s Porous Microstructure Analysis (PuMA) software, PROTECT introduces new modeling tools to predict the thermal and mechanical behavior of fibrous ceramic materials. These tools enable accurate prediction of performance metrics such as thermal conductivity and structural integrity, reducing reliance on costly physical testing. Preliminary advances in these areas will be presented. To support model validation, PROTECT is building a comprehensive database of raw material properties using advanced characterization techniques, including micro computed tomography (CT) scanning in collaboration with the University of Illinois Urbana-Champaign (UIUC). The presentation will detail the sampling workflows and analysis methods used to generate this detailed microstructural data and how it is used to develop improved models in PuMA. This multi-center collaboration, spanning NASA (JSC, ARC, KSC, GRC), Oak Ridge National Laboratory, UIUC, and SpaceX, is developing tailored TPS solutions for LEO, lunar, and Martian missions. By bridging heritage systems with the demands of modern spaceflight, PROTECT contributes to the advancement of reusable TPS technologies for future exploration missions.

Propulsion, Refractory, and Coating Materials↗
NASA NTRS2026

PROTECT: Production and Reuse of Thermally Efficient Ceramic Thermal Protection Systems

PROTECT (Production and Reuse Of Thermally Efficient Ceramic TPS) is a NASA Early Career Initiative focused on developing the next generation of reusable ceramic thermal protection systems (TPS). This project addresses key challenges in TPS design, including temperature capability, thermal stability, and refurbishment time, by integrating novel material development with predictive modeling. Leveraging enhanced capabilities in NASA’s Porous Microstructure Analysis (PuMA) software, PROTECT introduces new modeling tools to predict the thermal and mechanical behavior of fibrous ceramic materials. These tools enable accurate prediction of performance metrics such as thermal conductivity and structural integrity, reducing reliance on costly physical testing. Preliminary advances in these areas will be presented. To support model validation, PROTECT is building a comprehensive database of raw material properties using advanced characterization techniques, including micro computed tomography (CT) scanning in collaboration with the University of Illinois Urbana-Champaign (UIUC). The presentation will detail the sampling workflows and analysis methods used to generate this detailed microstructural data and how it is used to develop improved models in PuMA. This multi-center collaboration, spanning NASA (JSC, ARC, KSC, GRC), Oak Ridge National Laboratory, UIUC, and SpaceX, is developing tailored TPS solutions for LEO, lunar, and Martian missions. By bridging heritage systems with the demands of modern spaceflight, PROTECT contributes to the advancement of reusable TPS technologies for future exploration missions.

Propulsion, Refractory, and Coating Materials↗
NASA NTRS2005

INDUCTIVE SYSTEM HEALTH MONITORING WITH STATISTICAL METRICS

Model-based reasoning is a powerful method for performing system monitoring and diagnosis. Building models for model-based reasoning is often a difficult and time consuming process. The Inductive Monitoring System (IMS) software was developed to provide a technique to automatically produce health monitoring knowledge bases for systems that are either difficult to model (simulate) with a computer or which require computer models that are too complex to use for real time monitoring. IMS processes nominal data sets collected either directly from the system or from simulations to build a knowledge base that can be used to detect anomalous behavior in the system. Machine learning and data mining techniques are used to characterize typical system behavior by extracting general classes of nominal data from archived data sets. In particular, a clustering algorithm forms groups of nominal values for sets of related parameters. This establishes constraints on those parameter values that should hold during nominal operation. During monitoring, IMS provides a statistically weighted measure of the deviation of current system behavior from the established normal baseline. If the deviation increases beyond the expected level, an anomaly is suspected, prompting further investigation by an operator or automated system. IMS has shown potential to be an effective, low cost technique to produce system monitoring capability for a variety of applications. We describe the training and system health monitoring techniques of IMS. We also present the application of IMS to a data set from the Space Shuttle Columbia STS-107 flight. IMS was able to detect an anomaly in the launch telemetry shortly after a foam impact damaged Columbia's thermal protection system.

Iverson, David L.↗
DOE OSTI2026

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗
DOE OSTI2026

Classical combinatorial optimization scaling for random Ising models on 2D heavy-hex graphs

Motivated by near term quantum computing hardware limitations, combinatorial optimization problems that can be addressed by current quantum algorithms and noisy hardware with little or no overhead are used to probe capabilities of quantum algorithms such as the quantum approximate optimization algorithm. In this study, a specific class of near term quantum computing hardware defined combinatorial optimization problems, Ising models on heavy-hex graphs both with and without geometrically local cubic terms, are examined for their classical computational hardness via empirical computation time scaling quantification. Specifically the time-to-solution (TTS) metric using the classical heuristic simulated annealing is measured for finding optimal variable assignments (ground states), as well as the time required for the optimization software Gurobi to find an optimal variable assignment. Because of the sparsity of these Ising models, the classical algorithms are able to find optimal solutions efficiently even for large instances (i.e. 100 000 spin variables). The Ising models both with and without geometrically local cubic terms exhibit average-case linear-time or weakly quadratic scaling when solved exactly using Gurobi, and the Ising models with no cubic terms show evidence of exponential-time TTS scaling when sampled using simulated annealing. These findings point to the necessity of developing and testing more complex, namely more densely connected, optimization problems in order for quantum computing to ever have a practical advantage over classical computing. Our results are another illustration that different classical algorithms can indeed have exponentially different running times, thus making the identification of the best practical classical technique important in any quantum computing vs. classical computing comparison.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS1991

Rule groupings: A software engineering approach towards verification of expert systems

Currently, most expert system shells do not address software engineering issues for developing or maintaining expert systems. As a result, large expert systems tend to be incomprehensible, difficult to debug or modify and almost impossible to verify or validate. Partitioning rule based systems into rule groups which reflect the underlying subdomains of the problem should enhance the comprehensibility, maintainability, and reliability of expert system software. Attempts were made to semiautomatically structure a CLIPS rule base into groups of related rules that carry the same type of information. Different distance metrics that capture relevant information from the rules for grouping are discussed. Two clustering algorithms that partition the rule base into groups of related rules are given. Two independent evaluation criteria are developed to measure the effectiveness of the grouping strategies. Results of the experiment with three sample rule bases are presented.

Mehrotra, Mala↗
NASA NTRS1995

The widest practicable dissemination: The NASA technical report server

The search for innovative methods to distribute NASA's information lead a gross-roots team to create the NASA Technical Report Server (NTRS), which uses the World Wide Web and other popular Internet-based information systems as search engines. The NTRS is an inter-center effort which provides uniform access to various distributed publication servers residing on the Internet. Users have immediate desktop access to technical publications from NASA centers and institutes. This paper presents the NTRS architecture, usage metrics, and the lessons learned while implementing and maintaining the services over the initial 6-month period. The NTRS is largely constructed with freely available software running on existing hardware. NTRS builds upon existing hardware and software, and the resulting additional exposure for the body of literature contained will allow NASA to ensure that its institutional knowledge base will continue to receive the widest practicable and appropriate dissemination.

Nelson, Michael L.↗
NASA NTRS1995

The Widest Practicable Dissemination: The NASA Technical Report Server

The National Aeronautics and Space Act of 1958 established NASA and charged it to "provide for the widest practicable and appropriate dissemination of information concerning [...] its activities and the results thereof." The search for innovative methods to distribute NASA s information lead a grass-roots team to create the NASA Technical Report Server (NTRS), which uses the World Wide Web and other popular Internet-based information systems as search engines. The NTRS is an inter-center effort which provides uniform access to various distributed publication servers residing on the Internet. Users have immediate desktop access to technical publications from NASA centers and institutes. The NTRS is comprised of several units, some constructed especially for inclusion in NTRS, and others that are existing NASA publication services that NTRS reuses. This paper presents the NTRS architecture, usage metrics, and the lessons learned while implementing and maintaining the services over the initial 6-month period. The NTRS is largely constructed with freely available software running on existing hardware. NTRS builds upon existing hardware and software, and the resulting additional exposure for the body of literature contained will allow NASA to ensure that its institutional knowledge base will continue to receive the widest practicable and appropriate dissemination.

Nelson, Michael L.↗
NASA NTRSDate not supplied

Lessons Learned on Mega-Constellation Deployments and Impact to Space Domain Awareness

The breakneck expansion of multi-payload launches in low Earth orbit (LEO) has seen significant escalation over the last three years in the Space Domain Awareness (SDA) enterprise. The uptick in satellite deployment frequency, gradation of Mega-constellation deployments utilizing electric propulsion, and surge in metric observation density from the Space Surveillance Network (SSN) have imposed major system enhancements to ensure spaceflight safety. Beginning with the launch phase, new tactics, software, and procedures have been developed over the last few years to optimize the tasking of the SSN and ensure custody of all recently launched satellites that are added to the space catalog. Ensuring appropriate tasking levels were pivotal during the satellite separation phase, which necessitated updates to the mission systems for improved delineation between clustered satellites in a short window of time. The improved incorporation of utilizing owner operator provided ephemeris coupled with critical code improvements have now revolutionized how we maintain custody of earth orbiting objects. The exponential population growth of low-Earth orbiting satellites have also increased the quantity of Conjunction Data Messages sent out to partners such as the Trajectory Operations Group (TOPO) in Johnson Space Center. We will discuss the need for continued collaboration between the National Aeronautics and Space Administration (NASA) and other Mega-Constellation Satellite Operators to safeguard Human Space Flight operations. Lastly, we will discuss the increase in reentry reporting for satellites falling back to Earth’s atmosphere, and the challenges associated with these events.

Christian C Ramos↗
NASA NTRSDate not supplied

Lessons Learned on Mega-Constellation Deployments and Impact to Space Domain Awareness

The breakneck expansion of multi-payload launches in low Earth orbit (LEO) has seen significant escalation over the last three years in the Space Domain Awareness (SDA) enterprise. The uptick in satellite deployment frequency, gradation of mega-constellation deployments utilizing electric propulsion, and surge in metric observation density from the Space Surveillance Network (SSN) have driven major system enhancements to ensure spaceflight safety. Beginning with the launch phase, new tactics, software, and procedures have been developed over the last few years to optimize the tasking of the SSN and ensure custody of all recently launched satellites that are added to the space catalog. Ensuring appropriate tasking levels were pivotal during the satellite separation phase, which necessitated updates to the mission systems for improved delineation between clustered satellites in a short window of time. The improved incorporation of utilizing satellite owner/operator-provided ephemeris coupled with critical code improvements have revolutionized how we maintain custody of Earth orbiting objects. The exponential population growth of Low-Earth orbiting satellites have also increased the quantity of Conjunction Data Messages sent out to partners such as the Trajectory Operations Group (TOPO) in Johnson Space Center. We will discuss the need for continued collaboration between the National Aeronautics and Space Administration (NASA) and other mega-constellation satellite operators to safeguard human spaceflight operations. Lastly, we will discuss how mega-constellations are driving best practices for safe operations across the space community.

Christian Ramos↗
NASA NTRS1994

Software For Monitoring VAX Computer Systems

VAX Continuous Monitoring System (VAXCMS) computer program developed at NASA Headquarters to aid system managers in monitoring performances of VAX computer systems through generation of graphic images summarizing trends in performance metrics over time. VAXCMS written in DCL and VAX FORTRAN for use with DEC VAX-series computers running VMS 5.1 or later.

Farkas, Les↗
NASA NTRS1995

The widest practicable dissemination: The NASA technical report server

The National Aeronautics and Space Act of 1958 established NASA and charged it to 'provide for the widest practicable and appropriate dissemination of information concerning...its activities and the results thereof.' The search for innovative methods to distribute NASA's information lead a grass-roots team to create the NASA Technical Report Server (NTRS), which uses the World Wide Web and other popular Internet-based information systems as search engines. The NTRS is an inter-center effort which provides uniform access to various distributed publication servers residing on the Internet. Users have immediate desktop access to technical publications from NASA centers and institutes. The NTRS is comprised of several units, some constructed especially for inclusion in NTRS, and others that are existing NASA publication services that NTRS reuses. This paper presents the NTRS architecture, usage metrics, and the lessons learned while implementing and maintaining the services over the initial six-month period. The NTRS is largely constructed with freely available software running on existing hardware. NTRS builds upon existing hardware and software, and the resulting additional exposure for the body of literature contained will allow NASA to ensure that its institutional knowledge base will continue to receive the widest practicable and appropriate dissemination.

Nelson, Michael L.↗
NASA NTRS2010

Rapid Response Risk Assessment in New Project Development

A capability for rapidly performing quantitative risk assessments has been developed by JSC Safety and Mission Assurance for use on project design trade studies early in the project life cycle, i.e., concept development through preliminary design phases. A risk assessment tool set has been developed consisting of interactive and integrated software modules that allow a user/project designer to assess the impact of alternative design or programmatic options on the probability of mission success or other risk metrics. The risk and design trade space includes interactive options for selecting parameters and/or metrics for numerous design characteristics including component reliability characteristics, functional redundancy levels, item or system technology readiness levels, and mission event characteristics. This capability is intended for use on any project or system development with a defined mission, and an example project will used for demonstration and descriptive purposes, e.g., landing a robot on the moon. The effects of various alternative design considerations and their impact of these decisions on mission success (or failure) can be measured in real time on a personal computer. This capability provides a high degree of efficiency for quickly providing information in NASA s evolving risk-based decision environment

Graber, Robert R.↗
NASA NTRS2014

Coupled Solid Rocket Motor Ballistics and Trajectory Modeling for Higher Fidelity Launch Vehicle Design

Multi-stage launch vehicles with solid rocket motors (SRMs) face design optimization challenges, especially when the mission scope changes frequently. Significant performance benefits can be realized if the solid rocket motors are optimized to the changing requirements. While SRMs represent a fixed performance at launch, rapid design iterations enable flexibility at design time, yielding significant performance gains. The streamlining and integration of SRM design and analysis can be achieved with improved analysis tools. While powerful and versatile, the Solid Performance Program (SPP) is not conducive to rapid design iteration. Performing a design iteration with SPP and a trajectory solver is a labor intensive process. To enable a better workflow, SPP, the Program to Optimize Simulated Trajectories (POST), and the interfaces between them have been improved and automated, and a graphical user interface (GUI) has been developed. The GUI enables real-time visual feedback of grain and nozzle design inputs, enforces parameter dependencies, removes redundancies, and simplifies manipulation of SPP and POST's numerous options. Automating the analysis also simplifies batch analyses and trade studies. Finally, the GUI provides post-processing, visualization, and comparison of results. Wrapping legacy high-fidelity analysis codes with modern software provides the improved interface necessary to enable rapid coupled SRM ballistics and vehicle trajectory analysis. Low cost trade studies demonstrate the sensitivities of flight performance metrics to propulsion characteristics. Incorporating high fidelity analysis from SPP into vehicle design reduces performance margins and improves reliability. By flying an SRM designed with the same assumptions as the rest of the vehicle, accurate comparisons can be made between competing architectures. In summary, this flexible workflow is a critical component to designing a versatile launch vehicle model that can accommodate a volatile mission scope.

Ables, Brett↗
NASA NTRS2015

Distributed Space Mission Design for Earth Observation Using Model-Based Performance Evaluation

Distributed Space Missions (DSMs) are gaining momentum in their application to earth observation missions owing to their unique ability to increase observation sampling in multiple dimensions. DSM design is a complex problem with many design variables, multiple objectives determining performance and cost and emergent, often unexpected, behaviors. There are very few open-access tools available to explore the tradespace of variables, minimize cost and maximize performance for pre-defined science goals, and therefore select the most optimal design. This paper presents a software tool that can multiple DSM architectures based on pre-defined design variable ranges and size those architectures in terms of predefined science and cost metrics. The tool will help a user select Pareto optimal DSM designs based on design of experiments techniques. The tool will be applied to some earth observation examples to demonstrate its applicability in making some key decisions between different performance metrics and cost metrics early in the design lifecycle.

Constellation↗
NASA NTRSDate not supplied

Tomography Analysis of Orion Artemis 1 Heatshield Sample

The Orion spacecraft, under NASA's Artemis program, is an integral step in humanity's ambitions of deep space exploration, including our return to the Moon and subsequent mission to Mars. The performance of Orion's heatshield is central to ensuring the safety and success of such missions. This presentation offers a comprehensive overview of the process used in and findings derived from tomography scans of an Artemis 1 heatshield sample executed at the Lawrence Berkeley National Laboratory's Advanced Light Source. These tomography scans captured high-resolution X-Ray images of the heatshield's microstructure, allowing advanced imaging to be employed for 3D image segmentation and visualization of the sample. The Porous Media Analysis (PuMA) software stands central to our analysis, offering robust computational algorithms and methodologies to digitally compute properties of the heatshield material. The presentation discusses the following derived metrics: - Volume fractions, representing the spatial distribution and amounts of various components throughout the heatshield’s depth. - Porosity and crack distributions, offering insights into the void space within the material, critical for understanding the heatshield's structural integrity. - Fiber orientation, detailing the alignment and arrangement of fibers, significant for material orthotropy. - Permeability estimates, quantifying the passage of gas through the material, relevant for re-entry conditions and pyrolysis gasses. One distinctive feature of this study is the comparative evaluation against data obtained from tomography scans of the Exploration Flight Test-1 (EFT-1) heatshield. Such a comparison offers multiple insights, including evaluation of the consistency and repeatability of manufacturing processes as well as understanding of any evolutionary changes in heatshield design or material properties.

Micro-tomography↗
NASA NTRS2021

Casual Rerouting of AERONET Sun/Sky Photometers: Toward a New Network of Ground Measurements Dedicated to the Monitoring of Surface Properties?

This paper presents an innovative method for observing vegetation health at a very high spatial resolution (~5 × 5 cm) and low cost by upgrading an existing Aerosol RObotic NETwork (AERONET) ground station dedicated to the observation of aerosols in the atmosphere. This study evaluates the capability of a sun/sky photometer to perform additional surface reflectance observations. The ground station of Toulouse, France, which belongs to the AERONET sun/sky photometer network, is used for this feasibility study. The experiment was conducted for a 5-year period (between 2016 and 2020). The sun/sky photometer was mounted on a metallic structure at a height of 2.5 m, and the acquisition software was adapted to add a periodical (every hour) ground-observation scenario with the sun/sky photometer observing the surface instead of being inactive. Evaluation is performed by using a classical metric characterizing the vegetation health: the normalized difference vegetation index (NDVI), using as reference the satellite NDVI derived from a Sentinel-2 (S2) sensor at 10 × 10 m resolution. Comparison for the 5-year period showed good agreement between the S2 and sun/sky photometer NDVIs (i.e., bias = 0.004, RMSD = 0.082, and R = 0.882 for a mean value of S2A NDVI around 0.6). Discrepancies could have been due to spatial-representativeness issues (of the ground measurement compared to S2), the differences between spectral bands, and the quality of the atmospheric correction applied on S2 data (accuracy of the sun/sky photometer instrument was better than 0.1%). However, the accuracy of the atmospheric correction applied on S2 data in this station appeared to be of good quality, and no dependence on the presence of aerosols was observed. This first analysis of the potential of the CIMEL CE318 sun/sky photometer to monitor the surface is encouraging. Further analyses need to be carried out to estimate the potential in different AERONET stations. The occasional rerouting of AERONET stations could lead to a complementary network of surface reflectance observations. This would require an update of the software, and eventual adaptations of the measurement platforms to the station environments. The additional cost, based on the existing AERONET network, would be quite limited. These new surface measurements would be interesting for measurements of vegetation health (monitoring of NDVI, and also of other vegetation indices such as the leaf area and chlorophyll indices), for validation and calibration exercise purposes, and possibly to refine various scientific algorithms (i.e., algorithms dedicated to cloud detection or the AERONET aerosol retrieval algorithm itself). CIMEL is ready to include the ground scenario used in this study in all new sun/sky photometers.

Dominique Carrer↗
DOE OSTI2024

Software stewardship and advancement of a high-performance computing scientific application: QMCPACK

Here, we provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum Monte Carlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion of continuous integration (CI) targeting CPUs, using GitHub Actions own runners, and NVIDIA and AMD GPUs used in pre-exascale systems, (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Docker containers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the stewardship and advancement of community HPC codes to enable scientific discovery at scale.

97 MATHEMATICS AND COMPUTING↗