Search NASA⌕ Search

SEARCH · Search NASA

Results for “scientific software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

A multimission three-axis stabilized spacecraft flight dynamics ground support system

The Multimission Three-Axis Stabilized Spacecraft (MTASS) Flight Dynamics Support System (FDSS) has been developed in an effort to minimize the costs of ground support systems. Unlike single-purpose ground support systems, which attempt to reduce costs by reusing software specifically developed for previous missions, the multimission support system is an intermediate step in the progression to a fully generalized mission support system in which numerous missions may be served by one general system. The benefits of multimission attitude ground support systems extend not only to the software design and coding process, but to the entire system environment, from specification through testing, simulation, operations, and maintenance. This paper reports the application of an MTASS FDSS to multiple scientific satellite missions. The satellites are the Upper Atmosphere Research Satellite (UARS), the Extreme Ultraviolet Explorer (EUVE), and the Solar Anomalous Magnetospheric Particle Explorer (SAMPEX). Both UARS and EUVE use the multimission modular spacecraft (MMS) concept. SAMPEX is part of the Small Explorer (SMEX) series and uses a much simpler set of attitude sensors. This paper centers on algorithm and design concepts for a multimission system and discusses flight experience from UARS.

Langston, J.↗

Extreme Mapping: Looking for Water on the Moon

There are many challenges when exploring extreme environments. Gathering accurate data to build maps about places that you cannot go is incredibly complex. NASA supports scientists by remotely operating robotic rovers to explore uncharted territories. One potential upcoming mission is to look for water near a lunar pole (the Resource Prospector mission). Learn about the technical hurdles and research steps that NASA takes before the mission. NASA practices on Earth with Mission Analogs which simulate the proposed mission. This includes going to lunar-type landscapes, building field networks, testing out rovers, instruments and operational procedures. NASA sets up remote science back rooms just as there are for actual missions. NASA develops custom Ground Data Systems software to support scientific mission planning and monitoring over variable time delays, and separate commanding software and infrastructure to operate the rovers.

MOON↗

Small Spacecraft for Planetary Atmospheric, Surface, and Interior Structure Using Radio Links

Scientific studies using spacecraft radio links have been conducted on almost every Solar System exploration mission in the past five decades and have led to numerous discoveries. Radio Science experiments have elucidated the thermal history of the Moon from high resolution gravitational field measurements, unveiled the interiors of Titan, Enceladus, Mercury, Phobos, Vesta and Ceres providing key evidence for identifying subsurface oceans on icy moons; sounded Titan, Saturn, and Pluto’s atmospheres, and refined models for the atmospheres, surfaces, and interior structure of Mars and Venus. A Juno experiment is in progress measuring the gravitational field of Jupiter to reveal its interior structures, as did a similar recent Cassini experiment with Saturn. Experiments at Mercury, the Jovian system, and other targets, are in development or planning phases. Over the next 30 years, significant advances in radio and laser link-science technologies, including nearly one order of magnitude improvement achievable in range-rate and range accuracy, could enable many new scientific breakthroughs. Future exploration concepts in many cases focus on applications of small spacecraft and can include spacecraft constellations for studies of atmospheric dynamics, interior structures, and surface properties. A set of science-enabling radio link technologies specific to small spacecraft instrumentation on future solar system missions are under study and development. Examples include field tests of radio scattering to determine soil properties, smallsat constellations for dense geographic and temporal atmospheric probing, small science-quality software-defined transponders, miniature ultra-stable oscillators, and advanced radio-metric calibrations at the Deep Space Network. This paper describes many of these technologies and their scientific applications.

Elliott, Harvey↗

Magellan mission planning and orbital operations

The goal of NASA's Magellan mission is to understand the geological and geophysical processes that have shaped the planet Venus. Through synthetic aperture radar, radiometric, altimetric, and gravity measurements, the scientific community hopes to improve its knowledge of the planet's topography and internal mass distribution. This paper provides an overview of the Magellan mission; describes the spacecraft sequence software design, development, and test; addresses the nominal operational flow of stored sequence design and generation; briefly describes the ground processing of engineering telemetry and imaging data; and then summarizes the Magellan operational experience with non-routine behavior of the spacecraft during the cruise and mapping portions of the prime mission.

Venus↗

Equilipy: a python package for calculating phase equilibria

The CALPHAD (CALculation of PHAse Diagram) approach (Nigel Saunders & Miodownik, 1998) provides predictions for thermodynamically stable phases in multicomponent-multiphase materials across a wide range of temperatures. Consequently, the CALPHAD calculations became an essential tool in materials and process design (Luo, 2015). Such design tasks frequently require navigating a high-dimensional space due to multiple components involved in the system. This increasing complexity demands high-throughput CALPHAD calculations, especially in the rapidly evolving field of alloy design. In response to the need, we developed Equilipy an open-source Python package designed for calculating phase equilibria of multicomponent-multiphase systems. Equilipy is specifically tailored for high-throughput CALPHAD calculations, offering parallel computations across multiple processors and nodes with the given NPT input conditions namely elemental compositions (N), pressure (P), and temperature (T). Equilipy utilizes the program structure and Gibbs energy functions from the Fortran-based program, Thermochimica (Piro et al., 2013), with incorporating a new Gibbs energy minimization algorithm. This algorithm, originally developed by Capitani and Brown in 1987 (Capitani & Brown, 1987), has been revised and implemented to enhance the stability and performance of calculations. The Fortran codes are precompiled and interfaced with Python via F2PY, ensuring high computation speed. Benchmark tests shown in Figure 1 demonstrate that Equilipy’s computation speed is comparable to those of established commercial software, TC-Python and PanPython. This result highlights its efficiency and potential applications in various scientific and industrial fields.

97 MATHEMATICS AND COMPUTING↗

Field and data analysis studies related to the atmospheric environment

This report summarizes work on a broad array of projects including: (1) applications of meteorological and/or oceanographic satellites; (2) improvement of the current set of NASA/USAF lightning related launch commit criteria rules; (3) the design, building, testing and deployment of a set of cylindrical field mills for aircraft use; (4) the study of marginal electrification storm conditions in relationship to the current launch commit rules for the space shuttle and various other launch vehicles using an instrumented aircraft; (5) support of the DC-8 and ER-2 lightning instrument package as part of both the Tropical Ocean - Global Atmospheric/Coupled Ocean-Atmospheric Response Experiment and the Convection and Moisture Experiment; (6) design of electronic circuitry and microprocessor firmware for the NASA Advanced Ground Based Field Mill; (7) design and testing of electronic and computer instrumentation for atmospheric electricity measurements; (8) simulating observations from a lightning imaging sensor on the Tropical Rainfall Measuring satellite; and (9) supporting scientific visualization and the development of computer software tools.

Kidder, Stanley↗

Software engineering to sustain a high-performance computing scientific application: QMCPACK

We provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum MonteCarlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion ofcontinuous integration (CI) targeting CPU, using GitHub Actions runners, and graphics processing units (GPU) in pre-exascalesystems, using self-hosted hardware; (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Dockercontainers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, sustainable maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the sustainability of community HPC codes and scientific discovery at scale.

Godoy, William↗

An Open-Source Framework for Rapid Validation of Scientific ASICs

Spacely is an open-source framework for the post-silicon validation of analog, digital, and mixed-signal ASICs (Application-Specific Integrated Circuits) which maximizes the reuse of hardware and software, reducing the time taken to achieve meaningful test results. Spacely specifically addresses the needs of small, flexible ASIC design teams commonly found in academia or research institutions which benefit most from sharing the overhead of test stand creation between many unique ASIC designs. Spacely is a set of software, firmware, and design practices. It targets two primary hardware platforms (NI-PXI and Caribou) as well as offering extensible support for bench instruments. Spacely provides a high-level Python interface to all test hardware for accessibility, while also giving more sophisticated teams the opportunity to integrate custom test firmware. The design principles of Spacely are presented in brief. Current documentation is available at https://github.com/SpacelyProject/spacely-docs.

Quinn, Adam [Fermilab]↗

An Open-Source Framework for Rapid Validation of Scientific ASICs

Spacely is an open-source framework for the post-silicon validation of analog, digital, and mixed-signal ASICs (Application-Specific Integrated Circuits) which maximizes the reuse of hardware and software, reducing the time taken to achieve meaningful test results. Spacely specifically addresses the needs of small, flexible ASIC design teams commonly found in academia or research institutions which benefit most from sharing the overhead of test stand creation between many unique ASIC designs. Spacely is a set of software, firmware, and design practices. It targets two primary hardware platforms (NI-PXI and Caribou) as well as offering extensible support for bench instruments. Spacely provides a high-level Python interface to all test hardware for accessibility, while also giving more sophisticated teams the opportunity to integrate custom test firmware. The design principles of Spacely are presented, along with a demonstrative example of using Spacely to test a pixel detector readout ASIC.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Software Deployment Process at NERSC: Deploying the Extreme-scale Scientific Software Stack (E4S) Using Spack at the National Energy Research Scientific Computing Center (NERSC)

One of the many benefits of using a high-performance computing (HPC) system at a Department of Energy (DOE) Office of Science (SC) HPC facility is the large number of software products, built and optimized for the system. The HPC center staff and HPC vendors provide optimized software such as libraries and even full scientific applications, ready to be used by users as building blocks to accelerate scientific discovery. Behind each provided packaged software module are a large number of decisions - which compiler, optimizations, variants/options - to build the software on the target system. And, even before the software gets deployed, the software must be developed, tested, and maintained, including deprecating old versions and ensuring compatibility across versions. The software lifecycle is complex and is further convoluted by a web of interdependencies on other software.

97 MATHEMATICS AND COMPUTING↗

Overview and Initial Results of SAND-E: Semi-Autonomous Navigation for Detrital Environments

Unmanned aerial systems (UAS) and automated terrain analysis for science and navigation are new technologies for planetary exploration. The Mars Helicopter will fly with the Mars2020 rover, the Dragonfly quadcopter will explore Titan, and Soil Properties and Object Classification (SPOC) software will be used for path planning and navigation on the Mars2020 rover. Using an Argo J5 rover instrumented with stereo cameras and Autonomous Soil Assessment System (ASAS) software, and an off the shelf quadcopter, SAND-E tested the use of automated terrain analysis and UAS data for science operations in a Mars-analog environment in Iceland during July of 2019. Scientifically, we sought to determine changes in the physical and chemical properties of sediments along a glacial-fluvial-aeolian transport pathway. Operationally, we tested rover mission-like scenarios that included UAS images and classified terrain images. Here, we present the initial results for both the operations and science elements of the study. Site Selection: A goal of SAND-E is examine sorting and alteration of sediments in fluvial and aeolian environments in both mineral-dominated and glass-dominated basaltic settings. During the first year of the project we focused on a mineral-dominated environment. Selection of the location was based on prior publications that indicated our selected region had a greater abundance of crystalline sediments than other areas fluvial-aeolian settings in Iceland. Other criteria included the presence of both fluvial and aeolian landforms along a transport pathway such that the sediments in transport could be linked to their source rocks. We chose the Skjaldbreidauhraun glacial outwash plain, which sits at the base of Thórisjökull glacier. The site is 30 km north of Thingvellir National Park and ~2 hours from Reykjavik. The outwash plain is fed by two small catchments that drain from the base of the glacier and cut through hyaloclastite and shield volcano bedrock. The drainage progresses from steep alluvial fans near the glacier into a low-sloping fluvial braidplain that becomes confined by the Skjaldbreidur shield volcano and creates a shallow canyon cut into lava bedrock. The fluvial system was a typical braided alluvial environment composed pebble- and cobble-bedded longitudinal bars and sandy channel beds. The river remained active and fluctuated in response to diurnal runoff cycles near the glacier before disappearing into the sandy substrate downstream. The high concentration of suspended sediment in the river was evident by the cloudy water and the silt and clay-sized sediments that draped the channel beds after abandonment and created playas in the lowest sloping areas of the catchment. The entire fluvial system was affected by the winds generated by frontal systems and katabatic flows descending the glacier. This resulted in the formation of aeolian lag deposits and a wind-deflation plain where the fluvial system was not active. Wind ripples and drifts formed in abandoned fluvial channels from aeolian reworking of the sand-sized fluvial sediments. The silt- and clay-sized sediments found in fluvial channels, bar tops, and playas generated dust plumes during high wind events. Our operation sought to capture the variability in this system by sampling from the range of fluvial and aeolian features 6.3 km (proximal), 11.3 km (medial), and 14.4 km (distal) along the river from its origin at the base of glacier.

Ewing, R. C.↗

Software stewardship and advancement of a high-performance computing scientific application: QMCPACK

Here, we provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum Monte Carlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion of continuous integration (CI) targeting CPUs, using GitHub Actions own runners, and NVIDIA and AMD GPUs used in pre-exascale systems, (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Docker containers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the stewardship and advancement of community HPC codes to enable scientific discovery at scale.

97 MATHEMATICS AND COMPUTING↗

GMctdospp: Description and validation of a CT dose calculation system

Purpose: To develop a Monte Carlo (MC)-based computed tomography (CT) dose estimation method with a graphical user interface with options to define almost arbitrary simulation scenarios, to make calculations sufficiently fast for comfortable handling, and to make the software free of charge for general availability to the scientific community. Methods: A framework called GMctdospp was developed to calculate phantom and patient doses with the MC method based on the EGSnrc system. A CT scanner was modeled for testing and was adapted to half-value layer, beam-shaping filter, z-profile, and tube-current modulation (TCM). To validate the implemented variance reduction techniques, depth-dose and cross-profile calculations of a static beam were compared against DOSXYZnrc/EGSnrc. Measurements for beam energies of 80 and 120 kVp at several positions of a CT dose-index (CTDI) standard phantom were compared against calculations of the created CT model. Finally, the efficiency of the adapted code was benchmarked against EGSnrc defaults. Results: The CT scanner could be modeled accurately. The developed TCM scheme was confirmed by the dose measurement. A comparison of calculations to DOSXYZnrc showed no systematic differences. Measurements in a CTDI phantom could be reproduced within 2% average, with a maximal difference of about 6%. Efficiency improvements of about six orders of magnitude were observed for larger organ structures of a chest-examination protocol in a voxelized phantom. In these cases, simulations took 25 s to achieve a statistical uncertainty of ∼0.5%. Conclusions: A fast dose-calculation system for phantoms and patients in a CT examination was developed, successfully validated, and benchmarked. Influences of scan protocols, protection method, and other issues can be easily examined with the developed framework.

60 APPLIED LIFE SCIENCES↗

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗

Construction of an advanced software tool for planetary atmospheric modeling

Scientific model-building can be a time intensive and painstaking process, often involving the development of large complex computer programs. Despite the effort involved, scientific models cannot be distributed easily and shared with other scientists. In general, implemented scientific models are complicated, idiosyncratic, and difficult for anyone but the original scientist/programmer to understand. We propose to construct a scientific modeling software tool that serves as an aid to the scientist in developing, using and sharing models. The proposed tool will include an interactive intelligent graphical interface and a high-level domain-specific modeling language. As a test bed for this research, we propose to develop a software prototype in the domain of planetary atmospheric modeling.

Friedland, Peter↗

General Purpose Fortran Program for Discrete-Ordinate-Method Radiative Transfer in Scattering and Emitting Layered Media: An Update of DISORT

This update reports a state-of-the-art discrete ordinate algorithm for monochromatic unpolarized radiative transfer in non-isothermal, vertically inhomogeneous, but horizontally homogeneous media. The physical processes included are Planckian thermal emission, scattering with arbitrary phase function, absorption, and surface bidirectional reflection. The system may be driven by parallel or isotropic diffuse radiation incident at the top boundary, as well as by internal thermal sources and thermal emission from the boundaries. Radiances, fluxes, and mean intensities are returned at user-specified angles and levels. DISORT has enjoyed considerable popularity in the atmospheric science and other communities since its introduction in 1988. Several new DISORT features are described in this update: intensity correction algorithms designed to compensate for the 8-M forward-peak scaling and obtain accurate intensities even in low orders of approximation; a more general surface bidirectional reflection option; and an exponential-linear approximation of the Planck function allowing more accurate solutions in the presence of large temperature gradients. DISORT has been designed to be an exemplar of good scientific software as well as a program of intrinsic utility. An extraordinary effort has been made to make it numerically well-conditioned, error-resistant, and user-friendly, and to take advantage of robust existing software tools. A thorough test suite is provided to verify the program both against published results, and for consistency where there are no published results. This careful attention to software design has been just as important in DISORT's popularity as its powerful algorithmic content.

Tsay, Si-Chee↗

The LSST DESC DC2 Simulated Sky Survey

Here, we describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses this interconnectivity in a way that has not been attempted before. This effort encompasses a full end-to-end approach: starting from a large N-body simulation, through setting up LSST-like observations including realistic cadences, through image simulations, and finally processing with Rubin's LSST Science Pipelines. This last step ensures that we generate data products resembling those to be delivered by the Rubin Observatory as closely as is currently possible. The simulated DC2 sky survey covers six optical bands in a wide-fast-deep area of approximately 300 deg 2 , as well as a deep drilling field of approximately 1 deg 2 . We simulate 5 yr of the planned 10 yr survey. The DC2 sky survey has multiple purposes. First, the LSST DESC working groups can use the data set to develop a range of DESC analysis pipelines to prepare for the advent of actual data. Second, it serves as a realistic test bed for the image processing software under development for LSST by the Rubin Observatory. In particular, simulated data provide a controlled way to investigate certain image-level systematic effects. Finally, the DC2 sky survey enables the exploration of new scientific ideas in both static and time domain cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗

Fractals and Spatial Methods for Mining Remote Sensing Imagery

The rapid increase in digital remote sensing and GIS data raises a critical problem -- how can such an enormous amount of data be handled and analyzed so that useful information can be derived quickly? Efficient handling and analysis of large spatial data sets is central to environmental research, particularly in global change studies that employ time series. Advances in large-scale environmental monitoring and modeling require not only high-quality data, but also reliable tools to analyze the various types of data. A major difficulty facing geographers and environmental scientists in environmental assessment and monitoring is that spatial analytical tools are not easily accessible. Although many spatial techniques have been described recently in the literature, they are typically presented in an analytical form and are difficult to transform to a numerical algorithm. Moreover, these spatial techniques are not necessarily designed for remote sensing and GIS applications, and research must be conducted to examine their applicability and effectiveness in different types of environmental applications. This poses a chicken-and-egg problem: on one hand we need more research to examine the usability of the newer techniques and tools, yet on the other hand, this type of research is difficult to conduct if the tools to be explored are not accessible. Another problem that is fundamental to environmental research are issues related to spatial scale. The scale issue is especially acute in the context of global change studies because of the need to integrate remote-sensing and other spatial data that are collected at different scales and resolutions. Extrapolation of results across broad spatial scales remains the most difficult problem in global environmental research. There is a need for basic characterization of the effects of scale on image data, and the techniques used to measure these effects must be developed and implemented to allow for a multiple scale assessment of the data before any useful process-oriented modeling involving scale-dependent data can be conducted. Through the support of research grants from NASA, we have developed a software module called ICAMS (Image Characterization And Modeling System) to address the need to develop innovative spatial techniques and make them available to the broader scientific communities. ICAMS provides new spatial techniques, such as fractal analysis, geostatistical functions, and multiscale analysis that are not easily available in commercial GIS/image processing software. By bundling newer spatial methods in a user-friendly software module, researchers can begin to test and experiment with the new spatial analysis methods and they can gauge scale effects using a variety of remote sensing imagery. In the following, we describe briefly the development of ICAMS and present application examples.

Lam, Nina↗