Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

Accuracy, Scalability, and Efficiency of Mixed-Element USM3D for Benchmark Three-Dimensional Flows

The unstructured, mixed-element, cell-centered, finite-volume flow solver USM3D is enhanced with new capabilities including parallelization, line generation for general unstructured grids, improved discretization scheme, and optimized iterative solver. The paper reports on the new developments to the flow solver and assesses the accuracy, scalability, and efficiency. The USM3D assessments are conducted using a baseline method and the recent hierarchical adaptive nonlinear iteration method framework. Two benchmark turbulent flows, namely, a subsonic separated flow around a three-dimensional hemisphere-cylinder configuration and a transonic flow around the ONERA M6 wing are considered.

Pandya, Mohagna J.↗

Verification Benchmarks and Validation of MAT261 for High Energy Dynamic Impact Applications

Advanced computational methods for composite structures can enable smarter testing and potentially certification by analysis. These methods, known as progressive damage and failure analysis (PDFA) methods, can predict lamina level mechanics including failure and subsequent propagation. When introduced into a commercial off the shelf finite element solver such as ABAQUS, LS-DYNA, or ANSYS, it enables end users to effectively exercise PDFA methods; however, it requires an understanding of the assumed mechanics and underlying coded response. In this paper, verification benchmarks developed under the NASA Advanced Composite Consortium for a class of PDFA methods known as continuum damage mechanics approaches are applied to the native LS-DYNA material model MAT261. As a result of the verification, an instability was discovered and subsequently corrected with an engineering solution. The results of the preliminary MAT261 simulations for high energy dynamic impact and the engineering solution are compared and a discussion about the significance is presented.

Molitor, Matthew↗

Revised and extended benchmark results for Rayleigh scattering of sunlight in spherical atmospheres

While most of traditional Earth-atmosphere satellite remote sensing relies on radiative transfer in the plane parallel geometry, effects of sphericity are important at high sun and view zenith angles. Broad understanding of these effects is limited and, contrary to the plane-parallel case, finding accurate numerical results to test spherical RT codes is not easy. This paper aims to partially fill in this gap. Using the full-spherical RT code MYSTIC (Monte Carlo), and the plane-parallel RT code VLIDORT (discrete ordinates) corrected for atmospheric sphericity in the single and multiple scattering, we reproduced with better accuracy and extended the benchmark results by Adams & Kattawar [1978].

spherical atmospheres↗

Benchmarking and Performance of the NASA Multiscale Analysis Tool

The NASA Multiscale Analysis Tool (NASMAT) is as a “plug and play,” software package which utilizes multiscale recursive micromechanics as a platform for massively multiscale modeling of hierarchical materials and structures subjected to thermomechanical. This paper is intended to give an overview of the design of NASMAT and how the design supports modularity, upgradability and maintainability, interoperability, and utility. First, the software architecture and hierarchy will be explored. Details on each of the 11 NASMAT procedures and the arrangement of NASMAT data will be presented. Application program interfaces (APIs) that were developed to facilitate the communication of NASMAT with other programs will be described. The intended application for NASMAT is massively multiscale modeling on high performance computing systems. As such, results benchmarking the performance of the integration of NASMAT with the Abaqus commercial finite element method software are also presented.

Multiscale Modeling↗

Efficiency of Mixed-Element USM3D for Benchmark Three-Dimensional Flows

The unstructured, mixed-element, cell-centered, finite-volume flow solver USM3D is enhanced with new capabilities such as line generation for general unstructured grids and optimization of the iterative solver. The efficiency of the new developments is assessed in a massively parallel environment. The assessments are conducted using a baseline method and the recent hierarchical adaptive nonlinear iteration method framework. Three benchmark turbulent flows, namely, a subsonic separated flow around a three-dimensional hemisphere cylinder configuration, a transonic flow around the ONERA M6 wing, and a supersonic flow through a square duct are considered.

Mohagna J Pandya↗

Benchmark Problem Development for Testing Maturity of Intelligent Contingency Management Tools

Increasingly autonomous Advanced Air Mobility (AAM) vehicles will be required to handle diverse conditions with limited human intervention. Intelligent contingency management (iCM) approaches are under development to address how automated agents can handle unforeseen, unplanned, and unanticipated events. Benchmark scenario is needed to test the maturity of the developed iCM tools and techniques.

Jon Holbrook↗

QuAIL Tools for Benchmarking, Analysis and Quantum Algorithm Development

HybridQ and PySA are open-source tools developed by NASA to support benchmarking, analysis and quantum algorithm development in areas such as simulation, optimization and machine learning. These tools leverage classical hardware acceleration via high-performance computing CPU and GPU architectures and support high-performance computing. HybridQ is a highly extensible platform designed to provide a common framework to integrate multiple state-of-the-art techniques to simulate large scale quantum circuits. PySA is an extensible platform to optimize a classical cost function. We provide an outline of each of these open-source tools and highlight projects using each of these tools in contexts of simulation, optimization and machine learning.

Quantum Computing↗

SatNet: A Benchmark for Satellite Scheduling Optimization

Satellites provide essential services such as networking and weather tracking, and the number of near-earth and deep space satellites are expected to grow rapidly in the coming years. Communications with terrestrial ground stations is one of the critical functionalities of any space mission. Satellite scheduling is a problem that has been scientifically investigated since the 1970s. A central aspect of this problem is the need to consider resource contention and satellite visibility constraints as they require line of sight. Due to the combinatorial nature of the problem, prior solutions such as linear programs and evolutionary algorithms require extensive compute capabilities to output a feasible schedule for each scenario. Machine learning based scheduling can provide an alternative solution by training a model with historical data and generating a schedule quickly with model inference. We present SatNet, a benchmark for satellite scheduling optimization based on historical data from the NASA Deep Space Network. We propose formulation of the satellite scheduling problem as a Markov Decision Process and use reinforcement learning (RL) policies to generate schedules. The nature of constraints imposed by SatNet differ from other combinatorial optimization problems such as vehicle routing studied in prior literature. Our initial results indicate that RL is an alternative optimization approach that can generate candidate solutions of comparable quality to existing state-of-the-practice results. However, we also find that RL policies overfit to the training dataset and do not generalize well to new data, thereby necessitating continued research on reusable and generalizable agents.

Wilson, Brian↗

Benchmarking and Testing of Qualcomm Snapdragon System-on-Chip for JPL Space Applications and Missions

As some space missions become more challenging due to new environments, greater distances, or more limited size, weight, and power (SWaP) constraints, spacecraft avionics must adapt to allow the spacecraft to be more autonomous and agile---eliminating the Spacecraft-Earth-Spacecraft feedback loop whenever possible. Prime examples of such missions include Aerobots (such as Ingenuity with extremely low SWaP constraints and demanding signal/image processing during flight) and landers in possibly hostile environments (such as a Europa lander mission, with limited communication capacity, high latency, and constrained power budget). To address these challenges, JPL worked with Qualcomm to demonstrate the use of their Snapdragon 801 system-on-chip (SoC) onboard the Ingenuity Helicopter on Mars. The Qualcomm Snapdragon SoC contains various subsystems, including an ARM cluster, a Graphics processing unit, a Digital Signal Processing subsystem, a Neural Processing Engine, Image Signal Processing subsystem, among others. Since the success of Ingenuity, JPL is continuing to work with Qualcomm to address other applications of the Snapdragon SoC technology. This includes the deployment of two 855 Snapdragon development boards onboard the International Space Station (ISS) for successful in-situ benchmarking of applications in space (beyond those tested on Ingenuity). In this paper, we will examine the performance of various applications that have been identified to benefit from greater onboard computational capability. These applications include (among others): machine vision algorithms that are expected to be critical in autonomous entry-descent-and-landing scenarios and real-time Aerobot flight navigation; Hyperspectral compression algorithms; Synthetic Aperture Radar Processing along with various instrument processing algorithms. We discuss how the infusion of Qualcomm's Snapdragon SoC is capable of enabling missions that may not have been able to achieve their goals with traditional flight computing. In addition, we also show that for some algorithms, the software implementation on the Snapdragon SoC outperforms traditional FPGA implementations.

Cretu, Vlad↗

Benchmarking GOCART-2G in the Goddard Earth Observing System (GEOS)

The Goddard Chemistry Aerosol Radiation and Transport (GOCART) model, which controls the sources sinks and chemistry within the Goddard Earth Observing System, recently underwent a major refactoring and update to the representation of physical processes. The code refactoring increases flexibility such multiple instances of an aerosol species can be run and interact with radiation and cloud microphysics, in addition to the output of multiple wavelength aerosol optical properties in support of data assimilation. From a science perspective, a new radiatively active tracer, brown carbon, was added to distinguish smoke from other sources of organic aerosol thereby improving optical properties entering the radiative calculations. A four-year benchmark simulation was evaluated using in situ and space borne measurements to develop a baseline and prioritize future development. A comparison of simulated aerosol optical depth between GOCART-2G and MODIS retrievals indicates the model captures the overall spatial pattern and seasonal cycle of aerosol optical depth but overestimates aerosol extinction over dusty regions and underestimates aerosol extinction over northern hemisphere boreal forests, requiring further tuning of emissions. This MODIS-based analysis is corroborated by comparisons to MISR and selected AERONET stations. Despite the underestimate of aerosol optical depth in biomass burning regions in GEOS, there is an overestimate in the surface mass of organic carbon in the United States, especially during the summer months.

Allison Collow↗

Benchmark Performance Metrics of a Vane Propellant Management Device for a 0.15 m3 Liquid Hydrogen Tank

The use of cryogenic propellants has and will continue to play an integral role in manned-space exploration due the high specific impulses offered and its ubiquity through in-situ resource utilization. But guaranteeing vapor-free transfer of such low-surface tension liquids is difficult for traditional capillary-action propellant management devices (PMDs). Screen-channel liquid acquisition devices and compliant origami bladders are potential solutions, but to quantify the benefits these technologies offer, this paper present a cast study analyzing the performance metrics of an orthodox vane PMD as a benchmark for comparison. A 0.15 m3 liquid hydrogen tank at 20.3 K and 103 kPa was selected for study. Then assuming no body forces and no heat transfer (for simplicity), a steady-state 1-D differential equation was numerically solved in tandem with four possible wetted area configurations to yield an expulsion efficiency for a theoretically maximum inputted expulsion flow rate. Maximization of the flow rate was constrained by the onset of choked flow. Additional inputs, including vane height and vane number, were parametrically varied between 0.1 – 10 cm and 4 – 28 vanes, respectively.

Liquid Acquisition Device↗

Benchmark Problem for Autonomous Urban Air Mobility

This paper introduces a Community Benchmark Problem (CBP) for Intelligent Contingency Management (ICM) for Urban Air Mobility (UAM) aircraft. The CBP aims to provide a common framework for measuring and comparing the progress of autonomy solutions for UAM aircraft in handling emergency situations. The paper proposes a methodology for defining and quantifying five measures of complexity that capture the challenges and requirements of ICM for UAM: Mission, Environmental, Autonomy, Decision-Making, and Mission Fault. In addition, it proposes a methodology for defining and quantifying mission risk acceptability with the same goals: Contingency Management, Mission Success, Operational, Mission Redefinition, and Environmental. We describe how to use these measures to track progress of the development of ICM capability, as well as to create scenarios and evaluate the performance of different autonomy solutions.

autonomy↗

Community Benchmark Problem for Intelligent Contingency Management

This paper introduces a Community Benchmark Problem (CBP) for Intelligent Contingency Management (ICM) for Urban Air Mobility (UAM) aircraft. The CBP aims to provide a common framework for measuring and comparing the progress of autonomy solutions for UAM aircraft in handling emergency situations. The paper proposes a methodology for defining and quantifying five measures of complexity that capture the challenges and requirements of ICM for UAM: Mission, Environmental, Autonomy, Decision-Making, and Mission Fault. In addition, it proposes a methodology for defining and quantifying mission risk acceptability with the same goals: Contingency Management, Mission Success, Operational, Mission Redefinition, and Environmental. We describe how to use these measures to track progress of the development of ICM capability, as well as to create scenarios and evaluate the performance of different autonomy solutions.

autonomy↗

Transonic Limit Cycle Oscillations of the Benchmark Supercritical Wing

This paper considers transonic flutter mechanisms of the Benchmark Supercritical Wing, a model under study in the Aeroelastic Prediction Workshop series. Flutter boundaries are mapped out across an angle of attack sweep at Mach 0.8, utilizing both time-domain and linearized frequency-domain solvers, manual meshes and adapted meshes, and various governing equations. With increased angle of attack, linearized and finite amplitude flutter predictions exhibit differences above 3◦ as the flow begins to separate; the latter predictions are found to be driven by subcritical limit cycle oscillations whose strength increases with angle of attack. Moderate perturbation values provide a stability boundary at 5◦ which matches the experimental data, but it is not clear how the experimental perturbation, from one test condition to the next, can be reasonably characterized.

Bret Stanford↗

Benchmarking Computational Tools for Calling SNPs and Indels in Complex Microbial Populations

The NASA BioNutrients missions seek to understand the suitability of microorganisms for bioproduction during space flight. One topic of interest is the stability of microbial genomes during long-term ambient storage and subsequent rehydration and growth. To address these questions, samples from 8 species were flown to ISS for 5 years of desiccated storage at ambient temperature (Stasis Packs) and 2 species were packaged along with powdered media inside a bioreactor system to allow hydration and growth in microgravity (Production Packs). For both systems, Whole Genome Sequencing (WGS) of the DNA extracted from the returned samples and paired ground controls will be conducted to identify changes in genome stability due to time, storage conditions and growth in space. Across the technical replicates, ground controls, 10 timepoints, and multiple experimental conditions, ~300 samples have been selected for initial analysis with WGS sequencing to 100x coverage. A flexible and resource efficient mutation calling pipeline is needed to process this large dataset and allow for comparisons between species. Many bioinformatics tools for calling Indels and Single Nucleotide Variants (SNVs) are designed for use with pure isolates, where true variations from the reference genome are expected to dominate the reads aligning to the location of mutation. In contrast, DNA from the Stasis Pack (SP) samples was collected directly after recovery from desiccated storage and the Production Pack (PP) samples were collected after fermentation. In this context, reads with mutations are expected to be less frequent than reads that align with the reference genome, as each sample will include multiple lines of cells. Thus, BioNutrients samples are expected to be similar to samples from cancer cell or “pooled” sequencing approaches. In preparation for the analysis of the BioNutrients samples, we have tested three mutation calling tools (GATK for Microbes, BreSeq and DiscoSNP) designed for complex samples. A challenge of validating mutation identification pipelines is a lack of “Ground Truth” datasets, especially for complex samples. To compare these three tools, we sought to identify mutations in pre-existing WGS data collected from populations of Chlamydomonas reinhardtii that were exposed to UV mutagenesis and growth in LEO as part of the Space Algae-1 mission. Here we present a summary of these tools against the analysis originally conducted using the CRISP tool. Critical metrics are compared such as runtime, the number of SNPs, the number and size of Indels, and patterns of transversion and transitions identified by each tool are reported. By sharing these benchmarking results collected in support of the BioNutrients mission, we aim to guide others seeking to identify SNVs in similarly complex microbial samples.

Biology↗

Field Study and Energy-Plus Benchmarks for Energy Saver Homes having Different Envelope Designs

An alliance to maximize energy efficiency and cost-effective residential construction (ZEBRAlliance) built and field tested four homes that are 50 percent more energy efficient than a code compliant home. The homes are unoccupied for the duration of a two-year field study, thereby eliminating the confounding issue of occupancy habits. All homes have about the same consistent and scheduled internal load. Each home showcases a unique envelope strategy: 1) structural insulated panel (SIP), 2) optimal value wall framing (OVF), 3) advanced framing featuring the benefits of insulations mixed with phase change materials (PCM), and 4) an exterior insulation and finish system (EIFS). All homes have different weather resistive barriers (WRBs) and/or air barriers to limit air and moisture infiltration. Three homes provide space conditioning and water heating via a ground loop heat exchanger, while the fourth home uses a high efficiency air-to-air heat pump and heat pump water heater. Field performance and results of EnergyPlus V7.0 benchmarks were made for roof and attics as compared to cathedral design and for wall heat flows to validate models. The moisture content of the wall sheathing is shown to prove the protecting effectiveness of WRBs. Temperature distributions through insulations in the wall and ceiling with and without PCMs are described to characterize the performance of the PCM building envelopes.

Attic↗

EVALUATION OF U10MO FUEL PLATE IRRADIATION BEHAVIOR VIA NUMERICAL AND EXPERIMENTAL BENCHMARKING

This article analyzes dimensional changes due to irradiation of monolithic plate-type nuclear fuel and compares results with finite element analysis of the plates during fabrication and irradiation. Monolithic fuel plates tested in the Advanced Test Reactor (ATR) at Idaho National Lab (INL) are being used to benchmark proposed fuel performance for several high power research reactors. Post-irradiation metallographic images of plates sectioned at the midpoint were analyzed to determine dimensional changes of the fuel and the cladding response. A constitutive model of the fabrication process and irradiation behavior of the tested plates was developed using the general purpose commercial finite element analysis package, Abaqus. Using calculated burn-up profiles of irradiated plates to model the power distribution and including irradiation behaviors such as swelling and irradiation enhanced creep, model simulations allow analysis of plate parameters that are either impossible or infeasible in an experimental setting. The development and progression of fabrication induced stress concentrations at the plate edges was of primary interest, as these locations have a unique stress profile during irradiation. Additionally, comparison between 2D and 3D models was performed to optimize analysis methodology. In particular, the ability of 2D and 3D models account for out of plane stresses which result in 3-dimensional creep behavior that is a product of these components. Results show that assumptions made in 2D models for the out-of-plane stresses and strains cannot capture the 3-dimensional physics accurately and thus 2D approximations are not computationally accurate. Stress-strain fields are dependent on plate geometry and irradiation conditions, thus, if stress based criteria is used to predict plate behavior (as opposed to material impurities, fine micro-structural defects, or sharp power gradients), unique 3D finite element formulation for each plate is required.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Benchmarking Of Improved DPAC Transient Deflagration Analysis Code

The transient deflagration code DPAC (Deflagration Pressure Analysis Code) has been upgraded for use in modeling hydrogen deflagration transients. The upgraded code is benchmarked using data from vented hydrogen deflagration tests conducted at the HYDRO-SC Test Facility at the University of Pisa. DPAC originally was written to calculate peak deflagration pressures for deflagrations in radioactive waste storage tanks and process facilities at the Savannah River Site. Upgrades include the addition of a laminar flame speed correlation for hydrogen deflagrations and a mechanistic model for turbulent flame propagation, incorporation of inertial effects during venting, and inclusion of the effect of water vapor condensation on vessel walls. In addition, DPAC has been coupled with CEA, a NASA combustion chemistry code. The deflagration tests are modeled as end-to-end deflagrations. The improved DPAC code successfully predicts both the peak pressures during the deflagration tests and the times at which the pressure peaks.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗