Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Lunar Asset Messaging and On Orbit Navigation

NASA has titled its 2020 thrust for the Moon, Artemis. The increased focus on the Moon as a destination for future human and robotic expeditions necessitates general purpose navigational and communications infrastructure reducing their complexity to help establish a sustained presence. A framework through which Lunar missions can relay communications and localize their positions shifts the burden from the individual mission and enables resource allocation tailored to mission-specific goals. During the summer of 2020, student interns under the Innovation to Flight (i2F) program at the National Aeronautics and Space Administration’s (NASA) Jet Propulsion Laboratory (JPL) in collaboration with the University of Colorado Boulder designed, built, and tested a prototype framework capable of providing surface assets with communication and positioning services. The team utilized the existing i2F CubeSat bus in addition to developing several CubeSat engineering development units (EDUs), a ground vehicle, and a ground station to simulate a scenario in which a lunar surface mission is supported by these services. A primary goal of the summer was to develop a method for localizing the ground vehicle through trilateration. Distances are inferred from the round-trip time of flight (ToF) of radio signals between an asset and several elements. Signals were sent and received using LimeSDR software defined radios on-board both the ground vehicle and the EDUs; ToF and trilateration were calculated on a Qualcomm Snapdragon development board located within the LA MOON payload data system. The ModalAI chipset on the Qualcomm was instrumental in executing visual based position estimation. Communications was facilitated through a bent-pipe approach addressing the NASA requirement to provide solutions for in communication denied locations. The ground vehicle relayed information to other surface assets in addition to its ground station through the supporting constellation. This project demonstrates the feasibility of a lunar CubeSat constellation for the support of surface assets and explores packaging and operations of the components critical to trilateration and bent-pipe communication into a standard CubeSat form factor. When implemented, this framework will open a door for new surface missions designed with lower power requirements and increased operational access.

Huang, Calvin↗

Quarkonium physics at the dawn of the LHC era.

More than a hundred experimentalists and theorists met at DESY in October to discuss the latest advances in quarkonium physics. The Quarkonium Working Group (QWG) formed in 2002 to further research in all aspects of quarkonium physics and to bridge communication between theory and experiment in the field. The group has since sponsored a series of workshops on quarkonium physics, starting at CERN in November 2002 (CERN Courier March 2003 p6 and CERN Courier September 2006 p46). The latest meeting took place at DESY, Hamburg, on 17-20 October 2007. Hot topics included recent advances in the theory of quarkonium production at the Tevatron and the B-factories; quarkonium production and in-medium behaviour in heavy-ion collisions; the new narrow-resonance states discovered by the Belle, BaBar and CLEO experiments; applications of quarkonium physics to the search for physics beyond the Standard Model; and quarkonium experiments in the LHC era. Quarkonium physics has played an important role in establishing QCD as the accepted theory of strong interactions. It has decisively contributed to the development of the quark model of hadrons and to the understanding of the properties of QCD. It also provides a unique window into the interplay between perturbative and nonperturbative QCD. As such, quarkonium physics remains at the forefront of QCD research and is an important testing ground for state-of-the-art computational tools for QCD, such as effective field theories, factorization theorems, higher-order perturbative calculations and lattice QCD. The insights gained from quarkonium studies build greater confidence in predictions for Standard Model processes and, consequently, in predictions of new physics backgrounds at the LHC. The recent discovery of remarkable new resonance states in the charmonium region of the spectrum - exciting in its own right - provides further opportunities to test the theoretical framework of quarkonium physics.

43 PARTICLE ACCELERATORS↗

Feasibility Study on the Use of On-line Multivariate Statistical Process Control for Safeguards Applications in Natural Uranium Conversion Plants

The objective of this work was to determine the feasibility of using on-line multivariate statistical process control (MSPC) for safeguards applications in natural uranium conversion plants. Multivariate statistical process control is commonly used throughout industry for the detection of faults. For safeguards applications in uranium conversion plants, faults could include the diversion of intermediate products such as uranium dioxide, uranium tetrafluoride, and uranium hexafluoride. This study was limited to a 100 metric ton of uranium (MTU) per year natural uranium conversion plant (NUCP) using the wet solvent extraction method for the purification of uranium ore concentrate. A key component in the multivariate statistical methodology is the Principal Component Analysis (PCA) approach for the analysis of data, development of the base case model, and evaluation of future operations. The PCA approach was implemented through the use of singular value decomposition of the data matrix where the data matrix represents normal operation of the plant. Component mole balances were used to model each of the process units in the NUCP. However, this approach could be applied to any data set. The monitoring framework developed in this research could be used to determine whether or not a diversion of material has occurred at an NUCP as part of an International Atomic Energy Agency (IAEA) safeguards system. This approach can be used to identify the key monitoring locations, as well as locations where monitoring is unimportant. Detection limits at the key monitoring locations can also be established using this technique. Several faulty scenarios were developed to test the monitoring framework after the base case or normal operating conditions of the PCA model were established. In all of the scenarios, the monitoring framework was able to detect the fault. Overall this study was successful at meeting the stated objective.

Ladd-Lively, Jennifer L↗

Scalable Bayesian optimization with randomized prior networks

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment. Bayesian Optimization (BO) techniques are known to be effective in tackling global optimization problems using a relatively small number objective function evaluations, but their performance suffers when dealing with high-dimensional outputs. To overcome the major challenge of dimensionality, here we propose a deep learning framework for BO and sequential decision making based on bootstrapped ensembles of neural architectures with randomized priors. Using appropriate architecture choices, we show that the proposed framework can approximate functional relationships between design variables and quantities of interest, even in cases where the latter take values in high-dimensional vector spaces or even infinite-dimensional function spaces. In the context of BO, we augmented the proposed probabilistic surrogates with re-parameterized Monte Carlo approximations of multiple-point (parallel) acquisition functions, as well as methodological extensions for accommodating black-box constraints and multi-fidelity information sources. We test the proposed framework against state-of-the-art methods for BO and demonstrate superior performance across several challenging tasks with high-dimensional outputs, including a constrained multi-fidelity optimization task involving shape optimization of rotor blades in turbo-machinery.

97 MATHEMATICS AND COMPUTING↗

A Framework for Evaluating Climate Model Performance Metrics

The CMIP5 archive contains future climate projections from over 50 models provided by dozens of modeling centers from around the world. Individual model projections, however, are subject to biases created by structural model uncertainties. As a result, ensemble averaging of multiple models is often used to add value to model projections: consensus projections have been shown to consistently outperform individual models. Previous reports for the IPCC establish climate change projections based on an equal-weighted average of all model projections. However, certain models reproduce climate processes better than other models. Should models be weighted based on performance? Unequal ensemble averages have previously been constructed using a variety of mean state metrics. What metrics are most relevant for constraining future climate projections? This project develops a framework for systematically testing metrics in models to identify optimal metrics for unequal weighting multi-model ensembles. A unique aspect of this project is the construction and testing of climate process-based model evaluation metrics. A climate process-based metric is defined as a metric based on the relationship between two physically related climate variables?e.g., outgoing longwave radiation and surface temperature. Metrics are constructed using high-quality Earth radiation budget data from NASA's Clouds and Earth's Radiant Energy System (CERES) instrument and surface temperature data sets. It is found that regional values of tested quantities can vary significantly when comparing weighted and unweighted model ensembles. For example, one tested metric weights the ensemble by how well models reproduce the time-series probability distribution of the cloud forcing component of reflected shortwave radiation. The weighted ensemble for this metric indicates lower simulated precipitation (up to .7 mm/day) in tropical regions than the unweighted ensemble: since CMIP5 models have been shown to overproduce precipitation, this result could indicate that the metric is effective in identifying models which simulate more realistic precipitation. Ultimately, the goal of the framework is to identify performance metrics for advising better methods for ensemble averaging models and create better climate predictions.

Noel C Baker↗

Progressive transfer learning for advancing machine learning-based reduced-order modeling

Abstract To maximize knowledge transfer and improve the data requirement for data-driven machine learning (ML) modeling, a progressive transfer learning for reduced-order modeling (p-ROM) framework is proposed. A key concept of p-ROM is to selectively transfer knowledge from previously trained ML models and effectively develop a new ML model(s) for unseen tasks by optimizing information gates in hidden layers. The p-ROM framework is designed to work with any type of data-driven ROMs. For demonstration purposes, we evaluate the p-ROM with specific Barlow Twins ROMs (p-BT-ROMs) to highlight how progress learning can apply to multiple topological and physical problems with an emphasis on a small training set regime. The proposed p-BT-ROM framework has been tested using multiple examples, including transport, flow, and solid mechanics, to illustrate the importance of progressive knowledge transfer and its impact on model accuracy with reduced training samples. In both similar and different topologies, p-BT-ROM achieves improved model accuracy with much less training data. For instance, p-BT-ROM with four-parent (i.e., pre-trained models) outperforms the no-parent counterpart trained on data nine times larger. The p-ROM framework is poised to significantly enhance the capabilities of ML-based ROM approaches for scientific and engineering applications by mitigating data scarcity through progressively transferring knowledge.

97 MATHEMATICS AND COMPUTING↗

SLOWLY ROTATING GAS-RICH GALAXIES IN MODIFIED NEWTONIAN DYNAMICS (MOND)

We have carried out a search for gas-rich dwarf galaxies that have lower rotation velocities in their outskirts than MOdified Newtonian Dynamics (MOND) predicts, so that the amplitude of their rotation curves cannot be fitted by arbitrarily increasing the mass-to-light ratio of the stellar component or by assuming additional undetected matter. With presently available data, the gas-rich galaxies UGC 4173, Holmberg II, ESO 245-G05, NGC 4861, and ESO 364-G029 deviate most from MOND predictions and, thereby, provide a sample of promising targets in testing the MOND framework. In the case of Holmberg II and NGC 4861, we find that their rotation curves are probably inconsistent with MOND, unless their inclinations and distances differ significantly from the nominal ones. The galaxy ESO 364-G029 is a promising target because its baryonic mass and rotation curve are similar to Holmberg II but presents a higher inclination. Deeper photometric and H I observations of ESO 364-G029, together with further decreasing systematic uncertainties, may provide a strong test to MOND.

79 ASTRONOMY AND ASTROPHYSICS↗

Changes in the MJO under Greenhouse Gas–Induced Warming in CMIP5 Models

This study investigates changes to the Madden–Julian oscillation (MJO) in response to greenhouse gas–induced warming during the twenty-first century. Changes in the MJO’s amplitude, phase speed, and zonal scale are examined in five models from phase 5 of the Coupled Model Intercomparison Project (CMIP5) that demonstrate superior MJO characteristics. Under warming, the CMIP5 models exhibit a robust increase in the spectral power of planetary-scale, intraseasonal, eastward-propagating (MJO) precipitation anomalies (~10.9% K −1 ). The amplification of MJO variability is accompanied by an increase of the spectral power of the corresponding westward-traveling waves at a similar rate. This suggests that enhanced MJO variability in a warmer climate is likely caused by enhanced background tropical precipitation variability, not by changes in the MJO’s stability. All models examined show an increase in the MJO’s phase speed (1.8% K –1 –4.5% K −1 ) and a decrease in the MJO’s zonal wavenumber (1.0% K –1 –3.8% K −1 ). Using a linear moisture mode framework, this study tests the theory-predicted phase speed changes against the simulated phase speed changes. It is found that the MJO’s acceleration in a warmer climate is a result of enhanced horizontal moisture advection by the steepening of the mean meridional moisture gradient and the decrease in zonal wavenumber, which is partially offset by the lengthening of the convective moisture adjustment time scale and the increase in gross dry stability. While the ability of the linear moisture mode framework to explain MJO phase speed changes is model dependent, the theory can accurately predict the phase speed changes in the model ensemble.

54 ENVIRONMENTAL SCIENCES↗

Systems aspects of COBE science data compression

A general approach to compression of diverse data from large scientific projects has been developed and this paper addresses the appropriate system and scientific constraints together with the algorithm development and test strategy. This framework has been implemented for the COsmic Background Explorer spacecraft (COBE) by retrofitting the existing VAS-based data management system with high-performance compression software permitting random access to the data. Algorithms which incorporate scientific knowledge and consume relatively few system resources are preferred over ad hoc methods. COBE exceeded its planned storage by a large and growing factor and the retrieval of data significantly affects the processing, delaying the availability of data for scientific usage and software test. Embedded compression software is planned to make the project tractable by reducing the data storage volume to an acceptable level during normal processing.

Freedman, I.↗

A custom high-stability pulse generator for the test of a novel in-situ magnetic sensor developed to detect radiation damage in undulators

High-performance analog-to-digital converters (ADC) have been widely applied in many areas of science. For instance, magnetic field measurements based on the Faraday’s induction law require high-precision voltmeters to measure induced voltages. In this study in the context of free-electron lasers technology, the Magnetic Measurements Team at SLAC National Accelerator Laboratory proposed a novel in-situ radiation damage detection system (RDDS) for detecting small field variations in undulators. The system measures the flux change in a flexible printed-circuit coil attached to the magnet array during the undulator gap movement. The gap movement changes the magnetic field, which induces a voltage signal in the coil that is measured and integrated with an ADC. Although the system is capable of detecting relative flux changes better than 100 ppm, drift in the ADC’s gain or offset can cause apparent changes in the relative flux. This paper describes the first attempt to developed a high-precision verification circuit to perform ADC testing in the framework of the novel RDDS. The circuit generates a reference voltage pulse with a voltage–time integral relative precision better than 50 ppm for a few hundreds of mVs — the typical order of magnitude measured with the RDDS. The circuit’s design combines a fast and precise switch with a low-noise voltage reference. Long-term measurements allowed statistical analysis and showed that averaging the voltage–time integral of ten pulses gives the required 50 ppm stability. Moreover, reproducibility tests confirmed that the circuit’s output is invariable under small power supply instabilities and equipment shutdown. Instruments and applications designed to quantify the magnetic field by integrating voltage signals may use the pulse generator proposed in this paper for verification purposes.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Verification of the three-dimensional tetrahedral grid S{sub N} code THOR

In this work current capabilities implemented in the novel, arbitrary-order, tetrahedral-grid short characteristics S{sub N} radiation transport code THOR are verified based on four benchmark problems: (1) A one-group Method of Manufactured Solution (MMS) problem on a cuboidal domain, (2) an infinite medium eigenvalue problem with up-scattering, (3) a homogeneous torus and (4) a bare cube eigenvalue problem with anisotropic scattering up to order three. The first benchmark problem exercises the various spatial discretization options available in THOR: The short characteristics method in conjunction with polynomial expansions of the source and face fluxes either using the complete or Lagrange family of arbitrary orders. Using the numerical solution's order of convergence test in the framework of a mesh refinement study, correct implementation of a selection of spatial expansion orders is demonstrated for two meshes with tetrahedral aspect ratios close to unity and 50. The second benchmark problem exercises the implementation of angular fluxes on reflective boundary faces that are implicit within a mesh sweep, and up-scattering. The third benchmark problem comprises cyclic dependencies within the mesh sweep thus exercising the algorithm devised for 'breaking' the cyclic dependencies. Finally, the fourth benchmark problem, a simple bare cube, is used to test correct implementation of the anisotropic scattering capability. For all test problems THOR obtains solutions that converge to the reference/exact solution with the expected rate thereby contributing to our confidence in the correctness of its tested features in the present implementation. (authors)

97 MATHEMATICS AND COMPUTING↗

Karhunen–Loève deep learning method for surrogate modeling and approximate Bayesian parameter estimation

We evaluate the performance of the Karhunen-Loève Deep Neural Network (KL-DNN) framework for surrogate modeling and approximate Bayesian parameter estimation in partial differential equation models. In the surrogate model, the Karhunen-Loève (KL) expansions are used for the dimensionality reduction of the number of unknown parameters and variables, and a deep neural network is employed to relate the reduced space of parameters to that of the state variables. The KL-DNN surrogate model is used to formulate a maximum-a-posteriori-like least-squares problem, which is randomized to draw samples of the posterior distribution of the parameters. We test the proposed framework for a hypothetical unconfined aquifer via comparison with the forward MODFLOW and inverse PEST++ iterative ensemble smoother (IES) solutions as well as the state-of-the-art Fourier neural operator (FNO) and deep operator networks (DeepONets) operator learning surrogate models. Our results show that the KL-DNN surrogate model outperforms FNO and DeepONet for forward predictions. For solving inverse problems, the randomized algorithm provides the same or more accurate Bayesian predictions of the parameters than IES as evidenced by the higher log-predictive probability of both the estimated parameter field and the forecast hydraulic head. The posterior mean obtained from the randomized algorithm is closer to the reference parameter field than that obtained with FNO as the maximum a posteriori estimate.

Approximate Bayesian inference↗

Stochasticity, succession, and environmental perturbations in a fluidic ecosystem

Unraveling the drivers of community structure and succession in response to environmental change is a central goal in ecology. Although the mechanisms shaping community structure have been intensively examined, those controlling ecological succession remain elusive. To understand the relative importance of stochastic and deterministic processes in mediating microbial community succession, a unique framework composed of four different cases was developed for fluidic and nonfluidic ecosystems. The framework was then tested for one fluidic ecosystem: a groundwater system perturbed by adding emulsified vegetable oil (EVO) for uranium immobilization. Our results revealed that groundwater microbial community diverged substantially away from the initial community after EVO amendment and eventually converged to a new community state, which was closely clustered with its initial state. However, their composition and structure were significantly different from each other. Null model analysis indicated that both deterministic and stochastic processes played important roles in controlling the assembly and succession of the groundwater microbial community, but their relative importance was time dependent. Additionally, consistent with the proposed conceptual framework but contradictory to conventional wisdom, the community succession responding to EVO amendment was primarily controlled by stochastic rather than deterministic processes. During the middle phase of the succession, the roles of stochastic processes in controlling community composition increased substantially, ranging from 81.3% to 92.0%. Finally, there are limited successional studies available to support different cases in the conceptual framework, but further well-replicated explicit time-series experiments are needed to understand the relative importance of deterministic and stochastic processes in controlling community succession.

54 ENVIRONMENTAL SCIENCES↗

Membrane Composition Influences Expression Yield of Plant Cytochrome P450s in E. coli Lysate-Based Cell-Free Systems

Plant cytochrome P450 enzymes are central to natural product biosynthesis, but remain difficult to express in microbial hosts due to their transmembrane nature. Lysate-based, cell-free expression systems allow supplementation with artificial membranes to support the expression and translocation of transmembrane proteins. We developed a framework to systematically test liposomal membrane compositions to enhance the plant P450 expression yield. Adjustments to common phospholipid ratios or the addition of plant galactolipids had minimal impact on expression. In contrast, blended liposomes containing Egg PC, sterol-conjugated phospholipids, and PEGylated lipids produced concentration-dependent increases in expression. Expression of an Escherichia coli mechanosensitive channel and three plant P450s improved more than 2-fold, with some P450s showing up to 14-fold enhancement. Furthermore, these findings highlight membrane composition as a key determinant of the P450 expression yield in cell-free expression systems. While P450 activity was not measured, these findings provide a framework for future workflows toward achieving functional plant transmembrane enzymes for the bioproduction of natural products.

TXTL↗

From Physics Model to Results: An Optimizing Framework for Cross-Architecture Code Generation

Starting from a high-level problem description in terms of partial differential equations using abstract tensor notation, the Chemora framework discretizes, optimizes, and generates complete high performance codes for a wide range of compute architectures. Chemora extends the capabilities of Cactus, facilitating the usage of large-scale CPU/GPU systems in an efficient manner for complex applications, without low-level code tuning. Chemora achieves parallelism through MPI and multi-threading, combining OpenMP and CUDA. Optimizations include high-level code transformations, efficient loop traversal strategies, dynamically selected data and instruction cache usage strategies, and JIT compilation of GPU code tailored to the problem characteristics. The discretization is based on higher-order finite differences on multi-block domains. Chemora's capabilities are demonstrated by simulations of black hole collisions. This problem provides an acid test of the framework, as the Einstein equations contain hundreds of variables and thousands of terms.

Blazewicz, Marek↗

Muon g -2 anomaly and neutrino magnetic moments

We show that a unified framework based on an SU(2) H horizontal symmetry which generates a naturally large neutrino transition magnetic moment and explains the XENON1T electron recoil excess also predicts a positive shift in the muon anomalous magnetic moment. This shift is of the right magnitude to be consistent with the Brookhaven measurement as well as the recent Fermilab measurement of the muon g-2. A relatively light neutral scalar from a Higgs doublet with mass near 100 GeV contributes to muon g-2, while its charged partner induces the neutrino magnetic moment. In contrast to other multi-scalar theories, in the model presented here there is no freedom to control the sign and strength of the muon g-2 contribution. We analyze the collider tests of this framework and find that the HL-LHC can probe the entire parameter space of these models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Iterative reconstruction techniques for industrial CT: application and performance

BWXT Y-12, Oak Ridge National Laboratory, and the University of Tennessee have been working toward improved high-resolution X-ray computed tomography for non-destructive testing of manufactured objects. The emphasis of this work has been on iterative reconstruction, calibration, and performance testing. Algebraic reconstruction algorithms for CT have been developed that are more robust in handling incomplete and noisy data and permit high-resolution volumetric imaging on metallic part assemblies. A key source of artifacts in reconstructed CT images for industrial components is poor image statistics due to areas of high attenuation. This loss of information in the captured projections not only affects reconstruction of those areas, but also the surrounding regions. To overcome numerical instabilities arising from the ill-posed nature of inverse problems, standard regularization techniques can be applied as can Bayesian reconstruction techniques using prior data such as CAD information to improve image quality. To accelerate the reconstruction of certain regions of interest and reduce memory requirements, subvolume reconstruction has been implemented and tested. A computational framework has been implemented that facilitates the use of sophisticated iterative algorithms for reconstruction of three-dimensional images from high-resolution X-ray cone-beam projection data. The code supports parallel computing at two levels: message passing is used to farm the computation out across a network of computers while threads allow all processors available on any one computer to be used.

99 GENERAL AND MISCELLANEOUS↗

Assessment Environment for Complex Systems Software Guide

This Software Guide (SG) describes the software developed to test the Assessment Environment for Complex Systems (AECS) by the West Virginia High Technology Consortium (WVHTC) Foundation's Mission Systems Group (MSG) for the National Aeronautics and Space Administration (NASA) Aeronautics Research Mission Directorate (ARMD). This software is referred to as the AECS Test Project throughout the remainder of this document. AECS provides a framework for developing, simulating, testing, and analyzing modern avionics systems within an Integrated Modular Avionics (IMA) architecture. The purpose of the AECS Test Project is twofold. First, it provides a means to test the AECS hardware and system developed by MSG. Second, it provides an example project upon which future AECS research may be based. This Software Guide fully describes building, installing, and executing the AECS Test Project as well as its architecture and design. The design of the AECS hardware is described in the AECS Hardware Guide. Instructions on how to configure, build and use the AECS are described in the User's Guide. Sample AECS software, developed by the WVHTC Foundation, is presented in the AECS Software Guide. The AECS Hardware Guide, AECS User's Guide, and AECS Software Guide are authored by MSG. The requirements set forth for AECS are presented in the Statement of Work for the Assessment Environment for Complex Systems authored by NASA Dryden Flight Research Center (DFRC). The intended audience for this document includes software engineers, hardware engineers, project managers, and quality assurance personnel from WVHTC Foundation (the suppliers of the software), NASA (the customer), and future researchers (users of the software). Readers are assumed to have general knowledge in the field of real-time, embedded computer software development.

tests↗