SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Flavor as an Incomplete Structure: Conceptual Questions and the Role of DUNE

Flavor remains one of the most successful yet least understood structures of the Standard Model. The discovery of the Higgs boson completed the electroweak account of mass generation, but did not explain the origin of fermion families, mass hierarchies, or mixing patterns. In this sense, flavor can be regarded as an empirically successful but conceptually incomplete structure. Neutrinos occupy a particularly sensitive place within this problem: their masses are tiny, their mixing is large, and their mass-generation mechanism may differ from that of charged fermions. In this article, we discuss flavor as an open conceptual problem and argue that DUNE, as a phased program spanning precision oscillation measurements and sensitivity to BSM and dark-sector phenomena, provides a powerful framework for testing the self-consistency and possible limits of the present three-flavor description. In particular, the complementarity between the long-baseline program and the Phase I near-detector complex, together with the DUNE-PRISM strategy for controlling interaction-model systematics and enabling data-driven near-to-far predictions, makes DUNE especially well-suited to search for small, correlated departures from the minimal flavor framework.

Montanari, Claudio S. [Fermilab; INFN, Pavia] (ORC↗

NASA NTRS2017

Development of a High-Fidelity Simulation Environment for Shadow-Mode Assessments of Air Traffic Concepts

This paper describes the Shadow-Mode Assessment Using Realistic Technologies for the National Airspace System (SMART-NAS) Test Bed. The SMART-NAS Test Bed is an air traffic simulation platform being developed by the National Aeronautics and Space Administration (NASA). The SMART-NAS Test Bed's core purpose is to conduct high-fidelity, real-time, human-in-the-loop and automation-in-the-loop simulations of current and proposed future air traffic concepts for the United States' Next Generation Air Transportation System called NextGen. The setup, configuration, coordination, and execution of realtime, human-in-the-loop air traffic management simulations are complex, tedious, time intensive, and expensive. The SMART-NAS Test Bed framework is an alternative to the current approach and will provide services throughout the simulation workflow pipeline to help alleviate these shortcomings. The principle concepts to be simulated include advanced gate-to-gate, trajectory-based operations, widespread integration of novel aircraft such as unmanned vehicles, and real-time safety assurance technologies to enable autonomous operations. To make this possible, SNTB will utilize Web-based technologies, cloud resources, and real-time, scalable, communication middleware. This paper describes the SMART-NAS Test Bed's vision, purpose, its concept of use, and the potential benefits, key capabilities, high-level requirements, architecture, software design, and usage.

human-in-the-loop↗

DOE OSTI2025

Pion-nucleon scattering in baryon chiral perturbation theory combined with the 1/𝑁 𝑐 expansion

This work implements the combined baryon chiral perturbation theory (BChPT) and 1/𝑁 𝑐 expansions for pion-nucleon elastic scattering. The effective theory is based on the baryon sector dynamical spin-flavor 𝑆⁢𝑈⁡(4) symmetry emergent in the large 𝑁 𝑐 limit, whose breaking is controlled by the 1/𝑁 𝑐 expansion. The noncommutativity of the chiral and 1/𝑁 𝑐 expansions in unitarity corrections (loops) requires a linking of both expansions. As it was shown in the case of baryon masses and currents, the natural linking is the 𝜉 expansion, in which 𝒪⁡(𝑝) = 𝒪⁡(1/𝑁 𝑐 ) = 𝒪⁡(𝜉). The spin-flavor symmetry requires that the ground state baryons span an 𝑆⁢𝑈⁡(4) symmetric irreducible representation which implies that in particular 𝑁 and Δ are active degrees of freedom in the effective theory. The scattering amplitude is expanded to the next-to-next-to leading order in the 𝜉 expansion, corresponding to the one-loop contributions with the leading-order Lagrangian. The results are given for generic 𝑁 𝑐 in order to demonstrate the consistency of the framework. The spin-flavor symmetry plays a central role in maintaining the consistency of the effective theory with respect to the 1/𝑁 𝑐 expansion. This consistency manifests itself in an improvement in the convergence of the low energy expansion with respect to the case of the ordinary BChPT without an explicit dynamical Δ, which is known to be inconsistent with the constraints of 𝑁 𝑐 scaling. Fits to the 𝜋⁢𝑁 → 𝜋⁢𝑁, 𝑆, 𝑃, and 𝐷 partial wave amplitudes from the SAID data base are finally used to test the framework and to determine the energy range of its applicability.

Jayakodige, D. [Hampton Univ., Hampton, VA (United↗

DOE OSTI2024

Multicriteria-Based Selection of Microalgae Biorefineries: Biomass Composition Defines the Most Suitable Product Portfolios

The supply of microalgae-derived biofuels and bioproducts will be vital in a global-scale bioeconomy. As the diversity of microalgae strains and their compositional plasticity may yield a wide array of products of market interest, the design of effective biorefineries is a central aspect in the path to making microalgae-based products available in the market. In this way, the conversion of microalgae biomass should be planned to employ mature technologies, while maximizing economic and environmental benefits obtained from a diverse product portfolio. This study applied sequential, hybrid Multicriteria Decision Analyses (MCDA) to aid the decision-making process of outlining the most suitable biorefining pathways for specific compositional profiles. For this, the methodology simultaneously considered multiple technical, economic, and environmental criteria, such as market aspects for the main algae-derived products, potential reduction in greenhouse gas (GHG) emissions provided by the biobased alternatives, and technology readiness level of conversion routes, among others. The framework was tested using productivity and compositional data for 13 high-productivity summer strains cultivated under varying nutrient availability. The analysis pointed to compositional profile being a key driver in defining the core biorefining strategy of algae biomass, with lipid-to-carbohydrate ratios higher than roughly 1 warranting the preferential processing of lipids into hydrocarbon fuels with the remainder of the algae biomass compounds being sent to higher-value applications, such as carboxylic acids and renewable thermoplastic substitutes. An in-depth process simulation, techno-economic assessment (TEA), and life-cycle analysis (LCA) effort was carried out as a closing step to corroborate the results stemming from the proposed framework. This study validates the use of MCDAs as a screening method prior to implementing more time-consuming analysis techniques and makes a compelling case for this approach as a product selection tool on a wide range of algae species, thus helping establish species-agnostic (but composition-driven) biorefineries.

biofuels↗

NASA NTRSDate not supplied

Validation of Image-Based Neural Network Controllersthrough Adaptive Stress Testing

Neural networks have become state-of-the-art for computer vision problems because of their ability to efficiently model complex functions from large amounts of data. While neural networks can be shown to perform well empirically fora variety of tasks, their performance is difficult to guarantee.Neural network verification tools have been developed that can certify robustness with respect to a given input image; however,for neural network systems used in closed-loop controllers,robustness with respect to individual images does not address multi-step properties of the neural network controller and itsenvironment. Furthermore, neural network systems interacting in the physical world and using natural images are operating in a black-box environment, making formal verification in-tractable. This work combines the adaptive stress testing (AST)framework with neural network verification tools to search for the most likely sequence of image disturbances that cause the neural network controlled system to reach a failure. Anautonomous aircraft taxi application is presented, and results show that the AST method finds failures with more likely image disturbances than baseline methods. Further analysis of AST results revealed an explainable cause of the failure, giving insight into the problematic scenarios that should be addressed.

Adaptive Stress Testing, Marabou, Deep Neural Netw↗

DOE OSTI2026

Benchmarking quantum trial wavefunctions for phaseless auxiliary-field quantum Monte Carlo

The phaseless auxiliary-field quantum Monte Carlo (ph-AFQMC) method is a stochastic imaginary-time projection technique for computing ground-state properties of strongly correlated quantum systems, with accuracy that depends critically on the choice of trial wavefunction. Here, we investigate ph-AFQMC with trial states prepared using parameterized quantum circuits. In this work, we present a comprehensive benchmarking study of quantum trial wavefunctions spanning unitary coupled-cluster, Hamiltonian-informed, Jastrow-inspired, and adaptively constructed ansatze. The benchmarking evaluates accuracy, expressibility, and scalability of these ansatze within the QC-AFQMC framework. We test these ansatze on linear hydrogen chains under bond stretching and find that several ansatz families produce chemically accurate ph-AFQMC energies across the dissociation curve. We have performed simulations using the CUDA-Q quantum development platform on the GPU partition of the Perlmutter supercomputer. When comparing ansatze at similar numbers of variational parameters, we find that different ansatz families yield comparable ph-AFQMC results despite exhibiting substantially different variational energies, optimization costs, and circuit depths. Our results indicate that the variational energy of an ansatz is not always a reliable indicator of its quality for ph-AFQMC and reveal instances of over-parameterization. In the strongly correlated regime, trial wavefunctions obtained from adaptive ansatze, exemplified here by ADAPT-VQE with the UCCSD operator pool, can outperform their fixed-ansatz counterparts (UCCSD) in terms of projected energies while using substantially more compact circuits, providing a flexible route to optimize quantum resources within the ph-AFQMC framework.

Rofougaran, Rod [LBNL, Berkeley; Columbia U.; PNL,↗

DOE OSTI2024

Data‐driven variational method for discrepancy modeling: Dynamics with small‐strain nonlinear elasticity and viscoelasticity

Abstract The effective inclusion of a priori knowledge when embedding known data in physics‐based models of dynamical systems can ensure that the reconstructed model respects physical principles, while simultaneously improving the accuracy of the solution in the previously unseen regions of state space. This paper presents a physics‐constrained data‐driven discrepancy modeling method that variationally embeds known data in the modeling framework. The hierarchical structure of the method yields fine scale variational equations that facilitate the derivation of residuals which are comprised of the first‐principles theory and sensor‐based data from the dynamical system. The embedding of the sensor data via residual terms leads to discrepancy‐informed closure models that yield a method which is driven not only by boundary and initial conditions, but also by measurements that are taken at only a few observation points in the target system. Specifically, the data‐embedding term serves as residual‐based least‐squares loss function, thus retaining variational consistency. Another important relation arises from the interpretation of the stabilization tensor as a kernel function, thereby incorporating a priori knowledge of the problem and adding computational intelligence to the modeling framework. Numerical test cases show that when known data is taken into account, the data driven variational (DDV) method can correctly predict the system response in the presence of several types of discrepancies. Specifically, the damped solution and correct energy time histories are recovered by including known data in the undamped situation. Morlet wavelet analyses reveal that the surrogate problem with embedded data recovers the fundamental frequency band of the target system. The enhanced stability and accuracy of the DDV method is manifested via reconstructed displacement and velocity fields that yield time histories of strain and kinetic energies which match the target systems. The proposed DDV method also serves as a procedure for restoring eigenvalues and eigenvectors of a deficient dynamical system when known data is taken into account, as shown in the numerical test cases presented here.

Masud, Arif↗

DOE OSTI2025

De Novo Design of Proteins That Bind Naphthalenediimides, Powerful Photooxidants with Tunable Photophysical Properties

De novo protein design provides a framework to test our understanding of protein function and build proteins with cofactors and functions not found in nature. Here, we report the design of proteins designed to bind powerful photooxidants and the evaluation of the use of these proteins to generate diffusible small-molecule reactive species. Because excited-state dynamics are influenced by the dynamics and hydration of a photooxidant’s environment, it was important to not only design a binding site but also to evaluate its dynamic properties. Thus, we used computational design in conjunction with molecular dynamics (MD) simulations to design a protein, designated NBP (NDI Binding Protein), that held a naphthalenediimide (NDI), a powerful photooxidant, in a programmable molecular environment. Solution NMR confirmed the structure of the complex. We evaluated two NDI cofactors in this de novo protein using ultrafast pump–probe spectroscopy to evaluate light-triggered intra- and intermolecular electron transfer function. Moreover, we demonstrated the utility of this platform to activate multiple molecular probes for protein labeling.

carbonyls↗

DOE OSTI2026

The DESI DR1 peculiar velocity survey: Growth rate measurements from the galaxy power spectrum

The large-scale structure of the Universe and its evolution encapsulate a wealth of cosmological information. A powerful means of unlocking this knowledge lies in measuring the auto-power spectrum and/or the cross-power spectrum of the galaxy density and momentum fields, followed by the estimation of cosmological parameters based on these spectrum measurements. In this study, we generalize the cross-power spectrum model to accommodate scenarios in which the density and momentum fields are derived from distinct galaxy surveys. The growth rate of the large-scale structures of the Universe, commonly represented as fσ 8 , was extracted by jointly fitting the monopole and quadrupole moments of the auto-density power spectrum, the monopole of the auto-momentum power spectrum, and the dipole of the cross-power spectrum. Our estimators, theoretical models, and parameter-fitting framework were tested using mocks, confirming their robustness and accuracy in retrieving the fiducial growth rate from simulation. These techniques were then applied to analyse the power spectrum of the DESI Bright Galaxy Survey and Peculiar Velocity Survey. The fit result of the growth rate is fσ8 = 0.440$^{+0.080}_{−0.096}$ at effective redshift zeff = 0.07. By synthesizing the fitting outcomes from correlation functions, maximum likelihood estimation, and the power spectrum, a consensus value is yielded of fσ 8 (z eff = 0.07) = 0.450$^{+0.055}_{−0.055}$, and correspondingly we obtain γ = 0.580$^{+0.110}_{−0.110}$, Ω m = 0.301$^{+0.011}_{−0.011}$, and σ 8 = 0.834$^{+0.032}_{−0.032}$. The measured fσ8 and γ are consistent with the prediction of the Λ cold dark matter model and general relativity.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Local adaptation of both plant and pathogen: an arms‐race compromise in switchgrass rust

In coevolving species, parasites locally adapt to host populations as hosts locally adapt to resist parasites. Parasites often outpace host local adaptation since they have rapid life cycles, but host diversity, the strength of selection, and external environmental influence can result in complex outcomes. To better understand local adaptation in host–parasite systems, we examined locally adapted switchgrass (Panicum virgatum), and its leaf rust pathogen (Puccinia novopanici) across a latitudinal range in North America. We grew switchgrass genotypes in 10 replicated multiyear common gardens, measuring rust severity from natural infection in a ‘host reciprocal transplant’ framework for testing local adaptation. We conducted genome-wide association mapping to identify genetic loci associated with rust severity. Genetically differentiated rust populations were locally adapted to northern and southern switchgrass, despite host local adaptation to environmental conditions in the same regions. Rust resistance was polygenic, and distinct loci were associated with rust severity in the north and south. We narrowed a previously identified large-effect quantitative trait locus for rust severity to a candidate YELLOW STRIPE-LIKE gene and linked numerous other loci to defense-related genes. Overall, our results suggest that both hosts and parasites can be simultaneously locally adapted, especially when parasites impose less selection than other environmental factors.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

AI for Earthquake Physics

The core LANL program sponsored by Office of Science, Basic Energy Science, Chemical Sciences, Geosciences, and Biosciences (DOE-BES-CSGB) and led by PI Johnson aims to research earthquake faults to advance fault physics and earthquake hazards. All work completed is required to be made publicly available through publications and open-source codes supporting the published results. All routines are/will-be written in open source python and applied to publicly available data sets. These routines will format data from input into models, develop and test modeling frameworks for the problems addressed, and produce figures applicable to peer-reviewed manuscripts. All work is reviewed for Los Alamos Unlimited Release before submitting to a journal. This summary encompasses recently completed work and work to be complete for the duration of the program.

Johnson, Christopher↗

DOE OSTI2025

Review of Grey Box/Black Box Data Contamination Metrics on Open and Commercial Models

Dataset contamination is a problem where benchmarks and tasks used to evaluate the capabilities of Large Language Models (LLMs) have been incorporated into the training dataset of the models. This gives a false sense of performance that can overestimate how these models will function on truly unseen data. This problem becomes worse with commercial LLMs with larger and non-accessible training data, so techniques have been developed to try to measure the degree to which a model is contaminated with a benchmark’s data. To understand the effectiveness of these techniques, particularly when evaluating contamination on coding tasks, we review trends and categorize techniques by the degree of access to the model that is required. The research literature on this topic has reported mixed effectiveness of these techniques, so we select a set of black box (text access only) and grey box (access to model loss/probabilities required) techniques and apply them to both commercial and non-commercial models. We implement these metrics as part of a framework to test the contamination of Python code in LLMs to see to what extent we can replicate the effectiveness (or ineffectiveness) of these contamination detection techniques. Though we find mixed results in the capabilities of these metrics to identify contamination, we do observe evidence that they can identify contamination (broadly) in fine-tuned models when both a baseline and fine-tuned model is present. Additionally, similarity metrics were able to identify between contaminated and uncontaminated data even in situations where the data is distributionally similar (e.g., drawn from the same set of code projects).

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Tuning Shinkarev’s Bicycle: Separating the Parallel Cycles of Photosystem II Using Empirical Wavelet Transform

The oxygen-evolving complex (OEC) of Photosystem II (PSII) catalyzes light-driven water oxidation, a process necessary to sustain Earth’s atmospheric oxygen. Oxygen yields measured during single-turnover flash sequences exhibit period-four oscillations, which form the basis of the Joliot–Kok (S-state) model. However, when the oscillations of other processes contribute to the measured oxygen yield, fitting methods can conflate these signals and distort estimates of inefficiencies and initial S-state populations. To address this, we applied the empirical wavelet transform (EWT) as a model-independent method to separate overlapping oscillators and capture damping dynamics that are not well represented in Fourier analysis. We tested this framework on polarographic flash-oxygen traces from both our Synechocystis sp. PCC 6803 thylakoid membrane preparations and archival datasets on Chlorella and isolated chloroplasts. EWT consistently resolves the expected period-four component alongside a distinct binary oscillation. Simulations suggest that fitting this isolated period-four signal recovers VZAD parameters more accurately than analysis of raw traces, yielding different estimates for S-state distributions and transition probabilities. Notably, this binary oscillation aligns closely with semiquinone dynamics predicted solely from period-four fit parameters. These findings indicate that EWT can effectively distinguish complex signals in oxygen evolution, offering a framework potentially applicable to other spectroscopic probes of the S-state cycle.

Ferrari, Nicholas [Louisiana State Univ., Baton Ro↗

DOE OSTI2026

Improving the Confidence in Retrievals of Vertical Distributions of Cloud Condensation Nuclei Number Concentration from ARM Supported by Aircraft In Situ Observations

Accurate quantification of the vertical distribution of cloud condensation nuclei (CCN) number concentrations is critical for improving our understanding of aerosol–cloud interactions. Ground-based Raman lidars operated by the Atmospheric Radiation Measurement (ARM) program, together with surface CCN measurements, are used to retrieve vertically resolved CCN number concentrations (Retrieved Number concentration of CCN, RNCCN). These retrievals rely on several assumptions, including that aerosol composition is vertically homogeneous. To assess this assumption, we developed and tested a framework to infer the dominant aerosol classes/types at different altitudes. This was done by applying a k-Nearest-Neighbors (kNN) algorithm to lidar ratio and linear depolarization ratio measurements from Raman lidar. We evaluated the framework using aircraft aerosol and CCN measurements from the ARM Holistic Interactions of Shallow Clouds, Aerosols, and Land Ecosystems (HI-SCALE) field campaign. The results show that RNCCN performance degrades as vertical aerosol complexity increases, i.e., RNCCN agrees with the aircraft CCN in vertically homogeneous conditions, but closure decreases in layered aerosol structures. To generalize beyond individual examples, we introduce a metric (heterogeneity index) that quantifies the vertical complexity by assessing the variation of inferred aerosol classes/types. Case-level statistics show a tendency for RNCCN and aircraft differences to increase with this metric. By detecting retrievals that are likely compromised by aerosol vertical heterogeneity, the proposed framework improves the interpretability and effective use of RNCCN used for long-term evaluation of models and aerosol–cloud interactions.

Tian, Jingjing↗

DOE OSTI2026

Improving thermodynamic nudging in the E3SM Atmosphere Model version 2 (EAMv2): strategy and hindcast skills on weather systems

Nudging techniques are commonly employed to constrain atmospheric simulations toward observed states, facilitating model evaluation and sensitivity studies. However, if applied improperly – particularly to thermodynamic variables such as temperature and humidity – nudging can distort physical processes and introduce spurious biases, undermining the credibility of the simulations. This study presents an improved nudging implementation that applies vertically modulated tendencies to reduce adverse impacts on model physics. The framework is tested in version 2 of the Energy Exascale Earth System Model (EAMv2) using a suite of hindcast simulations nudged toward ERA5 reanalysis. We systematically evaluate the individual and combined effects of nudging wind, temperature, and humidity fields on the model's ability to represent large-scale atmospheric states and high-impact weather systems. Results show that the revised strategy – particularly when nudging temperature and humidity at selected levels – enhances hindcast skill by improving agreement with ERA5 without degrading the hydrological cycle or precipitation processes. Additional improvements in surface temperature, outgoing longwave radiation, and precipitation biases are achieved through targeted nudging of land-surface variables. The proposed approach strengthens the representation of large-scale conditions relevant to tropical cyclones, atmospheric rivers, and extratropical cyclones in the low-resolution EAMv2. These findings demonstrate that carefully designed thermodynamic nudging, especially of temperature and humidity, improves the realism of constrained simulations and broadens the utility of nudged EAMv2 for atmospheric modeling, machine learning, and high-impact weather research.

Atmospheric river↗

NASA NTRS1983

Rastall's and related theories are conservative gravitational theories although physically inequivalent to general relativity

The proper framework for testing Rastall's theory and its generalizations is in the case of non-negligible (i.e. discernible) gravitational effects such as gravity gradients. These theories have conserved integral four-momentum and angular momentum. The Nordtvedt effect then provides limits on the parameters which arise as the result of the non-zero divergence of the energy-momentum tensor.

Smalley, L. L.↗

NASA NTRS1992

Atmospheric effects on ejecta emplacement and crater formation on Venus from Magellan

Surface signatures of energy partitioning are used as a framework for testing extrapolations from laboratory experiments and other planetary settings to assess the effects of both gravity and an atmosphere on impact crater formation on Venus. The dense lower atmosphere of Venus is found to assume the role of a low-density target for bodies smaller than about 4 km in diameter. Air blasts created by cratering in the atmosphere produce distinctive surface signatures that allow the derivation of an independent assessment of impactor energy at the limit of break up. Dynamic pressures during entry of larger bodies will exceed their strength limit but may not prevent penetration of the atmosphere due to aerodynamic reshaping that minimizes the drag coefficient. This process may account for the formation of unusually small craters (1-3 km). The dense atmosphere of Venus preserves signatures of early time cratering processes on the surface that are typically lost on atmosphere-free surfaces.

Schultz, Peter H.↗

NASA NTRS2003

Earth's earliest biosphere-a proposal to develop a collection of curated archean geologic reference materials

The discovery of evidence indicative of life in a Martian meteorite has led to an increase in interest in astrobiology. As a result of this discovery, and the ensuing controversy, it has become apparent that our knowledge of the early development of life on Earth is limited. Archean stratigraphic successions containing evidence of Earth's early biosphere are well preserved in the Pilbara Craton of Western Australia. The craton includes part of a protocontinent consisting of granitoid complexes that were emplaced into, and overlain by, a 3.51-2.94 Ga volcanigenic carapace - the Pilbara Supergroup. The craton is overlain by younger supracrustal basins that form a time series recording Earth history from approximately 2.8 Ga to approximately 1.9 Ga. It is proposed that a well-documented suite of these ancient rocks be collected as reference material for Archean and astrobiological research. All samples would be collected in a well-defined geological context in order to build a framework to test models for the early evolution of life on Earth and to develop protocols for the search for life on other planets.

Archaea↗