Search NASA⌕ Search

SEARCH · Search NASA

Results for “independent evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Recommendations for Comprehensive and Independent Evaluation of Machine Learning‐Based Earth System Models

Abstract Machine learning (ML) is a revolutionary technology with demonstrable applications across multiple disciplines. Within the Earth science community, ML has been most visible for weather forecasting, producing forecasts that rival modern physics‐based models. Given the importance of deepening our understanding and improving predictions of the Earth system on all time scales, efforts are now underway to develop Earth‐system models (ESMs) capable of representing all components of the coupled Earth system (or their aggregated behavior) and their response to external changes over long timescales. Building trust in ESMs is a much more difficult problem than for weather forecast models, not least because the model must represent the alternate (e.g., future or paleoclimatic) coupled states of the system for which there are no direct observations. Given that the physical principles that enable predictions about the response of the Earth system are often not explicitly coded in these ML‐based models, demonstrating the credibility of ML‐based ESMs thus requires us to build evidence of their consistency with the physical system. To this end, this paper puts forward five recommendations to enhance comprehensive, standardized, and independent evaluation of ML‐based ESMs to strengthen their credibility and promote their wider use.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Evaluation of a frequency-dependent phase shift in chirped Raman lasers for atom gravimeters

Light-pulse atom gravimetry has emerged as a powerful technique for precisely measuring absolute gravitational acceleration. Raman lasers are commonly used in this technique to coherently manipulate the atomic wave packet, of which the effective frequency is chirped continuously to compensate for the Doppler shift. In this study we investigate an additional phase shift in the Raman lasers that arises due to the frequency chirp. Here, we directly measure this phase shift by recording the beat signal of the Raman lasers with a high-speed oscilloscope, providing an independent evaluation of the resultant error in atom gravimeters caused by this phase shift. Concurrently, we detect the influence of the additional phase shift on gravity measurements using our atom gravimeter, and the results are in good agreement with the independent evaluation. Notably, there may still be a residual error at the microgal level when performing differential measurements by reversing the direction of the effective wave vector of the Raman lasers. We propose that this residual error can in principle be eliminated by selecting the same chirp frequency range for both directions in the differential measurement.

Xu, Yaoyao [Huazhong Univ. of Science and Technolo↗
DOE OSTI2023

Machine learning models inaccurately predict current and future high-latitude C balances

The high-latitude carbon (C) cycle is a key feedback to the global climate system, yet because of system complexity and data limitations, there is currently disagreement over whether the region is a source or sink of C. Recent advances in big data analytics and computing power have popularized the use of machine learning (ML) algorithms to upscale site measurements of ecosystem processes, and in some cases forecast the response of these processes to climate change. Due to data limitations, however, ML model predictions of these processes are almost never validated with independent datasets. To better understand and characterize the limitations of these methods, we develop an approach to independently evaluate ML upscaling and forecasting. We mimic data-driven upscaling and forecasting efforts by applying ML algorithms to different subsets of regional process-model simulation gridcells, and then test ML performance using the remaining gridcells. In this study, we simulate C fluxes and environmental data across Alaska using ecosys, a process-rich terrestrial ecosystem model, and then apply boosted regression tree ML algorithms to training data configurations that mirror and expand upon existing AmeriFLUX eddy-covariance data availability. We first show that a ML model trained using ecosys outputs from currently-available Alaska AmeriFLUX sites incorrectly predicts that Alaska is presently a modeled net C source. Increased spatial coverage of the training dataset improves ML predictions, halving the bias when 240 modeled sites are used instead of 15. However, even this more accurate ML model incorrectly predicts Alaska C fluxes under 21st century climate change because of changes in atmospheric CO 2 , litter inputs, and vegetation composition that have impacts on C fluxes which cannot be inferred from the training data. Our results provide key insights to future C flux upscaling efforts and expose the potential for inaccurate ML upscaling and forecasting of high-latitude C cycle dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Structural variant analysis of a cancer reference cell line sample using multiple sequencing technologies

The cancer genome is commonly altered with thousands of structural rearrangements including insertions, deletions, translocation, inversions, duplications, and copy number variations. Thus, structural variant (SV) characterization plays a paramount role in cancer target identification, oncology diagnostics, and personalized medicine. As part of the SEQC2 Consortium effort, the present study established and evaluated a consensus SV call set using a breast cancer reference cell line and matched normal control derived from the same donor, which were used in our companion benchmarking studies as reference samples. We systematically investigated somatic SVs in the reference cancer cell line by comparing to a matched normal cell line using multiple NGS platforms including Illumina short-read, 10X Genomics linked reads, PacBio long reads, Oxford Nanopore long reads, and high-throughput chromosome conformation capture (Hi-C). We established a consensus SV call set of a total of 1788 SVs including 717 deletions, 230 duplications, 551 insertions, 133 inversions, 146 translocations, and 11 breakends for the reference cancer cell line. To independently evaluate and cross-validate the accuracy of our consensus SV call set, we used orthogonal methods including PCR-based validation, Affymetrix arrays, Bionano optical mapping, and identification of fusion genes detected from RNA-seq. We evaluated the strengths and weaknesses of each NGS technology for SV determination, and our findings provide an actionable guide to improve cancer genome SV detection sensitivity and accuracy. A high-confidence consensus SV call set was established for the reference cancer cell line. A large subset of the variants identified was validated by multiple orthogonal methods.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Temperature-dependent mechanical properties and crystal plasticity parameters for additively manufactured Haynes-214 alloy: Experiments and numerical modeling

Our experimental mechanical testing data demonstrated that the additively manufactured (AM) laser powder bed fusion (L-PBF) Haynes-214 alloy exhibits non-linear mechanical properties as the temperature rises from ambient to 870 °C. Crystal plasticity (CP) simulations provide an effective approach to gaining deeper insights into microstructure-property linkages under thermomechanical loading. This method can reduce the need for costly high-temperature mechanical testing while accounting for the effects of crystallographic texture and grain morphology on the mechanical behavior of AM materials. However, calibrating a CP model is time-consuming because individual simulations are computationally expensive and hundreds (or more) of iterations over parameter sets may be required. To address this issue, we have designed a machine learning-differential evolution (ML-DE) CP framework that can accurately interpolate the tensile properties of AM L-PBF Haynes-214 alloy across a wide temperature range from ambient to 870 °C, with minimal reliance on experimental data. The framework uses electron backscatter diffraction (EBSD) measurements to generate statistically equivalent microstructural volume elements to serve as inputs to the CP modeling framework. Stress–strain curves were generated from 1000 CP simulations, which serve as the training data set for the three ML regression algorithms explored: linear, extra-trees, and multi-layer perceptron. These three regression models were independently evaluated to compare their efficiency and identify the most suitable algorithm for the given problem. Results revealed that the extra-trees ML regressor outperforms the other models in both qualitative and quantitative aspects with an R 2 of 0.98. Subsequently, the differential evolution optimization approach is employed to calibrate the ML-based CP material parameters with experimental results obtained at various temperatures. Finally, temperature-dependent CP material parameters are formulated. The effectiveness and efficiency of the designed framework are validated through comparison with experimental results, demonstrating a high degree of agreement. These calibrated parametric constitutive equations enable further use of the CP model to study the deformation behavior of this alloy under a wide range of thermo-mechanical loading conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Enhancing the Quality and Reliability of Machine Learning Interatomic Potentials through Better Reporting Practices

Recent developments in machine learning interatomic potentials (MLIPs) have empowered even nonexperts in machine learning to train MLIPs for accelerating materials simulations. However, reproducibility and independent evaluation of presented MLIP results is hindered by a lack of clear standards in current literature. In this Perspective, we aim to provide guidance on best practices for documenting MLIP use while walking the reader through the development and deployment of MLIPs including hardware and software requirements, generating training data, training models, validating predictions, and MLIP inference. We also suggest useful plotting practices and analyses to validate and boost confidence in the deployed models. Finally, we provide a step-by-step checklist for practitioners to use directly before publication to standardize the information to be reported. Altogether, we hope that our work will encourage the reliable and reproducible use of these MLIPs, which will accelerate their ability to make a positive impact in various disciplines including materials science, chemistry, and biology, among others.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Source Characterization of the Declared North Korean Nuclear Tests From Regional Distance Coda Wave Spectral Ratios

Abstract Seismic observations of underground nuclear explosions provide crucial data on source yield and depth that cannot easily be estimated from other geophysical methods. However, it is difficult to obtain reliable yield estimates for test sites for which we do not have direct seismic calibration experiments. To obtain source information from uncalibrated sites and paths, local and regional seismic records of six, proximal, declared underground nuclear explosions in North Korea are used to compute spectral ratios of narrow‐band waveform envelopes of body‐wave coda that remove path and site effects to reveal precise, relative source moment. The yields of these explosions are obtained from the observed source ratios by simultaneously fitting the classical source model of Mueller and Murphy (1971), https://doi.org/10.1785/bssa0610061675 to all event pairs. The source model provides an impressive fit to the observations considering that the P phase coda derived source spectral ratios did not require a prior knowledge of the source or regionally calibrated corrections to be applied to the data. However, the observed corner frequencies from S wave coda spectral ratios are lower than the source model predictions, but are well fit by models calculated using the corner frequency consistent with the Fisk conjecture. The results presented here provide novel constraints on the spectral distributions of the energy radiated by the sources of the DPRK test series, and allows for an independent evaluation of existing estimated source model parameters.

58 GEOSCIENCES↗
DOE OSTI2023

Influence of Correlations on the Thermal Performance Modeling of Parabolic Trough Collectors

The influence of correlations on the thermal performance modeling of parabolic trough collectors was analyzed in this work. A versatile model for a parabolic trough collector was developed that allows one- and two-dimensional analysis and enables the use of correlations to calculate thermophysical properties and convection heat transfer coefficients. The model also allows the use of constant values for properties and/or coefficients obtained from the evaluation correlations at a specific temperature. The effect of each correlation was evaluated independently, and the results were compared with a reference case that considered a two-dimensional approach and used all the correlations. For the analyzed cases, the correlation for the absorber emittance has the strongest impact on the collector efficiency, leading to a lower error when used. Based on the results, a one-dimensional model approach considering a correlation for the absorber emittance leads to efficiency errors below 3% for collector lengths of up to 243.6 m. Compared with the reference case, a one-dimensional approach using all correlations for a collector with a length of 500 m, and operating with an inlet temperature of 773 K, can result in errors around 9%. However, using constant values for properties and heat transfer coefficients could lead to errors of up to 50%. Multiple thermal models for parabolic trough collectors proposed in the literature rely on a one-dimensional approach, estimated values for the heat transfer coefficients, and constant thermophysical properties. The errors associated with those approaches are analyzed and quantified in this work as a function of the collector length and operation temperature.

absorber emittance↗
DOE OSTI2024

Overall Cooling Effectiveness With Internal Serpentine Channels and Optimized Film Cooling Holes

Abstract The overall cooling effectiveness for gas turbine airfoils is a function of the combined cooling due to internal cooling configurations and film cooling configurations. Typically, film cooling configurations are evaluated independent of the cooling effects of the internal feed channels, generally based on adiabatic effectiveness measurements. In this study, we consider the coupled effects of internal cooling and film cooling configurations through measurements of overall cooling effectiveness for film cooling holes fed by a coflow/counterflow channel and a serpentine channel. A film cooling hole designed by adjoint optimization techniques (X-AOpt) is compared to a standard-shaped hole with 7 deg forward and lateral expansions (7-7-7 SI). Experiments without film cooling showed that the serpentine channel had 35–50% greater overall cooling effectiveness than the straight, coflow channel. Experiments with the X-AOpt hole combined with a serpentine channel showed an area-averaged overall cooling effectiveness of ϕ¯¯=0.58, which was a 70% increase compared to the overall cooling effectiveness of the serpentine channel without film cooling. When the X-AOpt hole was fed with a coflow channel with similar coolant mass flowrate, the overall cooling effectiveness was ϕ¯¯=0.44, i.e., 30% lower than when using the serpentine channel. Interestingly, adiabatic effectiveness measurements with the X-AOpt holes showed a more uniform hole-to-hole performance when using the serpentine channel compared to the coflow channel.

Engineering↗
DOE OSTI2023

Materials and Fuels Complex Operations Management Improvement Strategy for Fiscal Year 2023

The Materials and Fuels Complex (MFC) has experienced substantial growth in terms of staff, research, and production in recent years. MFC operational performance has effectively kept pace with this growth. However, to capture the continuous improvement actions needed to improve effectiveness and increase the efficiency of our management systems, a broad operations management strategy is necessary. The MFC Operations Management Improvement (OMI) Strategy is complementary to the MFC Five-Year Mission and Investment Strategies and the MFC Management Plan. The OMI strategy is structured to address the management systems outlined in the Nuclear Facility Management Standard Operations Model. Selected management systems are evaluated independently in chapters that describe the prior 5 years of performance improvement, a description of improvement actions for the MFC staff that directly perform within or contribute to the management system, process improvements, and any needed equipment improvements. Chapter selection is based on a management system’s need for improvement. In some cases, management systems may be combined in a single chapter. Additional chapters are added to address subject areas not formally described in the standard operations model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Validating Protection System Behavior with Machine Learning in a Master State Overseer

As power system protection devices continue the widespread transition from analog to digital, they become increasingly intricate. The internal functions and communication between critical grid components must now be significantly more complex to keep up with the demands of the modern smart grid. This brings increased difficulty in maintenance and monitoring, making it harder to identify potential misoperation, power anomalies, and cyber threats. Such issues are often only pinpointed after an exhaustive and costly post-mortem analysis, when a major outage or damage has already occurred. A solution is needed for validating protection systems as they operate, independently evaluating grid state and confirming whether the protection system is behaving accordingly. As opposed to incident response, this acts as a constant verification mechanism that raises a flag when subtler issues are noticed, catching them earlier and preventing larger incidents. This work presents the implementation of such a system, expanding on the prototype developed by the authors in a previous paper. This is accomplished with a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. Additionally, this system is contextualized within a larger, modular Master State awareness Overseer (MSO) framework, responsible for monitoring, analyzing, and managing an electric grid.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Fission Product Yield Modeling and Evaluation

Although independent and cumulative fission product yields have been a part of evaluated libraries for decades, there have been few updates over the years. The fission product yield sub-library in the ENDF/B-VIII.0 library is still largely based on the evaluation of England and Rider from the mid-90’s, with only more recent updates to the energy dependence of 239 Pu below 2 MeV and fixes to isomeric states and missing fission products. Over the past several years, there have been a wealth of new measurements of independent and cumulative fission product yields, particularly those with short half-lives, and there have been significant improvements in the modeling of prompt and delayed fission observables. Here, we describe recent progress in the improvement of fission product yield calculations, using the BeoH code and the underlying Hauser Fesh-bach Fission Fragment Decay (HF 3 D) model, developed at Los Alamos National Laboratory. We will describe our recent calculations for consistent prompt and delayed fission observables for major and minor actinides, including new work investigating isomeric ratios. We will detail the ongoing evaluation process for energy-dependent fission product yields from thermal up to 20 MeV incident neutron energy and some validation work that has been performed for these new fission product yield calculations. Additionally, we will discuss future perspectives of this work, highlighting the need for additional data.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2023

Shading contributes to Sphagnum decline in response to warming

Experimental warming of an ombrotrophic bog in northern Minnesota has caused a rapid decline in the productivity and areal cover of Sphagnum mosses, affecting whole-ecosystem carbon balance and biogeochemistry. Direct effects of elevated temperature and the attendant drying are most likely the primary cause of the effects on Sphagnum, but there may also be responses to the increased shading from shrubs, which increased with increasing temperature. To evaluate the independent effects of reduction in light availability and deposition of shrub litter on Sphagnum productivity, small plots with shrubs removed were laid out adjacent to the warming experiment on hummocks and hollows in three blocks and with five levels of shading. Four plots were covered with neutral density shade cloth to simulate shading from shrubs of 30%–90% reduction in light; one plot was left open. Growth of Sphagnum angustifolium/fallax and S. divinum declined linearly with increasing shade in hollows, but there was no response to shade on hummocks, where higher irradiance in the open plots may have been inhibitory. Shading caused etiolation of Sphagnum—they were thin and spindly under the deepest shade. A dense mat of shrub litter, corresponding to the amount of shrub litter produced in response to warming, did not inhibit Sphagnum growth or cause increases in potentially toxic base cations. CO 2 exchange and chlorophyll-a fluorescence of S. angustifolium/fallax from the 30% and 90% shade cloth plots were measured in the laboratory. Light response curves indicate that maximal light saturated photosynthesis was 42% greater for S. angustifolium/fallax grown under 30% shade cloth relative to plants grown under 90% shade cloth. The response of Sphagnum growth in response to increasing shade is consistent with the hypothesis that increased shade resulting from shrub expansion in response to experimental warming contributed to reduced Sphagnum growth.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Electroslag additive manufacturing: A pathway for high throughput near net shape production

Electroslag Additive Manufacturing (ESAM), a new high-throughput additive manufacturing (AM) method that combines Electroslag Strip Cladding (ESC) and wire arc AM (WAAM) is introduced. This combination enables the high deposition rate of ESC (more than 20 kg/h with a 60 mm strip electrode) to benefit from the precise geometric control of WAAM. As a precursor to ESAM, the ESC process is investigated in an AM context independently by evaluating both direct and staggered bead-stacking strategies and analyzing the microstructural and mechanical properties of each. This is followed by an ESAM demonstration producing an annular geometry by pairing ESC with gas tungsten arc welding (GTAW), wherein GTAW is utilized to construct annular walls that are subsequently infilled via ESC. The microstructure and mechanical properties of ESC-only AM are compared with that of the ESAM method and it is shown that printed integral retaining walls do not impact the resulting mechanical properties of ESAM. Furthermore, results indicate that ESAM-produced Alloy 625 parts exhibit tensile properties on par with cast counterparts, supporting the method’s scalability to components exceeding one metric ton, and possibly making ESAM a viable future manufacturing approach for competitive production of large-scale components currently manufactured by casting and forging.

Additive manufacturing↗
DOE OSTI2025

Nernst power factor and figure of merit in the compensated semimetal ScSb

Recently, topological semimetals have emerged as strong candidates for solid-state thermomagnetic refrigerators due to their enhanced Nernst effect. This enhancement arises from the combined contributions of the Berry-curvature-induced anomalous Nernst coefficient associated with topological bands and the normal Nernst effect resulting from synergistic electron-hole compensation. Generally, these two effects are intertwined in topological semimetals, making it challenging to evaluate them independently. Here, we report the observation of a high Nernst effect in the electron-hole compensated semimetal ScSb with topologically trivial electronic band structures. Remarkably, we find a high maximum Nernst power factor of 𝑃⁢𝐹 𝑁 ∼ 35 × 10 −4 W m −1 K −2 in ScSb. The Nernst thermopower (𝑆 𝑥⁢𝑦 ) exhibits a peak of ∼ 47 µ⁢V/K at 12 K and 14 T, yielding a Nernst figure of merit (𝑧 𝑁 ) of ∼ 28 × 10 −4 K −1 . Notably, despite its trivial electronic band structure, both the 𝑃⁢𝐹 𝑁 and 𝑧 𝑁 values of ScSb are comparable to those observed in topological semimetals with Dirac band dispersions. In conclusion, the origin of the large Nernst signal in ScSb is explained by compensated electron and hole carriers, through Hall resistivity measurements, angle-resolved photoemission spectroscopy, and density functional theory calculations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2026

Quantifying Operational Drivers of Multimodal Biometric Verification in Aerial Surveillance

Multimodal biometric verification is increasingly applied across operational contexts ranging from close-range security cameras and building-mounted surveillance to long-range ground sensors and unmanned aerial system (UAS) imagery. Variations in acquisition conditions—such as image resolution, viewing geometry, and motion artifacts—pose significant challenges for cross-domain algorithmic generalization. This study evaluates two independent multimodal biometric verification systems developed under the Intelligence Advanced Research Projects Activity (IARPA) Biometric Recognition and Identification at Altitude and Range (BRIAR) program, comparing performance on close-range and aerial datasets. Close-range video served as a baseline to quantify the decline in verification performance on aerial footage. The dataset included six UAS platforms, spanning small quadcopters at 10m altitude to medium-sized fixed-wing aircraft at 360m. Mixed-effects logistic regression identified image resolution (head and body pixel counts), head height, sensor characteristics, and algorithm selection as primary determinants of verification success, whereas demographic attributes and mission gait were not significant predictors. Activity type and collection site influenced performance in close-range data but had negligible impact on UAS imagery. These results clarify modality-specific strengths and limitations and highlight opportunities to enhance cross-domain biometric verification.

Peluso, Alina [ORNL] (ORCID:0000000328950406)↗
DOE OSTI2023

Prompt fission neutron multiplicity in the 239 Pu(n, f) reaction and its energy dependence

Measuring prompt fission neutrons to high precision is an experimental challenge, especially for radioactive fissioning nuclides. However, accurate average multiplicities, $\overline{v}_{p}$, and kinetic energy distributions of prompt fission neutrons are essential for fundamental and applied nuclear physics. We present here a recent measurement of the 239 Pu (n,f) $\overline{v}_{p}$ as a function of the incident-neutron energy, over the range 1-700 MeV. The measurement was performed with a cutting-edge setup and an innovative technique, which allowed to minimize and account for the main sources of bias. An unprecedented precision was therefore achieved. Our data are compared to GEF predictions as well as to evaluated libraries. For the first time, at low energies, the ENDF/B-VIII.0 nuclear data evaluation is validated with an independent measurement and the evaluated uncertainty reduced by up to 60%. This work paves the way to precisely measure prompt fission neutron multiplicities on highly radioactive nuclei.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗