Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Interpretable Deep Learning for Advancing Field-Enhanced Catalysis

This DOE Early Career project developed a physics-informed, interpretable AI-and-modeling framework to understand and exploit electric-field effects in heterogeneous catalysis, with ammonia cracking and synthesis as a representative pathway. The team built and validated methods to map local electric fields on metal surfaces and nanoparticles, showing that low-coordination features (tips/edges/corners) can concentrate fields by several-fold relative to flat facets. Using DFT-generated datasets, the project created physics-guided machine learning models that rapidly predict local electric fields and field-dependent adsorption energetics with near-DFT accuracy while reducing computational cost by orders of magnitude. These predictions were integrated with microkinetic modeling to quantify how field-dipole interactions reshape reaction energetics and mechanisms, enabling large increases in predicted catalytic rates and substantial reductions in operating temperature under favorable field conditions. To accelerate discovery of earth-abundant catalysts, the project combined interpretable ML screening (with electronic-structure descriptors identified as key drivers) with a generative inverse-design workflow based on diffusion models and physics constraints. The resulting closed-loop approach, linking simulation, mechanistic modeling, and AI, provides reusable tools and datasets for designing catalysts and operating conditions in field-enhanced catalysis, with broad relevance to electrostatic catalysis, plasma catalysis, electrocatalysis, and other energy-related chemical transformations.

30 DIRECT ENERGY CONVERSION↗

Whole genome sequencing of Mycobacterium bovis directly from clinical tissue samples without culture

Advancement in next generation sequencing offers the possibility of routine use of whole genome sequencing (WGS) for Mycobacterium bovis (M. bovis) genomes in clinical reference laboratories. To date, the M. bovis genome could only be sequenced if the mycobacteria were cultured from tissue. This requirement for culture has been due to the overwhelmingly large amount of host DNA present when DNA is prepared directly from a granuloma. To overcome this formidable hurdle, we evaluated the usefulness of an RNA-based targeted enrichment method to sequence M. bovis DNA directly from tissue samples without culture. Initial spiking experiments for method development were established by spiking DNA extracted from tissue samples with serially diluted M. bovis BCG DNA at the following concentration range: 0.1 ng/μl to 0.1 pg/μl (10 –1 to 10 –4 ). Library preparation, hybridization and enrichment was performed using SureSelect custom capture library RNA baits and the SureSelect XT HS2 target enrichment system for Illumina paired-end sequencing. The method validation was then assessed using direct WGS of M. bovis DNA extracted from tissue samples from naturally (n = 6) and experimentally (n = 6) infected animals with variable Ct values. Direct WGS of spiked DNA samples achieved 99.1% mean genome coverage (mean depth of coverage: 108×) and 98.8% mean genome coverage (mean depth of coverage: 26.4×) for tissue samples spiked with BCG DNA at 10 –1 (mean Ct value: 20.3) and 10 –2 (mean Ct value: 23.4), respectively. The M. bovis genome from the experimentally and naturally infected tissue samples was successfully sequenced with a mean genome coverage of 99.56% and depth of genome coverage ranging from 9.2× to 72.1×. The spoligoyping and M. bovis group assignment derived from sequencing DNA directly from the infected tissue samples matched that of the cultured isolates from the same sample. Our results show that direct sequencing of M. bovis DNA from tissue samples has the potential to provide accurate sequencing of M. bovis genomes significantly faster than WGS from cultures in research and diagnostic settings.

59 BASIC BIOLOGICAL SCIENCES↗

First Cosmology Results Using SNe Ia from the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation [First Cosmology Results Using Type IA Supernovae from the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation]

We present the analysis underpinning the measurement of cosmological parameters from 207 spectroscopically classified SNe Ia from the first 3 years of the Dark Energy Survey Supernova Program (DES-SN), spanning a redshift range of 0.017 < z < 0.849. We combine the DES-SN sample with an external sample of 122 low-redshift (z < 0.1) SNe Ia, resulting in a "DES-SN3YR" sample of 329 SNe Ia. Our cosmological analyses are blinded: after combining our DES-SN3YR distances with constraints from the Cosmic Microwave Background, our uncertainties in the measurement of the dark energy equation-of-state parameter, w, are 0.042 (stat) and 0.059 (stat+syst) at 68% confidence. We provide a detailed systematic uncertainty budget, which has nearly equal contributions from photometric calibration, astrophysical bias corrections, and instrumental bias corrections. We also include several new sources of systematic uncertainty. While our sample is less than one-third the size of the Pantheon sample, our constraints on w are only larger by 1.4×, showing the impact of the DES-SN Ia light-curve quality. We find that the traditional stretch and color standardization parameters of the DES-SNe Ia are in agreement with earlier SN Ia samples such as Pan-STARRS1 and the Supernova Legacy Survey. However, we find smaller intrinsic scatter about the Hubble diagram (0.077 mag). Interestingly, we find no evidence for a Hubble residual step (0.007 ± 0.018 mag) as a function of host-galaxy mass for the DES subset, in 2.4σ tension with previous measurements. In conclusion, we also present novel validation methods of our sample using simulated SNe Ia inserted in DECam images and using large catalog-level simulations to test for biases in our analysis pipelines.

79 ASTRONOMY AND ASTROPHYSICS↗

Multi-frequency General Relativistic Radiation-hydrodynamics with M 1 Closure

We report on recent upgrades to our general relativistic radiation-magnetohydrodynamics code, Cosmos++ , which expands the two-moment, M 1 , radiation treatment from gray to multi-frequency transport, including Doppler and gravitational frequency shifts. The solver accommodates either photon (Bose–Einstein) or neutrino (Fermi–Dirac) statistical distribution functions with absorption, emission, and elastic scattering processes. An implicit scheme is implemented to simultaneously solve the primitive inversion problem together with the radiation–matter coupling source terms, providing stability over a broad range of opacities and optical depths where the interaction terms can be stiff. We discuss our formulations and numerical methods, and validate our methods against a wide variety of test problems spanning optically thin to thick regimes in flat, weakly curved, and strongly curved spacetimes.

79 ASTRONOMY AND ASTROPHYSICS↗

Opportunities in AI/ML for the Rubin LSST Dark Energy Science Collaboration

The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) will produce unprecedented volumes of heterogeneous astronomical data (images, catalogs, and alerts) that challenge traditional analysis pipelines. The LSST Dark Energy Science Collaboration (DESC) aims to derive robust constraints on dark energy and dark matter from these data, requiring methods that are statistically powerful, scalable, and operationally reliable. Artificial intelligence and machine learning (AI/ML) are already embedded across DESC science workflows, from photometric redshifts and transient classification to weak lensing inference and cosmological simulations. Yet their utility for precision cosmology hinges on trustworthy uncertainty quantification, robustness to covariate shift and model misspecification, and reproducible integration within scientific pipelines. This white paper surveys the current landscape of AI/ML across DESC's primary cosmological probes and cross-cutting analyses, revealing that the same core methodologies and fundamental challenges recur across disparate science cases. Since progress on these cross-cutting challenges would benefit multiple probes simultaneously, we identify key methodological research priorities, including Bayesian inference at scale, physics-informed methods, validation frameworks, and active learning for discovery. With an eye on emerging techniques, we also explore the potential of the latest foundation model methodologies and LLM-driven agentic AI systems to reshape DESC workflows, provided their deployment is coupled with rigorous evaluation and governance. Finally, we discuss critical software, computing, data infrastructure, and human capital requirements for the successful deployment of these new methodologies, and consider associated risks and opportunities for broader coordination with external actors.

Aubourg, Eric [APC, Paris] (ORCID:000000025592023X↗

Initial ASME code rule analysis on Simple and Full assessment

ASME & ASTM codes present simple and full assessment methodologies to qualify nuclear grade graphite components. This report explains the theory behind the statistical portion of the codes and describes the issues discussed in a 2020 workshop in the simple assessment, as well as the full assessment. The methodology for the full assessment was developed by Hindley []. He used a validation methodology to match the experimental average failure load of test specimens from several geometries to the calculated 50% POF load to tune the grouping criteria parameters based on an RMSE penalty function. The grouping criteria consists of a minimum volume to satisfy the weakest link theory of the Weibull distribution and a minimum stress range parameter. Hindley’s work found a minimum link volume of 10 times the grain size and a stress range parameter of 7% [satisfy the validation requirements. Several studies found that the link volume of 10 times the grain size was not satisfactory for the volume grouping criteria for graphite grades with fine grains. ASME 2021 code adopted a new volume grouping criteria based on fracture toughness for calculation of the process zone volume. However, errors were found in the ASME 2021 code process zone volume equation and the question is now open as to what volume grouping criteria is satisfactory. This report presents results from sensitivity studies that were done to evaluate the volume grouping criteria effect on the full assessment POF. This report also presents results from sensitivity studies on other aspects of the code that affect the POF, the mesh size and the choice of the Weibull threshold parameter. All three sensitivity studies: the volume grouping criteria, the mesh size, and the threshold parameter choice are found to affect the component qualification decision for components of structural reliability class 1 (SRC-1). The sensitivity analysis results are presented in the body of the report for NBG-18, which is the same grade of graphite as Hindley used in his thesis. Results from NBG-17, IG-110, 2114, and PCEA are presented in the Appendix. For NBG-18, it was found that increasing the threshold increases the POF, finer meshes result in higher POFs, and that smaller link volume requirements lead to higher POFs (which is inconsistent with Hindley’s findings). This report proposes a new validation study similar to Hindley’s []. The purpose of the new validation study is to tune the threshold, mesh size and grouping criteria based on results from multiple grades of graphite, including finer grain graphites T220 (1-3 microns) and NG-CT-50 (5 microns). The test specimens will be broken at 3 labs, such that we can measure between lab measurement variability, with at least 5 test specimens per lab such that the within lab uncertainty can also be measured. Hindley’s validation method tried matching the average experimental load with the median. The future study will attempt to match failures at lower percentiles, which would be closer to the SRC POF limit. We are currently looking into what geometries make sense and the best method to measure multi-axial stress states. These design decisions are still being set.

36 MATERIALS SCIENCE↗

NDMAS Portal Updates

Overview of current ART-GCR Data, including fuel fabrication, irradiation monitoring, fuel and graphite, post-irradiation examination, graphite characterization, high temperature metals mechanical tests, methods validation data (including: HTTR, NSTF, and HTTF), addition of AGR fuel data, other GCR and related data, updated high temperature metals, ongoing and upcoming work, users guide, and the link to those interested in access to NDMAS.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Challenges and Opportunities for HVAC + Phase Change Material Thermal Energy Storage in Buildings

Phase-change material (PCM) thermal-energy storage (TES) integrated with HVAC and domestic hot water (DHW) can shift a large share of building thermal loads. By flattening and shifting loads, PCM TES reduces peak electricity use, eases stress on local and grid infrastructure, and lowers costs. It can also defer costly upgrades to service panels, distribution, and transmission. Higher energy density relative to chilled or hot water storage makes PCM TES practical for small, space limited, and retrofit projects, while packaged HVAC-integrated systems expand cost-effective load shifting to commercial buildings that previously lacked options. Despite this promise, deployment faces barriers. This paper presents challenges, opportunities, and lessons learned from lab and field integrations of PCM TES with packaged HVAC systems. Key challenges include misalignment between default heat pump controls tuned for direct-to-load operation and TES charge/discharge objectives, PCM properties that diverge from manufacturer claims and evolve with cycling, and high integration and deployment costs with off-the-shelf products. These studies underscore the need for factory built, integrated systems that arrive as prepackaged modules with proven controls, reducing design and installation effort and delivering predictable performance across projects. The paper outlines steps to enable viable and scalable PCM TES HVAC and DHW systems, including 1) validated methods that can be used to characterize PCM properties and TES system performance, 2) supervisory controls that optimize charge/discharge scheduling, and 3) factory integrated packaging that eliminates bespoke field engineering.

Dutton, Spencer↗

Quantitative Method Development and Validation of Naloxone and 6α‐naloxol from Male African Green Monkey Plasma.

Theopioid epidemic is a rapidly growing crisis around the world. Current models forpharmacokinetic assessment of countermeasures use African green monkeys (AGM). Arapid, sensitive and selective method was developed and validated usingLC‐MS/MS for the determination of naloxone and 6α‐naloxol in AGM plasma. Samplepreparation involved a simple solid phase extraction (SPE) using ahydrophilic‐lipophilic‐balanced reversed‐phase cartridge. Separation of naloxoneand 6α‐naloxol was achieved on a Halo C18, 2.1 × 50 mm, 2.7μ analytical columnusing an Agilent 1290 Infinity HPLC. A solvent system of methanol‐water‐formicacid was used for the elution of analytes. The analytes were detected and monitoredby a SCIEX QTRAP 6500 + triple quadrupole tandem mass spectrometer operatedin electrospray ionization (ESI) positive mode and multiple reaction monitoring(MRM). Molecular ion transitions for naloxone, 6α‐naloxol and naloxone‐D5 were 328.0/212.0,330.0/185.0, and 333.1/212.0 m/z, respectively. The method was validated usingcalibration and recovery assays with spiked samples. Linear calibration curveswere generated over the range of 1.5–100 ng/ml with values for the coefficientof determination (R 2 ) of >0.9950. The values for both inter‐dayand intra‐day precision and accuracy were well within the generally acceptedcriteria for analytical methods (≤15%). This method was subsequentlyused to measure plasma concentrations of naloxone and 6α‐naloxol in male AGMs administerednaloxone subcutaneously and intravenously. The developed method demonstratedexcellent recovery, repeatability, accuracy and sensitivity. Support or Funding Information DISCLAIMERS. The views expressed in this abstractare those of the authors (s) and do not reflect the official policy of theDepartment of Army, Department of Defense, or U. S. Government. This researchwas supported by the Defense Threat Reduction Agency – Joint Science andTechnology office, Medical S&T Division. Thisproject was supported in part by an appointment to the Research ParticipationProgram for the U.S. Army Medical Research and Materiel Command administratedby the Oak Ridge Institute for Science and Education through an agreementbetween the U.S. Army Medical Research and Materiel Command. This abstract is from the Experimental Biology 2018 Meeting. There is no full text article associated with this abstract published in The FASEB Journal .

Bandaru, Veera Venkata Ratnam↗

Development and Validation of Segmentation Method for Lung Cancer Volumetry on Chest CT

The set of criteria called Response Evaluation Criteria In Solid Tumors (RECIST) is used to evaluate the remedial effects of lung cancer, whereby the size of a lesion can be measured in one dimension (diameter). Volumetric evaluation is desirable for estimating the size of a lesion accurately, but there are several constraints and limitations to calculating the volume in clinical trials. In this study, we developed a method to detect lesions automatically, with minimal intervention by the user, and calculate their volume. Our proposed method, called a spherical region-growing method (SPRG), uses segmentation that starts from a seed point set by the user. SPRG is a modification of an existing region-growing method that is based on a sphere instead of pixels. The SPRG method detects lesions while preventing leakage to neighboring tissues, because the sphere is grown, i.e., neighboring voxels are added, only when all the voxels meet the required conditions. In this study, two radiologists segmented lung tumors using a manual method and the proposed method, and the results of both methods were compared. The proposed method showed a high sensitivity of 81.68–84.81% and a high dice similarity coefficient (DSC) of 0.86–0.88 compared with the manual method. In addition, the SPRG intraclass correlation coefficient (ICC) was 0.998 (CI 0.997–0.999, p < 0.01), showing that the SPRG method is highly reliable. If our proposed method is used for segmentation and volumetric measurement of lesions, then objective and accurate results and shorter data analysis time are possible.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Gaussian kernel density functions for compositional quantification in atom probe tomography

Highlights: • A methodology for compositional quantification from atom probe tomography is proposed. • A probability density function p(x) given discrete data points is constructed. • Each atom approximated by a Gaussian function with a particular smoothing parameter. • Density Kernel functions are used to find the optimum smoothing parameter. • The method is validated by using simulated data of semiconductor materials. - Abstract: Atom probe tomography (APT) has the ability to identify the nature and position of single atoms in a material with an almost 3D atomic resolution. However, the quantification of the material composition requires an appropriate treatment of the discrete APT data. When the amount of atoms selected to quantify the composition is relatively small, the spatial resolution is enhanced but the statistical error worsens. Conversely, the increase in the number of atoms considered reduces the spatial resolution, but improving the statistics. We have developed a methodology to reach an optimum equilibrium between the positional and the statistical error in an unsupervised form using Gaussian Kernel density functions. The validity of the method has been tested using APT simulated data of semiconductor materials. It has been proved that the chemical quantification in these materials requires the appropriate selection of the smoothing parameter, obtained without user intervention. In addition, the results have been compared to the usual techniques for composition measurement from APT data (voxelization and proximity histograms), showing better precision for high spatial resolution. This work supplies a data driven methodology based in Gaussian Kernel density functions for the accurate quantification of the composition from APT data.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Production of alternate realizations of DESI fiber assignment for unbiased clustering measurement in data and simulations

A critical requirement of spectroscopic large scale structure analyses is correcting for selection of which galaxies to observe from an isotropic target list. This selection is often limited by the hardware used to perform the survey which will impose angular constraints of simultaneously observable targets, requiring multiple passes to observe all of them. In SDSS this manifested solely as the collision of physical fibers and plugs placed in plates. In DESI, there is the additional constraint of the robotic positioner which controls each fiber being limited to a finite patrol radius. A number of approximate methods have previously been proposed to correct the galaxy clustering statistics for these effects, but these generally fail on small scales. To accurately correct the clustering we need to upweight pairs of galaxies based on the inverse probability that those pairs would be observed (Bianchi & Percival 2017). This paper details an implementation of that method to correct the Dark Energy Spectroscopic Instrument (DESI) survey for incompleteness. To calculate the required probabilities, we need a set of alternate realizations of DESI where we vary the relative priority of otherwise identical targets. These realizations take the form of alternate Merged Target Ledgers (AMTL), the files that link DESI observations and targets. We present the method used to generate these alternate realizations and how they are tracked forward in time using the real observational record and hardware status, propagating the survey as though the alternate orderings had been adopted. We detail the first applications of this method to the DESI One-Percent Survey (SV3) and the DESI year 1 data. We include evaluations of the pipeline outputs, estimation of survey completeness from this and other methods, and validation of the method using mock galaxy catalogs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Validating and Comparing Energy Estimation Methods at Water Resource Recovery Facilities

Water resource recovery facilities play a crucial role in the water-energy nexus, consuming a substantial amount of energy in the United States. Growing treatment volumes and more stringent water quality standards are expected to increase the amount of energy needed to treat wastewater, but accurately estimating energy consumption and potential remains challenging due to variability in scale, treatment methods, and effluent treatment standards. In this study, we used publicly available data to evaluate the accuracy of methods for estimating energy consumption and generation, then quantified uncertainty based on key factors like flow rate, treatment level, and geographic location. To validate methods, we estimated energy consumption and generation at the facility-level, then compared estimates to self-reported data from utilities in major U.S. cities. We found that process models of treatment trains under best practice configurations were accurate relative to other methods for estimating electricity use, total energy use, and electricity generation from biogas utilization, and less complex methods based on effluent treatment level and prime movers also performed well for estimating electricity consumption and generation, respectively. Applying the evaluated methods to a national inventory of treatment facilities, we estimate that annual energy consumption ranged from 56.3 x 10^3 to 82.5 x 10^3 TJ in 2012 and 83.6 x 10^3 to 127 x 10^3 TJ in 2042. Our results indicate that not all estimation methods are suited for every use case, so we recommend that researchers and practitioners select an estimation method based on data availability and desired computational intensity.

Hodson, Abigayle↗

Developing Data-Driven Synthetic Infrastructure Models for Resilience Analysis

Research on infrastructure resilience has produced promising methods to simulate and optimize complex networks to improve performance. However, restrictions on sharing infrastructure models and the steep cost of developing and maintaining infrastructure models presents a roadblock to adoption. To overcome this limitation, this research focuses on methods to create data-driven infrastructure models that will help improve infrastructure resilience and security. The analysis couples incomplete utility data, geospatial data, machine learning, and synthetic network generation methods to rapidly develop and update infrastructure models. The methods are validated using realistic utility models and site-specific data, with a focus on Puerto Rico due to its unique infrastructure challenges and available data. This research highlights promising opportunities for the use of synthetic network generation and machine learning to create infrastructure models when very little data is available. Results demonstrate that hybrid methods, which combine sparse utility data with synthetic models, can enhance model accuracy, and machine learning can predict model attributes using training data from other models. However, the complexity of infrastructure systems means that even minor changes in network connectivity can significantly impact simulation results. Resilience analysis using synthetic infrastructure models shows that while some system behaviors are preserved, the magnitude of disruptions may not be accurately represented, indicating the need for more research and validation before using synthetic models for critical infrastructure investment decisions. The framework outlined in this report represents a significant advance to infrastructure model development and could be applied to additional domains and sites. Future research will continue to streamline and validate methods to help reduce roadblocks to resilience analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗