Search NASA⌕ Search

SEARCH · Search NASA

Results for “machine learning and data science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

2023 Data Science Challenge Notebooks

THE DATA SCIENCE INSTITUTE WILL BE INVITING STUDENTS FROM UC MERCED AND UC RIVERSIDE TO PARTICIPATE IN A DATA SCIENCE CHALLENGE AT LLNL. IN THE CHALLENGE, THE STUDENTS WILL EXPLORE A DATA-DRIVEN APPROACH TO RECONSTRUCTING ELECTROANATOMICAL MAPS OF THE HEART AT CLINICALLY RELEVANT RESOLUTIONS, COMBINING INPUT FROM THE STANDARD 12-LEAD ECG WITH ADVANCED MACHINE LEARNING TECHNIQUES. THE DATA THE STUDENTS WILL HAVE ACCESS TO HAS BEEN IM REVIEWED FOR EXTERNAL RELEASE. (LLNL-MI-835833) THESE NOTEBOOKS WILL PROVIDE THE STUDENTS WITH INSTRUCTIONS OF HOW TO LOAD THE DATA AND WORK WITH THE DATA, ALONG WITH TUTORIALS TO DO BASIC MACHINE LEARNING TASKS LIKE LOGISTIC REGRESSION AND IMAGE CLASSIFICATION.

Landajuela Larma, Mikel↗

Nuclear Data Adjustment for Nonlinear Applications in the OECD/NEA WPNCS SG14 Benchmark -- A Bayesian Inverse UQ-based Approach for Data Assimilation

The Organization for Economic Cooperation and Development (OECD) Working Party on Nuclear Criticality Safety (WPNCS) proposed a benchmark exercise to assess the performance of current nuclear data adjustment techniques applied to nonlinear applications and experiments with low correlation to applications. This work introduces Bayesian Inverse Uncertainty Quantification (IUQ) as a method for nuclear data adjustments in this benchmark, and compares IUQ to the more traditional methods of Generalized Linear Least Squares (GLLS) and Monte Carlo Bayes (MOCABA). Posterior predictions from IUQ showed agreement with GLLS and MOCABA for linear applications. When comparing GLLS, MOCABA, and IUQ posterior predictions to computed model responses using adjusted parameters, we observe that GLLS predictions fail to replicate computed response distributions for nonlinear applications, while MOCABA shows near agreement, and IUQ uses computed model responses directly. We also discuss observations on why experiments with low correlation to applications can be informative to nuclear data adjustments and identify some properties useful in selecting experiments for inclusion in nuclear data adjustment. Performance in this benchmark indicates potential for Bayesian IUQ in nuclear data adjustments.

FOS: Computer and information sciences↗

Complex-valued universal linear transformations and image encryption using spatially incoherent diffractive networks

As an optical processor, a diffractive deep neural network (D2NN) utilizes engineered diffractive surfaces designed through machine learning to perform all-optical information processing, completing its tasks at the speed of light propagation through thin optical layers. With sufficient degrees of freedom, D2NNs can perform arbitrary complex-valued linear transformations using spatially coherent light. Similarly, D2NNs can also perform arbitrary linear intensity transformations with spatially incoherent illumination; however, under spatially incoherent light, these transformations are nonnegative, acting on diffraction-limited optical intensity patterns at the input field of view. Here, we expand the use of spatially incoherent D2NNs to complex-valued information processing for executing arbitrary complex-valued linear transformations using spatially incoherent light. Through simulations, we show that as the number of optimized diffractive features increases beyond a threshold dictated by the multiplication of the input and output space-bandwidth products, a spatially incoherent diffractive visual processor can approximate any complex-valued linear transformation and be used for all-optical image encryption using incoherent illumination. The findings are important for the all-optical processing of information under natural light using various forms of diffractive surface-based optical processors.

36 MATERIALS SCIENCE↗

Machine learning framework for assessment of microbial factory performance

Metabolic models can estimate intrinsic product yields for microbial factories, but such frameworks struggle to predict cell performance (including product titer or rate) under suboptimal metabolism and complex bioprocess conditions. On the other hand, machine learning, complementary to metabolic modeling necessitates large amounts of data. Building such a database for metabolic engineering designs requires significant manpower and is prone to human errors and bias. We propose an approach to integrate data-driven methods with genome scale metabolic model for assessment of microbial bio-production (yield, titer and rate). Using engineered E. coli as an example, we manually extracted and curated a data set comprising about 1200 experimentally realized cell factories from ~100 papers. We furthermore augmented the key design features (e.g., genetic modifications and bioprocess variables) extracted from literature with additional features derived from running the genome-scale metabolic model iML1515 simulations with constraints that match the experimental data. Then, data augmentation and ensemble learning (e.g., support vector machines, gradient boosted trees, and neural networks in a stacked regressor model) are employed to alleviate the challenges of sparse, non-standardized, and incomplete data sets, while multiple correspondence analysis/principal component analysis are used to rank influential factors on bio-production. The hybrid framework demonstrates a reasonably high cross-validation accuracy for prediction of E.coli factory performance metrics under presumed bioprocess and pathway conditions (Pearson correlation coefficients between 0.8 and 0.93 on new data not seen by the model).

59 BASIC BIOLOGICAL SCIENCES↗

Speeding up and reducing memory usage for scientific machine learning via mixed precision

Scientific machine learning (SciML) has emerged as a versatile approach to address complex computational science and engineering problems. Within this field, physics-informed neural networks (PINNs) and deep operator networks (DeepONets) stand out as the leading techniques for solving partial differential equations by incorporating both physical equations and experimental data. However, training PINNs and DeepONets require significant computational resources, including long computational times and large amounts of memory. In search of computational efficiency, training neural networks using half precision (float16) rather than the conventional single (float32) or double (float64) precision has gained substantial interest, given the inherent benefits of reduced computational time and memory consumed. However, we find that float16 cannot be applied to SciML methods, because of gradient divergence at the start of training, weight updates going to zero, and the inability to converge to a local minima. To overcome these limitations, we explore mixed precision, which is an approach that combines the float16 and float32 numerical formats to reduce memory usage and increase computational speed. Our experiments showcase that mixed precision training not only substantially decreases training times and memory demands but also maintains model accuracy. Here, we also reinforce our empirical observations with a theoretical analysis. The research has broad implications for SciML in various computational applications.

97 MATHEMATICS AND COMPUTING↗

Leveraging High-throughput Computation and Machine Learning to Discover and Understand Low-Temperature Fast Oxygen Conductors (Final Technical Report)

The major goals of this work are twofold: (1) to enable transformative basic understanding of structure-property-performance relationships governing oxygen transport in oxygen-active materials and (2) facilitate the discovery and rational design of new oxygen-active materials which transport oxygen efficiently at low temperature. Transformative understanding and materials design will be accomplished by synergistically combining materials data mining, machine learning, high-throughput computation and targeted experiments.

36 MATERIALS SCIENCE↗

Automated Proton Track Identification in MicroBooNE Using Gradient Boosted Decision Trees

MicroBooNE is a liquid argon time projection chamber (LArTPC) neutrino experiment that is currently running in the Booster Neutrino Beam at Fermilab. LArTPC technology allows for high-resolution, three-dimensional representations of neutrino interactions. A wide variety of software tools for automated reconstruction and selection of particle tracks in LArTPCs are actively being developed. Short, isolated proton tracks, the signal for low- momentum-transfer neutral current (NC) elastic events, are easily hidden in a large cosmic background. Detecting these low-energy tracks will allow us to probe interesting regions of the proton's spin structure. An effective method for selecting NC elastic events is to combine a highly efficient track reconstruction algorithm to find all candidate tracks with highly accurate particle identification using a machine learning algorithm. We present our work on particle track classification using gradient tree boosting software (XGBoost) and the performance on simulated neutrino data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Use of Sensors and Machine Learning for Signal Discovery in a Solvent Extraction Process

Reprocessing is an important step in the nuclear fuel cycle where usable nuclear materials are extracted from used fuel for recycling. The separation of materials for reuse simultaneously reduces not only the volume of nuclear waste, but its decay time to radioactivity levels similar to that of the originating uranium ore. As part of an initiative to steward research, development, and innovation into the nuclear fuel cycle, Idaho National Laboratory is designing and constructing a solvent extraction testbed named Beartooth. This testbed will allow researchers to refine separation processes, test innovative extraction processes, and give early career scientists opportunities to gain skills in performing separations chemistry utilizing centrifugal contactors. In addition, the Beartooth testbed is being uniquely designed to enable novel technologies including machine learning capabilities for the characterization of chemical process operations in near real-time. To aid in the design of Beartooth, a team of researchers are installing a variety of atypical sensors into a system of contactors for signal discovery. The team will implement machine learning methods on acquired sensor data to extract signal features. The goal is to provide a process operator with a deeper understanding of the chemical process and equipment usage. This work will summarize sensors utilized and preliminary results from an infrared camera.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Machine Learning technique for isotopic determination of radioisotopes using HPGe γ-ray spectra

γ-ray spectroscopy is a quantitative, non-destructive technique that may be utilized for the identification and quantitative isotopic estimation of radionuclides. Traditional methods of isotopic determination have various challenges that contribute to statistical and systematic uncertainties in the estimated isotopics. Furthermore, these methods typically require numerous pre-processing steps, and have only been rigorously tested in laboratory settings with limited shielding. Here, in this work, we examine the application of a number of machine learning based regression algorithms as alternatives to conventional approaches for analyzing γ-ray spectroscopy data in the Emergency Response arena. This approach not only eliminates many steps in the analysis procedure, and therefore offers potential to reduce this source of systematic uncertainty, but is also shown to offer comparable performance to conventional approaches in the Emergency Response Application.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Use of Sensors and Machine Learning for Signal Discovery in a Solvent Extraction Process – 23280

Reprocessing is an important step in the nuclear fuel cycle where usable nuclear materials are extracted from spent fuel for recycling. The extraction of materials for reuse simultaneously reduces not only the volume of nuclear waste, but its decay time to radioactivity levels similar to that of the originating uranium ore. As part of an initiative to steward research, development, and innovation into the nuclear fuel cycle, Idaho National Laboratory is designing and constructing a solvent extraction testbed named Beartooth. Beartooth will allow researchers to refine extraction processes, test innovative extraction processes, and give early career scientists opportunities to gain skills in performing separations chemistry that uses centrifugal contactors. In addition, the Beartooth testbed is being uniquely designed to enable novel technologies including machine learning capabilities for the characterization of chemical process operations in near real-time. To aid in the design of Beartooth, a team of researchers are installing a variety of atypical sensors into a system of contactors for signal discovery. The team will implement machine learning methods on sensor data to determine signal features with the goal of providing a process operator with a deeper understanding of the chemical process and equipment usage. This work will summarize sensors utilized and preliminary results from an infrared camera.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Characterizing Seasonal Variation of the Atmospheric Mixing Layer Height Using Machine Learning Approaches

As machine learning becomes more integrated into atmospheric science, XGBoost has gained popularity for its ability to assess the relative contributions of influencing factors in the atmospheric boundary layer height. To examine how these factors vary across seasons, a seasonal analysis is necessary. However, dividing data by season reduces the sample size, which can affect result reliability and complicate factor comparisons. To address these challenges, this study replaces default parameters with grid search optimization and incorporates cross-validation to mitigate dataset limitations. Using XGBoost with four years of data from the atmospheric radiation measurement (ARM) (Southern Great Plains (SGP) C1 site, cross-validation stabilizes correlation coefficient fluctuations from 0.3 to within 0.1. With optimized parameters, the R value can reach 0.81. Analysis of the C1 site reveals that the relative importance of different factors changes across seasons. Lower tropospheric stability (LTS, ~0.53) is the dominant factor at C1 throughout the year. However, during DJF, latent heat flux (LHF, 0.44) surpasses LTS (0.22). In SON, LTS (0.58) becomes more influential than LHF (0.18). Further comparisons among the four long-term SGP sites (C1, E32, E37, and E39) show seasonal variations in relative importance. Notably, during JJA, the differences in the relative importance of the three factors across all sites are lower than in other seasons. This suggests that boundary layer development in the summer is not dominated by a single factor, reflecting a more intricate process likely influenced by seasonal conditions such as enhanced convective activity, higher temperatures, and humidity, which collectively contribute to a balanced distribution of parameter impacts. Furthermore, the relative importance of LTS gradually increases from morning to noon, indicating that LTS becomes more significant as the boundary layer approaches its maximum height. Consequently, the LTS in the early morning in autumn exhibits greater relative importance compared to other seasons. This reflects a faster development of the mixing layer height (MLH) in autumn, suggesting that it is easier to retrieve the MLH from the previous day during this period. The findings enhance understanding of boundary layer evolution and contribute to improved boundary layer parameterization.

54 ENVIRONMENTAL SCIENCES↗

Explainable and trustworthy artificial intelligence for correctable modeling in chemical sciences

Data science has primarily focused on big data, but for many physics, chemistry, and engineering applications, data are often small, correlated and, thus, low dimensional, and sourced from both computations and experiments with various levels of noise. Typical statistics and machine learning methods do not work for these cases. Expert knowledge is essential, but a systematic framework for incorporating it into physics-based models under uncertainty is lacking. Here, we develop a mathematical and computational framework for probabilistic artificial intelligence (AI)–based predictive modeling combining data, expert knowledge, multiscale models, and information theory through uncertainty quantification and probabilistic graphical models (PGMs). We apply PGMs to chemistry specifically and develop predictive guarantees for PGMs generally. Our proposed framework, combining AI and uncertainty quantification, provides explainable results leading to correctable and, eventually, trustworthy models. The proposed framework is demonstrated on a microkinetic model of the oxygen reduction reaction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Improved Understanding of Coupled Water and Carbon Cycle Processes through Machine Learning Approaches

Focal Area(s): This white paper addresses how explainable machine learning (ML) algorithms can improve insights gained from complex data (Focal Area 3). We will also address how ML approaches related to sensor compression and low energy AI hardware can be used for efficient data acquisition (Focal Area 1). Science Challenge: We will focus on the coupled water cycle and carbon cycle processes in terrestrial ecosystems and terrestrial-aquatic interfaces. Thus, our approaches will be centered around several data-model integration challenges indicated in EESD strategic plans for two science focus areas: Terrestrial Ecosystem Science and Hydrobiogeochemistry. We can use AI to correct systematic model errors due to biases in either data or model structure/processes. Error patterns in model predictions usually vary by region, model, season etc. But there are systematic patterns in them. e.g., soil moisture tends to be overestimated in the arid western continental United States underestimated in wetter eastern USA; some land surface models tend to underestimate moisture in wet seasons and overestimate in dry seasons. Moreover, the consequences of extreme events (e.g., drought, extreme flooding, storm surges associated with tropical storms, hurricanes) on carbon cycle processes are not well represented in ecosystem and Earth system models. Redox-sensitive processes (e.g., rapid oxidation/reduction of iron and other redox-sensitive elements in soil microsites subjected to fluctuated hydrology) in terrestrial-aquatic interfaces further challenge model predictions of hot-spots (and hot-moments) due to poor understanding of underlying mechanisms. Thus, AI/ML approaches can be used to learn patterns in the data and model errors and use them to build model equations and correct process-based model errors.

54 ENVIRONMENTAL SCIENCES↗

Fission with Exotic Nuclei (Full Technical Report)

Despite its importance for stockpile stewardship or nuclear forensics, data on fission is fragmentary: most experiments have only been performed on stable actinide nuclei and are often incomplete, and theoretical simulations often contain many parameters hard to constrain, which results in large uncertainties. Consequently, nuclear libraries have large gaps for important isotopes. The goal of this project was to prepare to take advantage of the unprecedented yields of radioactive isotopes at the upcoming DOE Facility for Rare Ion Beams and to leverage recent progress in the field of machine learning to develop a comprehensive program of fission studies that could address some of the most pressing problems in nuclear fission over the next several decades. Our project leveraged synergies between experimental nuclear physics, nuclear theory, and data science expertise at LLNL. On the experimental front, our main objective was to develop in-house expertise for inverse kinematics reactions with relativistic beams as well as to field and test new detectors to perform correlated measurements of fission properties. On the theoretical side, the objective was to develop a novel, high-fidelity and scalable approach of fissionfragment calculations based on emulating computationally expensive, quantum-mechanical calculations of nuclear properties with deep neural networks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Processing NASA Earth Science Data on Nebula Cloud

Three applications were successfully migrated to Nebula, including S4PM, AIRS L1/L2 algorithms, and Giovanni MAPSS. Nebula has some advantages compared with local machines (e.g. performance, cost, scalability, bundling, etc.). Nebula still faces some challenges (e.g. stability, object storage, networking, etc.). Migrating applications to Nebula is feasible but time consuming. Lessons learned from our Nebula experience will benefit future Cloud Computing efforts at GES DISC.

Chen, Aijun↗

X-ray Absorption Spectroscopy Studies of a Molecular CO 2 -Reduction Catalyst Deposited on Graphitic Carbon Nitride

Metal-ligand complexes have been extensively explored as well-defined molecular catalysts in small molecule activation reactions such as carbon dioxide (CO 2 ) reduction. Many hybrid photocatalysts have been prepared by coupling such complexes with photoactive surfaces for use in solar CO 2 reduction. In this work, we employ X-ray absorption near edge structure (XANES) and extended X-ray absorption fine structure (EXAFS) spectroscopies, density functional theory (DFT) and computational XANES modeling to interrogate the structure of a hybrid photocatalyst consisting of a macrocyclic cobalt complex deposited on graphitic carbon nitride (C 3 N 4 ). Results show that the cobalt complex binds on C 3 N 4 through surface OH or NH 2 groups. By refining the local geometry and binding sites of this well-defined molecular cobalt complex on C 3 N 4 , here we established an important benchmark for modeling a large class of molecular catalysts that can be adapted to in situ/operando studies and further enhanced by applying chemometrics-based approaches and machine learning methods of XANES data analysis.

36 MATERIALS SCIENCE↗