Search NASA⌕ Search

SEARCH · Search NASA

Results for “multi-modal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

NeMO-Net – The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment

We present NeMO-Net, the Srst open-source deep convolutional neural network (CNN) and interactive learning and training software aimed at assessing the present and past dynamics of coral reef ecosystems through habitat mapping into 10 biological and physical classes. Shallow marine systems, particularly coral reefs, are under significant pressures due to climate change, ocean acidification, and other anthropogenic pressures, leading to rapid, often devastating changes, in these fragile and diverse ecosystems. Historically, remote sensing of shallow marine habitats has been limited to meter-scale imagery due to the optical effects of ocean wave distortion, refraction, and optical attenuation. NeMO-Net combines 3D cm-scale distortion-free imagery captured using NASA FluidCam and Fluid lensing remote sensing technology with low resolution airborne and spaceborne datasets of varying spatial resolutions, spectral spaces, calibrations, and temporal cadence in a supercomputer-based machine learning framework. NeMO-Net augments and improves the benthic habitat classification accuracy of low-resolution datasets across large geographic ad temporal scales using high-resolution training data from FluidCam.NeMO-Net uses fully convolutional networks based upon ResNet and ReSneNet to perform semantic segmentation of remote sensing imagery of shallow marine systems captured by drones, aircraft, and satellites, including WorldView and Sentinel. Deep Laplacian Pyramid Super-Resolution Networks (LapSRN) alongside Domain Adversarial Neural Networks (DANNs) are used to reconstruct high resolution information from low resolution imagery, and to recognize domain-invariant features across datasets from multiple platforms to achieve high classification accuracies, overcoming inter-sensor spatial, spectral and temporal variations.Finally, we share our online active learning and citizen science platform, which allows users to provide interactive training data for NeMO-Net in 2D and 3D, integrated within a deep learning framework. We present results from the PaciSc Islands including Fiji, Guam and Peros Banhos 1 1 2 1 3 1 where 24-class classification accuracy exceeds 91%.

Chirayath, Ved↗
NASA NTRS2017

RNAV STAR Procedural Adherence

In this exploratory archival study we mined the performance of 24 major US airports area navigation standard terminal arrival routes (RNAV STARs) over the preceding three years. Overlaying radar track data on top of RNAV STAR routes provided a comparison between aircraft flight paths and the waypoint positions and altitude restrictions. NASA Ames Supercomputing resources were utilized to perform the data mining and processing. We investigated STARs by lateral transition path (full-lateral), vertical restrictions (full-lateral/full-vertical), and skipped waypoints (skips). In addition, we graphed altitudes and their frequencies of occurrence for altitude restrictions. Full-lateral compliance was generally greater than Full-lateral/full-vertical, but the delta between the rates was not always consistent. Full-lateral/full-vertical usage medians of the 2016 procedures ranged from 0 in KDEN (Denver) to 21 in KMEM (Memphis). Waypoint skips ranged from 0 to nearly 100 for specific waypoints. Altitudes restrictions were sometimes missed by systemic amounts in 1000 ft. increments from the restriction, creating multi-modal distributions. Other times, altitude misses looked to be more normally distributed around the restriction. This work is a preliminary investigation into the objective performance of instrument procedures and provides a framework to track how procedural concepts and design intervention function. In addition, this tool may aid in providing acceptability metrics as well as risk assessment information.

Stewart, Michael J.↗
DOE OSTI2025

SANE: strategic autonomous non-smooth exploration for multiple optima discovery in multi-modal and non-differentiable black-box functions

Both computational and experimental material discovery bring forth the challenge of exploring multidimensional and multimodal parameter spaces, such as phase diagrams of Hamiltonians with multiple interactions, composition spaces of combinatorial libraries, material structure image spaces, and molecular embedding spaces. Often these systems are black-boxes and time-consuming to evaluate, which resulted in strong interest towards active learning methods such as Bayesian optimization (BO). However, these systems are often noisy which make the black box function severely multi-modal and non-differentiable, where a vanilla BO can get overly focused near a single or faux optimum, deviating from the broader goal of scientific discovery. To address these limitations, here we developed Strategic Autonomous Non-Smooth Exploration (SANE) to facilitate an intelligent Bayesian optimized navigation with a proposed cost-driven probabilistic acquisition function to find multiple global and local optimal regions, avoiding the tendency to becoming trapped in a single optimum. To distinguish between a true and false optimal region due to noisy experimental measurements, a human (domain) knowledge driven dynamic surrogate gate is integrated with SANE. We implemented the gate-SANE into pre-acquired piezoresponse spectroscopy data of a ferroelectric combinatorial library with high noise levels in specific regions, and piezoresponse force microscopy (PFM) hyperspectral data. SANE demonstrated better performance than classical BO to facilitate the exploration of multiple optimal regions and thereby prioritized learning with higher coverage of scientific values in autonomous experiments. Our work showcases the potential application of this method to real-world experiments, where such combined strategic and human intervening approaches can be critical to unlocking new discoveries in autonomous research.

Biswas, Arpan [University of Tennessee, Knoxville,↗
NASA NTRS2017

Objective Assessment Method for RNAV STAR Adherence

Flight crews and air traffic controllers have reported many safety concerns regarding area navigation standard terminal arrival routes (RNAV STARs). Specifically, optimized profile descents (OPDs). However, our information sources to quantify these issues are limited to subjective reporting and time consuming case-by-case investigations. This work is a preliminary study into the objective performance of instrument procedures and provides a framework to track procedural concepts and assess design specifications. We created a tool and analysis methods for gauging aircraft adherence as it relates to RNAV STARs. This information is vital for comprehensive understanding of how our air traffic behaves. In this study, we mined the performance of 24 major US airports over the preceding three years. Overlaying 4D radar track data onto RNAV STAR routes provided a comparison between aircraft flight paths and the waypoint positions and altitude restrictions. NASA Ames Supercomputing resources were utilized to perform the data mining and processing. We assessed STARs by lateral transition path (full-lateral), vertical restrictions (full-lateral/full-vertical), and skipped waypoints (skips). In addition, we graphed frequencies of aircraft altitudes relative to the altitude restrictions. Full-lateral adherence was always greater than Full-lateral/ full- vertical, as it is a subset, but the difference between the rates was not consistent. Full-lateral/full-vertical adherence medians of the 2016 procedures ranged from 0% in KDEN (Denver) to 21% in KMEM (Memphis). Waypoint skips ranged from 0% to nearly 100% for specific waypoints. Altitudes restrictions were sometimes missed by systematic amounts in 1,000 ft. increments from the restriction, creating multi-modal distributions. Other times, altitude misses looked to be more normally distributed around the restriction. This tool may aid in providing acceptability metrics as well as risk assessment information.

Stewart, Michael↗
NASA NTRS2003

Development of a Dynamically Configurable, Object-Oriented Framework for Distributed, Multi-modal Computational Aerospace Systems Simulation: Second Year Progress Report

Mesh generation has long been recognized as a bottleneck in the CFD process. While much research on automating the volume mesh generation process have been relatively successful,these methods rely on appropriate initial surface triangulation to work properly. Surface discretization has been one of the least automated steps in computational simulation due to its dependence on implicitly defined CAD surfaces and curves. Differences in CAD peometry engines manifest themselves in discrepancies in their interpretation of the same entities. This lack of "good" geometry causes significant problems for mesh generators, requiring users to "repair" the CAD geometry before mesh generation. The problem is exacerbated when CAD geometry is translated to other forms (e.g., IGES )which do not include important topological and construction information in addition to entity geometry. One technique to avoid these problems is to access the CAD geometry directly from the mesh generating software, rather than through files. By accessing the geometry model (not a discretized version) in its native environment, t h s a proach avoids translation to a format which can deplete the model of topological information. Our approach to enable models developed in the Denali software environment to directly access CAD geometry and functions is through an Application Programming Interface (API) known as CAPRI. CAPRI provides a layer of indirection through which CAD-specific data may be accessed by an application program using CAD-system neutral C and FORTRAN language function calls. CAPRI supports a general set of CAD operations such as truth testing, geometry construction and entity queries.

Afjeh, Abdollah A.↗
DOE OSTI2024

CO 2 storage site characterization using ensemble-based approaches with deep generative models

Estimating spatially distributed properties such as permeability from available sparse measurements is a great challenge in efficient subsurface CO 2 storage operations. In this paper, a deep generative model that can accurately capture complex subsurface structure is tested with an ensemble-based inversion method for accurate and accelerated characterization of CO 2 storage sites. We chose Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP) for its realistic reservoir property representation and Ensemble Smoother with Multiple Data Assimilation (ES-MDA) for its robust data fitting and uncertainty quantification capability. WGAN-GP are trained to generate high-dimensional permeability fields from a low-dimensional latent space and ES-MDA then updates the latent variables by assimilating available measurements. Several subsurface site characterization examples including Gaussian, channelized, and fractured reservoirs are used to evaluate the accuracy and computational efficiency of the proposed method and the main features of the unknown permeability fields are characterized accurately with reliable uncertainty quantification. Furthermore, the estimation performance is compared with a widely-used variational, i.e., optimization-based, inversion approach, and the proposed approach outperforms the variational inversion method in several benchmark cases. We explain such superior performance by visualizing the objective function in the latent space: because of nonlinear and aggressive dimension reduction via generative modeling, the objective function surface becomes extremely complex while the ensemble approximation can smooth out the multi-modal surface during the minimization. This suggests that the ensemble-based approach works well over the variational approach when combined with deep generative models at the cost of forward model runs unless convergence-ensuring modifications are implemented in the variational inversion.

42 ENGINEERING↗
NASA NTRS2017

A 3D Active Learning Application for NeMO-Net, the NASA Neural Multi-Modal Observation and Training Network for Global Coral Reef Assessment

NeMO-Net, the NASA neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive video game prototype for tablet and mobile devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using fluid lensing to create a dataset that will be used to train NeMO-Nets convolutional neural network. The application currently allows for users to classify preselected regions of coral in the Pacific and will be expanded to include additional regions captured using our NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as lower-resolution airborne remote sensing data from the ongoing NASA CORAL campaign. Active learning applications present a novel methodology for efficiently training large-scale Neural Networks wherein variances in identification can be rapidly mitigated against control data. NeMO-Net periodically checks users input against pre-classified coral imagery to gauge their accuracy and utilize in-game mechanics to provide classification training. Users actively communicate with a server and are requested to classify areas of coral for which other users had conflicting classifications and contribute their input to a larger database for ranking. In partnering with Mission Blue and IUCN, NeMO-Net leverages an international consortium of subject matter experts to classify areas of confusion identified by NeMO-Net and generate additional labels crucial for identifying decision boundary locations in coral reef assessment.

NeMO=NET↗
NASA NTRSDate not supplied

Expanding NeMO-Net Machine Learning Capabilities for Citizen Science

NASA NeMO-Net, the neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive citizen science video game, released this April, for desktop and iOS devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using diver photomosaic imagery, the UAV enabled NASA FluidCam instrument, and satellite datasets. To date, the application has had over 40,000 downloads and over60,000 unique coral reef classifications, each filtered through a user-based rating and expert evaluation system. We also present results from NeMO-Net’s convolutional neural network (CNN) models used to semantically segment 2D satellite imagery as well as projections of 3D coral reconstructions using user input data as training datasets. Fusing datasets using machine learning from multiple remote sensing platforms presents novel methodologies for assessing the health of coral ecosystems, which are critically endangered by a changing climate. In partnering with Mission Blue, the National Oceanic and Atmospheric Administration (NOAA), and the Living Oceans Foundation (LOF), NeMO-Net leverages an international consortium of subject matter experts to provide both proper training for citizen scientists and the generation of a labeled datasets to ingest into machine learning algorithms for global coral reef identification.

NeMO-Net↗
NASA NTRSDate not supplied

Expanding NeMO-Net Machine Learning Capabilities for Citizen Science

NASA NeMO-Net, the neural multi-modal observation and training network for global coral reef assessment, is an open-source deep convolutional neural network and interactive active learning training software aiming to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology as well as mapping of spatial distribution. We present an interactive citizen science video game, released this April, for desktop and iOS devices where users interactively label morphology classifications over mm-scale 3D coral reef imagery captured using diver photomosaic imagery, the UAV enabled NASA FluidCam instrument, and satellite datasets. To date, the application has had over 40,000 downloads and over 60,000 unique coral reef classifications, each filtered through a user-based rating and expert evaluation system. We also present results from NeMO-Net’s convolutional neural network (CNN) models used to semantically segment 2D satellite imagery as well as projections of 3D coral reconstructions using user input data as training datasets. Fusing datasets using machine learning from multiple remote sensing platforms presents novel methodologies for assessing the health of coral ecosystems, which are critically endangered by a changing climate. In partnering with Mission Blue, the National Oceanic and Atmospheric Administration (NOAA), and the Living Oceans Foundation (LOF), NeMO-Net leverages an international consortium of subject matter experts to provide both proper training for citizen scientists and the generation of a labeled datasets to ingest into machine learning algorithms for global coral reef identification.

NeMO-Net↗
DOE OSTI2026

Quantum-Inspired Bayesian Sampling for Uncertainty Quantification and Machine Learning (Final Technical Report)

With increasing simulation and measurement data, machine learning and artificial intelligence have been widely used in computational decision-making of complex engineering systems. The resulting tools, such as uncertainty quantification solvers, reinforcement learning, and physics-informed machine learning, have achieved great success in critical DOE tasks such as material discovery and design, energy system modeling and control, and numerical weather and climate prediction. A core topic in scientific machine learning and artificial intelligence is Bayesian inference: given an observed data set, people want to estimate the posterior distribution of a (possibly large) number of hidden parameters. Due to the flexibility and weak assumptions, Bayesian sampling has been the mainstream Bayesian inference solvers despite the rapid progress of approximate Bayesian inference. Classical Bayesian sampling methods such as Markov-chain Monte Carlo suffer from a low-acceptance rate due to the random walk nature, therefore state-of-the-art techniques use Hamiltonian Monte Carlo and its variants to efficiently draw posterior samples in a high dimension. The key idea of Hamiltonian Monte Carlo and its variants is to simulate the Hamiltonian dynamics of a classical particle with a fixed mass, and their performance significantly degrades when the posterior distribution is highly spiky or has multiple modes. Leveraging the idea of quantum physics, this project has investigated new theory, algorithms and applications of Bayesian inference (especially Bayesian sampling). The main results include: (1) novel quantum-inspired Bayesian sampling methods that can lead to better accuracy for challenging multi-modal or spiky distributions, (2) more scalable machine learning framework leveraging tensor-compressed Bayesian inference, and (3) Bayesian and sampling approaches for verifying the robustness of continuous and binary neural networks.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2024

The Knowledge-based Digital Platform Concept for Advanced Air Mobility Research and Development

National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC) is spearheading an innovative digital engineering approach to integrate, communicate, and facilitate the research of multi-modal transportation systems. The Knowledge-based Digital Platform (KbDP) is a concept being developed that ties the workflows of Project Managers (PM), Principal Investigators (PI), and System Engineers (SE) together across organizational boundaries. The overarching vision for the KbDP Concept for AAM R&D is a substantial undertaking. The initial concept and implementation will focus on UAM operations to tractably learn and adjust the concept with a manageable database. Lessons learned and best practices with a smaller scope will enable successful scalability to AAM R&D or even to the entire modes of transportation and logistics. The UAM vision is one in which advanced technologies and new operational procedures enable practical and cost-effective air transport as an integrated mode of movement of people and goods throughout metropolitan areas. Initial implementation of three KbDP concepts of use shows promising benefits to NASA’s Air Traffic Management-Exploration (ATM-X) UAM Airspace Subproject. It is envisioned that the KbDP will manage an information database defined by mathematical, data science, and system engineering principles. AIML algorithms play a vital role in this KbDP concept by extracting meaningful knowledge from the information database, which the human user leverages to improve the efficiency and effectiveness of their research greatly.

ATM↗
NASA NTRS2017

Improvement of Automated POST Case Success Rate Using Support Vector Machines

During early conceptual design of complex systems, concept down selection can have a large impact upon program life-cycle cost. Therefore, any concepts selected during early design will inherently commit program costs and affect the overall probability of program success. For this reason it is important to consider as large a design space as possible in order to better inform the down selection process. For conceptual design of launch vehicles, trajectory analysis and optimization often presents the largest obstacle to evaluating large trade spaces. This is due to the sensitivity of the trajectory discipline to changes in all other aspects of the vehicle design. Small deltas in the performance of other subsystems can result in relatively large fluctuations in the ascent trajectory because the solution space is non-linear and multi-modal [1]. In order to help capture large design spaces for new launch vehicles, the authors have performed previous work seeking to automate the execution of the industry standard tool, Program to Optimize Simulated Trajectories (POST). This work initially focused on implementation of analyst heuristics to enable closure of cases in an automated fashion, with the goal of applying the concepts of design of experiments (DOE) and surrogate modeling to enable near instantaneous throughput of vehicle cases [2]. Additional work was then completed to improve the DOE process by utilizing a graph theory based approach to connect similar design points [3]. The conclusion of the previous work illustrated the utility of the graph theory approach for completing a DOE through POST. However, this approach was still dependent upon the use of random repetitions to generate seed points for the graph. As noted in [3], only 8% of these random repetitions resulted in converged trajectories. This ultimately affects the ability of the random reps method to confidently approach the global optima for a given vehicle case in a reasonable amount of time. With only an 8% pass rate, tens or hundreds of thousands of reps may be needed to be confident that the best repetition is at least close to the global optima. However, typical design study time constraints require that fewer repetitions be attempted, sometimes resulting in seed points that have only a handful of successful completions. If a small number of successful repetitions are used to generate a seed point, the graph method may inherit some inaccuracies as it chains DOE cases from the non-global-optimal seed points. This creates inherent noise in the graph data, which can limit the accuracy of the resulting surrogate models. For this reason, the goal of this work is to improve the seed point generation method and ultimately the accuracy of the resulting POST surrogate model. The work focuses on increasing the case pass rate for seed point generation.

Zwack, Matthew R.↗
NASA NTRSDate not supplied

Applicability of Micro X-Ray Fluorescence Spectroscopy to Astromaterials Curation and Research

Introduction: The Astromaterials Acquisition and Curation Office at NASA’s Johnson Space Center (JSC) curates NASA’s astromaterial sample collections which includes: Apollo samples, Luna samples, Ant-arctic meteorites, cosmic dust particles, microparticle impacts into space-flown materials, Genesis solar wind atoms, Stardust comet Wild-2 particles, Stardust inter-stellar particles, Hayabusa asteroid Itokawa particles, Hayabusa 2 asteroid Ryugu particles, and future OSIRIS-Rex asteroid Bennu particles (landing in Sep-tember, 2023) [1–3]. To enhance JSC’s advanced cu-ration capabilities, we have recently installed a high-performance micro-X-ray fluorescence (µXRF) spec-trometer to assist in sample characterization through rapid, non-destructive, in-situ elemental analyses that do not require the sample preparation protocols (i.e., polishing and carbon-coating) commonly needed for electron beam analyses. With this new instrument, we are capable of detecting all elements down to carbon in a variable-pressure or He-purged chamber for anal-ysis of a wide range of sample types. Here we describe the instrumental set-up, capabilities, and applicability of µXRF analysis to astromaterials curation and re-search. Instrumentation and Methodology: The X-ray fluorescence and computed tomography lab (X-FaCT) lab at JSC is now equipped with a Bruker M4 Tornado Plus µXRF (Fig. 1). This system is an energy-dispersive x-ray spectrometer equipped with two 60 mm2 silicon drift detectors (SDD) that are able to be used simulta-neously for output count rates ~500,000 cps. New light element windows allow detecting and analyzing the entire elemental range from carbon to americium. Two x-ray tubes (micro-focus Rh with polycapillary lenses and W with collimators of 0.5, 1.0, 2.0, and 4.5 mm) with max excitation parameters of 50 kV, 30 W and 50 kV, 40 W, respectively, allow for more flexibility of the analysis of high energy lines. The motorized X-Y-Z stage has a mapping range of 190 x 160 mm and can support samples up to 7 kg (~15.5 lbs) and a height of 120 mm [4]. Analytical modes include elemental analysis (down to ~20 µm spot size) via point, line, or area of bulk materials (rock surfaces, thin sections, thick sections, etc.) as well as coating analysis (determination of thickness and composition) of samples. This system has a variable vacuum chamber (1 mbar to 1 atm) that is also equipped with a He-purge system which accommodates vacuum sensitive samples while still allowing detection of light elements at atmospheric pressure. Utility and Applicability of µXRF in Astro-materials research and exploration science (ARES): Elemental analysis using µXRF is commonly em-ployed for both terrestrial and planetary geological science disciplines [5]. It is especially useful for analy-sis of astromaterials given the limited sample prepara-tion required, which is not feasible for certain materi-als. Here we show select applications of µXRF anal-yses of astromaterials that can, have, and will be done at JSC’s X-FaCT lab. Point analysis: In-situ spot analyses (~20 µm spot size) on a cut slab of Martian meteorite NWA 10922 allowed for the discovery, qualitative elemental analy-sis and determination of different feldspar minerals [6]. These point analyses served as an effective prelim-inary step for subsequent quantitative analyses. Ana-lytical standards can be employed for more accurate quantification of µXRF spot analyses. Area analysis: This analytical mode measures all detectable elements (from C to Am) at each pixel (>5 µm pixel size) in a user-defined area. The results are shown as elemental maps which can be extracted as 16-bit TIFF’s for further data processing. In Fig. 2. we show elemental distribution maps of the high-Ti basalt 73001,531 that have been processed using ImageJ software. From these maps you can accurately and quickly (this map took ~50 mins.) identify mineral components, such as pyroxene, plagioclase, oxides, and phosphates, compositional zoning, and mineral textures. Detection of high-Z phases: µXRF techniques are es-pecially effective at analyzing trace minerals with high-atomic-number (high-Z) elements because the high-energy characteristic X-rays used (relative to SEM EDS) allow for mapping of K lines in elements up to La (typically SEM maps use L X-ray lines for elements >Zn, and these can often have interferences). Thus, µXRF is especially suited for identifying minerals like zircon, baddeleyite, REE-rich phosphates, Fe-rich met-als, oxides, sulfides, and phosphides [4]. In Fig. 3 we show elemental distribution maps for 73001,530 where we are able to correlate the original video image with, Zr, Si, Y and Hf elemental maps together identi-fying the location of a zircon. In this location you would expect lower Si compared to surrounding mate-rial, as well as higher Zr, Y, and Hf content compared to surrounding material, all of which is confirmed by our XRF ele-mental distribution maps (Figure 2.) Conclusions: The new M4 Tornado Plus µXRF within the Astromaterials Acquisition and Curation office at NASA JSC allows for rapid and non-destructive elemental analysis of astromaterials with limited or no sample preparation. µXRF analyses pro-vide crucial compositional knowledge for the prelimi-nary examination and curation of astromaterials. This instrument enhances the advanced curation capabili-ties in the X-FaCT laboratory at JSC by allowing pro-ductive, cohesive, and non-destructive multi-modal x-ray analyses on astromaterial samples, which is neces-sary for the comprehensive curation and study of our current and future astromaterial collections. Addition-ally, µXRF can provide complimentary information to researchers for studies on astromaterials. References: [1] Allen, C. et al., (2011). Chemie De Erde Geochemistry, 71, 1-20. [2] McCubbin, F. M. et al., (2016) 47th LPSC, abstract #2668 [3] Zeigler, R. A. et al., (2017) 48th LPSC, abstract #2772 [4] Bruker User Manual [5] Young et al., (2016) Appl. Geochemistry, 72, 77-87 [6] Mor-ris, R. V. et al., (2023) 54th LPSC.

E W O'Neal↗
DOE OSTI2023

Rapid AI-based Dissection of Ashes using Raman and XRF Spectroscopy (RADAR-X)

Waste-to-energy (WTE) facilities incinerate ~35 million tons of municipal solid waste annually in the United States. The incineration process reduces the mass and the volume of the waste fraction by over 75 and 95%, respectively. The fraction left after incineration remains as ash residues and is referred to as WTE ash, compromising of bottom and fly ash. In the United States, ~10 million tons of WTE ashes are generated annually and predominantly landfilled because of the lack of secondary end-use pathways. This incurs a significant financial burden (landfilling costs) on U.S. WTE facilities and also results in the loss of materials to the landfill. The primary objective of this research is to understand better the elemental and mineralogical composition of WTE ashes from diverse origins and find composition dependent upcycling pathways for diverting these ashes from landfills. This primary objective was addressed through three research tasks –(Task I) An AI-led Multi-Modal Approach for Compositional Analysis, (Task II) Developing a Dissolution-Based Test for Real Time Analysis, and (Task III) Establishing composition-dependent end uses. The chemical composition of WTE ash is dependent on two factors, i.e., the input waste composition and the operational parameters of a WTE facility (combustion conditions). Amongst these two factors, the input waste composition will likely show spatial and temporal variation. As a result, the chemical composition of WTE ash will also fluctuate. To understand the spatial and temporal variation in WTE ash composition, in Task I, we collected 128 ash samples (62 bottom ash and 66 fly ash samples) from 11 WTE facilities located in 11 U.S. states and characterized them via X-ray Fluorescence, powder X-ray Diffraction, and Raman Spectroscopy. The findings from this extensive characterization work indicated that the key elements in WTE fly ashes are Ca, Cl (greater than 10 wt. %), Si, S, K, Zn ( between 1 and 10 wt. %), Mg, Al, P, Ti, Fe, Cu, Br, and Pb (between 0.1 and 1 wt. %). Similarly, the key elements in WTE bottom ash fraction finer than 45μm are Ca (greater than 10 wt. %), Mg, Al, Si, S, Cl, K, Ti, Fe, Zn (between 1 and 10 wt. %), P, V, Cr, Mn, Cu, Br, and Pb (between 0.1 and 1 wt. %). Here, we note that the dominant fraction of WTE bottom ash is the coarse fraction. The coarse WTE bottom ash fraction (rich in silicon) was not characterized in this study because of excessive grinding requirements and their unsuitability as a supplementary cementitious material due to their coarse nature. The elements in WTE bottom ashes are present as calcite, anhydrite, vaterite, hydroxyapatite, quartz, bassanite, gehlenite, akermanite, hydrocalumite, and portlandite. Similarly, the mineralogical species present in WTE fly ashes are calcium chloride hydroxide, halite, calcite, anhydrite, sylvite, hydrocalumite, vaterite, hannebachite, quartz, and bassanite. Temporal variation in ash composition may also result in significant fluctuations in chemical compositions. Therefore, a WTE facility may need to monitor the ash composition (elemental and mineralogical composition) in real time. In Task I, we evaluated the possibility of using a portable X-ray fluorescence (XRF) spectrometer to monitor the elemental composition in real-time. Specifically, we collected XRF data on identical specimens via a portable XRF spectrometer (low-end) and a lab-based benchtop XRF spectrometer (high-end). The collected data was used to train an A.I. algorithm (portable XRF data as an input and benchtop XRF data as an output) to predict accurate elemental composition using portable XRF data. Finally, we developed a 2-minute photobleaching protocol to monitor the mineralogical characteristics of WTE ashes via Raman spectroscopy. Overall, the activities in Task I improved our understanding of ash composition and developed techniques to monitor elemental and mineralogical composition in near real-time. Based on the findings of Task I, we find that WTE ashes exhibit wide variability in mineralogy. For ICP-based elemental analysis, all the mineralogical species in WTE ashes must be brought into solution. This is traditionally accomplished with acid digestion using a combination of multiple acids. However, acid digestion with multiple acids is time-consuming and often fails to ensure complete digestion of the ash matrix. To address this limitation, in Task II, we developed an alkali-fusion-based digestion protocol using a combination of lithium tetraborate, lithium metaborate, and their combinations as possible alkali fluxes for digesting WTE ashes entirely and rapidly. The validity of the developed method was evaluated on two standard ash specimens, i.e., SRM 1633c coal fly ash and BCR-176R incineration fly ash specimen. The findings suggest that the developed protocol can ensure complete digestion of elements such as Al, Ba, Ca, Cr, Cu, Mg, Mn, P, Sr, V, Zn, Be, K, and rare earth elements. The recent changes in the energy market towards renewables and increased metal recycling have resulted in reduced supplies of supplementary cementitious materials (coal fly ash and slag). Therefore, in Task III, we evaluated the possibility of employing WTE ashes as SCMs. As the chemical composition of WTE ashes varies temporally (on an hourly basis), there was also a need to develop tests that can evaluate the suitability of material to act as supplementary cementitious material rapidly, i.e., in a few minutes. Therefore, in Task II, we also developed a rapid test to assess the suitability of a material to act as an SCM in 5 minutes. This represents a significant advance over the state-of-the-art R 3 test, which takes ~144 hours. This test was initially validated on amorphous aluminosilicates, such as calcined clays, and could be extended to evaluate other industrial by-products, such as WTE ashes. In Task III, we evaluated the possibility of employing WTE ashes for two applications, i.e., as an SCM and a lime substitute for clay stabilization. The findings from Task I indicated that WTE ashes are enriched in chlorine and, therefore, cannot be used directly as an SCM due to corrosion-related risks and altered hydration kinetics. Accordingly, we developed an ash treatment protocol to reduce the solubility of chlorine-containing species in WTE ashes. The developed treatment protocol also immobilized lead in certain mineral forms. As a result of the treatment, WTE ashes can be used as SCMs without any corrosion or heavy metal leaching concerns. The second application examined in this study was clay stabilization. WTE ashes are calcium-rich and can be an adequate lime replacement for clay stabilization. Our findings reveal that the sum of the concentrations of Ca(OH) 2 and CaClOH controls the clay stabilization capability of WTE ashes. In summary, in this work, we evaluated the elemental and mineralogical characteristics of U.S. WTE ashes from diverse origins and developed tests to evaluate the chemical characteristics of these ashes in real time through a portable XRF and a benchtop Raman spectrometer. Based on the chemical characteristics of these ashes, we developed an ash treatment process to enable the use of WTE ashes as an SCM and also evaluated the possibility of employing these ashes for clay stabilization. Overall, the findings from this work enables the diversion of WTE ashes from landfills for multiple end-uses, i.e., as an SCM or a lime substitute for clay stabilization.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Integrated analysis of X-ray diffraction patterns and pair distribution functions for machine-learned phase identification

Abstract To bolster the accuracy of existing methods for automated phase identification from X-ray diffraction (XRD) patterns, we introduce a machine learning approach that uses a dual representation whereby XRD patterns are augmented with simulated pair distribution functions (PDFs). A convolutional neural network is trained directly on XRD patterns calculated using physics-informed data augmentation, which accounts for experimental artifacts such as lattice strain and crystallographic texture. A second network is trained on PDFs generated via Fourier transform of the augmented XRD patterns. At inference, these networks classify unknown samples by aggregating their predictions in a confidence-weighted sum. We show that such an integrated approach to phase identification provides enhanced accuracy by leveraging the benefits of each model’s input representation. Whereas networks trained on XRD patterns provide a reciprocal space representation and can effectively distinguish large diffraction peaks in multi-phase samples, networks trained on PDFs provide a real space representation and perform better when peaks with low intensity become important. These findings underscore the importance of using diverse input representations for machine learning models in materials science and point to new avenues for automating multi-modal characterization.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Scalable Multi-Facility Workflows for Artificial Intelligence Applications in Climate Research

Earth observation satellites and earth system models are sources of vast, multi-modal datasets that are invaluable for advancing climate and environmental research. However, their scale and complexity pose significant challenges for processing and analysis. In this paper we discuss our experiences in developing and using a scientific research application using an automated multi-facility workflow that orchestrates data collection, preprocessing, artificial intelligence (AI) inferencing, and data movement across diverse computational resources, leveraging the Advanced Computing Ecosystem Testbed at the Oak Ridge Leadership Computing Facility (OLCF). We demonstrate that our workflow can be seamlessly integrated and orchestrated across research facilities managed by different federal agencies, thus allowing users to extract new scientific insights from climate datasets. The experimental results indicate that the multi-facility workflow significantly reduces processing time, enhances scalability, and maintains high efficiency across varying workloads. Notably, our workflow processes 12,000 high-resolution satellite images in just 44 seconds using 80 workers distributed across 10 nodes on the OLCF systems. Such high throughput is essential for dynamic tokenization and sharding of petascale satellite data for distributed AI model training and inferencing at scale across thousands of GPUs.

Kurihana, Takuya [ORNL] (ORCID:0000000156698565)↗
NASA NTRS1989

A layered abduction model of perception: Integrating bottom-up and top-down processing in a multi-sense agent

A layered-abduction model of perception is presented which unifies bottom-up and top-down processing in a single logical and information-processing framework. The process of interpreting the input from each sense is broken down into discrete layers of interpretation, where at each layer a best explanation hypothesis is formed of the data presented by the layer or layers below, with the help of information available laterally and from above. The formation of this hypothesis is treated as a problem of abductive inference, similar to diagnosis and theory formation. Thus this model brings a knowledge-based problem-solving approach to the analysis of perception, treating perception as a kind of compiled cognition. The bottom-up passing of information from layer to layer defines channels of information flow, which separate and converge in a specific way for any specific sense modality. Multi-modal perception occurs where channels converge from more than one sense. This model has not yet been implemented, though it is based on systems which have been successful in medical and mechanical diagnosis and medical test interpretation.

Josephson, John R.↗
NASA NTRS2011

NASA Tech Briefs, March 2011

Topics covered include: Optimal Tuner Selection for Kalman-Filter-Based Aircraft Engine Performance Estimation; Airborne Radar Interferometric Repeat-Pass Processing; Plug-and-Play Environmental Monitoring Spacecraft Subsystem; Power-Combined GaN Amplifier with 2.28-W Output Power at 87 GHz; Wallops Ship Surveillance System; Source Lines Counter (SLiC) Version 4.0; Guidance, Navigation, and Control Program; Single-Frame Terrain Mapping Software for Robotic Vehicles; Auto Draw from Excel Input Files; Observation Scheduling System; CFDP for Interplanetary Overlay Network; X-Windows Widget for Image Display; Binary-Signal Recovery; Volumetric 3D Display System with Static Screen; MMIC Replacement for Gunn Diode Oscillators; Feature Acquisition with Imbalanced Training Data; Mount Protects Thin-Walled Glass or Ceramic Tubes from Large Thermal and Vibration Loads; Carbon Nanotube-Based Structural Health Monitoring Sensors; Wireless Inductive Power Device Suppresses Blade Vibrations; Safe, Advanced, Adaptable Isolation System Eliminates the Need for Critical Lifts; Anti-Rotation Device Releasable by Insertion of a Tool; A Magnetically Coupled Cryogenic Pump; Single Piezo-Actuator Rotary-Hammering Drill; Fire-Retardant Polymeric Additives; Catalytic Generation of Lift Gases for Balloons; Ionic Liquids to Replace Hydrazine; Variable Emittance Electrochromics Using Ionic Electrolytes and Low Solar Absorptance Coatings; Spacecraft Radiator Freeze Protection Using a Regenerative Heat Exchanger; Multi-Mission Power Analysis Tool; Correction for Self-Heating When Using Thermometers as Heaters in Precision Control Applications; Gravitational Wave Detection with Single-Laser Atom Interferometers; Titanium Alloy Strong Back for IXO Mirror Segments; Improved Ambient Pressure Pyroelectric Ion Source; Multi-Modal Image Registration and Matching for Localization of a Balloon on Titan; Entanglement in Quantum-Classical Hybrid; Algorithm for Autonomous Landing; Quantum-Classical Hybrid for Information Processing; Small-Scale Dissipation in Binary-Species Transitional Mixing Layers; Superpixel-Augmented Endmember Detection for Hyperspectral Images; Coding for Parallel Links to Maximize the Expected Value of Decodable Messages; and Microwave Tissue Soldering for Immediate Wound Closure.

Source record↗