SEARCH · Search NASA

Results for “Data Platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Observations for Model Intercomparison Project (Obs4MIPs): status for CMIP6

The Observations for Model Intercomparison Project (Obs4MIPs) was initiated in 2010 to facilitate the use of observations in climate model evaluation and research, with a particular target being the Coupled Model Intercomparison Project (CMIP), a major initiative of the World Climate Research Programme (WCRP). To this end, Obs4MIPs (1) targets observed variables that can be compared to CMIP model variables; (2) utilizes dataset formatting specifications and metadata requirements closely aligned with CMIP model output; (3) provides brief technical documentation for each dataset, designed for nonexperts and tailored towards relevance for model evaluation, including information on uncertainty, dataset merits, and limitations; and (4) disseminates the data through the Earth System Grid Federation (ESGF) platforms, making the observations searchable and accessible via the same portals as the model output. Taken together, these characteristics of the organization and structure of obs4MIPs should entice a more diverse community of researchers to engage in the comparison of model output with observations and to contribute to a more comprehensive evaluation of the climate models. At present, the number of obs4MIPs datasets has grown to about 80; many are undergoing updates, with another 20 or so in preparation, and more than 100 are proposed and under consideration. A partial list of current global satellite-based datasets includes humidity and temperature profiles; a wide range of cloud and aerosol observations; ocean surface wind, temperature, height, and sea ice fraction; surface and top-of-atmosphere longwave and shortwave radiation; and ozone (O 3 ), methane (CH 4 ), and carbon dioxide (CO 2 ) products. A partial list of proposed products expected to be useful in analyzing CMIP6 results includes the following: alternative products for the above quantities, additional products for ocean surface flux and chlorophyll products, a number of vegetation products (e.g., FAPAR, LAI, burned area fraction), ice sheet mass and height, carbon monoxide (CO), and nitrogen dioxide (NO 2 ). While most existing obs4MIPs datasets consist of monthly-mean gridded data over the global domain, products with higher time resolution (e.g., daily) and/or regional products are now receiving more attention. Along with an increasing number of datasets, obs4MIPs has implemented a number of capability upgrades including (1) an updated obs4MIPs data specifications document that provides additional search facets and generally improves congruence with CMIP6 specifications for model datasets, (2) a set of six easily understood indicators that help guide users as to a dataset's maturity and suitability for application, and (3) an option to supply supplemental information about a dataset beyond what can be found in the standard metadata. With the maturation of the obs4MIPs framework, the dataset inclusion process, and the dataset formatting guidelines and resources, the scope of the observations being considered is expected to grow to include gridded in situ datasets as well as datasets with a regional focus, and the ultimate intent is to judiciously expand this scope to any observation dataset that has applicability for evaluation of the types of Earth system models used in CMIP.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Fast Response Temperature by airborne measurements over BNF

The original data were collected during the AAF Engineering Flights (AEF2025) in the vicinity of the ARM Bankhead National Forest (BNF) Atmospheric Observatory (https://www.arm.gov/capabilities/observatories/bnf ) in northwestern Alabama in March 2025. The ARM Aerial Facility ArcticShark uncrewed aerial system (UAS, https://www.arm.gov/capabilities/observatories/aaf/uas) was based at the public-use airport of Posey Field, Alabama (FAA LID: 1M4, 34.28027778° N, 87.60055556° W, 283m MSL) from March 9 through March 24, 2025. The ArcticShark UAS performed nine flights, including eight research flights over the AMF3 (BNF Main Site) and Supplemental Facilities to measure atmospheric state, turbulence, surface IR temperature and imagery, and aerosol number concentration and size distribution. The current data set presents fast response temperature in the atmospheric boundary layer and lower free troposphere measured on the airborne platform throughout the field campaign. The primary instruments used to create the current data set were the fine wire thermocouple probe, the Aircraft Integrated Meteorological Measurement System (AIMMS-30), the Pitot-static system (part of UAS flight control), and the infrared gas analyzer sensor for H2O and CO2 (LI-840). All parameters used in temperature calculations (static pressure, True Air Speed, and absolute humidity in form of dew point temperature) were included in the data set. For user convenience, one additional parameter was also included: the type of flight flag (level, up, down, turn, and combination of thereof).

Air temperature, fast response↗

DOE OSTI2025

CHELAX-BNF: Fast Response Temperature by airborne measurements

The original data were collected on board the ARM Aerial Facility ArcticShark uncrewed aerial system (UAS; https://www.arm.gov/capabilities/observatories/aaf/uas ) during the “Characterizing HEterogeneous Land-Atmosphere eXchanges at BNF” field campaign (CHEAX-BNF; https://arm.gov/research/campaigns/aaf2025CHELAX-BNF ). The ARM Aerial Facility ArcticShark UAS was based at the public-use airport of Posey Field, AL (FAA LID: 1M4, 34.28027778° N, 87.60055556° W, 283m MSL) from May 28 to June 23, 2025. The ArcticShark UAS performed 5 flights, including 4 research flights over the BNF Main Site (ARM Mobile Facility 3, https://arm.gov/capabilities/observatories/amf ) and Supplemental Facilities to measure atmospheric state, turbulence, surface IR temperature and imagery, aerosol number concentration, and aerosol size distribution. The current data set presents fast response temperature in the atmospheric boundary layer and lower free troposphere measured on the airborne platform throughout the field campaign. The primary instruments used to create the current data set were the fine wire thermocouple probe, the Aircraft Integrated Meteorological Measurement System (AIMMS-30), the Pitot-static system (part of UAS flight control), and the infrared gas analyzer sensor for H2O and CO2 (LI-840). All parameters used in temperature calculations (static pressure, True Air Speed, and absolute humidity in the form of dew point temperature) were included in the data set. For user convenience, one additional parameter was also included: the type of flight flag (level, up, down, turn, and combination of thereof).

Air temperature, fast response↗

DOE OSTI2023

National Opacity Program - Tri-Lab Assessment of Measurements and Models (Milestone 7720)

Opacity-on-NIF has obtained opacity data under conditions similar to those achieved by the entirely different Opacity-on-Z platform. From low- and high-Z elements at different anchor points, rigorously compare the opacity data between the laboratories and to multiple opacity theory models. Compare and assess the data acquisition and processing methods for obtaining opacities and for measuring/inferring sample conditions. Explain, or develop hypotheses for, any discrepancies. Map progress to the National Opacity Strategy and define future directions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2023

Milestone 7720: National Opacity Program - Tri-Lab Assessment of Measurements and Models

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

CORAL: A framework for rigorous self-validated data modeling and integrative, reproducible data analysis

Abstract Background Many organizations face challenges in managing and analyzing data, especially when relevant datasets arise from multiple sources and methods. Analyzing heterogeneous datasets and additional derived data requires rigorous tracking of their interrelationships and provenance. This task has long been a Grand Challenge of data science and has more recently been formalized in the FAIR principles: that all data objects be Findable, Accessible, Interoperable, and Reusable, both for machines and for people. Adherence to these principles is necessary for proper stewardship of information, for testing regulatory compliance, for measuring the efficiency of processes, and for facilitating reuse of data-analytical frameworks. Findings We present the Contextual Ontology-based Repository Analysis Library (CORAL), a platform that greatly facilitates adherence to all 4 of the FAIR principles, including the especially difficult challenge of making heterogeneous datasets Interoperable and Reusable across all parts of a large, long-lasting organization. To achieve this, CORAL's data model requires that data generators extensively document the context for all data, and our tools maintain that context throughout the entire analysis pipeline. CORAL also features a web interface for data generators to upload and explore data, as well as a Jupyter notebook interface for data analysts, both backed by a common API. Conclusions CORAL enables organizations to build FAIR data types on the fly as they are needed, avoiding the expense of bespoke data modeling. CORAL provides a uniquely powerful platform to enable integrative cross-dataset analyses, generating deeper insights than are possible using traditional analysis tools.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Integrated package of electron cyclotron emission imaging data processing and forward modeling in OMFIT

An Electron Cyclotron Emission Imaging (ECEI) data analysis module has been developed for the OMFIT platform to accommodate the needs of users at the DIII-D tokamak for physics applications. The user can easily access the ECEI spatial observation windows in the plasma that are calculated based on the automatically retrieved hardware setup and available DIII-D equilibria, perform spectral analysis, and make 2D electron temperature fluctuation images. The module provides a powerful data post processing package for extracting important physics parameters from the 2D measurements, including the radial structure and poloidal mode number of Alfven Eigenmodes, as well as the frequency-vs-wavenumber dispersion relationship of broadband MHD. Lastly, the module propagates characterized synthetic fluctuations for the user, so one can perform forward modeling tasks with simple analytical fluctuations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

How Can Construction Process Simulation Modeling Aid the Integration of Lean Principles in the Factory-Built Housing Industry?

New and existing factories that produce and deliver factory-built housing can benefit from construction process simulation modeling to explore the integration of Lean principles in their operations. Construction process simulation modeling provides digital or virtual recreations of the real-world factory environments to visualize, quantify, analyze, and optimize their underlying behavior, including factory productivity, material flow, labor dynamics, bottlenecks, and work scope. One of the key benefits of process simulation modeling is the ability to create and compare "what-if" scenarios, including integrating Lean principles such as reducing waste (for example, transportation, waiting), line balancing, and just-in-time concepts. In general, three process simulation methods are widely used: discrete event simulation (DES), agentbased modeling (ABM), and system dynamics (SD). Myriad process simulation software also is available, but depending on the industry, complexity of the system, and purposes of the simulation, some software might be more appropriate. Similar to how computer-aided design (CAD) software such as AutoCAD and Rhinoceros enable building design of modular or factory-built housing, process simulation modeling software such as jStrobe, ProModel, and AnyLogic can enable factory design of new and existing factories to deliver modular affordable housing at scale, as opposed to traditional site-built construction. Software with DES capabilities can help generate a process model that is a logical representation of resources and activities in a factory. Software with CAD-DES integration can leverage product-process data integration to help spatially visualize a DES model of the factory in the CAD environment. Software with multimethod simulation capabilities, widely used in the manufacturing industry, brings together DES, ABM, and SD in a single platform that allows visualization, quantification, analyses, and optimization at varying data fidelities. Near-real-time data from an existing factory can be directly plugged into multimethod simulation software so that the construction process simulation model is a near-accurate representation of the real-world factory conditions. This report provides insights into the use of simulation as an aid to integrate Lean concepts in factories, including guidelines for selecting the appropriate process simulation modeling method and software. These insights have been developed as part of ongoing process simulation modeling research, development, and demonstration projects at the U.S. Department of Housing and Urban Development, the U.S. Department of Energy, and the National Renewable Energy Laboratory focused on how process simulation models can enable better integration of resilience, energy efficiency, and low-carbon design strategies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Tethered Balloon Systems

Among ARM’s aerial platforms are tethered balloon systems (TBS), which consist of a helium-filled balloon, tether, winch, and sensors. TBS provide a safe way to collect data inside clouds, including mixed-phase clouds, where icing is a concern for airborne platforms. These systems are also flown above and below clouds to gather data related to wind, turbulence, thermodynamic state, aerosols, and the cloud-top environment.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Open Source Visualization and Analysis Platform for 3D Reconstructions of Materials by Transmission Electron Microscopy

Three-dimensional characterization of materials at the nano- and meso-scale has become possible with transmission and scanning transmission electron microscopes (S/TEM). Its importance has extended to a wide class of nanomaterials such as hydrogen fuel cells, solar cells, industrial catalysts, new battery materials and semiconductor devices, as well as spanning high-tech industry, universities, and national labs. While capable instrumentation is abundant, this rapidly expanding demand for high-resolution tomography is bottlenecked by software that is instead tailored for lower-dose, biological applications and not optimized for higher-resolution materials applications. Existing tomography fails to utilize the chemical information provided by S/TEM spectrometers. To address this problem, this project delivered a scalable, fully functional, freely-distributable, open Source materials tomography package with a modern user interface that enables automated acquisition, alignment, and real-time reconstruction of raw tomography data, and provides advanced segmentation, three-dimensional chemical visualization and analysis optimized for materials applications. It has established an extendable framework capable of automation for high-throughput for the tomography of materials from data acquisition to visualization. Phase I and II delivered a full-featured, cross-platform, clean and integrated application for S/TEM materials tomography. It can read projection data from the microscope, with graphical tools for alignment of data, tomographic reconstruction, segmentation, and visualization of the reconstructed 3D volume. The entire pipeline can be saved to an XML state file, enabling fully reproducible data processing and analysis with a full Python environment for the development of custom algorithms, processing, and analysis requirements. Phase IIB extended the application to provide real-time tomographic reconstruction, "live updates" as data is processed, analysis of big data, and multi-channel tomography. Here, quantitative assessment of nanomaterials can occur as data is being recorded on a 3D visualization platform that accommodates additional information from multiple channels. We provide unmatched high-throughput tomography, where the complete tomographic pipeline from measurement to 3D visualization can occur rapidly. The project was extended to offer capabilities for micro-CT, X-ray, neutron, focused ion beam, atomic electron tomography and atom probe tomography. With over 600 transmission electron microscopes worldwide and approximately 50 coming online each year, the demand and impact of an open-source tomography tool is large. Significant opportunities exist in high-tech industry, universities, and national labs to enable or enhance three-dimensional imaging at the nanoscale and bring automated high-throughput approaches that will accelerate progress in materials characterization and metrology. The project supports a service based business model by enabling lab-specific acquisition and processing customization and integration-support and development that will be provided into Phase III and beyond.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Deep Optical Switching on Subpicosecond Timescales in an Amorphous Ge Metamaterial

Active nanostructured optical components show promise as potential building blocks for novel light-based computing and data processing architectures. However, nanoscale all-optical switches that have low activation powers and high-contrast ultrafast switching have been elusive so far. Here, pump–probe measurements performed on amorphous-Ge-based micro-resonator metasurfaces that exhibit strong resonant modes in the mid-infrared are reported. Relative change is observed in transmittance of ΔT/T ≈ 1 with picosecond (down to τ ≈ 0.5 ps) free carrier relaxation rates, obtained with very low pump fluences of 50 μJ cm –2 . In this work, these observations are attributed to efficient free carrier promotion, affecting light transmittance via high quality-factor optical resonances, followed by an increased electron–phonon scattering of free carriers due to the amorphous crystal structure of Ge. Full-wave simulations based on a permittivity model that describes free-carrier damping through crystal structure disorder find excellent agreement with the experimental data. These findings offer an efficient and robust platform for all-optical switching at the nanoscale.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Optimizing inference of segmentation on high-resolution images in MLExchange

MLExchange is a machine learning (ML) operations platform providing web user-interfaces (UIs) for data visualization and analysis pipelines at synchrotron facilities. Among these UIs is the segmentation app which helps synchrotron users utilize ML algorithms to automatically segment high-resolution scientific images with minimal manual annotation effort. In this work, we share code optimizations that significantly speed up the segmentation inference workflow of large data in short time. By optimizing the sequence of CPU-GPU data transfers and introducing CPU parallelization to key operations, we improve the per-device, per-image frame computational efficiency and observe close to 3×$$\times$$ speedup over the original segmentation inference workflow run time when utilizing a single GPU. Further adaptations enabling multi-GPU inference yield more than 40×$$\times$$ speedup with 100 GPUs compared to the optimized single GPU inference workflow. This acceleration of the segmentation inference workflow will provide MLExchange users with easy access to segmentation results with little wait time.

Lu, Shizhao↗

DOE OSTI2025

Discovery, characterization, and application of chromosomal integration sites for stable heterologous gene expression in Rhodotorula toruloides

Rhodotorula toruloides is a non-model, oleaginous yeast uniquely suited to produce acetyl-CoA-derived chemicals. However, the lack of well-characterized genomic integration sites has impeded the metabolic engineering of this organism. Here we report a set of computationally predicted and experimentally validated chromosomal integration sites in R. toruloides. We first implemented an in silico platform by integrating essential gene information and transcriptomic data to identify candidate sites that meet stringent criteria. We then conducted a full experimental characterization of these sites, assessing integration efficiency, gene expression levels, impact on cell growth, and long-term expression stability. Among the identified sites, 12 exhibited integration efficiencies of 50% or higher, making them sufficient for most metabolic engineering applications. Using selected high-efficiency sites, we achieved simultaneous double and triple integrations and efficiently integrated long functional pathways (up to 14.7 kb). Additionally, we developed a new inducible marker recycling system that allows multiple rounds of integration at our characterized sites. Here, we validated this system by performing five sequential rounds of GFP integration and three sequential rounds of MaFAR integration for fatty alcohol production, demonstrating, for the first time, precise gene copy number tuning in R. toruloides. These characterized integration sites should significantly advance metabolic engineering efforts and future genetic tool development in R. toruloides.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

A high-throughput skim-sequencing approach for genotyping, dosage estimation and identifying translocations

The development of next-generation sequencing (NGS) enabled a shift from array-based genotyping to directly sequencing genomic libraries for high-throughput genotyping. Even though whole-genome sequencing was initially too costly for routine analysis in large populations such as breeding or genetic studies, continued advancements in genome sequencing and bioinformatics have provided the opportunity to capitalize on whole-genome information. As new sequencing platforms can routinely provide high-quality sequencing data for sufficient genome coverage to genotype various breeding populations, a limitation comes in the time and cost of library construction when multiplexing a large number of samples. Here we describe a high-throughput whole-genome skim-sequencing (skim-seq) approach that can be utilized for a broad range of genotyping and genomic characterization. Using optimized low-volume Illumina Nextera chemistry, we developed a skim-seq method and combined up to 960 samples in one multiplex library using dual index barcoding. With the dual-index barcoding, the number of samples for multiplexing can be adjusted depending on the amount of data required, and could be extended to 3,072 samples or more. Panels of doubled haploid wheat lines ( Triticum aestivum , CDC Stanley x CDC Landmark), wheat-barley ( T . aestivum x Hordeum vulgare ) and wheat-wheatgrass ( Triticum durum x Thinopyrum intermedium ) introgression lines as well as known monosomic wheat stocks were genotyped using the skim-seq approach. Bioinformatics pipelines were developed for various applications where sequencing coverage ranged from 1 × down to 0.01 × per sample. Using reference genomes, we detected chromosome dosage, identified aneuploidy, and karyotyped introgression lines from the skim-seq data. Leveraging the recent advancements in genome sequencing, skim-seq provides an effective and low-cost tool for routine genotyping and genetic analysis, which can track and identify introgressions and genomic regions of interest in genetics research and applied breeding programs.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2025

Statistical relationships across epigenomes using large-scale hierarchical clustering

Recent advances in genomics and sequencing platforms have revolutionized our ability to create immense data sets, particularly for studying epigenetic regulation of gene expression. However, the avalanche of epigenomic data is difficult to parse for biological interpretation given nonlinear complex patterns and relationships. This attractive challenge in epigenomic data lends itself to machine learning for discerning infectivity and susceptibility. In this study, we explore over 3000 epigenomes of uninfected individuals and provide a framework to characterize the relationships among epigenetic modifiers, their modifiers, genetic loci, and specific immune cell types across all chromosomes using hierarchical clustering. Hierarchical clustering of epigenomic data revealed consistent epigenetic patterns across chromosomes, demonstrating that variation due to epigenetic modifiers is greater than variation between cell types. Gene Ontology and KEGG pathway analyses indicated significant enrichment of genes involved in chromatin remodeling, mRNA splicing, immune responses, and the regulation of microRNAs and snoRNAs. Epigenetic modifiers frequently formed biologically relevant clusters, including the cohesin complex, RNA Polymerase II transcription factors, and PRC2 complex members. These clustering behaviors remained consistent across all chromosomes, supported by entropy analysis and high Adjusted Rand Index scores, indicating robust cross-chromosomal similarity. Co-occurrence analysis further revealed specific sets of modifiers that consistently appeared together within clusters, reflecting shared biological functions and interactions. Validation using another dataset confirmed the reproducibility of these clustering patterns and modifier co-occurrence relationships, underscoring the reliability and generalizability of the methodology.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Early Evaluation of Fugaku A64FX Architecture Using Climate Workloads

The Energy Exascale Earth System Model (E3SM) Project is an ongoing, state-of-the-science Earth system modeling, simulation, and prediction project that targets efficient utilization of U.S. Department of Energy’s (DOE) supercomputers to meet the science needs of the nation and the mission needs of DOE. This work focuses on our early evaluation of the A64FX architecture on Fugaku supercomputer using E3SM benchmarks. We will present results that track hardware trends, facilitate architecture comparison and the specific impact on our workload using an atmospheric model benchmark. We have two variants of the code written in Fortran and C++/Kokkos respectively which were used to collect data on a variety of CPU and GPU platforms. Furthermore, we have conducted a comparative evaluation of the compilers on the A64FX architecture and found GNU to be the best performer for our workload. Our experience so far indicates that Fugaku/A64FX shows promising energy efficiency (performance/Watt) with further performance gains possible through architecture-aware optimization efforts.

Sreepathi, Sarat↗

DOE OSTI2021

Cyber-Physical Event Emulation-Based Transmission-and-Distribution Co-Simulation for Situational Awareness of Grid Anomalies (SAGA)

Energy management of transmission and distribution networks (T&D) is becoming more challenging with the accelerated adoption of distributed energy resources (DERs)-such as distributed photovoltaic generation and battery energy storage systems (BESS)-on the electric grid. To better analyze the impacts of DERs on both transmission and distribution systems, a comprehensive T&D co-simulation platform is developed. Further, with DERs more actively participating in system operation-e.g., by providing real-time grid services-their cyber vulnerability needs to be better understood to maintain system reliability. This paper discusses a cyber-physical events emulation-based T&D co-simulation platform to perform comprehensive cyber events emulations, physical simulation, and analysis of interdependent impacts. Results from the case studies-which show how cyber events on a synthetic distribution network can impact operations on the transmission and distribution network-validate that the proposed T&D cosimulation platform can perform cyber-physical events emulation and produce response in near realtime; therefore, with extensive simulation using the proposed co-simulation platform, the system operators can accumulate adequate training data for system situational awareness of grid anomalies.

anomalies detection↗

DOE OSTI2023

Spy in the GPU-box: Covert and Side Channel Attacks on Multi-GPU System

The deep learning revolution has been enabled in large part by GPUs, and more recently accelerators, which make it possible to carry out computationally demanding training and inference in acceptable times. As the size of machine learning networks and workloads continues to increase, multi-GPU machines have emerged as an important platform offered on High Performance Computing and cloud data centers. Since these machines are shared among multiple users, it becomes increasingly important to protect applications against potential attacks. In this paper, we explore the vulnerability of Nvidia's DGX multi-GPU machines to covert and side channel attacks. These machines consist of a number of discrete GPUs that are interconnected through a combination of custom interconnect (NVLink) and PCIe connections. We reverse engineer the interconnected cache hierarchy and show that it is possible for an attacker on one GPU to cause contention on the L2 cache of another GPU. We use this observation to first develop a covert channel attack across two GPUs, achieving the best bandwidth of around 4 MB/s. We also develop a prime and probe attack on a remote GPU allowing an attacker to recover the cache access pattern of another workload. This access pattern can be used in any number of side channel attacks: we demonstrate a proof of concept attack that fingerprints the application running on the remote GPU, with high accuracy. We also develop a proof of concept attack to extract hyperparameters of a machine learning workload. Our work establishes for the first time the vulnerability of these machines to microarchitectural attacks and can guide future research to improve their security.

Dutta, Sankha↗