Search NASA⌕ Search

SEARCH · Search NASA

Results for “Open data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

The DECADE cosmic shear project IV: cosmological constraints from 107 million galaxies across 5,400 deg$^2$ of the sky

We present cosmological constraints from the Dark Energy Camera All Data Everywhere (DECADE) cosmic shear analysis. This work uses shape measurements for 107 million galaxies measured through Dark Energy Camera (DECam) imaging of $5,\!412$ deg$^2$ of sky that is outside the Dark Energy Survey (DES) footprint. We derive constraints on the cosmological parameters $S_8 = 0.791^{+0.027}_{-0.032}$ and $Ω_{\rm m} =0.269^{+0.034}_{-0.050}$ for the $Λ$CDM model, which are consistent with those from other weak lensing surveys and from the cosmic microwave background. We combine our results with cosmic shear results from DES Y3 at the likelihood level, since the two datasets span independent areas on the sky. The combined measurements, which cover $\approx\! 10,\!000$ deg$^2$, prefer $S_8 = 0.791 \pm 0.023$ and $Ω_{\rm m} = 0.277^{+0.034}_{-0.046}$ under the $Λ$CDM model. These results are the culmination of a series of rigorous studies that characterize and validate the DECADE dataset and the associated analysis methodologies (Anbajagane et. al 2025a,b,c). Overall, the DECADE project demonstrates that the cosmic shear analysis methods employed in Stage-III weak lensing surveys can provide robust cosmological constraints for fairly inhomogeneous datasets. This opens the possibility of using data that have been previously categorized as ``unusable'' for cosmic shear analyses, thereby increasing the statistical power of upcoming weak lensing surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Drone Flight Data Logs

This dataset represents the open-air tests for the drones when testing different flight scenarios. For some flights we created and tested with a set of onboard sensors. For others we used the native logs for the drones. We recorded relevant conditions for each of the flights to examine environmental issues and weight impacts. We also looked at segmentations of flights to investigate the energy used in each type of flight.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Revealing complex subsurface dynamics with continuous seismic monitoring: Observations using distributed acoustic sensing and surface orbital vibrators during hydraulic fracturing

Understanding hydraulic fracturing is crucial to improving the stimulation of unconventional reservoirs and increasing fluid production. This study develops a novel seismic monitoring technology using distributed acoustic sensing (DAS) and surface orbital vibrators (SOV) to capture fracture seismic response and mechanical properties at high temporal intervals. We analyze continuous time-lapse vertical seismic profiling (VSP) data acquired every hour during the first nine days of treatment of an unconventional reservoir in the Austin Chalk/Eagle Field Laboratory. The VSP data contain clear seismic signals scattered from the activated fractures. The spatiotemporal changes of the fracture reflectivity revealed by the SOV/DAS data correlate well with the observations of fracture locations inferred from low-frequency DAS data. These results capture the fracture opening and closure processes, as well as highlight potential prestage activations of the fractures due to hydraulic connectivity with preexisting fracture systems. Therefore, analysis of the presented data set provides a unique opportunity to understand fracture initiation and subsequent evolution, not only in the context of unconventional resources but also in enhanced geothermal systems.

Correa, Julia↗
DOE OSTI2025

DOE Repository Metadata Profile (DRMP): A Metadata Framework for Advancing Interoperability and AI Readiness Across Scientific Repositories

The Department of Energy (DOE) funds a diverse and distributed ecosystem of repositories that steward scientific data, publications, and software across its research programs, user facilities, and national laboratories. While significant progress has been made in standardizing dataset-level metadata, the metadata describing repositories themselves (their identity, governance, access interfaces, policies, and technical capabilities) remains inconsistent and fragmented across DOE-funded systems. This variability limits discoverability, interoperability, automated validation, and AI-driven analysis, all of which are increasingly essential for modern scientific workflows. To address this gap, the DOE Data Curation Working Group (DCWG) developed the DOE Repository Metadata Profile (DRMP). The DRMP is a practical, community-driven framework that defines how repositories can describe themselves in a consistent, machine-actionable, and scalable manner. The DRMP is not a new metadata schema. Instead, it is a mapping profile and structured element set capturing the essential characteristics of DOE repositories. It harmonizes repository-level metadata across six widely adopted community schemas: RE3Data; DCAT-US v3; Schema.org; Dublin Core; DataCite 4.6; and PREMIS 3.0. This harmonization eliminates reinvention and enables interoperability within DOE and across the broader scientific ecosystem. A core objective of the DRMP is to reduce burden on repositories by allowing them to reuse their existing metadata through a Rosetta-style crosswalk rather than redesigning local implementations. The profile introduces a three-level conformance model that supports incremental adoption: • Level 1 – Minimum Viable Record (MVR): foundational identification elements required for workflows, project registration, and basic repository presence. • Level 2 – Interoperable: structured metadata enabling alignment with national and international discovery systems. • Level 3 – AI-Ready: enhanced provenance, policy transparency, fixity, semantic context, and capabilities that support automated reasoning, model training governance, and machine-assisted curation. To support implementation, the DRMP includes JSON Schema definitions, OpenAPI patterns, and MCP templates that allow repositories to publish machine-readable metadata directly within existing platforms. These resources are modular and lightweight, enabling adoption without major architectural change. Adopting the DRMP enables repositories to: • Enhance discoverability and interoperability by aligning identifiers, classifications, and descriptive elements across widely used schema standards. • Support federated discovery and cross-registration across DOE systems, Data.gov, and international catalogs. • Enable AI agents and workflow orchestration systems to interpret repository-level metadata within the American Science Cloud (AmSC) through Model Context Protocol (MCP)-based context publication. • Demonstrate alignment with DOE’s open science, stewardship, and FAIR data priorities. This guidance represents a community-driven step forward. Through voluntary adoption and continued feedback, the DRMP advances a cohesive, machine-actionable description of DOE repositories that supports FAIR data practices, preparing the infrastructure for AI-enabled research, and strengthening the discoverability and reuse of DOE’s scientific outputs.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2020

Vulnerabilities in Artificial Intelligence and Machine Learning Applications and Data

Artificial intelligence (AI) applications driven by machine learning (ML) are transformational technologies within the international nuclear security regime. Advancements realized by AI—faster and improved data insights, more efficient and automated processes, reductions in human error—enable nuclear security applications such as behavior analysis for insider threat mitigation, source tracking of stolen nuclear material, and facial recognition software for physical protection. In addition to the advantages, however, there are also inherent vulnerabilities and threats associated with its use and risk mitigations must be built into any AI/ML-enabled systems. This work provides a background on AI and ML and different data types used in the field, including open-source intelligence information (OSINT) that is discoverable by AI tools and application data that are used by AI tools for decision-making and automation. Current and potential AI applications and vulnerabilities related to their use within the nuclear security regime are also discussed.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2024

Database schema design: Energy Flexibility Environmental Tradeoffs Tool

The Energy Flexibility-Environment Tradeoff Toolset is designed using Streamlit framework, with Python as the programming language. Data storage is facilitated through the use of SQLite. Streamlit is an open-source Python framework for machine learning and data science teams, and SQLite is the most used database engine.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

Soil architecture and subsurface stratigraphic heterogeneities across land-lake interfaces along Lake Erie.

Uploaded raw datasets from electrical resistivity tomography (ERT), ground penetrating radar (GPR), electromagnetic induction (EMI) and insitu sensors were acquired across land-lake interfaces along Lake Erie. These datasets were useful to delineate the soil architecture and subsurface stratigraphic heterogeneities. We combined multiple geophysical methods with lithostratigraphic logs from borehole cores and data from soil and borehole sensors to investigate spatial heterogeneities across land-lake interfaces. The apparent electrical conductivity (Eca) maps matched closely with the soil maps from public database and also detected additional soil units that were missing in the traditional soil maps. This implies that electromagnetic induction (EMI) could be relied upon for non invasive characterization of soils in sampling restricted sites where only non-invasive measurements are feasible. Results from electrical resistivity tomography (ERT) and Ground penetrating radar (GPR) are consistent with the surficial geology of the study area, and revealed that the vertical variabilities at the sites are mainly driven by stratigraphy.The ERT data (.stg) were acquired from three different sites portage river (PTR), crane creek (CRC) and old woman creek (OWC). The ".stg" files can be opened with ERT inversion software such as EarthImager, ResIpy or Res2DInv. The GPR data (.GPZ) were also acquired from the three sites, and the ".GPZ" data files can be opened with EKKO_project 5 software from Sensors & Software Inc., or with any other standard GPR software. The EM data (.csv) were acquired from the three sites while the soil sensor data (.csv) here were acquired only from crane creek site. The ".csv) files can be opened with MS Excel or any other spread sheet software.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Machine-Learning Accelerated Studies of Materials with High Performance and Edge Computing

In the studies of materials, experimental measurements often serve as the reference to verify physics theory and modeling; while theory and modeling provide a fundamental understanding of the physics and principles behind. However, the interactions and cross validation between them have long been a challenge even to-date. Not only that inferring a physics model from experimental data is itself a difficult inverse problem, another major challenge is the orders-of-magnitude longer wall-clock time required to carry out high-fidelity computer modeling to match the timescale of experiments. We envisage that by combining high performance computing, data science, and edge computing technology, the current predicament can be alleviated, and a new paradigm of data-driven physics research will open up. For example, we can accelerate computer simulations by first performing the large-scale modeling on high performance computers and train a machine-learned surrogate model. This computationally inexpensive surrogate model can then be transferred to the computing units residing closely to the experimental facilities to perform high-fidelity simulations at a much higher throughout. The model will also be more amenable to analyzing and validating experimental observations in comparable time scales at a much lower computational cost. Further integration of these accelerated computer simulations with an outer machine learning loop can also inform and direct future experiments, while making the inverse problem of physics model inference more tractable. We will demonstrate a proof-of-concept by using a quantum Monte Carlo application, Dynamical Cluster Approximation (DCA++), to machine-learn a surrogate model and accelerate the study of quantum correlated materials.

Li, Ying Wai↗
DOE OSTI2025

Online Bayesian State Estimation for Real-Time Monitoring of Growth Kinetics in Thin Film Synthesis

Rapid validation of newly predicted materials through autonomous synthesis requires real-time adaptive control methods that exploit physics knowledge, a capability that is lacking in most systems. Here, in this study, we demonstrate an approach to enable real-time control of thin film synthesis by combining in situ optical diagnostics with a Bayesian state estimation method. We developed a physical model for film growth and applied the direct filter (DF) method for real-time estimation of nucleation and growth rates during pulsed laser deposition (PLD). We validated the approach using simulated and experimental reflectivity data for WSe 2 growth and ultimately deployed the algorithm on an autonomous PLD system during the growth of 1T'-MoTe 2 . The DF robustly estimates growth parameters in real time at early stages of growth, down to 15% monolayer area coverage. This fusion of in situ diagnostics, data assimilation, and physical modeling opens new opportunities in adaptive control of synthesis trajectories toward desired material states.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Reconstruction of effective potential from statistical analysis of dynamic trajectories

The broad incorporation of microscopic methods is yielding a wealth of information on the atomic and mesoscale dynamics of individual atoms, molecules, and particles on surfaces and in open volumes. Analysis of such data necessitates statistical frameworks to convert observed dynamic behaviors to effective properties of materials. Here, we develop a method for the stochastic reconstruction of effective local potentials solely from observed structural data collected from molecular dynamics simulations (i.e., data analogous to those obtained via atomically resolved microscopies). Using the silicon vacancy defect in graphene as a model, we apply the statistical framework presented herein to reconstruct the free energy landscape from the calculated atomic displacements. Evidence of consistency between the reconstructed local potential and the trajectory data from which it was produced is presented, along with a quantitative assessment of the uncertainty in the inferred parameters.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2023

Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principles

Abstract We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the symmetry transformations and the corresponding generators. The constructed loss functions ensure that the applied transformations are symmetries and the corresponding set of generators forms a closed (sub)algebra. Our procedure is validated with several examples illustrating different types of conserved quantities preserved by symmetry. In the process of deriving the full set of symmetries, we analyze the complete subgroup structure of the rotation groups SO (2), SO (3), and SO (4), and of the Lorentz group S O ( 1 , 3 ) . Other examples include squeeze mapping, piecewise discontinuous labels, and SO (10), demonstrating that our method is completely general, with many possible applications in physics and data science. Our study also opens the door for using a machine learning approach in the mathematical study of Lie groups and their properties.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Fast event-based electron counting for small-molecule structure determination by MicroED

Electron counting helped realize the resolution revolution in single-particle cryoEM and is now accelerating the determination of MicroED structures. Its advantages are best demonstrated by new direct electron detectors capable of fast (kilohertz) event-based electron counting (EBEC). This strategy minimizes the inaccuracies introduced by coincidence loss (CL) and promises rapid determination of accurate structures. We used the Direct Electron Apollo camera to leverage EBEC technology for MicroED data collection. Given its ability to count single electrons, the Apollo collects high-quality MicroED data from organic small-molecule crystals illuminated with incident electron beam flux densities as low as 0.01–0.045 e − /Å 2 /s. Under even the lowest flux density (0.01 e − /Å 2 /s) condition, fast EBEC data produced ab initio structures of a salen ligand (268 Da) and biotin (244 Da). Each structure was determined from a 100° wedge of data collected from a single crystal in as few as 50 s, with a delivered fluence of only ∼0.5 e − /Å 2 . Fast EBEC data collected with a fluence of 2.25 or 3.33 e − /Å 2 also facilitated a 1.5 Å structure of thiostrepton (1665 Da). While refinement of these structures appeared unaffected by CL, a CL adjustment applied to EBEC data further improved the distribution of intensities measured from the salen ligand and biotin crystals. However, CL adjustment only marginally improved the refinement of their corresponding structures, signaling the already high counting accuracy of detectors with counting rates in the kilohertz range. Overall, by delivering low-dose structure-worthy data, fast EBEC collection strategies open new possibilities for high-throughput MicroED.

EBEC↗
DOE OSTI2023

Driving Next-Generation Workflows from the Data Plane

We observe the emergence of a new generation of scientific workflows that process data produced at a sustained rate by scientific instruments and large scale numerical simulations. This data is consumed by multiple analysis, visualization, or Machine Learning components not only to enable inference and justify the scientific program, but also to monitor and steer the evolution of these experiments. In such workflows, moving intermediate data efficiently is key to performance, more than efficiently scheduling computational tasks. However, most traditional workflow management systems focus on optimizing task scheduling and then deal with data management, assuming a “move little, compute for long” model, which makes them unfit to the efficient management of this new generation of workflows. Therefore, we advocate for a new way to manage scientific workflows. We propose to consider an efficiently and independently managed data plane that can store and stream data. Workflows compute components, in the application plane can then interact with the data plane, abstracted from complexities of data management. Then, the role of a workflow management system would become that of a control plane that allows users to connect services together to execute the workflow and manages connections between the application and data planes. In this position paper, we characterize several next-generation workflow motifs and describe how their interaction with the data plane is a challenge to traditional workflow management systems. Then, we express a set of requirements that a workflow management system should meet to efficiently manage next-generation workflows at different scales. Based on these requirements, we expose our vision of driving next-generation workflows from the data plane and list remaining open challenges.

Suter, Fred↗
DOE OSTI2022

Model-based interface design for smart field-device integration

Operational complexity is ever-increasing for electric utilities that face challenges including integration of DERs, customer expectation of energy choices, the proliferation of non-utility-owned resources, new business models with energy service providers, and new technology with IT/OT convergence. To maintain and improve the quality of operations, planning, and decision-making in general, utilities need to manage and navigate the complexity. Managing complexity requires a modular, scalable, and flexible solution. Connecting large amounts of DERs and introducing new services requires increased grid control and evolving applications. In this paper, we show an approach utilizing model-based standardized interfaces that simplifies integration and deployment of new algorithms and smart field devices for interoperability across legacy or new systems. A modular design is presented for a reference implementation of widely used DNP3 and IEEE 2030.5 interfaces within an open-source, standards-based data integration platform for integration of smart field devices with independently developed, best-of-breed applications.

Model-driven development, system integration, smar↗
DOE OSTI2025

Comparative transcriptomics uncovers poplar and fungal genetic determinants of ectomycorrhizal compatibility

Ectomycorrhizal symbiosis supports tree growth and is crucial for nutrient cycling and temperate and boreal ecosystems functioning. The establishment of functional ectomycorrhiza (ECM) first requires the association of compatible partners. However, host and fungal genetic determinants governing mycorrhizal compatibility are unknown. To identify such factors in poplar and its fungal associates, we mined existing and de novo tree and fungal transcriptional datasets. We identified co-expressed genes enabling ECM symbiosis at early and mature stages of the interaction. These sets of genes can be divided into general fungal-sensing and ECM-specific components. We highlight the importance of fungal modulation of plant JA-related defenses and the regulation of secretory pathways for ECM compatibility, including upregulation of key fungal small secreted proteins, the downregulation of plant secreted peroxidases, and the downregulation of plant cell wall remodeling proteins concomitantly with the upregulation of fungal glycosyl hydrolases acting on pectin. Not only gene regulation, but also its temporal scale and dynamics seem to play a crucial role for mycorrhizal compatibility. The expression profile of the host Common Symbiosis Pathway and nutrient transporters was also studied, revealing constitutive levels of expression and moderate upregulation in compatible ECM interactions. Overall, these results underscore the importance of novel biological functions during the establishment of ECM symbiosis, help us gain insights into the molecular events determining mycorrhiza compatibility, and serve as a data-rich transcriptomic resource to open new research questions in the field.

Marqués‐Gálvez, José Eduardo↗
DOE OSTI2024

Polaris Studio

SF-24-040 Polaris-studio is the Python entry point/front end for using the Polaris transportation simulator. The package contains the code used to create new models from open and user-provided data, an extensive range of convenience tools for data preparation and result analysis and the ability of designing, launching and tracking studies combining multiple individual Polaris simulations from a Python terminal. The Polaris Studio software contains several modules for accomplishing the above tasks, including the PolarisLib - the Polaris object model, Polaris Manager - code for setting up and running Polaris studies, QPOLARIS - an add-on for the QGis software to allow model files to be created and edited, PolarisVis - a juptyer-based postprocessing library, and Polaris Tools - a useful collection of supplemental tools for interacting with Polaris files.

Auld, Joshua↗
DOE OSTI2025

XES_Neo_Public

XES Neo is a fitting software that was based on the already approved EXAFS Neo genetic algorithm fitting software code. Using the principles of genetics, data fitting is done for x-ray emission spectroscopy data. Using the EXAFS Neo open source code, as well as the open source xes_neo code written by other collaborators, a new final repository for XES Neo was created with several necessary changes for general user use.

Humiston, Alaina [Los Alamos National Laboratory]↗
DOE OSTI2025

VISTA

SAND2025-14753O VISTA Image Management is a tool that serves as a thin wrapper around S3 storage, enabling teams to create projects, upload images, and add labels to data. It uses standard open-source libraries, employs conventional authentication and authorization methods, and is expected to run behind a reverse proxy that handles authentication. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Garland, Anthony [Sandia National Lab. (SNL-CA), L↗