Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data manipulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Common Electric Power Transmission System Model JSON Schema Specification

The Common Electric Power Transmission System Model (CTM) is an intuitive, extensible, language-agnostic, and error-resistant specification of electric power network components parameter names and units, and relation between components, intended for use by the research community developing new computational methods for power systems operations and simulation. Power system datasets following the CTM specification can be read as dictionaries and manipulated in that form in most programming languages (e.g., Python, Julia, C++). This standard data structure in CTM makes it easy to work in multiple power systems domains (e.g., economic operation, reliability assessment, electricity markets, stability assessment, etc.) without requiring conversions between use-case-specific file formats with information loss in the process. This repository specifies CTM as a JSON Schema, provides documentation, derivate (code-generated) implementations of CTM, and example data and usage of the schema for important use cases.

Aravena Solis, Ignacio↗
DOE OSTI2021

Electrochemical Manipulation and Radiolytic Evaluation of Organic Phase Neptunium

Presentation for Seed LDRD proposal presentation: This Seed LDRD research proposes to test an innovative approach to precisely control the oxidation state distribution of neptunium (Np) under used nuclear fuel (UNF) reprocessing conditions using novel electrochemical methods. Current UNF reprocessing technologies are not financially viable in the US, requiring significant scientific and technological innovation to improve cost efficiency. Reducing the number of process cycles is one avenue for increasing cost efficiency, of which resolving the challenge associated with isolating Np is critical. Under envisioned process conditions, Np is present in a mixture of extractable (Np(IV) and Np(VI)) and inextractable (Np(V)) oxidation states, the distribution of which is dependent on several factors, including ionizing radiation dose, that change throughout a reprocessing scheme. Consequently, Np unintentionally partitions into various UNF reprocessing phases and product streams, ultimately increasing the number of process cycles to isolate UNF components. Here, we propose to employ novel, high surface area, optically transparent, Ligand Modified tin-doped indium oxide Electrodes (LMES). These LMEs bind Np, and therefore enable concurrent generation and spectroscopic characterization of Np oxidation states in organic solutions. These proof-of-concept experiments will: (i) facilitate optimization of the proposed electrochemical system conditions for Np oxidation state manipulation; (ii) identify the accessible electrochemical window for Np complexes in the organic phase; (iii) report characteristic optical spectra for each accessible complexed Np oxidation state; and (iv) determine the lifetime and partitioning of a given atypical Np oxidation state in the organic phase in the presence and absence of ionizing radiation fields. The data gathered by this Seed LDRD will provide support for the design of an electrochemical process concept for the precise manipulation of Np oxidation states in UNF reprocessing solvent systems, with the intention of providing advanced control over Np mass transfer, and thus greater process efficiency and economy.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2023

Improving evapotranspiration computation with electrical resistivity tomography in a maize field

Abstract Hydrogeophysical methods have been increasingly used to study subsurface soil–water dynamics, yet their application beyond the soil compartment or the quantitative link to soil hydraulic properties remains limited. To examine how these methods can inform model‐based evapotranspiration (ET) calculation under varying soil water conditions, we conducted a pilot‐scale field study at an experimental maize plot with manipulated irrigation treatments. Our goal was to develop a workflow for (1) acquiring and inverting field electrical resistivity tomography (ERT) data, (2) correlating ERT to soil hydraulic properties, (3) spatially characterizing soil water stress that feeds into ET modeling (the FAO‐56 model), and (4) evaluating the performance of ERT‐based ET computation. Our results showed that ERT was able to capture decimeter‐scale soil water content (SWC) dynamics from root water uptake and irrigation manipulation and the contrast of soil water stress between deficiently and fully irrigated maize. We also demonstrated the flexibility of using ERT to spatially integrate soil water stress in the soil volume of interest, which could be adjusted based on different crops and plot layouts. The integration of the ERT datasets into ET modeling provided insights into the spatial heterogeneity of the subsurface that has been challenging for point‐based sensing, which can further our understanding of the hydraulic dynamics in the soil‐plant‐atmosphere continuum.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Machine Learning for Real-time Fusion Plasma Behavior Prediction and Manipulation (Final Report)

The goal of this project is to implement real-time analysis of 2D Beam Emission Spectroscopy (BES) data to predict and control transient and high-bandwidth events at DIII-D. In essence, we wish to bring high-bandwidth fluctuation diagnostics into the realm of real-time measurements and control. The BES ML models will necessarily be deep neural networks (DNN) with a “data flow” architecture for compatibility with high-throughput, low-latency evaluation on a field-programmable gate array (FPGA) or other emerging processor technologies. The real-time output will be fed to the plasma control system (PCS) for real-time control tasks, specifically for ELM control and avoidance and for QH-mode access and sustainment. We anticipate that the real-time analysis of fluctuation diagnostics will create new enabling technologies to predict and control transient events such as confinement mode transitions, edge-localized modes, Alfven eigenmode events, and disruptions. The proposed research is aligned with ITER research needs and DIII-D programmatic goals. For instance, the prediction and avoidance of ELM events is critical for ITER machine safety. Also, H-mode access with RMP ELM suppression in ITER is an active research area due to high separatrix density, narrow SOL width, and elevated LH transition power threshold.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Inferring microbial interactions with their environment from genomic and metagenomic data

Microbial communities assemble through a complex set of interactions between microbes and their environment, and the resulting metabolic impact on the host ecosystem can be profound. Microbial activity is known to impact human health, plant growth, water quality, and soil carbon storage which has lead to the development of many approaches and products meant to manipulate the microbiome. In order to understand, predict, and improve microbial community engineering, genome-scale modeling techniques have been developed to translate genomic data into inferred microbial dynamics. However, these techniques rely heavily on simulation to draw conclusions which may vary with unknown parameters or initial conditions, rather than more robust qualitative analysis. To better understand microbial community dynamics using genome-scale modeling, we provide a tool to investigate the network of interactions between microbes and environmental metabolites over time. Using our previously developed algorithm for simulating microbial communities from genome-scale metabolic models (GSMs), we infer the set of microbe-metabolite interactions within a microbial community in a particular environment. Because these interactions depend on the available environmental metabolites, we refer to the networks that we infer as metabolically contextualized , and so name our tool MetConSIN: Met abolically Con textualized S pecies I nteraction N etworks.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Estimating carrying capacity for juvenile salmon using quantile random forest models

Abstract Establishing robust methods and metrics to evaluate habitat quality is critical for the recovery of endangered Pacific salmonids ( Oncorhynchus spp.). A variety of modeling approaches are used for status and trend monitoring of anadromous species throughout the Pacific Northwest, USA, but current methods may fail to capture the complex relationship between fish and habitat and are often limited in predictive power beyond specific watersheds. Further, the focus on species distribution and abundance is not easily manipulated to predict carrying capacity and traditional stock‐recruitment analyses are reliant on long‐term data which are not always available. In this study, we developed a quantile random forest model to provide estimates of habitat carrying capacity for Chinook salmon ( O. tshawytscha ) parr during the summer months, at both the site and watershed scale. Quantile random forest models allow for the consideration of noisy data, correlated variables, and non‐linear relationships: common features in fish–habitat datasets. We leveraged Columbia Habitat Monitoring Program data to select habitat co‐variates and predict capacity at those sites. We also identified a set of globally available attributes to extrapolate capacity estimate predictions throughout wadeable streams within the Columbia River basin. Total capacity estimates for watersheds closely matched estimates from alternative fish productivity models. Carrying capacity estimates based on quantile random forest models, like those presented here, provide managers a framework to guide the identification, prioritization, and development of habitat rehabilitation actions to recover salmon populations.

See, Kevin E.↗
DOE OSTI2024

ISO_Fortran_binding_m v0.1.0

The Fortran programming language standard defines a broad feature set supporting the interoperability of Fortran programs with program written according to the C programming language standard. Among Fortran's C-interoperability features is a a C header file "ISO_Fortran_binding.h" This header file defines the interface to various C data structures and functions that C programs may use to access Fortran data entities. The ISO_Fortran_binding_m software defines a native Fortran module that presents an interface to these same data structures and functions. ISO_Fortran_bind_m thus enables Fortran programs to access and manipulate Fortran entities in ways that precisely mirror what C programs can do using ISO_Fortran_binding.h. ISO_Fortran_binding_m facilitates writing portable standard-conforming Fortran programs that emulate non-interoperable features, e.g., dynamic polymorphism, in a standard-conforming interoperable way similar but broader than what is demonstrated in Berkeley Lab's Caffeine software [1]. ISO_Fortran_binding_m also enables a Fortran programmer to extend Fortran's capabilities to emulate certain C functionality such as memory address arithmetic or computing C's "sizeof" function. [1] https://github.com/BerkeleyLab/caffeine/blob/213e3df1c319f0663306354414f352acda42a24f/src/caffeine/collective_subroutines/co_reduce_s.f90#L88 [2] https://github.com/BerkeleyLab/ISO_Fortran_binding_m/blob/0c585362bb4f2c72cf9049c800a7115b529ec533/src/iso_fortran_binding_m.F90#L196

Rouson, Damian↗
DOE OSTI2020

Tracking atomic structure evolution during directed electron beam induced Si-atom motion in graphene via deep machine learning

Using electron beam manipulation, we enable deterministic motion of individual Si atoms in graphene along predefined trajectories. Structural evolution during the dopant motion was explored, providing information on changes of the Si atom neighborhood during atomic motion and providing statistical information of possible defect configurations. The combination of a Gaussian mixture model and principal component analysis applied to the deep learning-processed experimental data allowed disentangling of the atomic distortions for two different graphene sublattices. This approach demonstrates the potential of e-beam manipulation to create defect libraries of multiple realizations of the same defect and explore the potential of symmetry breaking physics. The rapid image analytics enabled via a deep learning network further empowers instrumentation for e-beam controlled atom-by-atom fabrication. Here, the analysis described in the paper can be reproduced via an interactive Jupyter notebook at https://git.io/JJ3Bx.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

A New Integrated Analysis Suite for Fast-Ion Study in KSTAR

Here, an integrated workflow for fast-ion analysis was developed by adapting the One Modeling Framework for Integrated Task (OMFIT) workflow manager to support a standard and unified analysis platform for KSTAR users. The newly established analysis suite offers a graphical user interface–based workflow to enable users to readily access and handle experimental data archived in various data formats and servers. Further, users can analyze the data by importing modules designed for conducting certain tasks, such as profile fitting, equilibrium reconstruction, and postprocessing of tokamak data. The procedures for preparing the inputs for fast-ion simulations are streamlined by a common workflow manager, which enables the parallel processing of various tasks to efficiently analyze large fast-ion datasets. The OMFIT platform comprises a flexible Python-based application that enables users to freely manipulate the Python scripts for applications that are unavailable in the standard workflow. The framework also offers mapping tools to translate the output data into the Integrated Modeling and Analysis Suite format to maintain application compatibility for future ITER burning plasma experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Microbial community data from throughfall exclusion experiment: Metadata, SI, community composition, LefSe, and FunGuilR data tables from PARCHED Panama tropical forest soils, 2024-2025

Soil contains more carbon (C) than terrestrial vegetation and the atmosphere combined, with some of the largest terrestrial C stocks in tropical rainforests. Soil microbes decompose organic matter, playing a vital role in the storage or loss of soil C. With climate change, drought conditions are predicted to increase in many tropical regions, including both chronic drying and extended drought, potentially influencing these processes. This project explored the effects of chronic and seasonal drying on soil microbial communities across four distinct tropical forests in a long-term drying experiment. We investigated the effects of a chronic drying manipulation on soil microbial community abundance and variation across different forests and seasons. We also compared findings with previously published data from these forests after short-term drying. This project used soils from a long-term drying experiment established in 2018 across four seasonal lowland forests in Panama. Soils were collected from 0 – 10 cm depths during three seasonal periods in control and drying plots in 2024 and 2025 from a total of 32 plots (n = 4 per forest per treatment). The forests varied in baseline rainfall and soil fertility. We calculated alpha and beta diversity indices and compared taxonomic community composition. We found significant biogeographic variation in microbial diversity and taxonomy, with significant differences across the forests and significant effects of the drying treatment. Metadata and sample IDs are within Metadata_16S.csv and Metadata_ITS.csv. Relative abundance tables of every sample at every season are shown in the Excel workbooks 16S Relative Abundance.xlsx and ITS Relative Abundance.xlsx. They are then also shown in CSV files by each taxonomic level. Linear discriminant analysis effect size (LefSe) tables are shown for the full 16S and ITS datasets (n = 96), subsets for every site at every season (n = 8), and then for the forests with each plot merged by season (n = 8). FunGuildR data table of ITS data is uploaded.

Bacteria↗
DOE OSTI2022

A Julia Framework for Graph-Structured Nonlinear Optimization

Graph theory provides a convenient framework for modeling and solving structured optimization problems. Under this framework, the modeler can arrange/assemble the components of an optimization model (variables, constraints, objective functions, and data) within nodes and edges of a graph, and this representation can be used to visualize, manipulate, and solve the problem. In this work, we present a Julia framework for modeling and solving graph-structured nonlinear optimization problems. Our framework integrates the modeling package Plasmo.jl (which facilitates the construction and manipulation of graph models) and the nonlinear optimization solver MadNLP.jl (which provides capabilities for exploiting graph structures to accelerate solution). We illustrate with a simple example how model construction and manipulation can be performed in an intuitive manner using Plasmo.jl and how the model structure can be exploited by MadNLP.jl. We also demonstrate the scalability of the framework by targeting a large-scale, stochastic gas network problem that contains over 1.7 million variables.

Cole, David↗
DOE OSTI2024

A pyroxene-based quantum magnet with multiple magnetization plateaus

Pyroxenes (AMX 2 O 6 ) consisting of infinite one-dimensional edge-sharing MO 6 chains and bridging XO 4 tetrahedra are fertile ground for finding quantum materials. Thus, here, we have studied calcium cobalt germanate (CaCoGe 2 O 6 ) and calcium cobalt silicate (CaCoSi 2 O 6 ) crystals in depth. Heat capacity data show that the spins in both compounds are dominantly Ising-like, even after being manipulated by high magnetic fields. On cooling below the Néel temperatures, a sharp field–induced transition in magnetization is observed for CaCoGe 2 O 6 , while multiple magnetization plateaus beneath the full saturation moment are spotted for CaCoSi 2 O 6 . Our analysis shows that these contrasting behaviors potentially arise from the different electron configurations of germanium and silicon, in which the 3d orbitals are filled in the former but empty in the latter, enabling electron hopping. Thus, silicate tetrahedra can aid the interchain superexchange pathway between cobalt(II) ion centers, while germanate ones tend to block it during magnetization.

Science & Technology - Other Topics↗
DOE OSTI2024

Generation and control of nonlocal chiral currents in graphene superlattices by orbital Hall effect

Graphene-based superlattices offer a unique materials playground to exploit and control a higher number of electronic degrees of freedom, such as charge, spin, or valley for disruptive technologies. Recently, orbital effects, emerging in multivalley band structures lacking inversion symmetry, have been discussed as possible mechanisms for developing . Here, we report nonlocal transport measurements in small gap hBN/graphene/hBN moiré superlattices which reveal very strong magnetic field-induced chiral response which is stable up to sizable temperatures. The measured sign dependence of the nonlocal signal with respect to the magnetic field orientation clearly indicates the manifestation of emerging orbital magnetic moments. The interpretation of experimental data is well supported by numerical simulations, and the reported phenomenon stands as a formidable way of manipulation of the transverse flow of orbital information that could enable the design of orbitronic devices. Published by the American Physical Society 2024

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

SPRUCE Vertical Profiles of CO2 and H2O Concentrations in Air in Experimental Plots Beginning in 2015

This dataset provides a record of hourly average CO2 and H2O concentrations in air at 4 vertical locations (0.5, 1, 2, and 4 m above ground level (agl)) on the central tower location for each of 13 SPRUCE experimental plots. Ten plots have enclosures (plots 4, 6, 8, 10, 11, 13, 16, 17, 19, and 20) and three plots (5, 7 and 21) are ambients without enclosures. Data are included for measurement periods beginning in 2015 and extend throughout the whole ecosystem warming (WEW) manipulations for the SPRUCE Project (Hanson et al. 2016, 2017). In August 2015, WEW was initiated at 5 warming levels (+0, +2. +4.5, +6.75 and +9 °C) with 2 plots per warming level. DPH measurements were underway before the initiation of WEW heating treatments and both are expected to operate through 2025. Elevated CO2 treatments were initiated within 5 experimental plots (Plots 4, 10, 11, 16 and 19) in June of 2016. All measurements were made at the 8.1-ha S1 bog forest site in northern Minnesota, 40 km north of Grand Rapids, in the USDA Forest Service Marcell Experimental Forest (MEF).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Reliable Measures of Spread in High Dimensional Latent Spaces

Understanding geometric properties of the latent spaces of natural language processing models allows the manipulation of these properties for improved performance on downstream tasks. One such property is the amount of data spread in a model’s latent space, or how fully the available latent space is being used. We demonstrate that the commonly used measures of data spread, average cosine similarity and a partition function min/max ratio I (V), do not provide reliable metrics to compare the use of latent space across data distributions. We propose and examine six alternative measures of data spread, all of which improve over these current metrics when applied to seven synthetic data distributions. Of our proposed measures, we recommend one principal component-based measure and one entropy-based measure that provide reliable, relative measures of spread and can be used to compare models of different sizes and dimensionalities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Machine Learning of All Mycobacterium tuberculosis H37Rv RNA-seq Data Reveals a Structured Interplay between Metabolism, Stress Response, and Infection

Mycobacterium tuberculosis is one of the most consequential human bacterial pathogens, posing a serious challenge to 21st century medicine. A key feature of its pathogenicity is its ability to adapt its transcriptional response to environmental stresses through its transcriptional regulatory network (TRN). While many studies have sought to characterize specific portions of the M. tuberculosis TRN, and some studies have performed system-level analysis, few have been able to provide a network-based model of the TRN that also provides the relative shifts in transcriptional regulator activity triggered by changing environments. Here, we compiled a compendium of nearly 650 publicly available, high quality M. tuberculosis RNA-sequencing data sets and applied an unsupervised machine learning method to obtain a quantitative, top-down TRN. It consists of 80 independently modulated gene sets known as “iModulons,” 41 of which correspond to known regulons. These iModulons explain 61% of the variance in the organism’s transcriptional response. We show that iModulons (i) reveal the function of poorly characterized regulons, (ii) describe the transcriptional shifts that occur during environmental changes such as shifting carbon sources, oxidative stress, and infection events, and (iii) identify intrinsic clusters of regulons that link several important metabolic systems, including lipid, cholesterol, and sulfur metabolism. This transcriptome-wide analysis of the M. tuberculosis TRN informs future research on effective ways to study and manipulate its transcriptional regulation and presents a knowledge-enhanced database of all published high-quality RNA-seq data for this organism to date.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Status of FUDGE [Slides]

This presentation discusses the nuclear data management code FUDGE (For Updating Data and Generating Evaluations). While FUDGE is designed to support GNDS, the presentation also states that ENDF-6 and ENDL data files are also supported but must first be translated into GNDS; translators are included with FUDGE. It also states that FUDGE supports plotting, manipulating, checking for physical content, resonance reconstruction, Doppler broadening, etc. FUDGE also supports processing for Monte Carlo and deterministic transport. FUDGE is open source, and the latest public release was FUDGE-4.2.3 with support for GNDS-1.9. In summation, FUDGE capabilities include translating older formats into GNDS, translating GNDS back to ENDF-6, and visualizing, modifying, checking, and processing GNDS data. It also states that a new version of FUDGE is coming soon. The plan is to support GNDS-2.0 specification, but it may be released sooner if v2.0 is delayed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Automated Data Review of Analytical Laboratory Results at Los Alamos National Laboratory - 20299

Newport News Nuclear BWXT-Los Alamos, LLC (N3B) collects samples in support of the U.S. Department of Energy's (DOE) Office of Environmental Management (EM) Los Alamos Legacy Cleanup Contract (LLCC). N3B receives and reviews over 1.6 million sample data points annually in support of various ongoing environmental monitoring and remediation projects of the LLCC. N3B must demonstrate and document that reported external analytical laboratory data produced for the LLCC are of sufficient quality to fulfill their intended purpose and to support defensible decision making as described in EPA QA/G4 Guidance for the Data Quality Objectives Process 1994. In 2018, N3B assumed management of the LLCC along with the Environmental Information Management (EIM) database that contains all historical and current environmental data associated with the LLCC. The entire EIM database is shared between N3B, Triad National Security, LLC (Triad), and New Mexico Environment Department (NMED). These three parties jointly manage the database, its configuration, and changes / updates. All environmental data that are entered into EIM are updated and available, on a daily basis, in the linked public database Intellus New Mexico (Intellus). The quality and defensibility of the environmental data generated from sampling activities is a key component of an effective remediation process. Providing quality data is accomplished through a data assessment process that includes examination, verification, and validation. Examination is the assessment of completeness of the deliverables, identification of any reporting errors, and determining the usability of the data based on the laboratory's evaluation of its data as described in the case narrative received with the data. Verification consists of an evaluation of the Electronic Data Deliverables (EDD) data report to determine the extent to which the external analytical laboratories met method and contract-specific quality control and reporting requirements. Validation consists of determining the data quality and the extent to which the external analytical laboratories accurately and completely reported all sample and quality control results and satisfied all contract requirements. EIM contains an automatic Data Validation Module which performs automated data review (DVM ADR). DVM ADR is a tool to assist in the validation process. When DVM ADR is used in conjunction with manual examination of sample data packages, the combination of the two will meet and exceed the requirements of verification. N3B recognized an opportunity for process improvement, focusing on DVM ADR configuration and enhancements in EIM. Testing EIM's configuration provided proof of the DVM ADR's capabilities and flexibility to accurately perform routine data checks based on analytical methods and regulatory requirements. In addition, the DVM ADR module was improved through enhancements for all analytes, particularly upgrades for radiochemistry data. Extensive testing of the DVM ADR module occurred using EDDs from actual laboratory analyses on the EIM testing site. During this process, N3B manipulated EDD information to verify that the actual outcomes matched the expected outcomes. The results of this testing were shared with the database architects, and configuration improvements were identified to address these results. During this process, N3B identified that the radiochemical DVM ADR capabilities were underutilized, and so enhanced the DVM ADR functionality with respect to radioanalytical assessment. N3B environmental data uploads to Intellus on a daily basis from EIM, once the analytical data undergoes examination and verification. As such, it is important to have a high level of confidence in the quality and defensibility of the data. The process of manual examination, along with the DVM ADR, in conjunction with full validation of a percentage the data specified through the Data Quality Objectives greatly increases efficiency of data review and confidence level of the quality of the data, and gives the project managers, governmental offices, and the public expedited access to high-quality data. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗