SEARCH · Search NASA

Results for “data diversity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Fine scale transitions of the microbiota and metabolome along the gastrointestinal tract of herbivorous fishes

Abstract Background Gut microorganisms aid in the digestion of food by providing exogenous metabolic pathways to break down organic compounds. An integration of longitudinal microbial and chemical data is necessary to illuminate how gut microorganisms supplement the energetic and nutritional requirements of animals. Although mammalian gut systems are well-studied in this capacity, the role of microbes in the breakdown and utilization of recalcitrant marine macroalgae in herbivorous fish is relatively understudied and an emerging priority for bioproduct extraction. Here we use a comprehensive survey of the marine herbivorous fish gut microbial ecosystem via parallel 16S rRNA gene amplicon profiling (microbiota) and untargeted tandem mass spectrometry (metabolomes) to demonstrate consistent transitions among 8 gut subsections across five fish of the genus of Kyphosus . Results Integration of microbial phylogenetic and chemical diversity data reveals that microbial communities and metabolomes covaried and differentiated continuously from stomach to hindgut, with the midgut containing multiple distinct and previously uncharacterized microenvironments and a distinct hindgut community dominated by obligate anaerobes. This differentiation was driven primarily by anaerobic gut endosymbionts of the classes Bacteroidia and Clostridia changing in concert with bile acids, small peptides, and phospholipids: bile acid deconjugation associated with early midgut microbiota, small peptide production associated with midgut microbiota, and phospholipid production associated with hindgut microbiota. Conclusions The combination of microbial and untargeted metabolomic data at high spatial resolution provides a new view of the diverse fish gut microenvironment and serves as a foundation to understand functional partitioning of microbial activities that contribute to the digestion of complex macroalgae in herbivorous marine fish.

Sparagon, Wesley J. (ORCID:0000000296274174)↗

DOE OSTI2021

Freight Analysis Framework Version 5 (FAF5) Base Year 2017 Data Development Technical Report

The Freight Analysis Framework (FAF) integrates data from a variety of sources to create a comprehensive national picture of freight movements among states and major metropolitan areas by all modes of transportation. The latest of this data series is FAF5, which is the fifth generation FAF and is benchmarked on Commodity Flow Survey (CFS) 2017. Except for FAF1 that provided estimates for truck, rail, and water tonnage for calendar year 1998, later generations of FAF (FAF2 through FAF5) were built based on their benchmark year CFS data, for 2002, 2007, 2012, and 2017 respectively. The FAF is produced under a partnership between Bureau of Transportation Statistics (BTS) and Federal Highway Administration (FHWA). As a major data product of the FAF program, the FAF regional database provides a national picture of freight flows to, from, and within the United States (among regions and states), by commodity and mode for the base year, as well as for forecasts up to 30 years into the future in a 5-year interval. Additional FAF data products also include FAF network flows database, where truck movements are routed onto the national highway network, estimates of annual projections, and synchronized historical data series. This report is a technical document prepared to describe the data sources and methodologies applied in the process of building the FAF5 base-year 2017 regional database, released as FAF5.0 in February 2021. This report offers a description of the diverse data sources and modeling methods used in constructing the base year FAF5 regional database. The FAF5 base-year database is used as the base for development of forecasts and for assignment of truck flows on highway network. Similarly, the FAF5 base-year database will be used as the base to generate FAF5 annual estimates. In addition to this report, users are encouraged to refer to the FAF5 User’s Guide, which provides basic information of the data, including definitions of the data attributes, information on how to access the data and tool, as well as detailed data dictionary and code tables.

42 ENGINEERING↗

NASA NTRS2003

[Development and Use of Hidrosig]

The NASA portion of this joint NSF-NASA grant consists of objective 2 and a part of objective 3. A major effort was made on objective 2, and it consisted of developing a numerical GIs environment called Hidrosig. This major research tool is being developed by the University of Colorado for conducting river-network-based scaling analyses of coupled water-energy-landform-vegetation interactions including water and energy balances, and floods and droughts, at multiple space-time scales.Objective 2: To analyze the relevant remotely sensed products from satellites, radars and ground measurements to compute the transported water mass for each complete Strahler stream using an 'assimilated water balance equation' at daily and other appropriate time scales. This objective requires analysis of concurrent data sets for Precipitation (PPT), Evapotranspiration (ET) and stream flows (Q) on river networks. To solve this major problem, our decision was to develop Hidrosig, a new Open-Source GIs software. A research group in Colombia, South America, developed the first version of Hidrosig, and Ricardo Mantilla was part of this effort as an undergraduate student before joining the graduate program at the University of Colorado in 2001. Hydrosig automatically extracts river networks from large DEMs and creates a "link-based" data structure, which is required to conduct a variety of analyses under objective 2. It is programmed in Java, which is a multi-platform programming language freely distributed by SUN under a GPL license. Some existent commercial tools like Arc-Info, RiverTools and others are not suitable for our purpose for two reasons. First, the source code is not available that is needed to build on the network data structure. Second, these tools use different programming languages that are not most versatile for our purposes. For example, RiverTools uses an IDL platform that is not very efficient for organizing diverse data sets on river networks. Hidrosig establishes a clear data organization framework that allows a simultaneous analysis of spatial fields along river network structures involving Horton- Strahler framework. Software tools for network extraction from DEMs and network-based analysis of geomorphologic and topologic variables were developed during the first year and a part of second year.

Gupta, Vijay K.↗

NASA NTRSDate not supplied

Continued Environmental Microbiology Monitoring of the International Space Station (ISS) Veggie Unit Used for In-Flight, Crop-Based Food Systems

Crewmembers live and work in a closed environment that is monitored to ensure their health and safety. To ensure occupants’ health and safety during their spaceflight residency, Environmental Health System (EHS) microbial samples including air, surface, and water, are collected, enumerated, and analyzed quarterly to monitor on-board system contamination and potential risks to crew health. Quarterly monitoring of the microorganisms in the ISS environment supports crew safety and contributes to a large set of microbial concentration and diversity data. Based upon data historically collected over the years, in-flight microbial requirements have been established to maintain the health and safety of the spacecraft environment. This study leverages quarterly operational Environmental Health System (EHS) sampling by collecting additional microbial samples from the surface of the station’s Veggie plant production system. Microbial surface samples collected from the Veggie plant production system will yield microbial concentration and diversity that can be compared and analyzed with nominal surface samples from the vehicle. The data collected in this study will aid in the development of requirements for spaceflight-based food production systems. Continued surface sampling of the internal and external surfaces of the Veggie locker, along with collaboration from both Johnson Space Center (JSC) & Kennedy Space Center (KSC) scientists studying the microbiome of the veggie-crop systems, will be implemented as part of the future development of crop-based food system requirements for the ISS and beyond. This presentation will include a review of the study procedures and evaluations of the current results.

Christian Mena↗

NASA NTRS2010

The Crustal Dynamics Data Information System: A Resource to Support Scientific Analysis Using Space Geodesy

Since 1982. the Crustal Dynamics Data Information System (CDDIS) has supported the archive and distribution of geodetic data products acquired by the National Aeronautics and Space Administration (NASA) as well as national and international programs. The CDDIS provides easy, timely, and reliable access to a variety of data sets, products, and information about these data. These measurements. obtained from a global network of nearly 650 instruments at more than 400 distinct sites, include DORIS (Doppler Orbitography and Radiopositioning Integrated by Satellite), GNSS (Global Navigation Satellite System), SLR and LLR (Satellite and Lunar Laser Ranging), and VLBI (Very Long Baseline Interferometry). The CDDIS data system and its archive have become increasingly important to many national and international science communities, particularly several of the operational services within the International Association of Geodesy (IAG) and its observing system the Global Geodetic Observing System (GGOS), including the International DORIS Service (IDS), the International GNSS Service (IGS). the International Laser Ranging Service (ILRS), the International VLBI Service for Geodesy and Astrometry (IVS). and the International Earth rotation and Reference frame Service (IERS), Investigations resulting from the data and products available through the CDDIS support research in many aspects of Earth system science and global change. Each month, the CDDIS archives more than one million data and derived product files totaling over 90 Gbytes in volume. In turn. the global user community downloads nearly 1.2 TBytes (over 10.5 million files) of data and products from the CDDIS each month. The requirements of analysts have evolved since the start of the CDDIS; the specialized nature of the system accommodates the enhancements required to support diverse data sets and user needs. This paper discusses the CDDIS. including background information about the system and its. user communities. archive contents. available metadata, and future plans.

Noll. Carey E.↗

DOE OSTI2023

Testing SOAR tools in use

Investigations within Security Operation Centers (SOCs) are tedious as they rely on manual efforts to query diverse data sources, overlay related logs, correlate the data into information, and then document results in a ticketing system. Security Orchestration, Automation, and Response (SOAR) tools are a relatively new technology that promise, with appropriate configuration, to collect, filter, and display needed diverse information; automate many of the common tasks that unnecessarily require SOC analysts’ time; facilitate SOC collaboration; and, in doing so, improve both efficiency and consistency of SOCs. There has been no prior research to test SOAR tools in practice; hence, understanding and evaluation of their effect is nascent and needed. Here, in this paper, we design and administer the first hands-on user study of SOAR tools, involving 24 participants and six commercial SOAR tools. Our contributions include the experimental design, itemizing six characteristics of SOAR tools, and a methodology for testing them. We describe configuration of a cyber range test environment, including network, user, and threat emulation; a full SOC tool suite; and creation of artifacts allowing multiple representative investigation scenarios to permit testing. We present the first research results on SOAR tools. Concisely, our findings are that: per-SOC SOAR configuration is extremely important; SOAR tools increase efficiency and reduce context switching, although with potentially decreased ticketing accuracy/completeness; user preference is slightly negatively correlated with their performance with the tool; internet dependence varies widely among SOAR tools; and balance of automation with assisting decision making is preferred by senior participants. We deliver a public user- and tool-anonymized and -obfuscated version of the data.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

State of the art astronomical simulations have provided datasets which enabled the training of novel deep learning techniques for constraining cosmological parameters. However, differences in subgrid physics implementation and numerical approximations among simulation suites lead to differences in simulated datasets, which pose a hard challenge when trying to generalize across diverse data domains and ultimately when applying models to observational data. Recent work reveals deep learning algorithms are able to extract more information from complex cosmological simulations than summary statistics like power spectra. We introduce Domain Adaptive Graph Neural Networks (DA-GNNs), trained on CAMELS data, inspired by CosmoGraphNet (Villanueva-Domingo et al 2023). By utilizing GNNs, we can capitalize on their capacity to capture both astrophysical and topological features of galaxy distributions. Mixing these capabilities with domain adaptation techniques such as Maximum Mean Discrepancy (MMD), which enable extraction of domain-invariant features, our framework demonstrates enhanced accuracy and robustness. We present experimental results, including the alignment of distributions across domains through data visualization. These findings suggest that DA-GNNs are an efficient way of extracting domain independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2012

Mixed Layer Heights Derived from the NASA Langley Research Center Airborne High Spectral Resolution Lidar

The NASA airborne High Spectral Resolution Lidar (HSRL) has been deployed on board the NASA Langley Research Center's B200 aircraft to several locations in North America from 2006 to 2012 to aid in characterizing aerosol properties for over fourteen field missions. Measurements of aerosol extinction (532 nm), backscatter (532 and 1064 nm), and depolarization (532 and 1064 nm) during 349 science flights, many in coordination with other participating research aircraft, satellites, and ground sites, constitute a diverse data set for use in characterizing the spatial and temporal distribution of aerosols, as well as properties and variability of the Mixing Layer (ML) height. We describe the use of the HSRL data collected during these missions for computing ML heights and show how the HSRL data can be used to determine the fraction of aerosol optical thickness within and above the ML, which is important for air quality assessments. We describe the spatial and temporal variations in ML heights found in the diverse locations associated with these experiments. We also describe how the ML heights derived from HSRL have been used to help assess simulations of Planetary Boundary Layer (PBL) derived using various models, including the Weather Research and Forecasting Chemistry (WRF-Chem), NASA GEOS-5 model, and the ECMWF/MACC models.

Scarino, Amy J.↗

NASA NTRS2017

An Automaton Rover Enabling Long Duration In-Situ Science in Extreme Environments

The Automaton Rover for Extreme Environments (AREE) is a NASA Innovative Advanced Concept (NIAC) funded study focused on enabling long duration science on Venus by replacing vulnerable electronics with an entirely mechanical design. By utilizing high temperature alloys, the rover would survive on the surface of Venus for weeks if not months. The rover concept harvests wind energy using a turbine and stores it in a constant force spring. The mobility system would be guided by a mechanical computer and logic system, programed to carry out the mission. It would collect basic science data such as wind speed, temperature, and seismic events. Communicating the data back to Earth is the most challenging aspect of the system design with multiple options being explored in a trade: a simple electronic high temperature transponder, a retroreflector target or inscribing phonograph style records to be launched via a balloon to a high altitude drone capable of transmitting the data back to Earth. AREE is not only a new exciting in-situ rover concept, but also a paradigm shift to conducting in-situ science in extreme environments. Traditional extreme environment vehicles collect as many diverse data points as possible in the short period of time before system failure. AREE breaks that trend by exploring what can be done with only a few basic scientific measurements, but recorded over long periods of time. In addition to Venus, the concept can be useful in other extreme environments in the solar system including Mercury, Jupiter's radiation belts, the interiors of gas giants, the mantle of the Earth and volcanoes throughout the solar system.

Parness, Aaron↗

DOE OSTI2013

NGEE Arctic Data Management - status and planned activities for 2013

The open sharing of data and information among the NGEE Team, the broader scientific community, and the public is critical to meeting the scientific goals of the Next-Generation Ecosystem Experiment (NGEE) Arctic project. In implementing the integrated approach, the project is generating diverse data sets from observations, experiments, and models across field plot, polygonal landform, regional, and global scales and is drawing in a wealth of existing data products collected and generated by other research organizations across the Arctic. Developing the data management infrastructure to support this approach is a significant challenge. Nonetheless, the NGEE Arctic project is committed to upholding a rigorous and high-quality data management strategy and the implementation of that strategy in an innovative, cost-effective data collection, management, distribution, and archival framework. The NGEE Arctic Data Portal will support the current research in Barrow and provide a consistent framework to support future research efforts as they expand to other regions.

Devarakonda, Ranjeet↗

DOE OSTI2026

Generative large language models for predictive maintenance planning

Maintenance planning and the generation of necessary components for tasks can prove time-consuming and complex. Automating the creation of recurring or similar tasks by leveraging previous planning packages and data, while uncovering insights to automate planning package generation, presents an opportunity to conserve valuable time and resources. This work aims to harness the textual and probabilistic capabilities of large language models (LLMs) to automate the generation of planning packages. Utilizing diverse data sources ranging from raw data to handwritten text, both singular and collaborative LLMs are trained and tested. Results demonstrate their capability to generate essential planning package components, effectively replicating the statistical patterns in the data. This demonstrates the use of these tools inside a digital asset for automated planning. This work outlines a methodology for constructing datasets, a training suite, and evaluation methods for LLM-based textual and conversational planning tools utilized in an asset digital twin. Results indicate that the fine-tuned models generate estimated planning information within the statistical ranges observed in real maintenance data. The models achieve high accuracy (>90%) in document question-answering and instruction generation tasks. Furthermore, the conversational retrieval-augmented generation (RAG) assistant system achieves 100% document retrieval accuracy, while conversational information capture exceeds 98% across the majority of work-package assistant modules.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Using Atmospheric Inverse Modelling of Methane Budgets with Copernicus Land Water and Wetness Data to Detect Land Use-Related Emissions

Climate change mitigation requires countries to report their annual greenhouse gas (GHG) emissions and sinks, including those from land use, land use change, and forestry (LULUCF). In Finland, the LULUCF sector plays a crucial role in achieving net-zero GHG emissions, as the sector is expected to be a net sink. However, accurate estimates of LULUCF-related GHG emissions, such as methane (CH 4 ), remain challenging. We estimated LULUCF-related CH 4 emissions in Finland in 2013–2020 by combining national land cover and remote-sensed surface wetness data with CH 4 emissions estimated by an inversion model. According to our inversion model, most of Finland’s CH 4 emissions were attributed to natural sources such as open pristine peatlands. However, our research indicated that forests with thin tree cover surrounding open peatlands may also be a significant source of CH 4 . Unlike open pristine peatlands and pristine peatlands with thin tree cover, surrounding transient forests are included in the Finnish GHG inventory if they meet the criteria used for forest land. The current Finnish national GHG inventory may therefore underestimate CH 4 emissions from forested organic soils surrounding open peatlands, although more precise methods and data are needed to verify this. Given the potential impact on net GHG emissions, CH 4 emissions from transitional forests on organic soils should be further investigated. Furthermore, the results demonstrate the potential of combining atmospheric inversion modelling of GHGs with diverse data sources and highlight the need for methods to more easily combine atmospheric inversions with national GHG inventories.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Machine Learning for Prediction of Thermodynamic Descriptors

Our objective is to apply machine learning (ML) algorithms for the prediction of molecular catalysis descriptors from geometric properties derived from experimental crystallographic databases. Catalysis is often considered a “low-data” discipline that is poorly suited for ML methods. An exception is the extensive structural information that is available for molecular catalysts through the Cambridge Structural Database (CSD), which contains atomically precise molecular structures from X-ray diffraction analysis for >600K metal complexes. As a proof-of-principle, we targeted the prediction of hydricity, a thermodynamic property that provides understanding and control of catalytic hydride transfer. We built a training set composed of ~100 molecular complexes with a known hydricity and structural information from the CSD. This data set was converted into a machine-readable format using the smooth overlap of atomic positions (SOAP) representation and further labeled with simple electronic descriptors for the metal centers. Multiple different neural networks were trained on this data set, and the accuracy of the hydricity predictions ranged from < 2 kcal/mol to 20 kcal/mol. The accuracy of each model was highly sensitive to which compounds were in the train versus test set, underscoring the challenges associated with small and chemically diverse data sets. Finally, to further augment the data set, we attempted to experimentally measure several new hydricity values, however these experiments were unsuccessful due to undesired chemical reactivity of the selected complexes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

deadtrees.earth — An open-access and interactive database for centimeter-scale aerial imagery to uncover global tree mortality dynamics

Excessive tree mortality is a global concern and remains poorly understood as it is a complex phenomenon. We lack global and temporally continuous coverage on tree mortality data. Ground-based observations on tree mortality, e.g., derived from national inventories, are very sparse, and may not be standardized or spatially explicit. Earth observation data, combined with supervised machine learning, offer a promising approach to map overstory tree mortality in a consistent manner over space and time. However, global-scale machine learning requires broad training data covering a wide range of environmental settings and forest types. Low altitude observation platforms (e.g., drones or airplanes) provide a cost-effective source of training data by capturing high-resolution orthophotos of overstory tree mortality events at centimeter-scale resolution. Here, we introduce deadtrees.earth, an open-access platform hosting more than two thousand centimeter-resolution orthophotos, covering more than 1,000,000 ha, of which more than 58,000 ha are manually annotated with live/dead tree classifications. This community-sourced and rigorously curated dataset can serve as a comprehensive reference dataset to uncover tree mortality patterns from local to global scales using space-based Earth observation data and machine learning models. This will provide the basis to attribute tree mortality patterns to environmental changes or project tree mortality dynamics to the future. The open nature of deadtrees.earth, together with its curation of high-quality, spatially representative, and ecologically diverse data will continuously increase our capacity to uncover and understand tree mortality dynamics.

Citizen science↗

DOE OSTI2025

Computational tools and data integration to accelerate vaccine development: challenges, opportunities, and future directions

The development of effective vaccines is crucial for combating current and emerging pathogens. Despite significant advances in the field of vaccine development there remain numerous challenges including the lack of standardized data reporting and curation practices, making it difficult to determine correlates of protection from experimental and clinical studies. Significant gaps in data and knowledge integration can hinder vaccine development which relies on a comprehensive understanding of the interplay between pathogens and the host immune system. In this review, we explore the current landscape of vaccine development, highlighting the computational challenges, limitations, and opportunities associated with integrating diverse data types for leveraging artificial intelligence (AI) and machine learning (ML) techniques in vaccine design. We discuss the role of natural language processing, semantic integration, and causal inference in extracting valuable insights from published literature and unstructured data sources, as well as the computational modeling of immune responses. Furthermore, we highlight specific challenges associated with uncertainty quantification in vaccine development and emphasize the importance of establishing standardized data formats and ontologies to facilitate the integration and analysis of heterogeneous data. Through data harmonization and integration, the development of safe and effective vaccines can be accelerated to improve public health outcomes. Looking to the future, we highlight the need for collaborative efforts among researchers, data scientists, and public health experts to realize the full potential of AI-assisted vaccine design and streamline the vaccine development process.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2025

Machine Learning for Automated Weld Quality Monitoring and Control

Resistance Spot Welding (RSW) is a critical process in the automotive industry, valued for its cost-effectiveness, short cycle time, and robustness. However, achieving consistent high-quality joints remains challenging due to the complex interplay of various factors, like materials, processes, and manufacturing uncertainties, etc. Under the collaborative project between Oak Ridge National Laboratory (ORNL) and General Motors (GM), we have developed a robust and expansible machine learning (ML) framework aimed at enhancing quality control in RSW. By harnessing the power of machine learning, we have developed the ability to ensure every aspect of the welding process, from the initial process design stage to the final weld joint quality. The framework operates by analyzing a variety of data streams, including in-line process signals, process parameters, materials, and postprocessed weld joint data. Through this analysis, the models have been trained to detect deviations from optimal quality standards, leveraging their ability to identify signature data patterns and anomalies within in-line signals and construct complex correlations between these signals and weld quality parameters. Meanwhile, the machine learning framework is designed to adapt to a variety of materials, including high strength steels and aluminum alloys, etc. Its flexible architecture facilitates the incorporation of diverse data sources and features, enabling precise modeling and prediction across a broad range of material properties and weld quality variables. The expansible ML frameworks represent a promising transformation in weld quality monitoring and control, empowering industry to achieve high levels of efficiency, consistency, and reliability in manufacturing.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Machine Learning for Automated Weld Quality Monitoring and Control

42 ENGINEERING↗

NASA NTRS2002

The NASA Scientific and Technical Information (STI) Program's Implementation of Open Archives Initiation (OAI) for Data Interoperability and Data Exchange

Interoperability and data-exchange are critical for the survival of government information management programs. E-government initiatives are transforming the way the government interacts with the public. More information is to be made available through web-enabled technologies. Programs such as the NASA's Scientific and Technical Information (STI) Program Office are tasked to find more effective ways to disseminate information to the public. The NASA STI Program is an agency-wide program charged with gathering, organizing, storing, and disseminating NASA-produced information for research and public use. The program is investigating the use of a new protocol called the Open Archives Initiative (OAI) as a means to improve data interoperability and data collection. OAI promotes the use of the OAI harvesting protocol as a simple way for data sharing among repositories. In two separate initiatives, the STI Program is implementing OAI In collaboration with the Air Force, Department of Energy, and Old Dominion University, the NASA STI Program has funded research on implementing the OAI to exchange data between the three organizations. The second initiative is the deployment of OAI for the NASA technical report server (TRS) environment. The NASA TRS environment is comprised of distributed technical report servers with a centralized search interface. This paper focuses on the implementation of OAI to promote interoperability among diverse data repositories.

Rocker, JoAnne↗