Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Real-time GIS Programming and Geocomputation

Streaming data generated continuously from sensor networks, mobile devices, social media platforms and other edge devices have posed significant challenges to existing computing platforms for achieving both high throughput and low latency data processing in addition to scalable computing. This entry introduces a real-time computing and programming platform for time-critical GIS (Geographic Information System) applications. In this platform, advanced streaming data processing software, such as Apache Kafka and Spark Streaming, are integrated to enable data analytics in real-time. This computing platform can also be extended to integrate GeoAI (Geospatial Artificial Intelligence) based machine learning models to leverage both historical and streaming data to achieve real-time prediction and intelligent geospatial analytics. Two real-time geospatial applications in terms of flood simulation and climate data visualization are introduced to demonstrate how real-time programming and computing can help tackle real-world problems with important societal impacts.

Liu, Yan↗
DOE OSTI2022

Cybersecurity and Digital Components: Supply Chain Deep Dive Assessment

The report “America’s Strategy to Secure the Supply Chain for a Robust Clean Energy Transition” lays out the challenges and opportunities faced by the United States in the energy supply chain as well as the federal government plans to address these challenges and opportunities. It is accompanied by several issue-specific deep dive assessments, including this one, in response to Executive Order 14017 “America’s Supply Chains,” which directs the Secretary of Energy to submit a report on supply chains for the energy sector industrial base. The Executive Order is helping the federal government to build more secure and diverse U.S. supply chains, including energy supply chains. As the energy sector has become more globalized and increasingly complex, digitized, and even virtualized, its supply chain risk for digital components – the software, virtual platforms and services, and data – in energy systems has evolved and expanded. All digital components in U.S. energy sector systems are vulnerable and may be subject to cyber supply cha in risks stemming from a variety of threats, vulnerabilities, and impacts. This includes digital components in all systems within the ESIB, namely those systems operated by asset owners across different energy subsectors (e.g., electricity, oil and natural gas, and renewables) and the systems operated by a worldwide industrial complex with capabilities to perform research and development and design, produce, operate, and maintain energy sector systems, subsystems, components, or parts to meet U.S. energy requirements. Supply chain risks for digital components including software, virtual platforms and services, and data have grown in recent years as increasingly sophisticated cyber adversaries have targeted exploiting vulnerabilities in these digital assets. Supply chain risks for digital components in energy sector systems will continue to evolve and likely increase as these systems are increasingly interconnected, digitized, and remotely operated.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

The CanBikeCO Full Pilot: Long-Term Results and Analysis From an E-Bike Program in Colorado, USA

Personal micromobility devices like bicycles, e-bikes, and scooters are low- or zero-energy alternatives to single-occupancy vehicles. However, a lack of data has led to a dearth of data-driven research on personally owned e-bike usage. We present longitudinal findings from the CanBikeCO program, focused on e-bike adoption and use across demographics, trip characteristics, and geographies in the state of Colorado. CanBikeCO recorded travel survey data from low-income individuals provided with personal e-bikes by the Colorado Energy Office in six communities across Colorado from July 2021 to December 2022. The data were collected using a custom instance of the National Renewable Energy Laboratory OpenPATH platform, which combines passive data collection with semantic information such as trip mode and purpose labels. To our knowledge, there are no prior travel survey data on personally owned e-bikes with this range and scope. Insights from this unique dataset include: (i) work trips were 17% more likely than average trips to be taken on an e-bike, (ii) e-bikes were most often reported to replace cars (34% of e-bike trips) and other personal micromobility devices (22%), and (iii) participants favored walking for trips less than 1 mile, e-bikes for trips of 1-3 miles, and e-bikes, cars, or shared rides for trips of 3-20 miles. The data used to generate these results have been made available in the Transportation Secure Data Center. We find e-bike use is appealing across age groups and may be related to characteristics of land use, urban form, occupation, income, and car ownership. We conclude for this population that the energy demand added by e-bike use (induced demand and replacing non-motorized modes) is outweighed by the reduction in energy demand from replacement of single-occupancy vehicle trips with e-bike trips. Our findings suggest considerable potential for energy savings from personal e-bike ownership.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Hybrid feature-driven learning system for abnormality detection and localization

A cyber-physical system may have a plurality of monitoring nodes each generating a series of current monitoring node values over time representing current operation of the system. A data-driven features extraction computer platform may receive the series of current monitoring node values and generate current data-driven feature vectors based on the series of current monitoring node values. A residual features extraction computer platform may receive the series of current monitoring node values, execute a system model and utilize a stochastic filter to determine current residual values, and generate current residual-driven feature vectors based on the current residual values. An abnormal detection platform may then receive the current data-driven and residual-driven feature vectors and compare the current data-driven and residual-driven feature vectors with at least one decision boundary associated with an abnormal detection model. An abnormal alert signal may then be transmitted when appropriate based on a result of said comparison.

Abbaszadeh, Masoud↗
DOE OSTI2024

Investigating the impacts of solid phase extraction on dissolved organic matter optical signatures and the pairing with high‐resolution mass spectrometry data across a freshwater stream network

Abstract Advancing our understanding of dissolved organic matter (DOM) chemistry in aquatic systems necessitates the integration of data streams from multiple analytical platforms. Some measurements require pretreatment with solid phase extraction (SPE), while others are performed directly on whole water samples. Evidence has suggested that SPE will be biased against select DOM fractions, leading to concerns over the ability to establish data linkages across platforms with variable needs for SPE pretreatment, such as those from optical measurements and those that provide high‐resolution molecular information. Here, we directly addressed this concern by assessing the impact of SPE on DOM optical properties through excitation–emission matrices with parallel factor analysis (PARAFAC) for 47 samples across a stream network within a single watershed reflective of variable DOM sources. PARAFAC data was further paired with molecular information obtained by Fourier transform ion cyclotron resonance mass spectrometry (FTICR‐MS). A comparison of PARAFAC models first revealed no systematic qualitative differences in major components between whole water DOM and DOM isolated by SPE (SPE‐DOM); however, quantitative biases against select components were observed. Further linkages with FTICR‐MS data revealed that the molecular fingerprint associated with each PARAFAC component was consistent between the whole water DOM and SPE‐DOM. Our results suggest that bulk scale linkages across these analytical platforms could be inferred irrespective of the observed quantitative biases resulting from SPE for samples within this example watershed. This work represents a key step toward the systematic evaluation of linkages between optical and high‐resolution mass spectrometry datasets in freshwater lotic environments.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A case study on parallel HDF5 dataset concatenation for high energy physics data analysis

In High Energy Physics (HEP), experimentalists generate large volumes of data that, when analyzed, helps us better understand the fundamental particles and their interactions. This data is often captured in many files of small size, creating a data management challenge for scientists. In order to better facilitate data management, transfer, and analysis on large scale platforms, it is advantageous to aggregate data further into a smaller number of larger files. However, this translation process can consume significant time and resources, and if performed incorrectly the resulting aggregated files can be inefficient for highly parallel access during analysis on large scale platforms. In this paper, we present our case study on parallel I/O strategies and HDF5 features for reducing data aggregation time, making effective use of compression, and ensuring efficient access to the resulting data during analysis at scale. We focus on NOvA detector data in this case study, a large-scale HEP experiment generating many terabytes of data. Here, the lessons learned from our case study inform the handling of similar datasets, thus expanding community knowledge related to this common data management task.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Perspectives for self-driving labs in synthetic biology

Self-driving labs (SDLs) combine fully automated experiments and data collection with artificial intelligence (AI) and control algorithms that decide not only the set of parameters for the next experiment, but also potentially which scientific hypotheses to test. Taken to their ultimate expression, SDLs could usher a new paradigm of scientific research, where the world is probed, interpreted, and explained by machines for human benefit. Whereas there are functioning SDLs in the fields of chemistry and materials science, we contend that synthetic biology provides a unique opportunity since the genome provides a single, easily accessible, target for affecting the incredibly wide repertoire of biological cell behavior. Since they can provide large amounts of high-quality data, SDLs can be a platform for AI to develop approaches to systematically convert data into scientific knowledge systems. These knowledge systems can be used both to understand the biological world and to design bioengineered systems to fit a desired specification (inverse design). However, the level of investment required for the creation of biological SDLs is only warranted if directed towards solving difficult and enabling biological questions. Here, we discuss challenges and opportunities in creating SDLs for synthetic biology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Heterogeneous Visualization: A Call for Empirically Driven Technology Advancement and Adoption; Preprint

Our ability to generate data from simulations and experimental platforms is generally outpacing our ability to analyze those data efficiently and effectively. There are a growing number and variety of possible visualization display modalities, from commodity head-mounted displays to large-scale immersive environments, from desktop and touch displays to high-resolution display walls. Many of these visualization technologies and visual environments are rapidly evolving and could revolutionize analysis for certain classes of complex scientific and engineering data. However, the choice of what technology or combination of technologies to use has historically been largely ad hoc and lacks a carefully validated understanding of how to best utilize different visualization technologies to advance the science. To maximize the impact of our data and analyses, it is imperative that we use the most effective visualization environments for the analysis task at hand.

heterogeneous visualization↗
DOE OSTI2021

A cloud platform for atomic pair distribution function analysis: PDFitc

A cloud web platform for analysis and interpretation of atomic pair distribution function (PDF) data ( PDFitc ) is described. The platform is able to host applications for PDF analysis to help researchers study the local and nanoscale structure of nanostructured materials. The applications are designed to be powerful and easy to use and can, and will, be extended over time through community adoption and development. The currently available PDF analysis applications, structureMining, spacegroupMining and similarityMapping , are described. In the first and second the user uploads a single PDF and the application returns a list of best-fit candidate structures, and the most likely space group of the underlying structure, respectively. In the third, the user can upload a set of measured or calculated PDFs and the application returns a matrix of Pearson correlations, allowing assessment of the similarity between different data sets. structureMining is presented here as an example to show the easy-to-use workflow on PDFitc . In the future, as well as using the PDFitc applications for data analysis, it is hoped that the community will contribute their own codes and software to the platform.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

BigPanDA monitoring system evolution in the ATLAS Experiment

Monitoring services play a crucial role in the day-to-day operation of distributed computing systems. The ATLAS Experiment at LHC uses the Production and Distributed Analysis workload management system (PanDA WMS), which allows a million computational jobs to run daily at over 170 computing centers of the WLCG and opportunistic resources, utilizing 600k cores simultaneously on average. The BigPanDA monitor is an essential part of the monitoring infrastructure for the ATLAS Experiment that provides a wide range of views, from top-level summaries to a single computational job and its logs. Over the past few years of the PanDA WMS advancement in the ATLAS Experiment, several new components were developed, such as Harvester, iDDS, Data Carousel, and Global Shares. Due to its modular architecture, the BigPanDA monitor naturally grew into a platform where the relevant data from all PanDA WMS components and accompanying services are accumulated and displayed in the form of interactive charts and tables. Moreover the system has been adopted by other experiments beyond HEP. In this paper we describe the evolution of the BigPanDA monitor system, the development of new modules, and the integration process into other experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Mobility Energy Productivity and Equity: E-Bike Impacts for Low-Income Essential Workers in Denver

New mobility technologies such as electrified and shared mobility, combined with polices and incentive programs, are emerging to help address sustainability and equity issues in transportation planning. However, it can be difficult to understand the impacts of novel mobility trends and emerging modes on energy-efficient access. This is owing to a lack of (1) open-source tools enabling rapid data collection, and (2) open-source metrics that consider multimodal, multiactivity access and mobility within the contexts of sustainability and equity. Here, this paper addresses the topic of improving evaluation of transportation modes and incentive programs by integrating an open-source platform for tracking human travel data—the Open Platform for Agile Trip Heuristics (OpenPATH)—with a mobility metric that quantifies the efficiency of a region’s transportation system: Mobility Energy Productivity (MEP). Integration is demonstrated in the context of pilot programs in Colorado, where low-income essential workers were provided with electric bikes (e-bikes). OpenPATH-informed MEP calculations showed that several locations in downtown Denver provided comparable time-, cost-, and energy-efficient access to opportunities using e-bikes compared with driving. Additionally, providing e-bikes to low-income essential workers was found to be meaningful, as they utilized e-bikes the most to commute, despite driving still being their most utilized mode and the mode with highest MEP scores in Denver. We show how data collected from open-source tools coupled with robust metrics such as MEP can help evaluate the impacts of emerging mobility options. This could support developing policies to incentivize novel modes to achieve greater levels of sustainable, equitable, and efficient access.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Sensors with Intelligent Measurement Platform for Monitoring and Control in Distribution Circuits

This paper presents a medium-voltage intelligent measurement platform that provides post-processing of raw measurements received from commercially-available voltage/current sensors to enhance accuracy and bandwidth of the monitoring system. Furthermore, this platform integrates into a Data Distribution Service (DDS) messaging bus for distributed control and interoperability. The authors present the design, specifications, and major components included in the platform, and argue for applications and use cases that most benefit from this new approach. A laboratory testbed has been created to demonstrate the functionality, for which test results are presented for selected test cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

ARM TBS and TigerShark deployment data in 2021

In 2021, observational data collected using ARM platforms, including seven TigerShark UAS flights and 133 tethered balloon system (TBS) flights, were archived by the ARM Data Center and made publicly available to the user community.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Accomplishments of Thermal Neutron Scattering Research at North Carolina State University [Slides]

Thermal neutron scattering law (TSL) data evaluations have been completed and contributed to ENDF. New evaluations are underway. FLASSH is developing as a modern platform for thermal neutron data analysis featuring an enhanced user experience and low learning overhead. Advanced TSL techniques in combination with Doppler analysis have been developed, which were incorporated into FLASSH. ML/DL NeTS method development has been initiated. Experimental capabilities for validation have been developed at the PULSTAR reactor.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

NETL Plastic Pipes Project (Final Report)

Plastic or composite pipelines have been the bane of the utility locating industry because they are neither conductive nor magnetic which are the properties traditionally used to locate buried utilities. Ground penetrating radar (GPR) is an effective geophysical tool for locating plastic/composite pipelines where resistive cover allows for adequate penetration of radar energy. However, GPR has limited applicability in areas where the soil cover is conductive due to significant clay and/or salt content. This study examines complementary near-surface geophysical methods that are potentially useful for locating buried plastic/composite pipelines, either singly or in combination. Specifically, this modeling study used computational numerical methods to forward model the response of GPR, resistivity, seismic, gravity gradiometry, and photoacoustic/thermoacoustic imaging methods to plastic/composite pipelines for various scenarios including: (1) pipe diameters ranging between 2 in. to 12 in.; (2) burial depths ranging between 3 ft. to 4 ft.; (3) various degrees in contrast in physical properties (i.e., electrical permittivity, elasticity, resistivity, density); and (4) various experimental acquisition choices (e.g., GPR radar and seismic source frequencies, electrode spacing). Numerical modeling performed herein reconfirmed that GPR is the preferred method for detecting/locating plastic pipelines. A caveat for GPR detection is that the material covering the plastic pipe (trench fill material and adjacent soil) must be sufficiently resistive to allow the two-way propagation to the required depth of investigation and back to the surface. GPR was the only method modeled in this study that can be used to directly detect plastic pipelines of 2-in.-diameter and larger when buried 3-ft-deep. GPR data processing and imaging also can determine pipe depth, pipe diameter, trench dimensions, and moisture conditions. Seismic modeling results suggest that direct detection of a 12-in.-diameter plastic pipe at 3-ft.-depth may be possible under favorable conditions; however, the associated signature would be weak (e.g., surface- to S-wave, backscattered surface-waves, and/or forward scattered surface-waves to S-wave). Direct pipe detection under field conditions with noise and strong lateral geologic heterogeneity is doubtful. Numerical modeling also suggests that plastic pipelines can be indirectly located by detecting the trench in which they are buried. GPR, direct current (DC) resistivity, and seismic methods have the potential to locate the pipeline trench if there is sufficient contrast between the trench-wall and trench-fill materials for the physical property being measured by each method (i.e., electrical permittivity for GPR; resistivity for DC resistivity; or density, compressional velocity, or shear velocity for seismic). Modeling also indicated that currently available (commercial) gravity gradiometers would be unable to directly detect/locate plastic pipelines ≤ 8-in.-diameter when buried 3-ft.-deep given the typical instrument noise floor for field surveying as well as the expected density variations due to geologic heterogeneity. The numerical modeling performed in this project did not identify a universal geophysical technology that can locate buried plastic pipelines in all parts of the United States (although GPR is suggested for all areas with resistive cover). However, the project results suggest that a towed land streamer simultaneously acquiring multiple geophysical data types including multi-offset GPR, multi-channel DC resistivity, seismic geophone- and/or distributed acoustic sensing (DAS), and potentially photoacoustic/thermoacoustic data would be an appropriate platform for locating buried plastic pipeline. Moreover, the complementary multiphysics data acquired by a towed land streamer would permit the use of joint and/or cooperative inversion frameworks for a more rigorous and consistent data interpretation.

42 ENGINEERING↗
DOE OSTI2022

Hydrological Perspectives on Integrated, Coordinated, Open, Networked (ICON) Science

Hydrologic sciences depend on data monitoring, analyses, and simulations of hydrologic processes to ensure safe, sufficient, and equal water distribution. These hydrologic data come from but are not limited to primary (lab, plot, and field experiments) and secondary sources (remote sensing, UAVs, hydrologic models) that typically follow FAIR Principles (Findable, Accessible, Interoperable, and Reusable: (go-fair.org)). Easy availability of FAIR data has become possible because the hydrology-oriented organizations have pushed the community to increase coordination of the protocols for generating data and sharing model platforms. In addition, networking at all levels has emerged with an invigorated effort to activate community science efforts that complement conventional data collection methods. However, it has become difficult to decipher various complex hydrologic processes with increasing data. Machine learning, a branch of artificial intelligence, provide more accurate and faster alternatives to better understand different hydrological processes. The Integrated, Coordinated, Open, Networked (ICON) framework provides a pathway for water users to include and respect diversity, equity, and inclusivity. In addition, ICONs support the integration of peoples with historically marginalized identities into this professional discipline of water sciences. This article comprises three independent commentaries about the state of ICON principles in hydrology and discusses the opportunities and challenges of adopting them.

(ICON) principles to address↗
DOE OSTI2024

UAS remote sensing (AltaX platform): Red-green-blue (RGB) imagery, thermal infrared (TIR) imagery, and canopy reflectance (Level 0 data), Seward Peninsula, Alaska, 2023

Airborne remote sensing data collected using Brookhaven National Laboratory’s (BNL) heavy-lift unoccupied aerial system (UAS) AltaX platform on the Seward Peninsula, Alaska, USA. This package includes raw (L0) data from 11 flights flown over the NGEE-Arctic Kougarok mile marker 64 (MM64) and Teller MM 27 sites in July, 2023. The AltaX is a multi-sensor UAS platform that simultaneously measures very high spatial resolution optical red/green/blue (RGB) and thermal infrared (TIR) surface “skin” temperature imagery, as well as near-surface surface reflectance at 1 nm intervals in the visible to near-infrared spectral range from ~350 – 1000 nm. This package provides the Level 0 (raw, unprocessed) data collected by the platform and sensors. Ancillary aircraft data, flight mission parameters, and general flight conditions provided by the onboard flight and data collection computers are also included. Data and metadata are provided as text (*.txt, *.json), binary (*.dat, *.ulg), tabular (*.csv), geospatial (*.kml. *kmz), image (*.jpg, *.png, *.tif) and pdf formats. The metadata documents contain flight campaign, platform, sensor, flight and file metadata, along with a description of the L0 data and the file naming scheme.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗