SEARCH · Search NASA

Results for “granular data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2018

Tools, Techniques, and Methodologies: A Survey of Digital Forensics for SCADA Systems

Security aspects of SCADA environments and the systems within are increasingly a center of interest to researchers and security professionals. As the rise of sophisticated and nation-state malware targeting such systems flourishes, traditional digital forensics tools struggle to transfer the same capabilities to systems lacking typical volatile memory primitives, monitoring software, and the compatible operating-system primitives necessary for conducting forensic investigations. Even worse, SCADA systems are typically not designed and implemented with security in mind, nor were they purpose-built to monitor and record system data at the granularity associated with traditional IT systems. Rather, these systems are often built to control field devices and drive industrial processes. More succinctly, SCADA systems were not designed with a primary goal of interacting with the digital world. Consequently, forensics investigators well-versed in the world of digital forensics and incident response face an array of challenges that prevent them from conducting effective forensic investigation in environments with vast amounts of critical infrastructure. In order to bring SCADA systems within the reach of the armies of digital forensics professionals and tooling already available, both researchers and practitioners need a guide to the current state-of-the-art techniques, a road-map to the challenges lying on the path forward, and insight into the future directions R&D must move towards. To that end, this paper presents a survey into the literature on digital forensics applied to SCADA systems. We cover not only the challenges to applying digital forensics to SCADA like most other reviews, but also the range of proposed frameworks, methodologies, and actual implementations in literature.

Asmar Awad, Rima↗

DOE OSTI2019

Visualization and Analytics of Distribution Systems with Deep Penetration of Distributed Energy Resources (VADER)

In its current state, the distribution system is incapable of handling small to moderate amounts of photovoltaic (PV) penetration. This is because it was initially designed for handling passive loads which, at the level of a substation, have low variability and are forecastable with high accuracy. It has been an open loop system with little monitoring and control. With the addition of PV energy sources, the overall scenario will change dramatically due to (1) two way power flow on network; and (2) high aggregate variability. Additionally, changes on the consumption side lead to a number of smart loads, Electric Vehicles (EVs), and Demand Response. These fundamental changes in the characteristics of the generation and consumption of power will lead to a number of practical engineering problems which must be overcome to allow increased penetration of Distributed PV. Solving the unique engineering challenges which arise at moderate levels of PV penetration requires closed loop integration of data from (1) PV sources; (2) customer load data from smart meters; (3) EV charging data; and (4) local and line mounted precision instruments. These data are not traditionally used by utilities in operations since they are ”non-SCADA” and the current grid does not require such levels of control. To integrate this data and provide real time intelligence from these non-SCADA data, we created the Visualization and Analytics of Distribution Systems with Deep Penetration of Distributed Energy Resources (VADER) platform. VADER is a collection of analytics enabled by integration of massive and heterogeneous data streams for granular real-time monitoring, visualization and control of Distributed Energy Resources (DER) in distribution networks. VADER analytics enable utilities to have greater visibility into distributed energy resources. We built several batch- and stream-analytics in VADER which help operators better understand the impact of distributed energy resources on the grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2019

Energy Reporting: Device Demonstration, Communication Protocols, and Codes and Standards

Energy reporting is the principle that all energy-using devices in buildings should be able to track their own energy use and report this to the local network. Energy reporting can provide building owners with easy access to highly granular energy use data. This report makes the case that energy reporting should become a free basic feature of all devices, and reports on a project intended to move us towards that goal. The project collected a set of demonstration devices with energy reporting features, including products that were modified by the project team or the manufacturer, or are already available for sale. To show these devices operating live at meetings and conferences, the team created a management system that queries the energy reporting devices for their data, stores the data, and displays it in compelling visualizations. The devices covered a wide range, including heating, ventilation, and air conditioning (thermostat and air purifier); lighting (individual bulb, task light, and auto-dimming overhead light); a vehicle charger; a water heater; electronics (notebook personal computer and universal serial bus charger); and three external meters (one integral with a dimming light switch). The demonstration uses a variety of communication protocols. The report reviews existing communication protocols that support energy reporting and describes how to use them with a proposed reference data model for energy reporting. It also assesses ways that energy codes and standards processes can be leveraged to drive energy reporting technology into the market. Energy reporting could ultimately save California on the order of 2.5 terawatt-hours per year and about $0.8 billion per year. Energy reporting is a highly practical technology with minimal (sometimes no) cost to consumers and manufacturers. This report discusses creation of the energy reporting devices themselves, analysis and recommendations for data models and protocols for energy reporting, and energy codes and standards implications of energy reporting technology. While energy reporting does not directly save energy, it provides information for better decision-making to save energy in changing equipment operation, maintenance, and replacement.

devices↗

DOE OSTI2025

American-Made Solar Prize: Edgeli Enables DER Integration (CRADA 615) (Final Report)

The purpose of this project was to demonstrate how granular time series data and automated data transformation, and impact assessment tools could speed interconnection approvals for distributed energy resource projects of various types and sizes. Types included community solar, rooftop solar, and EV charging projects. Using software routines to automate the transformation of data (e.g. GIS) to a network database and power flow model then applying scenarios to create hourly (8760) hosting capacity values and voltage and thermal impacts for specific projects, we were able to demonstrate the feasibility of quickly assembling and analyzing key utility data sets for interconnection purposes. The outcomes of this effort will become the foundation for future work that will enhance and encapsulate the software components developed as part of this project, into web services (e.g. APIs) that can be integrated into queue management systems and automate interconnection screening processes.

14 SOLAR ENERGY↗

NASA NTRS1995

Parallel rendering

This article provides a broad introduction to the subject of parallel rendering, encompassing both hardware and software systems. The focus is on the underlying concepts and the issues which arise in the design of parallel rendering algorithms and systems. We examine the different types of parallelism and how they can be applied in rendering applications. Concepts from parallel computing, such as data decomposition, task granularity, scalability, and load balancing, are considered in relation to the rendering problem. We also explore concepts from computer graphics, such as coherence and projection, which have a significant impact on the structure of parallel rendering algorithms. Our survey covers a number of practical considerations as well, including the choice of architectural platform, communication and memory requirements, and the problem of image assembly and display. We illustrate the discussion with numerous examples from the parallel rendering literature, representing most of the principal rendering methods currently used in computer graphics.

Crockett, Thomas W.↗

DOE OSTI2026

Scalable and Secure Power Outage Data Reporting: A Hexagonal Geospatial Approach

Power outages disrupt critical infrastructure and cause billions of dollars in economic losses annually in the United States. Accurate and granular outage reporting is vital for effective restoration and mitigation. This paper examines the integration of the Hexagonal Hierarchical Geospatial Indexing System (H3) to enhance power outage reporting, leveraging its uniform grid structure, scalable resolutions, and support for privacy-preserving analysis. Using high-resolution LandScan Global population data and K-anonymization techniques, this work achieves a balance between data granularity and privacy. Results show that lower privacy thresholds (e.g., K-anonymity = 2) enable higher resolution, while stricter thresholds (e.g., >15 people per hex) reduce granularity, potentially affecting localized responses. State-and county-level resolution case studies demonstrate H3’s adaptability and the trade-offs between precision and privacy. The proposed H3-based framework offers a scalable and efficient solution for geospatial data integration within the energy sector, such as outage data, aiding utilities and regulators in improving resilience and response efforts, particularly in disaster-prone regions.

Ahmad, Nasir [ORNL] (ORCID:0000000150677368)↗

DOE OSTI2021

Advanced Health Information Technology Analytic Framework and Application to Hazard Detection

Health Information Technology (HIT) aims to improve healthcare outcomes by organizing and analyzing various health-related data. With data accumulating at a staggering rate, the importance of real-time analytics has been increasing dramatically, shifting the focus of informatics from batch processing to streaming analytics. HIT is also facing unprecedented challenges in adapting to this new requirement and leveraging advanced IT technologies. This paper introduces a HIT data and compute platform that supports multi-granularity real-time analytics from heterogeneous data sources. The paper first identifies functional requirements and proposes a framework that satisfies the requirements using state-of-the-art big data technologies including Apache Kafka, Spark Structured Streaming Engine, and Delta Lake. To demonstrate its capability to support data analytics in multiple time granularities analytics, a statistical process control-based hazard detection algorithm has been implemented on top of the framework to detect unexpected hazards from order cancellation data of the Department of US Veterans Affairs (VA) in near real-time.

Kumar, Mohit↗

DOE OSTI2024

Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms

Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.

Dask↗

NASA NTRS1999

In Situ Identification of Mineral Resources with an X-Ray-Optical "Hands-Lens" Instrument

The recognition of material resources on a planetary surface requires exploration strategies not dissimilar to those employed by early field geologists who searched for ore deposits primarily from surface clues. In order to determine the location of mineral ores or other materials, it will be necessary to characterize host terranes at regional or subregional scales. This requires geographically broad surveys in which statistically significant numbers of samples are rapidly scanned from a roving platform. To enable broad-scale, yet power-conservative planetary-surface exploration, we are developing an instrument that combines x-ray diffractometry (XRD), x-ray fluorescence spectrometry (XRF), and optical capabilities; the instrument can be deployed at the end of a rover's robotic arm, without the need for sample capture or preparation. The instrument provides XRD data for identification of mineral species and lithological types; diffractometry of minerals is conducted by ascertaining the characteristic lattice parameters or "d-spacings" of mineral compounds. D-spacings of 1.4 to 25 angstroms can be determined to include the large molecular structures of hydrated minerals such as clays. The XRF data will identify elements ranging from carbon (Atomic Number = 6) to elements as heavy as barium (Atomic Number = 56). While a sample is being x-rayed, the instrument simultaneously acquires an optical image of the sample surface at magnifications from lx to at least 50x (200x being feasible, depending on the sample surface). We believe that imaging the sample is extremely important as corroborative sample-identification data (the need for this capability having been illustrated by the experience of the Pathfinder rover). Very few geologists would rely on instrument data for sample identification without having seen the sample. Visual inspection provides critical recognition data such as texture, crystallinity, granularity, porosity, vesicularity, color, lustre, opacity, and so forth. These data can immediately distinguish sedimentary from igneous rocks, for example, and can thus eliminate geochemical or mineral ambiguities arising, say between arkose and granite. It would be important to know if the clay being analyzed was part of a uniform varve deposit laid down in a quiescent lake, or the matrix of a megabreccia diamictite deposited as a catastrophic impact ejecta blanket. The unique design of the instrument, which combines Debye-Scherrer geometry with elements of standard goniometry, negates the need for sample preparation of any kind, and thus negates the need for power-hungry and mechanically-complex sampling systems that would have to chip, crush, sieve, and mount the sample for x-ray analysis. Instead, the instrument is simply rested on the sample surface of interest (like a hand lens); the device can interrogate rough rock surfaces, coarse granular material, or fine rock flour. A breadboard version of the instrument has been deployed from the robotic arm of the Marsokhod rover in field trials at NASA Ames, where large vesicular boulders were x-rayed to demonstrate the functionality of the instrument design, and the ability of such a device to comply with constraints imposed by a roving platform. Currently under development is a flight prototype concept of this instrument that will weigh 0.3 kg, using about 4500 J of energy per sample analysis. It requires about 5 min. for XRD analysis, and about 30 min. for XRF interrogation. Its small mass and rugged design make it ideal for deployment on small rovers of the type currently envisaged for the exploration of Mars (e.g., Sojourner-scale platforms). The design utilizes a monolithic P-N junction photodiode pixel array for XRD, a Si PIN photodiode/avalanche photodiode system for XRF, and an endoscopic imaging camera system unobtrusively embedded between the detectors and the x-ray source (the endoscope with its board-mounted camera can be adapted for IR light in addition to visible wavelenths. A rugged, miniature (7 cu cm) x-ray source for the instrument has already been breadboarded.

Marshall, J.↗

DOE OSTI2016

Pore Space Connectivity and the Transport Properties of Rocks

Pore connectivity is likely one of the most important factors affecting the permeability of reservoir rocks. Furthermore, connectivity effects are not restricted to materials approaching a percolation transition but can continuously and gradually occur in rocks undergoing geological processes such as mechanical and chemical diagenesis. Here, we compiled sets of published measurements of porosity, permeability and formation factor, performed in samples of unconsolidated granular aggregates, in which connectivity does not change, and in two other materials, sintered glass beads and Fontainebleau sandstone, in which connectivity does change. We compared these data to the predictions of a Kozeny-Carman model of permeability, which does not account for variations in connectivity, and to those of Bernabé et al. (2010, 2011) model, which does [Bernabé Y., Li M., Maineult A. (2010) Permeability and pore connectivity: a new model based on network simulations, J. Geophys. Res. 115, B10203; Bernabé Y., Zamora M., Li M., Maineult A., Tang Y.B. (2011) Pore connectivity, permeability and electrical formation factor: a new model and comparison to experimental data, J. Geophys. Res. 116, B11204]. Both models agreed equally well with experimental data obtained in unconsolidated granular media. But, in the other materials, especially in the low porosity samples that had undergone the greatest amount of sintering or diagenesis, only Bernabé et al. model matched the experimental data satisfactorily. In comparison, predictions of the Kozeny-Carman model differed by orders of magnitude. The advantage of the Bernabé et al. model was its ability to account for a continuous, gradual reduction in pore connectivity during sintering or diagenesis. Though we can only speculate at this juncture about the mechanisms responsible for the connectivity reduction, we propose two possible mechanisms, likely to be active at different stages of sintering and diagenesis, and thus allowing the gradual evolution observed experimentally.

58 GEOSCIENCES↗

DOE OSTI2018

3-D Unsteady Model for Be-Steam Reaction in Water-Cooled Ceramic Breeder Blanket

Here, the design of the water-cooled ceramic breeder (WCCB) blanket includes beryllium multiplier layers. At elevated temperature, beryllium reacts with steam in an exothermic reaction producing beryllium oxide and hydrogen. Such situation may occur in WCCB in the case of the rupture of one of the cooling pipes in the blanket module. This process occurs locally in a complex 3-D geometry of the blanket containing several different granular levels and a network of cooling pipes and structural supports. The process is also inherently unsteady since reaction rate depends on concentration of steam and pure beryllium which changes in time. In order to perform the detailed analysis of the process, the model of the reacting flowthrough porous media was developed and introduced into 3-D computational fluid dynamics code. In this model, granular beds are introduced as porous solids simplifying the model geometry and reducing typical mesh size to manageable amount of tens of millions of elements. A reaction rate between solid beryllium and steam is obtained from experimental results, and depends on temperature and concentration of the reactants. The differential equation for beryllium oxide fraction is introduced, allowing obtaining distributions of beryllium oxide in space and time. Multicomponent flow consisting of a homogenous mixture of steam and hydrogen is considered flowing through the porous solid with variable properties. Sink and source terms for steam and hydrogen fractions are determined by local beryllium oxide mass fraction source according to the molar ratios of beryllium steam reaction. The conjugated heat transfer approach is applied to calculate heat transfer in support structures as well as coolant flow, simultaneously with the porous medium steam flow in a blanket's granular beds. The model is validated using experimental data on beryllium steam reaction for granular bed samples.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2026

A filter-dependent granular temperature model from large-scale CFD-DEM data

The computational study of strongly-coupled, gas–solid flows at scales relevant to most environmental and engineering applications requires the use of ‘coarse-grained’ methodologies such as the two-fluid model, particle-in-cell approach or the multiphase Reynolds Averaged Navier–Stokes equations. While these strategies enable computations at desirable length- and time-scales, they rely heavily on models to capture important flow physics that occur at scales smaller than the mesh. To date, the models that do exist are based on a limited set of flow conditions, such as very dilute particle phase. To this end, we leverage a large-scale repository of CFD-DEM data to develop filter-size dependent models for the mean variance in particle volume fraction, a quantity commonly used to assess the degree of clustering, and the granular temperature, a key quantity for accurately predicting gas–solid flows. In conclusion, because of its filter-size dependence, the granular temperature model can be directly translated to coarse-grained approaches and tied directly to grid size.

AMReX↗

NASA NTRSDate not supplied

Statistical Classification of Biosignature Information using Multiple Instrument Observations

The accurate identification of biosignatures (indications of life) from data taken from remote or in situ planetary exploration is one of the most important challenges in astrobiology, the interdisciplinary field examining habitability and the potential for extraterrestrial life. This study employs machine learning algorithms to optimize the identification of biosignatures, with an emphasis on those which are agnostic to a specific biochemical basis. We exploit the wealth of terrestrial data available from biogenic and abiogenic systems to enhance efficient feature prioritization. Our dataset, pulled from public databases and laboratory recorded measurements, includes elemental abundance, isotopic fractionation, and VNIR/Raman spectra The data curation process included standardization for detection limits and ranges. Subsequent feature extraction yielded detailed inputs for machine learning, including combinations of elemental content, isotopic ratios, and parameters of spectral peaks and troughs. Feature significance was evaluated across diverse machine learning methodologies, such as k-nearest neighbors, logistic regression, Random Forest, support vector machines, and Gaussian Naïve Bayes, along with a combined voting classifier. We utilized Receiver Operating Characteristic Area Under the Curve (ROC AUC) across 2,000 50% test-train splits as a robust metric of model performance. Results revealed a promising ROC AUC of 0.853 for the combined voting classifier. Removing elemental abundance data notably reduced model accuracy (13% decrease in AUC), highlighting its critical role in biosignature detection. Several other individual data features exhibited significance within their respective data types, offering additional granularity. This research fortifies the relevance of machine learning to astrobiology, potentially enhancing life detection missions by allowing algorithmic prioritization of high-interest samples for further investigation. Future work will refine data standardization, expand the dataset to include more terrestrial systems, and incorporate convolutional neural networks for spectral feature extraction. The potential for public data sharing is also under exploration, reinforcing our commitment to collective scientific advancement.

Statistical↗

DOE OSTI2016

Validation of spatiodemographic estimates produced through data fusion of small area census records and household microdata

Techniques such as Iterative Proportional Fitting have been previously suggested as a means to generate new data with the demographic granularity of individual surveys and the spatial granularity of small area tabulations of censuses and surveys. This article explores internal and external validation approaches for synthetic, small area, household- and individual-level microdata using a case study for Bangladesh. Using data from the Bangladesh Census 2011 and the Demographic and Health Survey, we produce estimates of infant mortality rate and other household attributes for small areas using a variation of an iterative proportional fitting method called P-MEDM. We conduct an internal validation to determine: whether the model accurately recreates the spatial variation of the input data, how each of the variables performed overall, and how the estimates compare to the published population totals. We conduct an external validation by comparing the estimates with indicators from the 2009 Multiple Indicator Cluster Survey (MICS) for Bangladesh to benchmark how well the estimates compared to a known dataset which was not used in the original model. The results indicate that the estimation process is viable for regions that are better represented in the microdata sample, but also revealed the possibility of strong overfitting in sparsely sampled sub-populations.

42 ENGINEERING↗

NASA NTRS2019

Experimental Facility to Measure Power and Forces to Excavate Lunar Regolith Simulants

An Excavation Lab has been built at the NASA Glenn Research Center in support of the NASA In-Situ Resource Utilization (ISRU) program objectives to measure the power and forces needed to excavate granular lunar regolith. The data obtained will be used to validate excavation models used in system studies and for developing light weight, energy efficient digging devices for activities on the moon and mars. The Excavation Lab houses the Advanced Planetary Excavator (APEX), an electrically actuated backhoe arm with a bucket, which is used to dig GRC-3B, a simulant of granular lunar regolith comprised of silica sand and silt. A load cell is mounted between the arm and the bucket to measure digging forces. Dig trajectories files are created and used to control the APEX for repeatability. Comparison of preliminary data recorded for the same trajectory in air and in GRC-3B shows measurable difference in power and load cell measurements. Load cell forces for a linear dig in GRC-3B are presented.

Excavation↗

DOE OSTI2018

Solvent effects on differentiation of mouse brain tissue using laser microdissection ‘cut and drop’ sampling with direct mass spectral analysis

Rationale: Laser microdissection-liquid vortex capture/electrospray ionization mass spectrometry (LMD-LVC/ESI-MS) has potential for on-line classification of tissue but an investigation into what analytical conditions provide best spectral differentiation has not been conducted. The effects of solvent, ionization polarity, and spectral acquisition parameters on differentiation of mouse brain tissue regions are described.Methods: Individual 40 × 40 μm microdissections from cortex, white, grey, granular, and nucleus regions of mouse brain tissue were analyzed using different capture/ESI solvents, in positive and negative ion mode ESI, using time-of-flight (TOF)-MS and sequential window acquisitions of all theoretical spectra (SWATH)-MS (a permutation of tandem-MS), and combinations thereof. Principal component analysis-linear discriminant analysis (PCA-LDA), applied to each mass spectral dataset, was used to determine the accuracy of differentiation of mouse brain tissue regions. Results: Mass spectral differences associated with capture/ESI solvent composition manifested as altered relative distributions of ions rather than the presence or absence of unique ions. In negative ion mode ESI, 80/20 (v/v) methanol/water yielded spectra with low signal/noise ratios relative to other solvents. PCA-LDA models acquired using 90/10 (v/v) methanol/chloroform differentiated tissue regions with 100% accuracy while data collected using methanol misclassified some samples. The combination of SWATH-MS and TOF-MS data improved differentiation accuracy.Conclusions: Combined TOF-MS and SWATH-MS data differentiated white, grey, granular, and nucleus mouse tissue regions with greater accuracy than when solely using TOF-MS data. Using 90/10 (v/v) methanol/chloroform, tissue regions were perfectly differentiated. Lastly, these results will guide future studies looking to utilize the potential of LMD-LVC/ESI-MS for tissue and disease differentiation.

47 OTHER INSTRUMENTATION↗

NASA NTRS1985

Bouguer Images of the North American Craton

Processing of existing gravity and aeromagnetic data with modern methods is providing new insights into crustal and mantle structures for large parts of the United States and Canada. More than three-quarters of a million ground station readings of gravity are now available for this region. These data offer a wealth of information on crustal and mantle structures when reduced and displayed as Bouguer anomalies, where lateral variations are controlled by the size, shape and densities of underlying materials. Digital image processing techniques were used to generate Bouguer images that display more of the granularity inherent in the data as compared with existing contour maps. A dominant NW-SE linear trend of highs and lows can be seen extending from South Dakota, through Nebaska, and into Missouri. This trend is probably related to features created during an early and perhaps initial episode of crustal assembly by collisional processes. The younger granitic materials are probably a thin cover over an older crust.

Arvidson, R. E.↗

DOE OSTI2020

End-Use Load Profiles for the U.S. Building Stock

The End-Use Load Profiles for the U.S. Building Stock project uses New ResStock and ComStock models to statistically represent the energy use of U.S. buildings. The project's hybrid approach combines best-available ground truth data, such as submetering studies and statistical disaggregation of whole-building interval meter data, with the reach, cost-effectiveness, and granularity of physics-based and data-driven building stock modeling to deliver a nationally-comprehensive data set at a fraction of the historical cost.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗