Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed data generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Transportation Energy Data Book: Edition 38

The Transportation Energy Data Book: Edition 38 is a statistical compendium prepared and published by Oak Ridge National Laboratory (ORNL) under contract with the U.S. Department of Energy, Office of Energy Efficiency and Renewable Energy, Vehicle Technologies Office. Designed for use as a desk-top reference, the Data Book represents an assembly and display of statistics and information that characterize transportation activity, and presents data on other factors that influence transportation energy use. The purpose of this document is to present relevant statistical data in the form of tables and graphs. The latest edition of the Data Book is available via the Internet. This edition of the Data Book has 13 chapters which focus on various aspects of the transportation industry. Chapter 1 - focuses on petroleum; Chapter 2 - energy; Chapter 3 - highway vehicles; Chapter 4 - light vehicles; Chapter 5 - heavy vehicles; Chapter 6 - alternative fuel vehicles; Chapter 7 - transit and shared mobility; Chapter 8 - fleet vehicles; Chapter 9 - household vehicles; Chapter 10 - nonhighway modes; Chapter 11 - transportation and the economy; Chapter 12 - greenhouse gas emissions; and Chapter 13 - criteria pollutant emissions. The sources used represent the latest available data. There are also three appendices which include detailed source information for some tables, measures of conversion, and energy tables and figures with electricity generation and distribution taken into account. A glossary of terms is also included for the reader’s convenience.

02 PETROLEUM↗
DOE OSTI2022

Scalable and Energy-Efficient Methods for Interactive Exploration of Scientific Data

The main scientific contributions of this project are the following novel concepts for multidimensional arrays: shape-based similarity join (SIGMOD 2016), incremental view maintenance (SIGMOD 2017), user-defined stencil functions (HPDC 2017), and distributed caching for in-situ processing (SSDBM 2018). Building on our collaboration with the astrophysics group at LBNL, we applied these techniques to the data generated in the Palomar Transient Factory (PTF) astronomical survey. They played a pivotal role in the first-ever observation of a neutron star merger, which produces gravitational waves and turns out to be the origin of heavy elements, including gold. This has lead to a Science magazine article that has received extensive media coverage on ACM TechNews, Slashdot, FiveThirtyEight, and Quanta Magazine, among others. Additionally, two other articles detailing related aspects of the same discovery have been published in the Astrophysical Journal Letters journal. These publications have more than 3,000 citations according to Google Scholar (as of February 2022). This cross-disciplinary collaboration provided very good opportunities to apply database techniques to real-life scientific problems. The fact that they facilitated major discoveries in astrophysics proves the importance of our research. In addition to the work on multidimensional array databases, this project has also developed stochastic gradient descent (SGD) optimization algorithms for training large scale machine learning models, methods for querying in-situ data, and a database query optimizer based on sketch synopses.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1982

Lunar seismic data analysis

The scientific data transmitted continuously from all ALSEP (Apollo Lunar Surface Experiment Package) stations on the Moon and recorded on instrumentation tapes at receiving stations distributed around the Earth were processed. The processing produced sets of computer-compatible digital tapes, from which various other data sets convenient for analysis were generated. The seismograms were read, various types of seismic events were classified; the detected events were cataloged.

Nakamura, Y.↗
NASA NTRS1991

Fusion techniques using distributed Kalman filtering for detecting changes in systems

A comparison is made of the performances of two detection strategies that are based on different data fusion techniques. The strategies detect changes in a linear system. One detection strategy involves combining the estimates and error covariance matrices of distributed Kalman filters, generating a residual from the used estimates, comparing this residual to a threshold, and making a decision. The other detection strategy involves a distributed decision process in which estimates from distributed Kalman filters are used to generate distributed residuals which are compared locally to a threshold. Local decisions are made and these decisions are then fused into a global decision. The performances of each of these detection schemes are compared, and it is concluded that better performance is achieved when local decisions are made and then fused into a global decision.

Belcastro, Celeste M.↗
NASA NTRS1992

Remote Earth Sciences data collection using ACTS

Given the focus on global change and the attendant scope of such research, we anticipate significant growth of requirements for investigator interaction, processing system capabilities, and availability of data sets. The increased complexity of global processes requires interdisciplinary teams to address them; the investigators will need to interact on a regular basis; however, it is unlikely that a single institution will house sufficient investigators with the required breadth of skills. The complexity of the computations may also require resources beyond those located within a single institution; this lack of sufficient computational resources leads to a distributed system located at geographically dispersed institutions. Finally the combination of long term data sets like the Pathfinder datasets and the data to be gathered by new generations of satellites such as SeaWiFS and MODIS-N yield extra-ordinarily large amounts of data. All of these factors combine to increase demands on the communications facilities available; the demands are generating requirements for highly flexible, high capacity networks. We have been examining the applicability of the Advanced Communications Technology Satellite (ACTS) to address the scientific, computational, and, primarily, communications questions resulting from global change research. As part of this effort three scenarios for oceanographic use of ACTS have been developed; a full discussion of this is contained in Appendix B.

Evans, Robert H.↗
NASA NTRS1993

Erosive burning of solid propellants

Presented here is a review of the experimental and modeling work concerning erosive burning of solid propellants (augmentation of burning rate by flow of product gases across a burning surface). A brief introduction describes the motor design problems caused by this phenomenon, particularly for low port/throat area ratio motors and nozzleless motors. Various experimental techniques for measuring crossflow sensitivity of solid propellant burning rates are described, with the conclusion that accurate simulation of the flow, including upstream flow development, in actual motors is important since the degree of erosive burning depends not only on local mean crossflow velocity and propellant nature, but also upon this upstream development. In the modeling area, a brief review of simplified models and correlating equations is presented, followed by a description of more complex numerical analysis models. Both composite and double-base propellant models are reviewed. A second generation composite model is shown to give good agreement with data obtained in a series of tests in which composite propellant composition and heterogeneity (particle size distribution) were systematically varied. Finally, the use of numerical models for the development of erosive burning correlations is described, and a brief discussion of scaling is presented.

King, Merrill K.↗
NASA NTRS1995

Model-based VQ for image data archival, retrieval and distribution

An ideal image compression technique for image data archival, retrieval and distribution would be one with the asymmetrical computational requirements of Vector Quantization (VQ), but without the complications arising from VQ codebooks. Codebook generation and maintenance are stumbling blocks which have limited the use of VQ as a practical image compression algorithm. Model-based VQ (MVQ), a variant of VQ described here, has the computational properties of VQ but does not require explicit codebooks. The codebooks are internally generated using mean removed error and Human Visual System (HVS) models. The error model assumed is the Laplacian distribution with mean, lambda-computed from a sample of the input image. A Laplacian distribution with mean, lambda, is generated with uniform random number generator. These random numbers are grouped into vectors. These vectors are further conditioned to make them perceptually meaningful by filtering the DCT coefficients from each vector. The DCT coefficients are filtered by multiplying by a weight matrix that is found to be optimal for human perception. The inverse DCT is performed to produce the conditioned vectors for the codebook. The only image dependent parameter used in the generation of codebook is the mean, lambda, that is included in the coded file to repeat the codebook generation process for decoding.

Manohar, Mareboyana↗
NASA NTRS2012

Aerosol and Surface Parameter Retrievals for a Multi-Angle, Multiband Spectrometer

This software retrieves the surface and atmosphere parameters of multi-angle, multiband spectra. The synthetic spectra are generated by applying the modified Rahman-Pinty-Verstraete Bidirectional Reflectance Distribution Function (BRDF) model, and a single-scattering dominated atmosphere model to surface reflectance data from Multiangle Imaging SpectroRadiometer (MISR). The aerosol physical model uses a single scattering approximation using Rayleigh scattering molecules, and Henyey-Greenstein aerosols. The surface and atmosphere parameters of the models are retrieved using the Lavenberg-Marquardt algorithm. The software can retrieve the surface and atmosphere parameters with two different scales. The surface parameters are retrieved pixel-by-pixel while the atmosphere parameters are retrieved for a group of pixels where the same atmosphere model parameters are applied. This two-scale approach allows one to select the natural scale of the atmosphere properties relative to surface properties. The software also takes advantage of an intelligent initial condition given by the solution of the neighbor pixels.

Broderick, Daniel↗
DOE OSTI2020

Real-time Intrusion Detection for High-bandwidth Research Networks using Unsupervised Deep Learning

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks across distributed collaboration sites for processing, storage, and analysis. Like general purpose networks, research networks experience attacks. However, monitoring traffic in such high-bandwidth network environments is challenging with conventional deep packet inspection (DPI)- based network intrusion detection systems (NIDS). Recently, machine learning (ML) algorithms have shown potential in detecting anomalous patterns with better generalizability and faster speed. Compared to the general purpose networks, traffic movement in research network is less volatile and more likely to benefit from the ML-based anomaly analysis. We present ThunderSecure, an efficient AI-powered system for detecting anomalies in 100G research networks. ThunderSecure implements a high-throughput packet processing infrastructure using multi-cores and GPUs. It takes time-series statistics from a variety of network measurements and uses 2D Convolutional Neural Network (CNN) to explore both spatial and temporal dependencies in network data stream. Patterns of science data traffic are learned with a one-class neural network, which blends an Adversarial Autoencoder (AAE) with Gaussian mixture density estimation. Testing traffic flows exhibiting significant deviations from the learned baseline of normality are marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets recorded from a 100G research network at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. To the best of our knowledge, this is the first ML work in the area of network anomaly detection that has been validated on such extreme scale datasets. Results show that ThunderSecure can recognize science data traffic that are captured long after the training and make nearly certain detection on those with anomalous flows injected, even in the case when the anomaly-to-normal mixing ratio is 0.1%.

Gong, Qian↗
DOE OSTI2021

DISTRIBUTION TRANSFORMER ASSET MONITORING ON THE GRID EDGE USING SMART SENSOR DATA

As new loads such as rooftop photovoltaics, electric vehicles and other distributed energy resources become commonplace on the distribution grid, the stress on already aging assets begins to escalate. This increased loading and changing dynamics can exacerbate failure rates. While traditional monitoring efforts focus on transmission and generation assets, utilities are now beginning to pay close attention to distribution assets in order to increase reliability indices and reduce cost from unexpected outages. This research develops low-cost and scalable methods to monitoring the health of a critical distribution grid asset: the service transformer. Existing methods in literature are either invasive and thus difficult to implement or require the device to be tested offline in an expensive lab setting. Data from the ubiquitous smart meter as well as a novel Bluetooth based transformer monitor are leveraged to automatically notify the utility of deteriorating or damaged transformers. Voltage, temperature, and vibration are some of the signals measured and analyzed by the proposed algorithms to predict transformer failures. Furthermore, these algorithms are designed to keep the implementation and processing costs low by taking advantage of edge computing where possible.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Optimal Eco-Driving Control of Connected and Autonomous Vehicles Through Signalized Intersections

This article focuses on the speed planning problem for connected and automated vehicles (CAVs) communicating to traffic lights. The uncertainty of traffic signal timing for signalized intersections on the road is considered. The eco-driving problem is formulated as a data-driven chance-constrained robust optimization problem. Effective red-light duration (ERD) is defined as a random variable, and describes the feasible passing time through the signalized intersections. Usually, the true probability distribution for ERD is unknown. Consequently, a data-driven approach is adopted to formulate chance constraints based on empirical sample data. This incorporates robustness into the eco-driving control problem with respect to uncertain signal timing. Dynamic programming (DP) is employed to solve the optimization problem. The simulation results demonstrate that the proposed method can generate optimal speed reference trajectories with 40% less vehicle fuel consumption, while maintaining the arrival time at a similar level compared to a modified intelligent driver model (IDM). The proposed control approach significantly improves the controller's robustness in the face of uncertain signal timing, without requiring to know the distribution of the random variable a priori.

33 ADVANCED PROPULSION SYSTEMS↗
NASA NTRS1993

Update of GRASP/Ada reverse engineering tools for Ada

The GRASP/Ada project (Graphical Representations of Algorithms, Structures, and Processes for Ada) successfully created and prototyped a new algorithmic level graphical representation for Ada software, the Control Structure Diagram (CSD). The primary impetus for creation of the CSD was to improve the comprehension efficiency of Ada software and, as a result, improve reliability and reduce costs. The emphasis was on the automatic generation of the CSD from Ada PDL or source code to support reverse engineering and maintenance. The CSD has the potential to replace traditional pretty printed Ada source code. In Phase 1 of the GRASP/Ada project, the CSD graphical constructs were created and applied manually to several small Ada programs. A prototype CSD generator (Version 1) was designed and implemented using FLEX and BISON running under VMS on a VAX 11-780. In Phase 2, the prototype was improved and ported to the Sun 4 platform under UNIX. A user interface was designed and partially implemented using the HP widget toolkit and the X Windows System. In Phase 3, the user interface was extensively reworked using the Athena widget toolkit and X Windows. The prototype was applied successfully to numerous Ada programs ranging in size from several hundred to several thousand lines of source code. Following Phase 3,e two update phases were completed. Update'92 focused on the initial analysis of evaluation data collected from software engineering students at Auburn University and the addition of significant enhancements to the user interface. Update'93 (the current update) focused on the statistical analysis of the data collected in the previous update and preparation of Version 3.4 of the prototype for limited distribution to facilitate further evaluation. The current prototype provides the capability for the user to generate CSD's from Ada PDL or source code in a reverse engineering as well as forward engineering mode with a level of flexibility suitable for practical application. An overview of the GRASP/Ada project with an emphasis on the current update is provided.

Cross, James H., II↗
DOE OSTI2026

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗
DOE OSTI2020

Error-mitigated data-driven circuit learning on noisy quantum hardware

Application-level benchmarks measure how well a quantum device performs meaningful calculations. In the case of parameterized circuit training, the computational task is the preparation of a target quantum state via optimization over a loss landscape. This is complicated by various sources of noise, fixed hardware connectivity, and generative modeling, the choice of target distribution. Gradient-based training has become a useful benchmarking task for noisy intermediate-scale quantum computers because of the additional requirement that the optimization step uses the quantum device to estimate the loss function gradient. In this work, we use gradient-based data-driven circuit learning to qualitatively evaluate the performance of several superconducting platform devices and present results that show how error mitigation can improve the training of quantum circuit Born machines with 28 tunable parameters.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS1997

Flood Management Enhancement Using Remotely Sensed Data

SENTAR, Inc., entered into a cooperative agreement with NASA Goddard Space Flight Center (GSFC) in December 1994. The intent of the NASA Cooperative Agreement was to stimulate broad public use, via the Internet, of the very large remote sensing databases maintained by NASA and other agencies, thus stimulating U.S. economic growth, improving the quality of life, and contributing to the implementation of a National Information Infrastructure. SENTAR headed a team of collaborating organizations in meeting the goals of this project. SENTAR's teammates were the NASA Marshall Space Flight Center (MSFC) Global Hydrology and Climate Center (GHCC), the U.S. Army Space and Strategic Defense Command (USASSDC), and the Alabama Emergency Management Agency (EMA). For this cooperative agreement, SENTAR and its teammates accessed remotely sensed data in the Distributed Active Archive Centers, and other available sources, for use in enhancing the present capabilities for flood disaster management by the Alabama EMA. The project developed a prototype software system for addressing prediction, warning, and damage assessment for floods, though it currently focuses on assessment. The objectives of the prototype system were to demonstrate the added value of remote sensing data for emergency management operations during floods and the ability of the Internet to provide the primary communications medium for the system. To help achieve these objectives, SENTAR developed an integrated interface for the emergency operations staff to simplify acquiring and manipulating source data and data products for use in generating new data products. The prototype system establishes a systems infrastructure designed to expand to include future flood-related data and models or to include other disasters with their associated remote sensing data requirements and distributed data sources. This report covers the specific work performed during the seventh, and final, milestone period of the project, which began on 1 October 1996 and ended on 31 January 1997. In addition, it provides a summary of the entire project.

Romanowski, Gregory J.↗
DOE OSTI2024

Continuous soil temperature measurements from 2019-10-4 to 2020-10-4, Teller road Mile 27, Seward Peninsula, Alaska

The dataset contains depth-resolved soil temperature measured at 45 discrete locations in a watershed located along the Nome-Teller road at Mile 27 in Seward Peninsula, Alaska. The dataset was generated to understand the local heterogeneity of soil thermal dynamics and their controls in a discontinuous permafrost region. At each location, temperatures were measured by a distributed temperature profiling probe designed based on Dafflon et al (2022). The dataset includes a description of the probe locations in the "Probe_locations.csv" file and the 45 data files (Soil_temperatures_*.csv). Metadata files include data descriptions (_dd.csv) for tabular data. All included files are listed and described in NGA513_flmd.csv.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Particlization in fluid dynamical simulations of heavy-ion collisions: The IS3D module

The IS3D particlization module simulates the emission of hadrons from heavy-ion collisions via Monte-Carlo sampling of the Cooper–Frye formula which converts fluid dynamical information into local phase-space distributions for hadrons. The code package includes multiple choices for the non-equilibrium correction to these distribution functions: the 14-moment approximation, first-order Chapman–Enskog expansion, and two types of modified equilibrium distributions. This makes it possible to explore to what extent heavy-ion experimental data are sensitive to different choices for δf n , presently the main source of theoretical uncertainty in the particlization stage. Here, we validate our particle sampler with a high degree of precision by generating several million hadron emission events from a longitudinally boost-invariant hypersurface and comparing the event-averaged particle spectra and space–time distributions to the Cooper–Frye formula.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Impacts of Experimentally Obtained Harmonic Spectrums of Residential Appliances on Distribution Feeder: Preprint

This paper focuses on the harmonic load flow study for a set of residential loads and the impacts of the harmonic contents on the distribution feeder. Owing to the increased use of the power electronic based appliances and energy efficient home equipment like the lighting loads, the percentage of non-linear loads has increased in the distribution system which can impact the system performance, loss, and stability. Thus a comprehensive knowledge of their power quality and harmonic analysis is essential to improve the load models, voltage stability assessment, determining possible interactions at harmonic frequencies, protection planning, and the effect of the system impedance. For this study, the household appliances include the lighting, power electronics, resistive, and motor loads with a nominal supply voltage of 120 V single-phase or 240 V split-phase at a nominal frequency of 60 Hz. The harmonic spectrum as obtained from the experimental data is used to solve the harmonic load flow for a detailed secondary network including the distribution transformer extracted from a real distribution feeder's model. Additionally, the impact of the voltage harmonic on a three phase test load is presented through experimental results. The harmonic data of the transformer terminal voltage as obtained from the former load flow study is scaled to generate the source voltage for the three phase configuration of the grid simulator to make the test setup very similar to a real scenario.

24 POWER TRANSMISSION AND DISTRIBUTION↗