Search NASA⌕ Search

SEARCH · Search NASA

Results for “Streaming Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,801 records · Page 100
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources

Apache Calcite is a foundational software framework that provides query processing, optimization, and query language support to many popular open-source data processing systems such as Apache Hive, Apache Storm, Apache Flink, Druid, and MapD. The goal of this paper is to formally introduce Calcite to the broader research community, brie y present its history, and describe its architecture, features, functionality, and patterns for adoption. Calcite's architecture consists of a modular and extensible query optimizer with hundreds of built-in optimization rules, a query processor capable of processing a variety of query languages, an adapter architecture designed for extensibility, and support for heterogeneous data models and stores (relational, semi-structured, streaming, and geospatial). This exible, embeddable, and extensible architecture is what makes Calcite an attractive choice for adoption in big-data frameworks. It is an active project that continues to introduce support for the new types of data sources, query languages, and approaches to query processing and optimization.

Begoli, Edmon↗
DOE OSTI2020

Interacting radiation after Planck and its implications for the Hubble tension

Standard cosmology predicts that prior to matter-radiation equality about 41% of the energy density was in free-streaming neutrinos. In many beyond Standard Model scenarios, however, the amount and free-streaming nature of this component is modified. For example, this occurs in models with new neutrino self-interactions or an additional dark sector with interacting light particles. Here, we consider several extensions of the standard cosmology that include a non-free-streaming radiation component as motivated by such particle physics models and use the final Planck data release to constrain them. This release contains significant improvements in the polarization likelihood which plays an important role in distinguishing free-streaming from interacting radiation species. Fixing the total amount of energy in radiation to match the expectation from standard neutrino decoupling we find that the fraction of free-streaming radiation must be ffs > 0.8 at 95% CL (combining temperature, polarization and baryon acoustic oscillation data). Allowing for arbitrary contributions of free-streaming and interacting radiation, the effective number of new non-free-streaming degrees of freedom is constrained to be Nfld < 0.6 at 95% CL. Cosmologies with additional radiation are also known to ease the discrepancy between the local measurement and CMB inference of the current expansion rate H0. We show that including a non-free-streaming radiation component allows for a larger amount of total energy density in radiation, leading to a mild improvement of the fit to cosmological data compared to previously discussed models with only a free-streaming component.

particle physics - cosmology connection↗
NASA NTRS1974

High performance N2O4/amine elements: Data dump covering. Task 1: Literature review

The phenomenon of reactive stream separation (RSS) in the N2O4/amine earth-storable propellant combinations is reviewed. Early theoretical models of RSS are presented, as are experimental combustion data under simulated rocket conditions. N2O4/amine combustion chemistry data is also provided. More recent work in the development of a comprehensive model is described.

Hines, W. S.↗
NASA NTRS2014

Ionosphere Plasma State Determination in Low Earth Orbit from International Space Station Plasma Monitor

A plasma diagnostic package is deployed on the International Space Station (ISS). The system - a Floating Potential Measurement Unit (FPMU) - is used by NASA to monitor the electrical floating potential of the vehicle to assure astronaut safety during extravehicular activity. However, data from the unit also reflects the ionosphere state and seems to represent an unutilized scientific resource in the form of an archive of scientific plasma state data. The unit comprises a Floating Potential probe and two Langmuir probes. There is also an unused but active plasma impedance probe. The data, at one second cadence, are collected, typically for a two week period surrounding extravehicular activity events. Data is also collected any time a visiting vehicle docks with ISS and also when any large solar events occur. The telemetry system is unusual because the package is mounted on a television camera stanchion and its data is impressed on a video signal that is transmitted to the ground and streamed by internet to two off center laboratory locations. The data quality has in the past been challenged by weaknesses in the integrated ground station and distribution systems. These issues, since mid‐2010, have been largely resolved and the ground stations have been upgraded. Downstream data reduction has been developed using physics based modeling of the electron and ion collecting character in the plasma. Recursive algorithms determine plasma density and temperature from the raw Langmuir probe current voltage sweeps and this is made available in real time for situational awareness. The purpose of this paper is to describe and record the algorithm for data reduction and to show that the Floating probe and Langmuir probes are capable of providing long term plasma state measurement in the ionosphere. Geophysical features such as the Appleton anomaly and high latitude modulation at the edge of the Auroral zones are regularly observed in the nearly circular, 51 deg inclined, 400 km altitude ISS orbit. Evidence of waves in the ion collection current data is seen in geographic zones known to exhibit the spread‐F phenomenon. An anomaly in the current collection characteristic of the cylindrical probe appears also too be organized by the geomagnetic field.

Kramer, Leonard↗
NASA NTRSDate not supplied

STEREO Observations of Stream Interaction Regions in 2007-2016:Relationship with Heliospheric Current Sheets, Solar Cycle Variations, and Dual Observations

We have conducted a survey of 575 slow-to-fast stream interaction regions (SIRs) using STEREOA/B data in 2007-2016 (Jian et al., 2019). Among 518 well-defined SIRs, 54% are associated with heliospheric current sheet (HCS) crossings, and 34% are without any HCS crossing. The other 12% of the SIRs often occur in association with magnetic sectors shorter than 3 days. The SIRs with HCS crossings have slightly slower speeds but higher maximum number densities, magnetic field strengths, dynamic pressures, and total pressures than the SIRs without an HCS. The iron charge state is higher throughout the SIRs with an HCS than the SIRs without an HCS, by about 1/3 charge unit. In contrast with the comparable phases of solar cycle 23,slightly more SIRs and higher recurrence rates are observed in the years 2009-2016 of cycle 24,with a lower HCS association rate, possibly attributed to persistent equatorial coronal holes and more pseudostreamers in this recent cycle. The solar wind speed, peak magnetic field and pressures of SIRs are all lower in this cycle, but the weakening is less than for the comparable background solar wind parameters. Before STEREO B lost contact in 2014 October, 151 SIR pairs were observed by the twin spacecraft. Of the dual observations, the maximum speed is the best correlated of the plasma parameters. We have obtained a sample of plasma parameter differences analogous to those that would be observed for a mission at Lagrange point 4 or 5.By studying several cases with large discrepancies between the dual observations, we have also investigated the effects of HCS relative location, tilt of stream interface, and small transients on the SIR properties.

Lan K Jian↗
DOE OSTI2018

Defining a Metric Space of Host Logs and Operational Use Cases

Host logs, in particular, Windows Event Logs, are a valuable source of information often collected by security operation centers (SOCs). The semi-structured nature of host logs inhibits automated analytics, and while manual analysis is common, the sheer volume makes manual inspection of all logs impossible. Although many powerful algorithms for analyzing time-series and sequential data exist, utilization of such algorithms for most cyber security applications is either infeasible or requires tailored, research-intensive preparations. In particular, basic mathematic and algorithmic developments for providing a generalized, meaningful similarity metric on system logs is needed to bridge the gap between many existing sequential data mining methods and this currently available but under-utilized data source. In this paper, we provide a rigorous definition of a metric product space on Windows Event Logs, providing an embedding that allows for the application of established machine learning and time-series analysis methods. We then demonstrate the utility and flexibility of this embedding with multiple use-cases on real data: (1) comparing known infected to new host log streams for attack detection and forensics, (2) collapsing similar streams of logs into semantically-meaningful groups (by user, by role), thereby reducing the quantity of data but not the content, (3) clustering logs as well as short sequences of logs to identify and visualize user behaviors and background processes over time. Overall, we provide a metric space framework for general host logs and log sequences that respects semantic similarity and facilitates a wide variety of data science analytics to these logs without data-specific preparations for each.

Verma, Miki↗
NASA NTRS1991

MeV/n ions associated with corotating high-speed solar wind streams at less than 1 AU during 1978 to 1986

Data from the Goddard Space Flight Center experiments on the ISEE 3/ICE, IMP 8, and Helios 1 spacecraft are used to investigate ion enhancements of more than 1 MeV/n associated with corotating high-speed solar wind streams at least 1 AU during 1978-1986. The observations are consistent with ion acceleration from the solar wind by corotating shocks in the outer heliosphere.

Richardson, I. G.↗
NASA NTRS1992

Estimating reflected and emitted components of the radiation balance using remotely-sensed spectral data from KUREX-91

The estimation of incoming and outgoing radiation streams using bidirectional spectral reflectances and bidirectional thermal emittances is described. Good agreement between measured and modeled estimates of the radiation balance is obtained. The data used were collected over selected grassland sites on the Streletskaya Steppe Reserve in Russia in July 1991. Results from this study compare well with results obtained during the first ISLSCP field experiment (FIFE) study in Kansas in 1987-89.

Blad, B. L.↗
DOE OSTI2018

Text-based Analytics for Biosurveillance

The ability to prevent, mitigate, or control a biological threat depends on how quickly the threat is identified and characterized. Ensuring the timely delivery of data and analytics is an essential aspect of providing adequate situational awareness in the face of a disease outbreak. This chapter outlines an analytic pipeline for supporting an advanced early warning system that can integrate multiple data sources and provide situational awareness of potential and occurring disease situations. The pipeline, includes real-time automated data analysis founded on natural language processing (NLP), semantic concept matching, and machine learning techniques, to enrich content with metadata related to biosurveillance. Online news articles are presented as an example use case for the pipeline, but the processes can be generalized to any textual data. In this chapter, the mechanics of a streaming pipeline are briefly discussed as well as the major steps required to provide targeted situational awareness. The text-based analytic pipeline includes various processing steps as well as identifying article relevance to biosurveillance (e.g., relevance algorithm) and article feature extraction (who, what, where, why, how, and when). The ability to prevent, mitigate, or control a biological threat depends on how quickly the threat is identified and characterized. Ensuring the timely delivery of data and analytics is an essential aspect of providing adequate situational awareness in the face of a disease outbreak. This chapter outlines an analytic pipeline for supporting an advanced early warning system that can integrate multiple data sources and provide situational awareness of potential and occurring disease situations. The pipeline, includes real-time automated data analysis founded on natural language processing (NLP), semantic concept matching, and machine learning techniques, to enrich content with metadata related to biosurveillance. Online news articles are presented as an example use case for the pipeline, but the processes can be generalized to any textual data. In this chapter, the mechanics of a streaming pipeline are briefly discussed as well as the major steps required to provide targeted situational awareness. The text-based analytic pipeline includes various processing steps as well as identifying article relevance to biosurveillance (e.g., relevance algorithm) and article feature extraction (who, what, where, why, how, and when).

Biomedical NLP↗
DOE OSTI2024

Via Machinae 2.0 : Full-sky, model-agnostic search for stellar streams in Gaia DR2

ABSTRACT We present an update to Via Machinae, an automated stellar stream-finding algorithm based on the deep learning anomaly detector ANODE. Via Machinae identifies stellar streams within Gaia, using only angular positions, proper motions, and photometry, without reference to a model of the Milky Way potential for orbit integration or stellar distances. This new version, Via Machinae 2.0, includes many improvements and refinements to nearly every step of the algorithm, that altogether result in more robust and visually distinct stream candidates than our original formulation. In this work, we also provide a quantitative estimate of the false positive rate of Via Machinae 2.0 by applying it to a simulated Gaia-mock catalogue based on galaxia, a smooth model of the Milky Way that does not contain substructure or stellar streams. Finally, we perform the first full-sky search for stellar streams with Via Machinae 2.0, identifying 102 streams at high significance within the Gaia Data Release 2, of which only 10 have been previously identified. While follow-up observations for further confirmation are required, taking into account the false positive rate presented in this work, we expect approximately 90 of these stream candidates to correspond to real stellar structures.

Astronomy & Astrophysics↗
NASA NTRS1986

Low-speed performance of an axisymmetric, mixed-compression, supersonic inlet with auxiliary inlets

A test program was conducted to determine the aerodynamic performance and acoustic characteristics associated with the low-speed operation of a supersonic, axisymmetric, mixed-compression inlet with auxiliary inlets. Blow-in-auxiliary doors were installed on the NASA Ames P inlet. One door per quadrant was located on the cowl in the subsonic diffuser selection of the inlet. Auxiliary inlets with areas of 20 and 40 percent of the inlet capture area were tested statically and at free-stream Mach numbers of 0.1 and 0.2. The effects of boundary layer bleed inflow were investigated. A JT8D fan simulator driven by compressed air was used to pump inlet flow and to provide a characteristic noise signature. Baseline data were obtained at static free-stream conditions with the sharp P-inlet cowl lip replaced by a blunt lip. Auxiliary inlets increased overall total pressure recovery of the order of 10 percent.

Trefny, C. J.↗
NASA NTRS1985

Wave/particle interactions in the plasma sheet

The most frequent and intense waves observed in the geomagnetic tail region are short wavelength electrostatic broadband emissions. Early observations of these waves were made by using IMP 7 and 8 respectively. A broad frequency range for the waves was found, from about 10Hz to several kHz, with an average r.m.s. electric field amplitude of about 1mV/m was found. Other less frequent and less intense wave modes were also identified: magnetic noise bursts and electrostatic electron-cyclotron waves. The highest frequency of occurrence of the electrostatic noise as found in the region near the plasma sheet boundary when anisotropic fluxes of ions streaming either earthward or antiearthward were present. It was confirmed, by using ISEE data that the waves were usually observed during times of ion streaming and that the intensity and frequency range was maximum in the plasma sheet boundary layer and fell off dramatically in the tail lobe and central plasma sheet regions. It is suggested that increases in the electron and ion temperature in going from the tail lobe to the central plasma sheet are a result of scattering of resonant, boundary layer plasma.

Dusenberry, P. R.↗
NASA NTRS1982

Whistler mode turbulence in the disturbed solar wind

The magnetic field fluctuations with frequencies lying between the ion and electron cyclotron frequenices are enhanced downstream of interplanetary shocks in fast streams. Although spectra synthesized from ISEE 3 magnetometer and plasma wave instrument data can be described by one power law below 1 Hz, and another one above, measurement behind four shocks of the spectral index above the ion cyclotron frequency showed it to be twice the figure below, while no clear relationship is apparent in the weaker fast stream events. Although the data base is limited, the ratios of the average wave magnetic amplitude to electric field amplitudes confirm that the waves are whistler mode emissions, as suggested by their frequency range. It is indirectly deduced that the whistler waves are generated in such a way as to propagate at large angles to the local interplanetary field.

Coroniti, F. V.↗
DOE OSTI2016

Adsorption of iodine on hydrogen-reduced silver-exchanged mordenite: Experiments and modeling

The adsorption process of iodine, a major volatile radionuclide in the off-gas streams of spent nuclear fuel reprocessing, on hydrogen-reduced silver-exchanged mordenite (Ag 0 Z) was studied at the micro-scale. The gas-solid mass transfer and reaction involved in the adsorption process were investigated and evaluated with appropriate models. Optimal conditions for reducing the silver-exchanged mordenite (AgZ) in a hydrogen stream were determined. Kinetic and equilibrium data of iodine adsorption on Ag 0 Z were obtained by performing single-layer adsorption experiments with experimental systems of high precision at 373–473 K over various iodine concentrations. Results indicate approximately 91% to 97% of the iodine adsorption was through the silver-iodine reaction. The effect of temperature on the iodine loading capacity of Ag 0 Z was discussed. In conclusion, the Shrinking Core model describes the data well, and the primary rate controlling mechanisms were macro-pore diffusion and silver-iodine reaction. © 2016 American Institute of Chemical Engineers AIChE J, 2016

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2016

A joint probability approach for coincidental flood frequency analysis at ungauged basin confluences

A reliable and accurate flood frequency analysis at the confluence of streams is of importance. Given that long-term peak flow observations are often unavailable at tributary confluences, at a practical level, this paper presents a joint probability approach (JPA) to address the coincidental flood frequency analysis at the ungauged confluence of two streams based on the flow rate data from the upstream tributaries. One case study is performed for comparison against several traditional approaches, including the position-plotting formula, the univariate flood frequency analysis, and the National Flood Frequency Program developed by US Geological Survey. It shows that the results generated by the JPA approach agree well with the floods estimated by the plotting position and univariate flood frequency analysis based on the observation data.

confluence point↗
DOE OSTI2019

Trace Element Mass Flow Rates from U.S. Coal Fired Power Plants

Trace elements (TEs) exit coal-fired power plants (CFPPs) via solid, liquid, and gaseous waste streams. Estimating the TE concentrations of these waste streams is essential to selecting pollution controls and estimating emission reduction benefits. Our report presents a generalizable mass balance model for estimating TE mass flow rates in CFPP waste streams and evaluates model accuracy for the U.S. coal fleet given current data constraints. We stochastically estimate, using a bootstrapping approach, the 2015 plant-level mass flow rates of Hg, Se, As, and Cl to solid, liquid, and gas phase waste streams by combining publicly available data for combusted coal TE concentrations with estimates of TE partitioning within installed air pollution control processes. When compared with measured and reported data on TE mass flow rates, this model generally overestimates masses by 30–50%, with larger errors for Hg. The partitioning estimates are consistent for Se, As, and Cl removal from flue gas, but tend to underestimate Hg removal. While our model is suitable for first-order estimates of TE mass flows, future work to enhance model performance should focus on collecting and using new data on TE concentrations in the coal blend, where data quality is the weakest.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2023

Long-Term Changes in Concentration and Yield of Riverine Dissolved Silicon From the Poles to the Tropics

Riverine exports of silicon (Si) influence global carbon cycling through the growth of marine diatoms, which account for ~25% of global primary production. Climate change will likely alter river Si exports in biome-specific ways due to interacting shifts in chemical weathering rates, hydrologic connectivity, and metabolic processes in aquatic and terrestrial systems. Nonetheless, factors driving long-term changes in Si exports remain unexplored at local, regional, and global scales. We evaluated how concentrations and yields of dissolved Si (DSi) changed over the last several decades of rapid climate warming using long-term data sets from 60 rivers and streams spanning the globe (e.g., Antarctic, tropical, temperate, boreal, alpine, Arctic systems). We show that widespread changes in river DSi concentration and yield have occurred, with the most substantial shifts occurring in alpine and polar regions. The magnitude and direction of trends varied within and among biomes, were most strongly associated with differences in land cover, and were often independent of changes in river discharge. These findings indicate that there are likely diverse mechanisms driving change in river Si biogeochemistry that span the land-water interface, which may include glacial melt, changes in terrestrial vegetation, and river productivity. Finally, trends were often stronger in months outside of the growing season, particularly in temperate and boreal systems, demonstrating a potentially important role of shifting seasonality for the flux of Si from rivers. Our results have implications for the timing and magnitude of silica processing in rivers and its delivery to global oceans.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

EXploring the dust content of galactic winds with Herschel. I. NGC 4631

We present a detailed analysis of deep far-infrared observations of the nearby edge-on star-forming galaxy NGC 4631 obtained with the Herschel Space Observatory. Our Photodetector Array Camera and Spectrometer (PACS) images at 70 and 160 μm show a rich complex of filaments and chimney-like features that extends up to a projected distance of 6 kpc above the plane of the galaxy. The PACS features often match extraplanar Hα, radio-continuum, and soft X-ray features observed in this galaxy, pointing to a tight disk–halo connection regulated by star formation. On the other hand, the morphology of the colder dust component detected on a larger scale in the Spectral and Photometric Imaging Receiver 250, 350, and 500 μm data matches the extraplanar H I streams previously reported in NGC 4631 and suggests a tidal origin. The PACS 70/160 μm ratios are elevated in the central ∼3.0 kpc region above the nucleus of this galaxy (the “superbubble”). A pixel-by-pixel analysis shows that dust in this region has a higher temperature and/or an emissivity with a steeper spectral index (β>2) than the dust in the disk, possibly the result of the harsher environment in the superbubble. Star formation in the disk seems energetically insufficient to lift the material out of the disk, unless it was more active in the past or the dust-to-gas ratio in the superbubble region is higher than the Galactic value. Some of the dust in the halo may also have been tidally stripped from nearby companions or lifted from the disk by galaxy interactions.

79 ASTRONOMY AND ASTROPHYSICS↗

Refine your search to explore more results.