Search NASA⌕ Search

SEARCH · Search NASA

Results for “streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95

Developing an Effective Model for Predicting Spatially and Temporally Continuous Stream Temperatures from Remotely Sensed Land Surface Temperatures

Although water temperature is important to stream biota, it is difficult to collect in a spatially and temporally continuous fashion. We used remotely-sensed Land Surface Temperature (LST) data to estimate mean daily stream temperature for every confluence-to-confluence reach in the John Day River, OR, USA for a ten year period. Models were built at three spatial scales: site-specific, subwatershed, and basin-wide. Model quality was assessed using jackknife and cross-validation. Model metrics for linear regressions of the predicted vs. observed data across all sites and years: site-specific r2 = 0.95, Root Mean Squared Error (RMSE) = 1.25 °C; subwatershed r2 = 0.88, RMSE = 2.02 °C; and basin-wide r2 = 0.87, RMSE = 2.12 °C. Similar analyses were conducted using 2012 eight-day composite LST and eight-day mean stream temperature in five watersheds in the interior Columbia River basin. Mean model metrics across all basins: r2 = 0.91, RMSE = 1.29 °C. Sensitivity analyses indicated accurate basin-wide models can be parameterized using data from as few as four temperature logger sites. This approach generates robust estimates of stream temperature through time for broad spatial regions for which there is only spatially and temporally patchy observational data, and may be useful for managers and researchers interested in stream biota.

McNyset, Kristina↗

Weakly supervised anomaly detection in the Milky Way

ABSTRACT Large-scale astrophysics data sets present an opportunity for new machine learning techniques to identify regions of interest that might otherwise be overlooked by traditional searches. To this end, we demonstrate how Classification Without Labels (CWoLa), a weakly supervised anomaly detection method, can help identify cold stellar streams within the more than one billion Milky Way stars observed by the Gaia satellite. CWoLa operates without the use of labelled streams or knowledge of astrophysical principles. Instead, it uses a classifier to distinguish between mixed samples for which the proportions of signal and background samples are unknown. As a proof of concept, we demonstrate that this computationally lightweight strategy is able to detect both simulated streams and the known stream GD-1 in data. Originally designed for high-energy collider physics, this technique may have broad applicability within astrophysics as well as other domains interested in identifying localized anomalies.

79 ASTRONOMY AND ASTROPHYSICS↗

ANOTHER LOOK AT THE EASTERN BANDED STRUCTURE: A STELLAR DEBRIS STREAM AND A POSSIBLE PROGENITOR

Using the Sloan Digital Sky Survey Data Release 7, we re-examine the Eastern Banded Structure (EBS), a stellar debris stream first discovered in Data Release 5 and more recently detected in velocity space by Schlaufman et al. The visible portion of the stream is 18{sup 0} long, lying roughly in the Galactic Anticenter direction and extending from Hydra to Cancer. At an estimated distance of 9.7 kpc, the stream is {approx}170 pc across on the sky. The curvature of the stream implies a fairly eccentric box orbit that passes close to both the Galactic center and to the Sun, making it dynamically distinct from the nearby Monoceros, Anticenter, and GD-1 streams. Within the stream is a relatively strong, 2{sup 0}-wide concentration of stars with a very similar color-magnitude distribution that we designate Hydra I. Given its prominence within the stream and its unusual morphology, we suggest that Hydra I is the last vestige of EBS's progenitor, possibly already unbound or in the final throes of tidal dissolution. Though both Hydra I and the EBS have a relatively high-velocity dispersion, given the comparatively narrow width of the stream and the high frequency of encounters with the bulge and massive constituents of the disk that such an eccentric orbit would entail, we suggest that the progenitor was likely a globular cluster and that both it and the stream have undergone significant heating over time.

79 ASTRONOMY AND ASTROPHYSICS↗

The Infrared Astronomical Satellite /IRAS/ Scientific Data Analysis System /SDAS/ sky flux subsystem

The sky flux subsystem of the Infrared Astronomical Satellite Scientific Data Analysis System is described. Its major output capabilities are (1) the all-sky lune maps (8-arcminute pixel size), (2) galactic plane maps (2-arcminute pixel size) and (3) regional maps of small areas such as extended sources greater than 1-degree in extent. The major processing functions are to (1) merge the CRDD and pointing data, (2) phase the detector streams, (3) compress the detector streams in the in-scan and cross-scan directions, and (4) extract data. Functional diagrams of the various capabilities of the subsystem are given. Although this device is inherently nonimaging, various calibrated and geometrically controlled imaging products are created, suitable for quantitative and qualitative scientific interpretation.

Stagner, J. R.↗

Falcon: Visual analysis of large, irregularly sampled, and multivariate time series data in additive manufacturing

Flexible visual analysis of long, high-resolution, and irregularly sampled time series data from multiple sensor streams is a challenge in several domains. In the field of additive manufacturing, this capability is critical for realizing the full potential of large-scale 3D printers. Here, we propose a visual analytics approach that helps additive manufacturing researchers acquire a deep understanding of patterns in log and imagery data collected by 3D printers. Our specific goals include discovering patterns related to defects and system performance issues, optimizing build configurations to avoid defects, and increasing production efficiency. We introduce Falcon, a new visual analytics system that allows users to interactively explore large, time-oriented data sets from multiple linked perspectives. Falcon provides overviews, detailed views, and unique segmented time series visualizations, all with adjustable scale options. To illustrate the effectiveness of Falcon at providing thorough and efficient knowledge discovery, we present a practical case study involving experts in additive manufacturing and data from a large-scale 3D printer. The techniques described are applicable to the analysis of any quantitative time series, though the focus of this paper is on additive manufacturing.

97 MATHEMATICS AND COMPUTING↗

A study of axial compressor blade optimization for operation in the low Reynolds number regime

Original and previously published experimental data is presented in this study of axial compressor blade optimization for use in the subcritical Reynolds number region. Three methods of increasing cascade performance at these low Rc are presented, discussed, and compared: (1) use of sharp-leading-edge profiles, (2) trip wires or roughness elements, and (3) high free-stream turbulence. The original data was collected in the VKI C-1 cascade wind tunnel; during these tests blade chord Reynolds number was varied from 250,000 down to about 17,000. Each technique demonstrated an increase in low Reynolds number (based on chord) performance for certain profiles, with the sharp-leading-edge profile as the potential optimum. Axial compressors or pumps that must operate for a significant amount of their design life under low Reynolds number conditions might benefit substantially from these methods.

Roberts, W. B.↗

Airoscope telemetry system

The AIROscope (Ames Infrared Observatory telescope) telemetry system is described from signal conditioning on the gondola to display and storage at the ground station. All analog and digital data from the systems and experiments on the gondola go to a PCM encoder which formats the data into 10-bit words. Therefore, 0.1-percent resolution is inherently available for experimental data. The coded bit stream directly modulates the carrier of the FM transmitter. To insure reliable transmission over a 650-km range an 11-watt FM transmitter operating at 1483.5 MHz is used on the gondola. Modulation is narrow band FM with a maximum deviation of plus or minus 500 kHz. The maximum modulation frequency is determined by the data bit rate which could be as high as 500 kbps. Presently, a rate of 20.48 kbps is used. The ground station receiving system includes a steerable antenna (19-db gain), preamplifier (21-db gain) and receiver. All data are recorded on a tape recorder. The recorded signal then can be played back through the PCM decommutator unit at a later time for detailed data analysis by the experimenter.

Pitts, K. J.↗

Real-time charged track reconstruction for CLAS12

Abstract This paper presents the results of charged particle track reconstruction in CLAS12 using artificial intelligence. In our approach, we use machine learning algorithms to reconstruct tracks, including their momentum and direction, with high accuracy from raw hits of the CLAS12 drift chambers. The reconstruction is performed in real-time, with the rate of data acquisition, and allows for the identification of event topologies in real-time. This approach revolutionizes the Nuclear Physics experiments' data processing, allowing us to identify and categorize the experimental data on the fly, and will lead to a significant reduction in experiment data processing. It can also be used in streaming readout applications leading to more efficient data acquisition and post-processing.

Instruments & Instrumentation↗

Scalable Performance Environments for Parallel Systems

As parallel systems expand in size and complexity, the absence of performance tools for these parallel systems exacerbates the already difficult problems of application program and system software performance tuning. Moreover, given the pace of technological change, we can no longer afford to develop ad hoc, one-of-a-kind performance instrumentation software; we need scalable, portable performance analysis tools. We describe an environment prototype based on the lessons learned from two previous generations of performance data analysis software. Our environment prototype contains a set of performance data transformation modules that can be interconnected in user-specified ways. It is the responsibility of the environment infrastructure to hide details of module interconnection and data sharing. The environment is written in C++ with the graphical displays based on X windows and the Motif toolkit. It allows users to interconnect and configure modules graphically to form an acyclic, directed data analysis graph. Performance trace data are represented in a self-documenting stream format that includes internal definitions of data types, sizes, and names. The environment prototype supports the use of head-mounted displays and sonic data presentation in addition to the traditional use of visual techniques.

Reed, Daniel A.↗

Nuclear Materials Process Modeling at the Y-12 National Security Complex

The Y-12 National Security Complex (Y-12) has implemented process modeling for various accountable nuclear materials operations that are performed throughout the plant. Using a discrete, event-based dynamic simulation program, key nuclear material streams are modeled, allowing Y-12 to effectively manage numerous points of interest within the plant’s production operations. Integration of the various material processes into a single, interdependent supply and demand model is one of the ongoing focuses within Y-12’s process modeling effort. The primary purpose of using dynamic simulation modeling is to allow for analysis of the nuclear materials inventories and forecasted supplies based on future demands. Analysis of these inventories includes capacity evaluation, bottleneck mitigation, and assessments of individual pieces of equipment to inform future facility investment decisions and associated project schedules. Modeling of the nuclear materials processes throughout the complex also allows for incorporation of changes relevant to production capabilities such as the upcoming transition of specific operations to the new Uranium Processing Facility. Prior to implementation of process modeling, Y-12 forecasted supply and demand of accountable nuclear materials streams using Microsoft Excel. With deterministic models such as Microsoft Excel, the annual forecasts, generated within data input condition parameters, can only provide a fixed point of data. Fixed data cannot simulate integrated material streams and account for the possibility of occurrences and other changes that dynamic simulations take into consideration. Y-12’s dynamic process modeling allows integrated simulations of multiple accountable nuclear materials processes, including supply and demand forecasting and analysis, and is a coordinated effort involving many steps of verification and validation (V&V), site briefings, testing, reporting, data mining, planning, and documentation that spans various programs throughout the Y-12 complex.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The Bear Brook Watershed in Maine: Multi-Decadal Whole-Watershed Experimental Acidification

The Bear Brook Watershed in Maine (BBWM) is a long-term research site established to study the response of forest ecosystem function to environmental disturbances of chronic acidic deposition and ecosystem nitrogen enrichment. Starting in 1989, the West Bear (treated) watershed received bimonthly applications of ammonium sulfate [(NH4)2SO4] fertilizer from above the canopy, whereas East Bear (reference) received ambient deposition. The treatments were stopped in 2016, marking the beginning of the recovery phase. Research at the site has focused on soils, streams, and vegetation. Here, we describe data collected over three decades at the BBWM—input and stream output nutrient fluxes, quantitative soil pits and soil chemistry, and soil temperature and moisture.

Patel, Kaizad F.↗

Conservative solute transport processes and associated transient storage mechanisms: Comparing streams with contrasting channel morphologies, land use and land cover

Abstract Land use within a watershed impacts stream channel morphology and hydrology and, therefore, in‐stream solute transport processes and associated transient storage mechanisms. This study evaluated transport processes in two contrasting stream sites where channel morphology was influenced by the surrounding land use, land cover, climate and geologic controls: Como Creek, CO, a relatively undisturbed, high gradient, forested stream with a gravel bed and complex channel morphology, and Clear Creek, IA, an incised, low‐gradient stream with low‐permeability substrate draining an agricultural landscape. We performed conservative stream tracer injections at these sites to address the following questions: (1) How does solute transport vary between streams with differing morphologies? and (2) How does solute transport at each stream site change as a function of discharge? We analysed in‐stream tracer time series data and compared results quantifying solute attenuation in surface and subsurface transient storage zones. Significant trends were observed in these metrics with varying discharge conditions at the forested site but not at the agricultural site. There was a broad range of transport mechanisms and evidence of substantial exchange with both surface and hyporheic transient storage in the relatively undisturbed, forested stream. Changing discharge conditions activated or deactivated different solute transport mechanisms in the forested site and greatly impacted advective travel time. Conversely in the simplified agricultural stream, there was a narrow range of solute transport behaviour across flows and predominantly surface transient storage at all measured discharge conditions. These results demonstrate how channel simplification inhibits available solute transport mechanisms across varying discharge conditions.

54 ENVIRONMENTAL SCIENCES↗

Collaborative project. Ocean-atmosphere interaction from meso- to planetary-scale. Mechanics, parameterization, and variability

Most climate models are currently run with grid spacings of around 100km, which, with today’s computing power, allows for long (up to 1000 year) simulations, or ensembles of simulations to explore climate change and variability. However this grid spacing does not resolve important components of the weather/climate system such as atmospheric fronts and mesoscale systems, and ocean boundary currents and eddies. The overall aim of this project has been to look at the effect of these small-scale features on the weather/climate system using a suite of high and low resolution climate models, idealized models and observations. High-resolution global coupled integrations using CAM/CESM were carried out at NCAR by the lead PI. At TAMU, we have complemented the work at NCAR by analyzing datasets from the high-resolution (28km) CESM integrations (Small et al., 2014) as well as very high resolution (9km, 3km) runs using a coupled regional climate (CRCM) carried out locally. The main tasks carried out were: 1. Analysis of surface wind in observations and high-resolution CAM/CCSM simulations 2. Development of a feature-tracking algorithm for studying midlatitude air-sea interaction by following oceanic mesoscale eddies and creating composites of the atmospheric response overlying the eddies. 3. Applying the Lagrangian analysis technique in the Gulf Stream region to compare data from observational reanalyses, global CESM coupled simulations, 9km regional coupled simulations and 3km convection-resolving regional coupled simulations. Our main findings are that oceanic mesoscale eddies influence not just the atmospheric boundary layer above them, but also the lower portions of the free troposphere above the boundary layer. Such a vertical response could have implications for a remote influence of Gulf Stream oceanic eddies on North Atlantic weather patterns through modulation of the storm track, similar to what has been noted in the North Pacific. The coarse resolution observational reanalyses perhaps underestimate the atmospheric response, but the 28km global model resolution appears to be adequate to capture some, but not all, aspects of the boundary response. The higher resolution regional models show a stronger response in certain fields such as the latent heat flux.

58 GEOSCIENCES↗

A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)

Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.

97 MATHEMATICS AND COMPUTING↗

EFFECT OF FUEL IMPURITIES ON FUEL CELL PERFORMANCE AND DURABILITY

A fuel cell is an electrochemical energy conversion device that produces electricity during the combination of hydrogen and oxygen to produce water. Proton exchange membranes fuel cells are favored for portable applications as well as stationary ones due to their high power density, low operating temperature, and low corrosion of components. In real life operation, the use of pure fuel and oxidant gases results in an impractical system. A more realistic and cost efficient approach is the use of air as an oxidant gas and hydrogen from hydrogen carriers (i.e., ammonia, hydrocarbons, hydrides). However, trace impurities arising from different hydrogen sources and production increases the degradation of the fuel cell. These impurities include carbon monoxide, ammonia, sulfur, hydrocarbons, and halogen compounds. The International Organization for Standardization (ISO) has set maximum limits for trace impurities in the hydrogen stream; however fuel cell data is needed to validate the assumption that at those levels the impurities will cause no degradation. This report summarizes the effect of selected contaminants tested at SRNL at ISO levels. Runs at ISO proposed concentration levels show that model hydrocarbon compound such as tetrahydrofuran can cause serious degradation. However, the degradation is only temporary as when the impurity is removed from the hydrogen stream the performance completely recovers. Other molecules at the ISO concentration levels such as ammonia don't show effects on the fuel cell performance. On the other hand carbon monoxide and perchloroethylene shows major degradation and the system can only be recovered by following recovery procedures.

08 HYDROGEN↗

Contrasting stream nitrate and sulfate response to recovery from experimental watershed acidification

Improvements in air quality have led to ecosystem recovery from acidic deposition, but the mechanisms and trajectories of this recovery are not fully understood. Here, we present long-term stream response and recovery data for paired watersheds at the Bear Brook Watershed in Maine (BBWM) during declining ambient SO 4 and NO 3 in precipitation. East Bear (EB) received ambient deposition from 1989 to 2018; West Bear (WB) received artificially elevated N+S from 1989 to 2016. The WB treatment was discontinued after 2016, the beginning of the recovery from both the experimental N+S and ambient decline. Stream SO 4 in WB gradually declined after the treatment ended, from ~147 µeq L -1 in 2010-16 to ~126 µeq L -1 in 2017-18. The declining S inputs induced desorption of SO 4 from soil phase surfaces, with stream loss far exceeding precipitation input. At the current rate of recovery, it will be many decades before the WB stream returns to pre-treatment SO 4 concentrations. In contrast, NO 3 is only weakly adsorbed in soil, and WB stream NO 3 concentrations rapidly declined from ~39 µeq L -1 in 2010-16 to ~5 µeq L -1 in 2017-18, comparable to the N-limited EB stream. The acid anions are strongly coupled to base cation chemistry in streams, and there was a distinct hysteretic response of Ca and Mg to the chronic acidification, as (Ca+Mg) increased rapidly during the initial years, followed by declining values due to depletion of the soil exchange complex. This 30-year monitoring study (1989-2019) provides insights into recovery mechanisms from acidic deposition and highlights the role of abiotic processes in soil that mediate nutrient cycling and retention. Finally, documenting the rapid response of N alongside the slower recovery for S identifies the temporal resolution necessary for other whole-watershed recovery studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dataset for "Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models" Willard et al. (2024)

This data release provides all data and code used in the paper " "Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models" Willard et al. (2024)" to model stream temperature, evaluate, and assess results. The associated manuscript explores current open questions in prediction in ungauged and unmonitored basins concerning top-down versus bottom-up approaches, tradeoffs between data available and input requirements, and the appropriate representation of catchment attributes as inputs to deep learning models. Modeling was done primarily with long short-term memory (LSTM) models, and stream site coverage spans 1362 locations across the conterminous United States. The data is organized into these items items:Code repository and data for the paper " "Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models" Willard et al. (2024)".Code: stream_temp_ml_regionalization.zip contains the code repositoryData to run the code: - data_dir.zip -- contains all files that should be moved to the "DATA_DIR" variable defined in the "set_env_vars.sh" script in the code repository- metadata_dir.zip -- contains all files that should be moved to the "METADATA_DIR" variable defined in the "set_env_vars.sh" script in the code repository- error_analysis_attribute_and_groundwater_dir.zip - workflows for the extended error analysis by stream attribute and groundwater influenceData produced by the code and used in the paper:- outputs_dir.zip - contains model output and results (outputs_dir/results), model weights (outputs_dir/models), and all other outputs used for the paper including feature importances.To cite this code, please use the following BibTeX or MLA entries:bibtex:@misc{willard2024streamdata, author = {Jared Willard and Fabio Ciulla and Helen Weierbach and Vipin Kumar and Charuleka Varadharajan}, title = {Dataset for "Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models"}, year = {2024}, doi = {10.15485/2448016}, publisher = {ESS-DIVE Repository}, url = {https://doi.org/10.15485/2448016}}MLA: Willard, Jared, et al. Dataset for "Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models". 2024. ESS-DIVE Repository, doi:10.15485/2448016.

54 ENVIRONMENTAL SCIENCES↗