Remote Streaming & Visualization of ECCO Data with Jupyter Notebook and IDX
Explore the source record for details and available documents.
HECC↗
SEARCH · Search NASA
Results for “Streaming Data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Real Time implementation of Artificial Intelligence compression algorithm for High-Speed Streaming Readout signals
The new generation of high-energy physics experiments plans to acquire data in streaming mode. With this approach, it is possible to access the information of the whole detector (organized in time slices) for optimal and lossless triggering of data acquisitions. With this approach, data rates, especially in large detectors, are often very high, and the network is likely to be the bottleneck for the entire Streaming Read Out system. The aim of this work is to study the implementation of a lossy compression algorithm based on Artificial Intelligence: an Autoencoder. With Machine Learning it is possible to achieve a high compression ratio and fast inference time with only a small degradation of the signals, almost negligible for the specific application. This work explores different configurations of the Autoencoder and the implementation on different hardware. Different Autoencoder configurations are explored to find the best trade-off between compression ratio and reconstruction loss, both for signals and energy spectrum. Different hardware implementations are also explored to find the best platform to achieve real-time performance for the specific application.
Rossi, Fabio (ORCID:0009000385713885)↗
A Larger Extent for the Ophiuchus Stream
We present new kinematic data for the Ophiuchus stellar stream. Spectra have been taken of member candidates at the MMT telescope using Hectospec, Hectochelle, and Binospec, which provide more than 1800 new velocities. Combined with proper-motion measurements of stars in the field by the Gaia—DR2 catalog, we have derived stream membership probabilities, resulting in the detection of more than 200 likely members. These data show the stream extends to more than three times the length shown in the discovery data. A spur to the main stream is also detected. The high-resolution spectra allow us to resolve the stellar velocity dispersion, found to be 1.6 ± 0.3 km s{sup −1}.
79 ASTRONOMY AND ASTROPHYSICS↗
Validation of the ERBE scanner scene identification methodology: Analysis with Nimbus-7 ERB data
Maximum Likelihood Estimation (MLE) procedure for scene identification currently being utilized in the ERBE scanner data processing stream is applied to the Nimbus-7 ERB Scanner data for the month of June 1979. The Earth radiation budget parameters derived using MLE method show very good agreement with the values provided using sorting into angular bins (SAB) method. Results of the fields on different spatial scales are presented. A satellite zenith angle study indicates that the MLE procedure considerably improves the scene selection over the method of bispectral thresholds applied in the Nimbus-7 ERB data processing. Agreement with SAB results improved further when the observations were cut off at 75% in satellite zenith. Sampling constraints, however require that the cut-off angle should not be lower than 70%. Quantitative details about the reliability of the scene identification are also presented.
Vermury, S.↗
Encryption of Signal Pulses to Replace Tamper-indicating Conduit
In order to verify signal integrity and point of origin for TTL pulse data used in IAEA systems, and to avoid the need for expensive tamper-indicating conduit or electronic techniques, we propose the development of a signal pulse signing and encryption in-line device. In measurement applications in which the data acquisition electronics is separate from the enclosed, sealed detector, tamper-indicating techniques are required to protect raw TTL pulse streams between the detector and the data acquisition module, i.e UMSR. The goal of this proposed project is to design a rad-tolerant transmitter that would mount inside the sealed detector system and a receiver in the sealed electronics cabinet with the data acquisition instrument. This transmitter/receiver pair would digitally sign and encrypt the pulse stream data at the detector then transmit the data to the sealed cabinet where the receiver would decrypt the data and reproduce the original pulse stream. Existing tamper indicating techniques, such as LiveWire’s spread spectrum time domain reflectometry rely on detecting physical changes to the wiring system and can be blind to fast coupling of micro-second wide pulses. Digital signing and encryption techniques such as the Sandia Laboratories Enhanced Data Authentication System (EDAS) are capable of encrypting communications data, i.e. RS-232, but are not capable reproducing a critical time correlated data streams. Recent NA-241 Safeguards Technology supported developments have reduced the need for special conduit to transmit data via Ethernet by incorporating the IAEA RAINSTORM data encryption and authentication protocol, a tamper indicator is still required to protect raw pulse data from detectors to the acquisition electronics. Encrypting pulse data is especially complicated for radiation detection instruments due to the time correlation data analysis that is performed on this data stream. Any corruption in the timing information will produce errors in measurement values.
97 MATHEMATICS AND COMPUTING↗
Single-Stream Empirical Jet-Noise Models Based on Scale-Model Data
Accurate single-stream jet-noise models for hot jets in flight are necessary for predicting noise of future commercial supersonic aircraft at takeoff. Previous comparisons between flight data and existing models have shown unacceptably large errors in the predictive tools. In the current effort, acoustic data were acquired in the Aero-Acoustic Propulsion Laboratory at the NASA Glenn Research Center for a single-stream hot jet with a range of operating conditions and simulated flight speeds that include those expected at takeoff of commercial supersonic aircraft. Models are presented for the resulting shape functions used to estimate the average spectra derived from the appropriate scaling of the jet-noise data.
Acoustics↗
Characterization of robotics parallel algorithms and mapping onto a reconfigurable SIMD machine
The kinematics, dynamics, Jacobian, and their corresponding inverse computations are six essential problems in the control of robot manipulators. Efficient parallel algorithms for these computations are discussed and analyzed. Their characteristics are identified and a scheme on the mapping of these algorithms to a reconfigurable parallel architecture is presented. Based on the characteristics including type of parallelism, degree of parallelism, uniformity of the operations, fundamental operations, data dependencies, and communication requirement, it is shown that most of the algorithms for robotic computations possess highly regular properties and some common structures, especially the linear recursive structure. Moreover, they are well-suited to be implemented on a single-instruction-stream multiple-data-stream (SIMD) computer with reconfigurable interconnection network. The model of a reconfigurable dual network SIMD machine with internal direct feedback is introduced. A systematic procedure internal direct feedback is introduced. A systematic procedure to map these computations to the proposed machine is presented. A new scheduling problem for SIMD machines is investigated and a heuristic algorithm, called neighborhood scheduling, that reorders the processing sequence of subtasks to reduce the communication time is described. Mapping results of a benchmark algorithm are illustrated and discussed.
Lee, C. S. G.↗
System Collects And Displays Demultiplexed Data
Electronic system collects, manipulates, and displays in real time results of manipulation of streams of data transmitted from remote scientific instrumentation. Interface circuit shifts data-and-clock signal from differential logic levels of multiplexer to single-ended logic levels of computer. System accommodates nonstandard data-transmission protocol. Software useful in applications where Macintosh computers used in real-time display and recording of data.
Reschke, Millard F.↗
Joint Modeling of GD-1 and C-19 as Old Streams
DESI observational data for the GD-1 and C-19 streams are compared to stream simulations in a common evolving multi-halo potential of a Milky Way-like galaxy based on a cosmological simulation. The goal is to find the best match of the stream velocity spread and the density power spectrum stream density to simulations having either CDM or WDM subhalos. The cocoon velocity width integrated over the length of the stream is independent of orbital blurring along the stream and the power spectrum integrates over the width of the stream, sidestepping the geometric details of the streams. Streams develop from star clusters inserted at $\simeq$1 Gyr after the Big Bang and evolved for 13 Gyr to their current orbital positions. Streams in a CDM subhalo population provide the best match to the velocity width, with streams younger than 10 Gyr ruled out as insufficiently hot. The progenitor star cluster masses, which determine the fraction of stars released at late times which comprise the stream core, are found to be $\simeq 8\times 10^4 M_\odot$ for GD-1 and $\simeq 4\times 10^4 M_\odot$ for C-19, although the mass depends on the star cluster half mass radius. Stream heating leads to stream lumpiness which is measurable for the relatively large and clean GD-1 dataset. The stream density power spectrum measured along the length of the DESI GD-1 sample is in good agreement with CDM simulations, with 1.7 to 1.9 times more power than WDM 7 keV and 5.5 keV simulations.
Carlberg, Raymond G. [Toronto U.] (ORCID:000000027↗
FPGA based demodulation of laser induced fluorescence in plasmas
We present a field programmable gate array (FPGA)-based system that counts photons from laser-induced fluorescence (LIF) on a laboratory plasma. This is accomplished with FPGA-based up/down counters that demodulate the data, giving a background-subtracted LIF signal stream that is updated with a new point as each laser amplitude modulation cycle completes. We demonstrate using the FPGA to modulate a laser at 1 MHz and demodulate the resulting LIF data stream. Finally, this data stream is used to calculate an LIF-based measurement sampled at 1 MHz of a plasma ion fluctuation spectrum.
47 OTHER INSTRUMENTATION↗
Earth Science Data Fusion with Event Building Approach
Objectives of the NASA Information And Data System (NAIADS) project are to develop a prototype of a conceptually new middleware framework to modernize and significantly improve efficiency of the Earth Science data fusion, big data processing and analytics. The key components of the NAIADS include: Service Oriented Architecture (SOA) multi-lingual framework, multi-sensor coincident data Predictor, fast into-memory data Staging, multi-sensor data-Event Builder, complete data-Event streaming (a work flow with minimized IO), on-line data processing control and analytics services. The NAIADS project is leveraging CLARA framework, developed in Jefferson Lab, and integrated with the ZeroMQ messaging library. The science services are prototyped and incorporated into the system. Merging the SCIAMACHY Level-1 observations and MODIS/Terra Level-2 (Clouds and Aerosols) data products, and ECMWF re- analysis will be used for NAIADS demonstration and performance tests in compute Cloud and Cluster environments.
Lukashin, C.↗
Altitude-Wind-Tunnel Investigation of the 19B-2, 19B-8, and 19XB-1 Jet Propulsion Engines: Performance and Windmilling Drag Characteristics - 3
The performance characteristics of the 19B-8 and 19XB-1 turbojet engines and the windmilling-drag characteristics of the 19B-6 engine were determined in the Cleveland altitude wind tunnel. The investigations were conducted on the 19B-8 engine at simulated altitudes from 5000 to 25,000 feet with various free-stream ram-pressure ratios and on the 19XB--1 engine at simulated altitudes from 5000 to 30,000 feet with approximately static free-stream conditions. Data for these two engines are presented to show the effect of altitude, free-stream ram-pressure ratio, and tail-pipe-nozzle area on engine performance. A 21-percent reduction in tail-pipe-nozzle area of the 19B-8 engine increased the let thrust 43 percent the net thrust 72 percent, and the fuel consumption 64 percent. An increase in free-stream ram-pressure ratio raised the jet thrust and the air flow and lowered the net thrust throughout the entire range of engine speeds for the 19B-8 engine. At similar operating conditions, the corrected jet thrust and corrected air flow were approximately the same for both engines, and the corrected specific fuel consumption based on jet thrust was lower for the 19XB-1 engine than for the 19B-8 engine. The thrust and air-flow data obtained with both engines at various altitudes for a given free-stream rampressure ratio were generalized to standard sea-level atmospheric conditions. The performance parameters involving fuel consumption generalized only at high engine speeds at simulated altitudes as high as 15,000 feet. The windmilling drag of the 19B-8 engine increased rapidly as the airspeed was increased.
Fleming, WIlliam A.↗
Mixer-ejector nozzle for jet noise suppression
An aero/acoustic model test of a mixer-ejector nozzle was conducted at the 9 x 15 foot low-speed acoustic wind tunnel at NASA Lewis Research Center. The objective of the test was to get a preliminary assessment of ejector pumping and noise reduction potential of this device for possible application in the exhaust system of an advanced supersonic civil transport. The results of the test showed that goal levels of pumping were achieved. Exit pressure/temperature traverse data showed that there was good mixing between the primary and secondary streams. Acoustics data were dominated by shock noise; jet mixing noise levels were low because of a facility limit on primary temperature. The mixer-ejector did significantly reduce shock noise relative to the baseline conic nozzle. Because the relative magnitudes of jet mixing noise and shock noise were not in the correct proportion to properly model engine noise, an Effective Perceived Noise Level (EPNL) assessment was precluded.
Lord, W. K.↗
Method and device for maximizing memory system bandwidth by accessing data in a dynamically determined order
A data processing system is disclosed which comprises a data processor and memory control device for controlling the access of information from the memory. The memory control device includes temporary storage and decision ability for determining what order to execute the memory accesses. The compiler detects the requirements of the data processor and selects the data to stream to the memory control device which determines a memory access order. The order in which to access said information is selected based on the location of information stored in the memory. The information is repeatedly accessed from memory and stored in the temporary storage until all streamed information is accessed. The information is stored until required by the data processor. The selection of the order in which to access information maximizes bandwidth and decreases the retrieval time.
Wulf, William A.↗
Stereo and Solar Cycle 24
The twin STEREO spacecrafi, launched in October 2006, are in heliocentric orbits near 4 AU with one spacecraft (Ahead) leading Earth in its orbit around the Sun and the other (Behind) trailing Earth. As viewed from the Sun, the STEREO spacecraft are continually separating from one another at about 45 degrees per year with Earth biseding the angle. At present, th@spaser=raft are a bit more than 45 degrees apart, thus they are able to each 'vie@ ground the limb's of the Sun by about 23 degrees, corresponding to about 1.75 days of solar rotation. Both spameraft contain an identical set of instruments including an extreme ultraviolet imager, two white light coronagraphs, tws all-sky imagers, a wide selection of energetic particle detectors, a magnetometer and a radio burst tracker. A snapshot of the real time data is continually broadcast to NOW-managed ground stations and this small stream of data is immediately sent to the STEREO Science Center and converted into useful space weather data within 5 minutes of ground receipt. The resulting images, particle, magnetometer and radio astronomy plots are available at ~ ~ j ~ g ~ ~ ~ i t , : gAs~ timqe~ co~n~ting ue~s ijnto~ ~ ~ ~ ~ . ~ g ~ solar cycle 24, the separation angle becomes 90 degrees in early 2009 and 180 degrees in early 201 1 as the activity heads toward maximum. By the time of solar maximum, STEREO will provide for the first time a view of the entire Sun with the mronagraphs and e*reme ultraviolet instruments. This view wilt allow us to follow the evolution of active regions continuously and also detect new active regions long before they pose a space weather threat to Earth. The in situ instruments will be able to provide about 7 days advanced notice of co-rotating structures in the solar wind. During this same intewal near solar maximum, the wide-angle imagers on STEREB will both be ;able to view EarlCP-dirsted CMEs in their plane-oPsky. When combined with Eat-lhorbiting assets available at that time, it seems solar cycle 24 will mark a great increase in our ability to understand and predict space weather.
Kaise,r Michael L.↗
Ice dynamics at the mouth of ice stream B, Antarctica
Data collected in the region of the mouth of ice stream B, West Antarctica, during three field seasons are presented. The physical characteristics of the mouth of ice stream B are described, and the dynamics in the vicinity of the DNB network are discussed. The dynamics of ice stream B from DNB to the grounding line is briefly considered, and a force analysis of the grounding line region is made. The results demonstrate that the dynamic situation of the region at the mouth of ice stream B is distinctly different from either the greater portion of the ice stream upstream or the Ross ice shelf downstream.
Bindschadler, R. A.↗
Cloud Absorption Radiometer Autonomous Navigation System - CANS
CAR (cloud absorption radiometer) acquires spatial reference data from host aircraft navigation systems. This poses various problems during CAR data reduction, including navigation data format, accuracy of position data, accuracy of airframe inertial data, and navigation data rate. Incorporating its own navigation system, which included GPS (Global Positioning System), roll axis inertia and rates, and three axis acceleration, CANS expedites data reduction and increases the accuracy of the CAR end data product. CANS provides a self-contained navigation system for the CAR, using inertial reference and GPS positional information. The intent of the software application was to correct the sensor with respect to aircraft roll in real time based upon inputs from a precision navigation sensor. In addition, the navigation information (including GPS position), attitude data, and sensor position details are all streamed to a remote system for recording and later analysis. CANS comprises a commercially available inertial navigation system with integral GPS capability (Attitude Heading Reference System AHRS) integrated into the CAR support structure and data system. The unit is attached to the bottom of the tripod support structure. The related GPS antenna is located on the P-3 radome immediately above the CAR. The AHRS unit provides a RS-232 data stream containing global position and inertial attitude and velocity data to the CAR, which is recorded concurrently with the CAR data. This independence from aircraft navigation input provides for position and inertial state data that accounts for very small changes in aircraft attitude and position, sensed at the CAR location as opposed to aircraft state sensors typically installed close to the aircraft center of gravity. More accurate positional data enables quicker CAR data reduction with better resolution. The CANS software operates in two modes: initialization/calibration and operational. In the initialization/calibration mode, the software aligns the precision navigation sensors and initializes the communications interfaces with the sensor and the remote computing system. It also monitors the navigation data state for quality and ensures that the system maintains the required fidelity for attitude and positional information. In the operational mode, the software runs at 12.5 Hz and gathers the required navigation/attitude data, computes the required sensor correction values, and then commands the sensor to the required roll correction. In this manner, the sensor will stay very near to vertical at all times, greatly improving the resulting collected data and imagery. CANS greatly improves quality of resulting imagery and data collected. In addition, the software component of the system outputs a concisely formatted, high-speed data stream that can be used for further science data processing. This precision, time-stamped data also can benefit other instruments on the same aircraft platform by providing extra information from the mission flight.
Kahle, Duncan↗
Random Forest Regressor-Based Approach for Detecting Fault Location and Duration in Power Systems
Power system failures or outages due to short-circuits or “faults” can result in long service interruptions leading to significant socio-economic consequences. It is critical for electrical utilities to quickly ascertain fault characteristics, including location, type, and duration, to reduce the service time of an outage. Existing fault detection mechanisms (relays and digital fault recorders) are slow to communicate the fault characteristics upstream to the substations and control centers for action to be taken quickly. Fortunately, due to availability of high-resolution phasor measurement units (PMUs), more event-driven solutions can be captured in real time. In this paper, we propose a data-driven approach for determining fault characteristics using samples of fault trajectories. A random forest regressor (RFR)-based model is used to detect real-time fault location and its duration simultaneously. This model is based on combining multiple uncorrelated trees with state-of-the-art boosting and aggregating techniques in order to obtain robust generalizations and greater accuracy without overfitting or underfitting. Four cases were studied to evaluate the performance of RFR: 1. Detecting fault location (case 1), 2. Predicting fault duration (case 2), 3. Handling missing data (case 3), and 4. Identifying fault location and length in a real-time streaming environment (case 4). A comparative analysis was conducted between the RFR algorithm and state-of-the-art models, including deep neural network, Hoeffding tree, neural network, support vector machine, decision tree, naive Bayesian, and K-nearest neighborhood. Experiments revealed that RFR consistently outperformed the other models in detection accuracy, prediction error, and processing time.
24 POWER TRANSMISSION AND DISTRIBUTION↗