Search NASA⌕ Search

SEARCH · Search NASA

Results for “data corruption”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Can Applications Recover from fsync Failures?

We analyze how file systems and modern data-intensive applications react to fsync failures. First, we characterize how three Linux file systems (ext4, XFS, Btrfs) behave in the presence of failures. We find commonalities across file systems (pages are always marked clean, certain block writes always lead to unavailability) as well as differences (page content and failure reporting is varied). Next, we study how five widely used applications (PostgreSQL, LMDB, LevelDB, SQLite, Redis) handle fsync failures. Our findings show that although applications use many failure-handling strategies, none are sufficient: fsync failures can cause catastrophic outcomes such as data loss and corruption. Our findings have strong implications for the design of file systems and applications that intend to provide strong durability guarantees.

Computer Science↗
DOE OSTI2020

Encryption of Signal Pulses to Replace Tamper-indicating Conduit

In order to verify signal integrity and point of origin for TTL pulse data used in IAEA systems, and to avoid the need for expensive tamper-indicating conduit or electronic techniques, we propose the development of a signal pulse signing and encryption in-line device. In measurement applications in which the data acquisition electronics is separate from the enclosed, sealed detector, tamper-indicating techniques are required to protect raw TTL pulse streams between the detector and the data acquisition module, i.e UMSR. The goal of this proposed project is to design a rad-tolerant transmitter that would mount inside the sealed detector system and a receiver in the sealed electronics cabinet with the data acquisition instrument. This transmitter/receiver pair would digitally sign and encrypt the pulse stream data at the detector then transmit the data to the sealed cabinet where the receiver would decrypt the data and reproduce the original pulse stream. Existing tamper indicating techniques, such as LiveWire’s spread spectrum time domain reflectometry rely on detecting physical changes to the wiring system and can be blind to fast coupling of micro-second wide pulses. Digital signing and encryption techniques such as the Sandia Laboratories Enhanced Data Authentication System (EDAS) are capable of encrypting communications data, i.e. RS-232, but are not capable reproducing a critical time correlated data streams. Recent NA-241 Safeguards Technology supported developments have reduced the need for special conduit to transmit data via Ethernet by incorporating the IAEA RAINSTORM data encryption and authentication protocol, a tamper indicator is still required to protect raw pulse data from detectors to the acquisition electronics. Encrypting pulse data is especially complicated for radiation detection instruments due to the time correlation data analysis that is performed on this data stream. Any corruption in the timing information will produce errors in measurement values.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1993

The Spacelab IPS Star Simulator

The cost of doing business in space is very high. If errors occur while in orbit the costs grow and desired scientific data may be corrupted or even lost. The Spacelab Instrument Pointing System (IPS) Star Simulator is a unique test bed that allows star trackers to interface with simulated stars in a laboratory before going into orbit. This hardware-in-the-loop testing of equipment on earth increases the probability of success while in space. The IPS Star Simulator provides three fields of view 2.55 x 2.55 deg each for input into star trackers. The fields of view are produced on three separate monitors. Each monitor has 4096 x 4096 addressable points and can display 50 stars (pixels) maximum at a given time. The pixel refresh rate is 1000 Hz. The spectral output is approximately 550 nm. The available relative visual magnitude range is two to eight visual magnitudes. The star size is less than 100 arcsec. The minimum star movement is less than 5 arcsec and the relative position accuracy is approximately 40 arcsec. The purpose of this paper is to describe the IPS Star Simulator design and to provide an operational scenario so others may gain from the approach and possible use of the system.

Wessling, Francis C., III↗
NASA NTRS1993

The Spacelab IPS Star Simulator

The cost of doing business in space is very high. If errors occur while in orbit the costs grow and desired scientific data may be corrupted or even lost. The Spacelab Instrument Pointing System (IPS) Star Simulator is a unique test bed that allows star trackers to interface with simulated stars in a laboratory before going into orbit. This hardware-in-the loop testing of equipment on earth increases the probability of success while in space. The IPS Star Simulator provides three fields of view 2.55 x 2.55 degrees each for input into star trackers. The fields of view are produced on three separate monitors. Each monitor has 4096 x 4096 addressable points and can display 50 stars (pixels) maximum at a given time. The pixel refresh rate is 1000 Hz. The spectral output is approximately 550 nm. The available relative visual magnitude range is 2 to 8 visual magnitudes. The star size is less than 100 arc seconds. The minimum star movement is less than 5 arc seconds and the relative position accuracy is approximately 40 arc seconds. The purpose of this paper is to describe the LPS Star Simulator design and to provide an operational scenario so others may gain from the approach and possible use of the system.

Wessling, Francis C., III↗
NASA NTRS1999

Results from the First Two Flights of the Static Computer Memory Integrity Testing Experiment

This paper details the scientific objectives, experiment design, data collection method, and post flight analysis following the first two flights of the Static Computer Memory Integrity Testing (SCMIT) experiment. SCMIT is designed to detect soft-event upsets in passive magnetic memory. A soft-event upset is a change in the logic state of active or passive forms of magnetic memory, commonly referred to as a "Bitflip". In its mildest form a soft-event upset can cause software exceptions, unexpected events, start spacecraft safeing (ending data collection) or corrupted fault protection and error recovery capabilities. In it's most severe form loss of mission or spacecraft can occur. Analysis after the first flight (in 1991 during STS-40) identified possible soft-event upsets to 25% of the experiment detectors. Post flight analysis after the second flight (in 1997 on STS-87) failed to find any evidence of soft-event upsets. The SCMIT experiment is currently scheduled for a third flight in December 1999 on STS-101.

Hancock, Thomas M., III↗
NASA NTRS2010

Flexible Modes Control Using Sliding Mode Observers: Application to Ares I

The launch vehicle dynamics affected by bending and sloshing modes are considered. Attitude measurement data that are corrupted by flexible modes could yield instability of the vehicle dynamics. Flexible body and sloshing modes are reconstructed by sliding mode observers. The resultant estimates are used to remove the undesirable dynamics from the measurements, and the direct effects of sloshing and bending modes on the launch vehicle are compensated by means of a controller that is designed without taking the bending and sloshing modes into account. A linearized mathematical model of Ares I launch vehicle was derived based on FRACTAL, a linear model developed by NASA/MSFC. The compensated vehicle dynamics with a simple PID controller were studied for the launch vehicle model that included two bending modes, two slosh modes and actuator dynamics. A simulation study demonstrated stable and accurate performance of the flight control system with the augmented simple PID controller without the use of traditional linear bending filters.

Shtessel, Yuri B.↗
NASA NTRS2016

Stewardship of NASA's Earth Science Data and Ensuring Long-Term Active Archives

Program, NASA has followed an open data policy, with non-discriminatory access to data with no period of exclusive access. NASA has well-established processes for assigning and or accepting datasets into one of 12 Distributed Active Archive Centers (DAACs) that are parts of EOSDIS. EOSDIS has been evolving through several information technology cycles, adapting to hardware and software changes in the commercial sector. NASA is responsible for maintaining Earth science data as long as users are interested in using them for research and applications, which is well beyond the life of the data gathering missions. For science data to remain useful over long periods of time, steps must be taken to preserve: (1) Data bits with no corruption, (2) Discoverability and access, (3) Readability, (4) Understandability, (5) Usability' and (6). Reproducibility of results. NASAs Earth Science data and Information System (ESDIS) Project, along with the 12 EOSDIS Distributed Active Archive Centers (DAACs), has made significant progress in each of these areas over the last decade, and continues to evolve its active archive capabilities. Particular attention is being paid in recent years to ensure that the datasets are published in an easily accessible and citable manner through a unified metadata model, a common metadata repository (CMR), a coherent view through the earthdata.gov website, and assignment of Digital Object Identifiers (DOI) with well-designed landing product information pages.

Data Management↗
DOE OSTI2022

Binary classification with noisy quantum circuits and noisy quantum data

We study the effects of single-qubit noises in the quantum circuit and the corruption in the quantum training data to the performance of binary classification problem. We find that under the presence of errors, the measurement at a qubit is affected only by the noise in the corresponding qubit, and that the errors on other qubits do not affect this outcome. Furthermore, for the task where we fit a binary classifier using a quantum training data, we show that the noise in the data can work as a regularizer, implying that we can benefit from the noise in certain cases. We support our findings with simulations.

Lee, Yonghoon↗
NASA NTRS2010

Adaptive Data-based Predictive Control for Short Take-off and Landing (STOL) Aircraft

Data-based Predictive Control is an emerging control method that stems from Model Predictive Control (MPC). MPC computes current control action based on a prediction of the system output a number of time steps into the future and is generally derived from a known model of the system. Data-based predictive control has the advantage of deriving predictive models and controller gains from input-output data. Thus, a controller can be designed from the outputs of complex simulation code or a physical system where no explicit model exists. If the output data happens to be corrupted by periodic disturbances, the designed controller will also have the built-in ability to reject these disturbances without the need to know them. When data-based predictive control is implemented online, it becomes a version of adaptive control. The characteristics of adaptive data-based predictive control are particularly appropriate for the control of nonlinear and time-varying systems, such as Short Take-off and Landing (STOL) aircraft. STOL is a capability of interest to NASA because conceptual Cruise Efficient Short Take-off and Landing (CESTOL) transport aircraft offer the ability to reduce congestion in the terminal area by utilizing existing shorter runways at airports, as well as to lower community noise by flying steep approach and climb-out patterns that reduce the noise footprint of the aircraft. In this study, adaptive data-based predictive control is implemented as an integrated flight-propulsion controller for the outer-loop control of a CESTOL-type aircraft. Results show that the controller successfully tracks velocity while attempting to maintain a constant flight path angle, using longitudinal command, thrust and flap setting as the control inputs.

Barlow, Jonathan Spencer↗
NASA NTRS2010

Data-Based Predictive Control with Multirate Prediction Step

Data-based predictive control is an emerging control method that stems from Model Predictive Control (MPC). MPC computes current control action based on a prediction of the system output a number of time steps into the future and is generally derived from a known model of the system. Data-based predictive control has the advantage of deriving predictive models and controller gains from input-output data. Thus, a controller can be designed from the outputs of complex simulation code or a physical system where no explicit model exists. If the output data happens to be corrupted by periodic disturbances, the designed controller will also have the built-in ability to reject these disturbances without the need to know them. When data-based predictive control is implemented online, it becomes a version of adaptive control. One challenge of MPC is computational requirements increasing with prediction horizon length. This paper develops a closed-loop dynamic output feedback controller that minimizes a multi-step-ahead receding-horizon cost function with multirate prediction step. One result is a reduced influence of prediction horizon and the number of system outputs on the computational requirements of the controller. Another result is an emphasis on portions of the prediction window that are sampled more frequently. A third result is the ability to include more outputs in the feedback path than in the cost function.

Barlow, Jonathan S.↗
DOE OSTI2025

Investigating the Vulnerabilities of the Direct Transfer Trip Scheme for Network Protector Units in the Secondary Networks of Electric Power Distribution Grids

Network protector units (NPUs) are crucial parts of the protection of secondary networks to effectively isolate faults occurring on the primary feeders. When a fault occurs on the primary feeder, there is a path of the fault current going through the service transformers that causes a negative flow of current on the NPU connected to the faulted feeder. Conventionally, NPUs rely on the direction of current with respect to the voltage to detect faults and make a correct trip decision. However, the conventional NPU logic does not allow the reverse power flow caused by distributed energy resources installed on secondary networks. The communication-assisted direct transfer trip logic for NPUs can be used to address this challenge. However, the communication-assisted scheme is exposed to some vulnerabilities arising from the disruption or corruption of the communicated data that can endanger the reliable operation of NPUs. This paper evaluates the impact of the malfunction of the communication system on the operation of communication-assisted NPU logic. To this end, the impact of packet modification and denial-of-service cyberattacks on the communication-assisted scheme are evaluated. The evaluation was performed using a hardware-in-the-loop (HIL) co-simulation testbed that includes both real-time power system and communication network digital simulators. This paper evaluates the impact of the cyberattacks for different fault scenarios and provides a list of recommendations to improve the reliability of communication-assisted NPU protection.

direct transfer trip↗
NASA NTRS2000

Experimental Results of the Impact of an Ion Thruster Plasma on Microwave Propagation

Electric thrusters are being considered for a variety of space missions because of the significant propellant savings that result from the use of high performance, electric propulsion technologies, Propellant mass savings reduces spacecraft launch requirements and increases mission lifetime and payload. The impact of electric thruster plasma plumes on microwave signal propagation however is an important spacecraft integration concern. Arcjets were the first electric thrusters to be considered for operational missions. Ling, et al., studied the effect of arcjet plumes on propagation. Arcjets produce a lightly ionized plume and Ling's analysis predicted that the plume would have a negligible effect on communication. Plumes from the higher performance ion thrusters being developed exhibit higher ionization levels, plasma temperatures and particle velo@ities than arcjets. Therefore, there was a need to assess the impact due to these plumes. To address this need, the authors designed and performed a series of experiments to examine propagation effects of plumes. The challenge with these experiments was that they had to be performed in the operational environment of the thruster. Therefore, the experiments were conducted inside a metal chamber which could be depressurized to simulate a near vacuum condition of space. The metal chamber presents a potential large source of error to the propagation measurements due to the corruption of the desired data by multiple wall reflections within the chamber. This chamber effect was minimized by employing a pulsed-continuous wave transmitter and receiver system. This system, based on an HP8510 Network Analyzer, uses external hardware time gating to eliminate the clutter of the spurious reflections. Additionally, high gain antennas were used in the measurements to ensure that minimal amounts of energy ",ere transmitted/received in undesirable directions. The measurements took place in Vacuum Facility 5 of the Electric Propulsion Laboratory at the NASA Glenn Research Center. This facility utilizes a cylindrical, stainless steel, vacuum chamber, which is 18.3 m long and 4.6 m in diameter. For the tests being described here a 30 cm diameter, xenon ion thruster was used. The thruster provided between 500 W and 2.3 kW of operating power. The thruster was mounted on a stand along the axis of the chamber near one of its ends.

Zaman, Afroz J.↗
NASA NTRS2000

Experimental Results of the Impact of an Ion Thruster Plasma on Microwave Propagation

Electric thrusters are being considered for a variety of space missions because of the significant propellant savings that result from the use of high performance, electric propulsion technologies. Propellant mass savings reduces spacecraft launch requirements and increases mission lifetime and payload. The impact of electric thruster plasma plumes on microwave signal propagation however is an important spacecraft integration concern. Arcjets were the first electric thrusters to be considered for operational missions. Ling, et al. studied the effect of arcjet plumes on propagation. Arcjets produce a lightly ionized plume and Ling's analysis predicted that the plume would have a negligible effect on communication. Plumes from the higher performance ion thrusters being developed exhibit higher ionization levels, plasma temperatures and particle velocities than arcjets. Therefore, there was a need to assess the impact due to these plumes. To address this need, the authors designed and performed a series of experiments to examine propagation effects of plumes. The challenge with these experiments was that they had to be performed in the operational environment of the thruster. Therefore, the experiments were conducted inside a metal chamber which could be depressurized to simulate a near vacuum condition of space. The metal chamber presents a potential large source of error to the propagation measurements due to the corruption of the desired data by multiple wall reflections within the chamber. This chamber effect was minimized by employing a pulsed-continuous wave transmitter and receiver system. This system based on an HP8510 Network Analyzer, uses external hardware time gating to eliminate the clutter of the spurious reflections. Additionally, high gain antennas were used in the measurements to ensure that minimal amounts of energy were transmitted/received in undesirable directions. The measurements took place in Vacuum Facility 5 of the Electric Propulsion Laboratory at the NASA Glenn Research Center. This facility utilizes a cylindrical, stainless steel, vacuum chamber, which is 18.3 m long and 4.6 m in diameter. For the tests being described here a 30 cm diameter, xenon ion thruster was used. The thruster provided between 500 W and 2.3 kW of operating power. The thruster was mounted on a stand along the axis of the chamber near one of its ends and could be moved axially.

Zaman, Afroz J.↗
NASA NTRS2016

Development of RFI Mitigation Techniques with Digital Beamforming

Remote sensing radars with longer wavelengths penetrate deeper into the observed scene and are more suitable for the scientific observation of ice sheets or vegetation. Therefore, SAR systems are moving to lower frequencies like L- or P-band. However, as the frequency spectrum is a limited resource, this means that the occupied frequency band has to be shared with existing users. These users can have serious impact on the imaging quality. Radio frequency interference (RFI) that arrives at the antenna together with the SAR backscatter is causing a drop of the signal-to-noise ratio. Despite the high processing gain of the SAR signal, artifacts can appear in the image if the RFI is strong enough. This can lead to a corruption of the acquired data and make it unsuitable for scientific purposes. Hence, the investigation of methods for RFI mitigation is critical to the performance of radar missions and to ensure they meet their main task.

Digital Beamforming↗
DOE OSTI2023

Power System Event Detection Using the Energy Detector: A Performance Analysis

As the grid becomes smarter, the need to accurately detect, predict, and classify waveform phenomena is growing. When it comes to detecting high-frequency behaviors, i.e. transients, it is especially important to employ an event detection system that is able to accurately uncover these types of disturbances that would otherwise be lost with traditional hardware. In this paper, we first present the energy detector; a waveform event detection system that adaptively monitors a signal's energy and picks out high-frequency events that deviate from the nominal state. Secondly, we evaluate the performance of this detector against waveform data that have been corrupted by sensor irregularities. Using Oak Ridge National Laboratory's sensor testbed, we are able to show the results of the detector's performance against events that have been corrupted by three distinct sensor types, and examine how these results change with multiple trials. The results show excellent performance when detecting the beginning of an anomalous event with an average of less than 1% error.

Ekti, Ali Riza↗
DOE OSTI2024

Complete and Correct Transfer of Information (CACTI)

Many distributed systems, file transfer mechanisms, and message passing systems offer reliability mechanisms such as acknowledgements, retries, and durability. While these tools may be “good enough” for their typical use cases, they may not offer sufficient coverage for the wide range of faults that impact data transfers and communication. A gap in the reliability measures may lead to some small amount of data loss. Some high-consequence systems cannot tolerate the loss or corruption of even a single record. We present seven principles that will counter a wide range of faults and protect against data loss and corruption. These principles bring together lessons learned from a wide range of technologies and can inform appropriate system design and application usage. These principles will help readers reason on how prevent data loss in a multi-hop pipeline and how to properly use tools that may have a deficiency in reliability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Community Energy by Design: A Simulation-Based Design Workflow Using Measured Data Clustering to Calibrate Urban Building Energy Models (UBEMs)

This paper presents a workflow that informs urban design decisions using measured data clustering to calibrate urban building energy models. The method's goal is to support urban design in terms of form, building systems configurations, as well as influencing user behavior aspects in the built environment through a systemic analysis of measured data to develop reliable future-case design scenario energy models. Detailed data on appliance-level electricity use are employed via data clustering to calibrate a urban building energy model for the Mueller community in Austin, TX, USA. The data were collected by the Pecan Street Institute for a year in 2014 from consumers in Austin and other surrounding cities. First, collected energy data were restructured and cleaned from corrupt and/or missing information. Second, in order to identify common energy use patterns, a model-based clustering algorithm for functional data was applied. Behavioral/usage profiles are determined through clustering and translated into usage schedules and behaviors. As a result, an urban building energy model built in the urban modeling interface (umi) was calibrated, with fully calibrated and semi-calibrated buildings, within a maximum calibration error margin of 14% for daily-scale averages. Finally, an illustration of calibrated-urban building energy model design case scenarios is presented, and implications on community energy potential effects are discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Boosting the signal-to-noise of low-field MRI with deep learning image reconstruction

Recent years have seen a resurgence of interest in inexpensive low magnetic field (< 0.3 T) MRI systems mainly due to advances in magnet, coil and gradient set designs. Most of these advances have focused on improving hardware and signal acquisition strategies, and far less on the use of advanced image reconstruction methods to improve attainable image quality at low field. We describe here the use of our end-to-end deep neural network approach (AUTOMAP) to improve the image quality of highly noise-corrupted low-field MRI data. We compare the performance of this approach to two additional state-of-the-art denoising pipelines. We find that AUTOMAP improves image reconstruction of data acquired on two very different low-field MRI systems: human brain data acquired at 6.5 mT, and plant root data acquired at 47 mT, demonstrating SNR gains above Fourier reconstruction by factors of 1.5- to 4.5-fold, and 3-fold, respectively. In these applications, AUTOMAP outperformed two different contemporary image-based denoising algorithms, and suppressed noise-like spike artifacts in the reconstructed images. The impact of domain-specific training corpora on the reconstruction performance is discussed. The AUTOMAP approach to image reconstruction will enable significant image quality improvements at low-field, especially in highly noise-corrupted environments.

42 ENGINEERING↗