Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS1984

Extraction of topography from side-looking satellite systems A case study with SPOT simulation data

Techniques for reconstructing topographic data from side-looking satellite systems have been developed whereby nadir and off-nadir passes are coaligned to calculate the stereo displacement for each pixel in the nadir view by correlating a small subarea to a corresponding subarea in the off-nadir pass. The correlation algorithm was tested on two pairs of data sets consisting of patterns of bars and boxes and then applied to the SPOT simulation data set. The correlation was a maximum in areas where the relief was changing gradually, while in areas of constantly changing topography, the correlation decreased.

Ungar, S. G.↗
DOE OSTI2021

Dynamic Distribution of High-Rate Data Processing from CERN to Remote HPC Data Centers

The prompt reconstruction of the data recorded from the Large Hadron Collider (LHC) detectors has always been addressed by dedicated resources at the CERN Tier-0. Such workloads come in spikes due to the nature of the operation of the accelerator and in special high load occasions experiments have commissioned methods to distribute (spill-over) a fraction of the load to sites outside CERN. The present work demonstrates a new way of supporting the Tier-0 environment by provisioning resources elastically for such spilled-over workflows onto the Piz Daint Supercomputer at CSCS. Furthermore, this is implemented using containers, tuning the existing batch scheduler and reinforcing the scratch file system, while still using standard Grid middleware. ATLAS, CMS and CSCS have jointly run selected prompt data reconstruction on up to several thousand cores on Piz Daint into a shared environment, thereby probing the viability of the CSCS high performance computer site as on demand extension of the CERN Tier-0, which could play a role in addressing the future LHC computing challenges for the high luminosity LHC.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Methods and systems for obtaining reconstructed low-frequency seismic data for determining a subsurface feature

A computer-implemented method for obtaining reconstructed seismic data for determining a subsurface feature, includes: determining an initial training velocity model, training a machine learning model based on first training seismic data and second training seismic data generated from the training velocity model, the first training seismic data corresponding to one or more first frequencies, the second training seismic data corresponding to one or more second frequencies lower than the one or more first frequencies, obtaining, based on measured seismic data and the machine learning model, reconstructed seismic data corresponding to the one or more second frequencies, generating a velocity model based on the measured seismic data, the reconstructed seismic data, and a full waveform inversion (FWI), and when the generated velocity model does not satisfy a preset condition, updating the training velocity model based on the generated velocity model, to obtain updated reconstructed seismic data for determining a subsurface feature.

58 GEOSCIENCES↗
NASA NTRS2023

Reconstructing PM 2.5 Data Record for the Kathmandu Valley Using a Machine Learning Model

This paper presents a method for reconstructing the historical hourly concentrations of particulate matter 2.5 (PM2.5) over the Kathmandu Valley from 1980 to the present. The method uses a machine learning model that is trained using PM2.5 readings from US Embassy (Phora Durbar) as a ground truth, and the meteorological data from Modern-Era Retrospective Analysis for Research and Applications v2 (MERRA2) as input. The Extreme Gradient Boosting (XGBoost) model acquires a credible 10-fold cross-validation (CV) score of ~83.4%, an r2-score of ~84%, a Root Mean Square Error (RMSE) of ~15.82 µg/m3, and a Mean Absolute Error (MAE) of ~10.27 µg/m3. Further demonstrating the model's applicability to years other than those for which truth values are unavailable, the multiple cross-test with an unseen data set offered r2-scores for 2018, 2019, and 2020 ranging from 56% to 67%. The model-predicted data agrees with true values and indicates that MERRA2 underestimates PM2.5 over the region. It strongly agrees with ground-based evidence showing substantially higher mass concentrations in the dry pre- and post-monsoon seasons than in the monsoon months. It also shows a strong anti-correlation between PM2.5 concentration and humidity. The results also demonstrate that none of the years fulfilled the annual mean air quality index (AQI) standards set by the World Health Organization (WHO).

machine learning↗
DOE OSTI2021

On the numerical accuracy in finite-volume methods to accurately capture turbulence in compressible flows

The goal of the present article is to understand the impact of numerical schemes for the reconstruction of data at cell faces in finite-volume methods, and to assess their interaction with the quadrature rule used to compute the average over the cell volume. Here, third-, fifth- and seventh-order WENO-Z schemes are investigated. On a problem with a smooth solution, the theoretical order of convergence rate for each method is retrieved, and changing the order of the reconstruction at cell faces does not impact the results, whereas for a shock-driven problem all the methods collapse to first-order. Here, study of the decay of compressible homogeneous isotropic turbulence reveals that using a high-order quadrature rule to compute the average over a finite-volume cell does not improve the spectral accuracy and that all methods present a second-order convergence rate. However the choice of the numerical method to reconstruct data at cell faces is found to be critical to correctly capture turbulent spectra. In the context of simulations with finite-volume methods of practical flows encountered in engineering applications, it becomes apparent that an efficient strategy is to perform the average integration with a low-order quadrature rule on a fine mesh resolution, whereas high-order schemes should be used to reconstruct data at cell faces.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

FIRM: federated image reconstruction using multimodal tomographic data

Here, we propose a federated algorithm for reconstructing images using multimodal tomographic data sourced from dispersed locations, addressing the challenges of traditional unimodal approaches that are prone to noise and reduced image quality, as well as the limitations of centralized multimodal approaches that require extensive data transfer, leading to significant communication overhead, storage demands, and potential data privacy concerns. Our approach formulates a joint inverse optimization problem incorporating multimodality constraints and solves it in a federated framework through local gradient computations complemented by lightweight central operations, thereby ensuring data decentralization. Leveraging the connection between our federated algorithm and the quadratic penalty method, we introduce an adaptive step-size rule with guaranteed sublinear convergence. Numerical results demonstrate superior computational efficiency and improved image reconstruction quality compared to existing approaches.

federated algorithm↗
NASA NTRS1973

Linear filtering of ballistic-entry-probe data for atmospheric reconstruction.

A Kalman-Schmidt filter is used to estimate atmospheric and trajectory parameters for entry into the Venusian atmosphere. A significantly improved version of the Landing Trajectory Reconstruction (LTR) computer program, used to obtain the estimates is described. Major improvements involve precision and linearity control of numerical differencing, corrected perturbation modeling, and incorporation of a refractivity model. Important results show that gyroscopic data are not usable with LTR, that atmospheric properties are generally well estimated for altitudes less than 100 km, and that the two LTR modes of operation are complementary in performance.

Sabin, M. L.↗
DOE OSTI2025

Multi-channel, multi-template event reconstruction for SuperCDMS data using machine learning

SuperCDMS SNOLAB uses kilogram-scale germanium and silicon detectors to search for dark matter. Each detector has Transition Edge Sensors (TESs) patterned on the top and bottom faces of a large crystal substrate, with the TESs electrically grouped into six phonon readout channels per face. Noise correlations are expected among a detector's readout channels, in part because the channels and their readout electronics are located in close proximity to one another. Moreover, owing to the large size of the detectors, energy deposits can produce vastly different phonon propagation patterns depending on their location in the substrate, resulting in a strong position dependence in the readout-channel pulse shapes. Both of these effects can degrade the energy resolution and consequently diminish the dark matter search sensitivity of the experiment if not accounted for properly. We present a new algorithm for pulse reconstruction, mathematically formulated to take into account correlated noise and pulse shape variations. This new algorithm fits N readout channels with a superposition of M pulse templates simultaneously - hence termed the N$\times$M filter. We describe a method to derive the pulse templates using principal component analysis (PCA) and to extract energy and position information using a gradient boosted decision tree (GBDT). We show that these new N$\times$M and GBDT analysis tools can reduce the impact from correlated noise sources while improving the reconstructed energy resolution for simulated mono-energetic events by more than a factor of three and for the 71Ge K-shell electron-capture peak recoils measured in a previous version of SuperCDMS called CDMSlite to $<$ 50 eV from the previously published value of $\sim$100 eV. These results lay the groundwork for position reconstruction in SuperCDMS with the N$\times$M outputs.

Albakry, M. F. [British Columbia U.; TRIUMF]↗
NASA NTRS1993

Methods of evaluating the effects of coding on SAR data

It is recognized that mean square error (MSE) is not a sufficient criterion for determining the acceptability of an image reconstructed from data that has been compressed and decompressed using an encoding algorithm. In the case of Synthetic Aperture Radar (SAR) data, it is also deemed to be insufficient to display the reconstructed image (and perhaps error image) alongside the original and make a (subjective) judgment as to the quality of the reconstructed data. In this paper we suggest a number of additional evaluation criteria which we feel should be included as evaluation metrics in SAR data encoding experiments. These criteria have been specifically chosen to provide a means of ensuring that the important information in the SAR data is preserved. The paper also presents the results of an investigation into the effects of coding on SAR data fidelity when the coding is applied in (1) the signal data domain, and (2) the image domain. An analysis of the results highlights the shortcomings of the MSE criterion, and shows which of the suggested additional criterion have been found to be most important.

Dutkiewicz, Melanie↗
DOE OSTI2020

Considerations for three-dimensional image reconstruction from experimental data in coherent diffractive imaging

The Datasets folder contains 3 datasets, corresponding to the datasets mentioned in the article with 670, 2691 and 586 images. The Runs folder has all the runs used. Besides the images itself it also contains tags for each image under `/entry_1/image_1/detector_and_photon_corrected/tags`. The `headings` attribute gives the name of each tag. The `Jonas Strict` tag corresponds to the 670 images, the `Redflamingo` tag to the 2691 images and the `Redflamingo_Ida_subset` tag to the 586 images. The final dataset with 260 images can be obtained from `Datasets/amoc6914-Redflamingo-manual-586.h5` and use the `/model/diameterNM` group to select the 260 images with size closest to 214 nm.

AMO↗
NASA NTRS1989

Space Shuttle propulsion performance reconstruction from flight data

The aplication of extended Kalman filtering to estimating Space Shuttle Solid Rocket Booster (SRB) performance, specific impulse, from flight data in a post-flight processing computer program. The flight data used includes inertial platform acceleration, SRB head pressure, and ground based radar tracking data. The key feature in this application is the model used for the SRBs, which represents a reference quasi-static internal ballistics model normalized to the propellant burn depth. Dynamic states of mass overboard and propellant burn depth are included in the filter model to account for real-time deviations from the reference model used. Aerodynamic, plume, wind and main engine uncertainties are included.

Rogers, Robert M.↗
NASA NTRSDate not supplied

A Machine Learning Model for Solar Sail Shape Reconstruction Using Flight Data

Solar sail deformation leads to disturbance torques from solar radiation pressure, driving performance requirements for momentum management systems. For the Solar Cruiser technology demonstrator mission, we have developed a model leveraging neural network-based machine learning to derive sail shape characteristics. The model uses torque and attitude telemetry simulated from a reduced-order tensor model of the deformed sail mesh over a characterization sequence. The machine learning model predicts sail boom deflection with comparable accuracy to that of an onboard context camera. This model can discover sail shape with no additional mass or data downlink requirements, allowing for validation of sail force modeling assumptions using in flight data. The results from the project hold promise for the further implementation of machine learning techniques in solar sail telemetry analysis and control.

solar sail↗
NASA NTRSDate not supplied

A Machine Learning Model for Solar Sail Shape Reconstruction Using Flight Data

Solar sail deformation leads to disturbance torques from solar radiation pressure, driving performance requirements for momentum management systems. For the Solar Cruiser technology demonstrator mission, we have developed a model leveraging neural network-based machine learning to derive sail shape characteristics. The model uses torque and attitude telemetry simulated from a reduced-order tensor model of the deformed sail mesh over a characterization sequence. The machine learning model predicts sail boom deflection with comparable accuracy to that of an onboard context camera. This model can discover sail shape with no additional mass or data downlink requirements, allowing for validation of sail force modeling assumptions using in flight data. The results from the project hold promise for the further implementation of machine learning techniques in solar sail telemetry analysis and control.

solar sail↗
DOE OSTI2022

A data science approach for analysis and reconstruction of spinodal-like composition fields in irradiated FeCrAl alloys

A statistical method for the analysis of continuously distributed data representative of composition fluctuations in irradiated FeCrAl alloys acquired using Energy Dispersive X-ray Spectroscopy (EDS) method is presented. Using probability distribution functions, direct and cross-covariances between the elemental compositions, the effects of alloy composition and irradiation dose were investigated on the spatial distribution and length scale of composition fluctuations at the nanoscale. We have observed that, for neutron-irradiated FeCrAl alloys, the distribution of Fe and Cr followed a left-skewed and right-skewed distribution, respectively for all (average) alloy compositions and irradiation doses. The analysis also revealed enhanced spatial gradients in the elemental compositions at higher irradiation dose. Direct and cross-covariance estimates of the experimental data were also utilized for reconstruction of composition data through fitting it to a parametric form of the covariance functions. Linear Model of Coregionalization was used to determine the parameters of the covariance functions. Subsequently, a spectral method was utilized for simulating a realization of the alloy compositions. Close correspondence was observed between the experimental and the reconstructed data which was analyzed using probability distribution functions and covariance functions. Composition space of the experimental and reconstructed data and dislocation velocities as a function of applied stress and line directions over the entire composition maps were also examined.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Open Source Visualization and Analysis Platform for 3D Reconstructions of Materials by Transmission Electron Microscopy

Three-dimensional characterization of materials at the nano- and meso-scale has become possible with transmission and scanning transmission electron microscopes (S/TEM). Its importance has extended to a wide class of nanomaterials such as hydrogen fuel cells, solar cells, industrial catalysts, new battery materials and semiconductor devices, as well as spanning high-tech industry, universities, and national labs. While capable instrumentation is abundant, this rapidly expanding demand for high-resolution tomography is bottlenecked by software that is instead tailored for lower-dose, biological applications and not optimized for higher-resolution materials applications. Existing tomography fails to utilize the chemical information provided by S/TEM spectrometers. To address this problem, this project delivered a scalable, fully functional, freely-distributable, open Source materials tomography package with a modern user interface that enables automated acquisition, alignment, and real-time reconstruction of raw tomography data, and provides advanced segmentation, three-dimensional chemical visualization and analysis optimized for materials applications. It has established an extendable framework capable of automation for high-throughput for the tomography of materials from data acquisition to visualization. Phase I and II delivered a full-featured, cross-platform, clean and integrated application for S/TEM materials tomography. It can read projection data from the microscope, with graphical tools for alignment of data, tomographic reconstruction, segmentation, and visualization of the reconstructed 3D volume. The entire pipeline can be saved to an XML state file, enabling fully reproducible data processing and analysis with a full Python environment for the development of custom algorithms, processing, and analysis requirements. Phase IIB extended the application to provide real-time tomographic reconstruction, "live updates" as data is processed, analysis of big data, and multi-channel tomography. Here, quantitative assessment of nanomaterials can occur as data is being recorded on a 3D visualization platform that accommodates additional information from multiple channels. We provide unmatched high-throughput tomography, where the complete tomographic pipeline from measurement to 3D visualization can occur rapidly. The project was extended to offer capabilities for micro-CT, X-ray, neutron, focused ion beam, atomic electron tomography and atom probe tomography. With over 600 transmission electron microscopes worldwide and approximately 50 coming online each year, the demand and impact of an open-source tomography tool is large. Significant opportunities exist in high-tech industry, universities, and national labs to enable or enhance three-dimensional imaging at the nanoscale and bring automated high-throughput approaches that will accelerate progress in materials characterization and metrology. The project supports a service based business model by enabling lab-specific acquisition and processing customization and integration-support and development that will be provided into Phase III and beyond.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Divergent urbanization-induced impacts on global surface urban heat island trends since 1980s

Urbanization experiences different speeds and forms under diverse development stages across the globe. However, urbanization-induced impacts on long-term surface urban heat island intensity (I s ) trends across global cities and the regulators of such impacts remain understudied. Here we estimate interannual trends in daytime I s (i.e., urban-rural differences in surface temperatures) across 511 major cities for 1985 –2020 using annual averages calculated by using reconstructed land surface temperature data derived from more than >250,000 Landsat thermal images. Our study reveals that the global mean I s growth rate is 0.156 °C/decade. We further examine I s change associated with per 1% impervious land growth (denoted as ß) in each city throughout the research period and during different periods. The global mean ß is 0.018 ± 0.025 °C/% (mean ± 1 standard deviation) for the whole period, with greater values in humid than in arid climates; and the ß may change during different periods, e.g., it has more than tripled when urban impervious land exceeds 30%, indicating the spatiotemporally divergent impacts of urbanization on Is trends across global cities. The spatial variations in ß across global cities are well correlated with rural vegetation abundance and precipitation but not with urban population. Among these three factors, rural vegetation abundance possesses the greatest standardized regression coefficient of partial least-squares model, signifying the critical role of biome background in regulating ß. Furthermore, the finding implies that future urbanization over densely vegetated regions should be more carefully and strategically planned due to the greater urbanization-induced surface warming effect.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2014

Revisiting AVHRR Tropospheric Aerosol Trends Using Principal Component Analysis

The advanced very high resolution radiometer (AVHRR) satellite instruments provide a nearly 25 year continuous record of global aerosol properties over the ocean. It offers valuable insights into the long-term change in global aerosol loading. However, the AVHRR data record is heavily influenced by two volcanic eruptions, El Chichon on March 1982 and Mount Pinatubo on June 1991. The gradual decay of volcanic aerosols may last years after the eruption, which potentially masks the estimation of aerosol trends in the lower troposphere, especially those of anthropogenic origin. In this study, we show that a principal component analysis approach effectively captures the bulk of the spatial and temporal variability of volcanic aerosols into a single mode. The spatial pattern and time series of this mode provide a good match to the global distribution and decay of volcanic aerosols. We further reconstruct the data set by removing the volcanic aerosol component and reestimate the global and regional aerosol trends. Globally, the reconstructed data set reveals an increase of aerosol optical depth from 1985 to 1990 and decreasing trend from 1994 to 2006. Regionally, in the 1980s, positive trends are observed over the North Atlantic and North Arabian Sea, while negative tendencies are present off the West African coast and North Pacific. During the 1994 to 2006 period, the Gulf of Mexico, North Atlantic close to Europe, and North Africa exhibit negative trends, while the coastal regions of East and South Asia, the Sahel region, and South America show positive trends.

volcanoes↗