Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data migration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1987

High-speed inlet research program and supporting analyses

A Mach 5 cruise aircraft was studied in a joint program effort. The propulsion system chosen for this aircraft was an over-under turbojet/ramjet system. The ramjet portion of the inlet is to be tested in NASA Lewis' 10 x 10 SWT. Goals of the test program are to obtain performance data and bleed requirements, and also to obtain analysis code validation data. Supporting analysis of the inlet using a three-dimensional Navier-Stokes code (PEPSIS) indicates that sidewall shock/boundary layer interactions cause large separated regions in the corners underneath the cowl. Such separations generally lead to inlet unstart, and are thus a major concern. As a result of the analysis, additional bleed regions were added to the inlet model sidewalls and cowl to control separations in the corners. A two-dimensional analysis incorporating bleed on the ramp is also presented. Supporting experiments for the Mach 5 programs were conducted in the Lewis' 1 x 1 SWT. A small-scale model representing the inlet geometry up to the ramp shoulder and cowl lip was tested to verify the accelerator plate test technique and to obtain data on flow migration in the ramp and sidewall boundary layers. Another study explored several ramp bleed configurations to control boundary layer separations in that region. Design of a two-dimensional Mach 5 cruise inlet represents several major challenges including multimode operation and dual flow, high temperatures, and three-dimensional airflow effects.

Coltrin, Robert E.↗
NASA NTRSDate not supplied

NASA’s Global Imagery Browse Services and Worldview Migrate to Mapbox Vector Tiles: The Drawbacks and Advantages

NASA’s Global Imagery Browse Services (GIBS) is in the process of migrating their vector data from raster tiles to Mapbox Vector Tiles (MVTs). MVTs are becoming ubiquitous in the world of web mapping. Serving data in place of pixels for each feature presents numerous new visualization opportunities as well as various new challenges to overcome. This presentation will cover some of the hardships these teams encountered, the techniques used to overcome those barriers, and it will give you a glimpse at how the user experience was enhanced.

Benjamin King↗
NASA NTRS2018

Earthdata Cloud Analytics Project

This presentation describes a nascent project in NASA to develop a framework to support end-user analytics of NASA's Earth science data in the cloud. The chief benefit of migrating EOSDIS (Earth Observation System Data and Information Systems) data to the cloud is to position the data next to enormous computing capacity to allow end users to process data at scale. The Earthdata Cloud Analytics project will user a service-based approach to facilitate the infusion of evolving analytics technology and the integration with non-NASA analytics or other complementary functionality at other agencies and in other nations.

data services↗
NASA NTRS2018

Generalizing a Data Analysis Pipeline in the Cloud to Handle Diverse Use Cases in NASA's EOSDIS

NASA's Earth Observing System Data and Information System (EOSDIS) is tasked with archiving and distributing Earth Observation data across a range of disciplines, including atmospheric science, oceanography, land processes, natural hazards, solar radiance and even socioeconomic aspects relating to the environment. Driven by rapidly rising data volumes, EOSDIS is migrating to a cloud computing based archive over the next few years. Although this simplifies data management somewhat, the main aim is to provide the data in an environment where end users can bring their analysis to the data rather than attempting to download and manage ever-increasing volumes. To that end, a cloud-based analysis platform is being constructed to enable data transformations, analyses and visualization without egressing the data from the cloud. In this endeavor, we expect a wide variety of users, algorithms and use cases. Consequently, the architecture of this cloud analytics platform is expressly designed to be based on open services, thus fostering an ecosystem that enables the efficient combination of common components with data-specific or analysis-specific components. Reviewed and approved by Andrew Mitchell, ESDIS project manager.

Cloud computing↗
NASA NTRSDate not supplied

Pyroscopegridding: Geo-Leo Aerosol Data Fusion (an Open-Source Package)

The retrieval of aerosol optical depths (AODs) from sun-synchronous polar orbiting satellites, such as MODISs, VIIRSs, OMI, TROPOMI, etc., has been widely adopted as a method for obtaining information regarding particulate matter (PM) and related atmospheric processes. However, the advent of recently launched geostationary satellites, such as GOES-16/17/18, Himawari-8/9, and Meteosat Third Generation (MTG), has led to an increased temporal resolution of AOD observations (order of 10 minutes), resulting in typically one or more images per hour during daylight hours, compared to the once-per-day observations obtained from LEO satellites. By integrating these observations, the diurnal cycle of global AOD can be characterized at local, regional, and global scales. The scientific community is still examining the novel data from geostationary satellite observations and evaluating methods for effectively merging these observations with differing spatial and temporal resolutions. This presents a significant ""Big Data"" challenge, encompassing not only data storage, but also data discoverability, accessibility, and migration within cloud computing environments. This study presents our attempts at fusing Level 2 aerosol data from six satellites, three of which are geostationary (GOES-16/17 and Himawari-8) and three of which are polar orbiting (TERRA/MODIS, AQUA/MODIS, and SNPP-VIIRS), using the Dark Target aerosol retrieval algorithm. The ability to fuse remote sensing products on demand into desired temporal and spatial domains empowers researchers and practitioners to more efficiently work with satellite and sensor data. It is our hope that through making our open-source package and accompanying functionality available, the scientific community will have improved access to aerosol data processing resources.

Jennifer Wei↗
NASA NTRS1984

A SAR correlation algorithm which accommodates large-range migration

This paper presents an algorithm for azimuth correlation of synthetic aperture radar (SAR) data with extraordinarily large-range migration which cannot be accommodated by the existing frequency domain interpolation approach used in current Seasat SAR processing. A mathematical model is provided for the SAR range-correlated point-target response both in the spatial and frequency domains. A simple and efficient processing algorithm derived from the exact two-dimensional correlation algorithm is given. This algorithm enables azimuth correlation by two cascaded one-dimensional correlation steps. The first step is to transform the range-correlated SAR data into the frequency domain in azimuth, followed by a newly developed range convolution filter to correct the range-dispersed spectrum of the range-correlated point-target response (RCPTR). The second step is the frequency-domain range migration correction approach for the azimuth compression. Simulation results provided here indicate that this processing algorithm yields a satisfactory compressed impulse response for SAR data with large-range migration whereas previous methods were subject to a broadening of the impulse response along range.

Jin, M. Y.↗
NASA NTRS1993

Data management in NOAA

The NOAA archives contain 150 terabytes of data in digital form, most of which are the high volume GOES satellite image data. There are 630 data bases containing 2,350 environmental variables. There are 375 million film records and 90 million paper records in addition to the digital data base. The current data accession rate is 10 percent per year and the number of users are increasing at a 10 percent annual rate. NOAA publishes 5,000 publications and distributes over one million copies to almost 41,000 paying customers. Each year, over six million records are key entered from manuscript documents and about 13,000 computer tapes and 40,000 satellite hardcopy images are entered into the archive. Early digital data were stored on punched cards and open reel computer tapes. In the late seventies, an advanced helical scan technology (AMPEX TBM) was implemented. Now, punched cards have disappeared, the TBM system was abandoned, most data stored on open reel tapes have been migrated to 3480 cartridges, many specialized data sets were distributed on CD ROM's, special archives are being copied to 12 inch optical WORM disks, 5 1/4 inch magneto-optical disks were employed for workstation applications, and 8 mm EXABYTE tapes are planned for major data collection programs. The rapid expansion of new data sets, some of which constitute large volumes of data, coupled with the need for vastly improved access mechanisms, portability, and improved longevity are factors which will influence NOAA's future systems approaches for data management.

Callicott, William M.↗
NASA NTRS2011

Telemetry and Science Data Software System

The Telemetry and Science Data Software System (TSDSS) was designed to validate the operational health of a spacecraft, ease test verification, assist in debugging system anomalies, and provide trending data and advanced science analysis. In doing so, the system parses, processes, and organizes raw data from the Aquarius instrument both on the ground and while in space. In addition, it provides a user-friendly telemetry viewer, and an instant pushbutton test report generator. Existing ground data systems can parse and provide simple data processing, but have limitations in advanced science analysis and instant report generation. The TSDSS functions as an offline data analysis system during I&T (integration and test) and mission operations phases. After raw data are downloaded from an instrument, TSDSS ingests the data files, parses, converts telemetry to engineering units, and applies advanced algorithms to produce science level 0, 1, and 2 data products. Meanwhile, it automatically schedules upload of the raw data to a remote server and archives all intermediate and final values in a MySQL database in time order. All data saved in the system can be straightforwardly retrieved, exported, and migrated. Using TSDSS s interactive data visualization tool, a user can conveniently choose any combination and mathematical computation of interesting telemetry points from a large range of time periods (life cycle of mission ground data and mission operations testing), and display a graphical and statistical view of the data. With this graphical user interface (GUI), the data queried graphs can be exported and saved in multiple formats. This GUI is especially useful in trending data analysis, debugging anomalies, and advanced data analysis. At the request of the user, mission-specific instrument performance assessment reports can be generated with a simple click of a button on the GUI. From instrument level to observatory level, the TSDSS has been operating supporting functional and performance tests and refining system calibration algorithms and coefficients, in sync with the Aquarius/SAC-D spacecraft. At the time of this reporting, it was prepared and set up to perform anomaly investigation for mission operations preceding the Aquarius/SAC-D spacecraft launch on June 10, 2011.

Bates, Lakesha↗
NASA NTRSDate not supplied

Breaking Barriers: Integrating Geo-Leo Aerosol Data with an Open-Source Approach

The scientific community is still examining the novel data from geostationary satellite observations and evaluating methods for effectively fusing the polar observations with various spatial and temporal resolutions. However, the merged data will present a significant ""Big Data"" challenge, including processing, storage, data discoverability, accessibility, and migration within cloud computing environments. We have developed an open-source package to fuse aerosol optical depths (AOD) products from six satellite sensors in the past four years (2019~2023), and this presentation will update our recent progress. Using this Python-based package, we produced a level 3 global (AOD) product in a quarter-degree spatial resolution every half-hour, fusing the Level 2 AOD data with the Dark Target aerosol retrieval algorithm from six satellites: three geostationary (GOES-16/17 and Himawari-8) with high temporal resolution, and three polar orbiting (TERRA/MODIS, AQUA/MODIS, and SNPP-VIIRS) with global coverage. By integrating these observations, the diurnal cycle of global AOD in this fused product can be characterized at local, regional, and global scales. Furthermore, we are committed to openness and transparency by providing our package and its associated functionalities as open-source. Our dedication to adhering to the FAIR, CARE, and TRUST principles ensures that our users can rely on the integrity and ethical standards of our work. For instance of Interoperability, this package fuses remote sensing products on demand into desired temporal and spatial domains. It can be run in a central processing unit (CPU) or a Graphics processing unit (GPU) mode. This package will empower researchers and practitioners to use satellite and sensor data efficiently in various applications and research.

Xiaohua Pan↗
NASA NTRS2011

Determining the Completeness of the Nimbus Meteorological Data Archive

NASA launched the Nimbus series of meteorological satellites in the 1960s and 70s. These satellites carried instruments for making observations of the Earth in the visible, infrared, ultraviolet, and microwave wavelengths. The original data archive consisted of a combination of digital data written to 7-track computer tapes and on various film media. Many of these data sets are now being migrated from the old media to the GES DISC modern online archive. The process involves recovering the digital data files from tape as well as scanning images of the data from film strips. Some of the challenges of archiving the Nimbus data include the lack of any metadata from these old data sets. Metadata standards and self-describing data files did not exist at that time, and files were written on now obsolete hardware systems and outdated file formats. This requires creating metadata by reading the contents of the old data files. Some digital data files were corrupted over time, or were possibly improperly copied at the time of creation. Thus there are data gaps in the collections. The film strips were stored in boxes and are now being scanned as JPEG-2000 images. The only information describing these images is what was written on them when they were originally created, and sometimes this information is incomplete or missing. We have the ability to cross-reference the scanned images against the digital data files to determine which of these best represents the data set from the various missions, or to see how complete the data sets are. In this presentation we compared data files and scanned images from the Nimbus-2 High-Resolution Infrared Radiometer (HRIR) for September 1966 to determine whether the data and images are properly archived with correct metadata.

Johnson, James↗
NASA NTRS2016

An Enriched Shell Finite Element for Progressive Damage Simulation in Composite Laminates

A formulation is presented for an enriched shell nite element capable of progressive damage simulation in composite laminates. The element uses a discrete adaptive splitting approach for damage representation that allows for a straightforward model creation procedure based on an initially low delity mesh. The enriched element is veri ed for Mode I, Mode II, and mixed Mode I/II delamination simulation using numerical benchmark data. Experimental validation is performed using test data from a delamination-migration experiment. Good correlation was found between the enriched shell element model results and the numerical and experimental data sets. The work presented in this paper is meant to serve as a rst milestone in the enriched element's development with an ultimate goal of simulating three-dimensional progressive damage processes in multidirectional laminates.

McElroy, Mark W.↗
DOE OSTI2025

Recent Collaborations and Innovations to Demonstrate Next-Generation Techniques for Monitoring Subsurface Carbon Storage

World Carbon Capture, Utilization, and Storage (CCUS) Conference, Bergen, Norway, September 1–4, 2025. This talk provides a high-level overview of many novel and sustainable carbon storage-monitoring methods to accelerate the deployment of CCUS technologies at future CCUS sites across the United States. The Energy & Environmental Research Center’s work impacts the general CCUS industry by providing novel low-impact methods for tracking the injected plume’s migration and more autonomous data collection and processing techniques for performing assurance monitoring. Specifically, the results benefit 1) CCUS community members through knowledge sharing of lessons learned; 2) CCUS operators through commercialization of additional methods, including improvements to workflows and simplification of fieldwork; and 3) CCUS project stakeholders through implementation of low-impact and more autonomous monitoring solutions.

02 PETROLEUM↗
DOE OSTI2026

IER-620 CED-3b: Experiment Execution Summary for the Pulsed-Neutron Die-Away Experiments (PNDA) with Propylene Glycol and Mobilmet 423

There is a strong need for new benchmarks to validate neutron thermal scattering laws (TSLs). Lawrence Livermore National Laboratory (LLNL) has designed a Pulsed-Neutron Die Away (PNDA) testbed for this purpose. The experiment has a deuterium-tritium (D-T) neutron generator that impinges a 10 -4 s, mono-energetic pulse of 14.1 MeV neutrons on a target sample. After the pulse, the neutron population moderates and establishes a thermal equilibrium within the sample, with a fundamental spatial mode and characteristic decay-time eigenvalue, ⍺. The ⍺ eigenvalue can be extracted from the experimental measurements of the time-dependent neutron flux coming off the surface of the sample and can then be used as an integral parameter (similar to k eff ) to validate nuclear data involved with neutron migration, thermalization, and absorption. For moderating materials and geometric configurations, the ⍺ eigenvalue is heavily dependent on thermal neutron scattering of the target material. For that reason, a PNDA experiment can have a higher sensitivity to TSLs than is commonly available with the k eff parameter in critical experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1974

Evaluate ERTS imagery for mapping and detection of changes of snowcover on land and on glaciers

The author has identified the following significant results. The area of snowcover on 10 individual drainage basins in the North Cascades, Washington, has been determined by use of a semi-automatic radiance threshold technique. The result is a unique record of the changing water storage as snow in these important hydrologic units, the runoff of which is utilized for hydroelectric power, dilution of wastes and heat, support of salmon migration, and irrigation. These data allow a new type of hydrologic modelling to proceed which should permit more accurate forecasts of streamflow. A new technique has been developed for measuring snow-covered area or snowline altitude semi-automatically. This variable contour overlay method permits the snowcover to be matched efficiently to the best fit contour of altitude. The motion of the Yentna Glacier during the concluding phase of its surge was successfully measured by a flicker technique using images of two dates. It appears that displacements as small as 100 to 200 m can be measured. Motion of the Tweedsmuir Glacier in Alaska was measured using ERTS-1 images enlarged to 1:50,000. Changes detected included a shock wave moving down the glacier, the margin expanding, the moraine pattern deforming, and the marginal valley deepening.

Meier, M. F.↗
NASA NTRS2002

Reducing the Requirements and Cost of Astronomical Telescopes

Limits on astronomical telescope apertures are being rapidly approached. These limits result from logistics, increasing complexity, and finally budgetary constraints. In an historical perspective, great strides have been made in the area of aperture, adaptive optics, wavefront sensors, detectors, stellar interferometers and image reconstruction. What will be the next advances? Emerging data analysis techniques based on communication theory holds the promise of yielding more information from observational data based on significant computer post-processing. This paper explores some of the current telescope limitations and ponders the possibilities increasing the yield of scientific data based on the migration computer post-processing techniques to higher dimensions. Some of these processes hold the promise of reducing the requirements on the basic telescope hardware making the next generation of instruments more affordable.

Smith, W. Scott↗
NASA NTRS2023

Top‐Down Regulation by a Reindeer Herding System Limits Climate‐Driven Arctic Vegetation Change at a Regional Scale

Warming-driven growth of tall woody vegetation in the Arctic has the potential to accelerate climate change through multiple positive feedbacks. Local-scale evidence suggests that large herbivores limit this vegetation shift, but there is uncertainty at larger, regional scales whether current herbivory pressure is a major top-down control on ecosystem structure and functioning. Across a 67,000 km2 region of the Yamal Peninsula in West Siberia, we integrated satellite remote sensing with a novel data set mapping the migrations of herds comprising 151,000 domesticated reindeer. Where reindeer numbers varied over space, higher reindeer herbivory pressure was consistently linked with lower coverage of tall woody vegetation. Within areas dominated by this vegetation type, productivity and climate were increasingly decoupled where reindeer density was higher. Our spaceborne fingerprint detection suggests that large herbivores, at current population densities, counteract Arctic vegetation responses to climate change over large spatial scales.

Reindeer Herding System↗