Search NASA⌕ Search

SEARCH · Search NASA

Results for “archival processes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Fireballs in the Sky: An Augmented Reality Citizen Science Program

Fireballs in the Sky is an innovative Australian citizen science program that connects the public with the research of the Desert Fireball Network (DFN). This research aims to understand the early workings of the solar system, and Fireballs in the Sky invites people around the world to learn about this science, contributing fireball sightings via a user-friendly augmented reality mobile app. Tens of thousands of people have downloaded the app world-wide and participated in the science of meteoritics. The Fireballs in the Sky app allows users to get involved with the Desert Fireball Network research, supplementing DFN observations and providing enhanced coverage by reporting their own meteor sightings to DFN scientists. Fireballs in the Sky reports are used to track the trajectories of meteors - from their orbit in space to where they might have landed on Earth. Led by Phil Bland at Curtin University in Australia, the Desert Fireball Network (DFN) uses automated observatories across Australia to triangulate trajectories of meteorites entering the atmosphere, determine pre-entry orbits, and pinpoint their fall positions. Each observatory is an autonomous intelligent imaging system, taking 1000 by 36 megapixel all-sky images throughout the night, using neural network algorithms to recognize events. They are capable of operating for 12 months in a harsh environment, and store all imagery collected. We developed a completely automated software pipeline for data reduction, and built a supercomputer database for storage, allowing us to process our entire archive. The DFN currently stands at 50 stations distributed across the Australian continent, covering an area of 2.5 million square kilometers. Working with DFN's partners at NASA's Solar System Exploration Research Virtual Institute, the team is expanding the network beyond Australia to locations around the world. Fireballs in the Sky allows a growing public base to learn about and participate in this exciting research.

Day, Brian↗

The ICESat-2 Mission: Land, Ocean, and Inland Water Data Products for Middle and Low Latitude Science and Applications

NASA’s Ice, Cloud, and Land Elevation Satellite (ICESat-2) is a polar orbiting mission, launched on September 15, 2018, with over two years of nearly continuous observations. The sole instrument onboard is the Advanced Topographic Laser Altimeter System (ATLAS), a micropulse, high repetition rate, six-beam, 532 nm Lidar with photon-counting technology. Although designed primarily for detecting height changes in ice caps and sea ice in the high latitudes, it continuously observes all terrain in its track including middle and low latitude regions as well, during approximately 15 orbits per day. The official ICESat-2 products include not only cryosphere data but also global high resolution parameters associated with tree canopies, land surface, oceans, and over 1.5 million inland water bodies consisting of lakes, rivers and coastal waters. This presentation provides an overview and the status of the ICESat-2 mission including: i) a summary of the salient technological features and orbit design, ii) the official ICESat-2 science data products for ice, vegetation canopy, ocean sea level, and inland water including several examples in the middle and low latitudes, iii) a list of NASA sponsored software tools for globally browsing the two year archive and for processing both the raw data and the official ICESat-2 geophysical data products, and iv) avenues for interested users to connect with the ICESat-2 Applications Program for answering questions and assistance in possibly using ICESat-2 data in your particular science or application. The overall goal is to facilitate the use of ICESat-2 data not only for science investigations but also for improved decision support applications with societal benefit. Additional ICESat-2 information, documentation and data products are publicly available at https://nsidc.org/data/icesat-2

ICESat-2↗

Maximizing Earth Science Observations with Data Harmonization: Harmonized Landsat/Sentinel-2

In August 2021, NASA released science quality harmonized Landsat/Sentinel-2 products for both cloud-based access and direct download from the Land Processes Distributed Active Archive Center (LP DAAC). These 30-meter products, HLSS30 (Sentinel-2 component) and HLSL30 (Landsat component) are placed on the same grid and are generated and distributed fully in the cloud. Similarly, ESA is prototyping harmonized Landsat Sentinel-2 products at 10-meter resolution. The data production and science teams from NASA and ESA will present technical details on the data production system, data product status and availability, and the benefit of harmonizing instruments with similar sensing characteristics between the agencies.

Earth Science↗

NASA Life Sciences Portal (NLSP): Supporting Scientific Transparency and Reproducibility

NASA’s Life Sciences Ports (NLSP) serves the scientific community by providing curated data from space life science experiment. The Human Research Program (HRP) with the help of NLSP is currently transforming their life sciences data archive systems and processes to improve compliance with the FAIR principles [1]. Some of these improvements will at the same time support the twin pillars of Open Science [2]: transparency of methods and reproducibility of results. Scientific transparency is marked by the easily intelligible communication of what has been investigated: what were the procedures for collecting sample and the characteristics of samples collected? what kinds of measurements were made, what were the environmental conditions of the measurements? What were the analysis techniques of the collected data? Reproducibility of the results and findings from the investigation requires a high level of transparency for all but the simplest investigations; the slightest deviation in communicating and replicating complex experimental procedures or data analyses can often yield quite different data and even findings, thwarting their validation. One of the ways the NLSP is aiming to improve the communication of scientific information is through the use of ontology-driven metadata. Ontologies are powerful, graph-based knowledge representation structures, which can be leveraged to increase data interoperability, the area of the FAIR principles in which many data systems most lack compliance. Over the past decade, there has been a concerted effort in the biomedical community to develop modular and narrowly focused domain and application-specific ontologies in a common, open-source framework, the Open Biological and Biomedical Ontology (OBO) Foundry [3]. The open sharing and modular nature of this effort promises huge increases in harmonized data sharing for systems that leverage these models. Which is in line with the FAIR Data Principles of Findability, Accessibility, Interoperability, and Reuse for scientific data management and stewardship. 1. Wilkinson, M.D., et al., The FAIR Guiding Principles for scientific data management and stewardship. Sci Data, 2016. 3: p. 160018. 2. National Academies of Sciences, E. and Medicine, Open Science by Design: Realizing a Vision for 21st Century Research. 2018, Washington, DC: The National Academies Press. 232. 3. Smith, B., et al., The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol, 2007. 25(11): p. 1251-5.

Life Sciences data↗

NASA Life Sciences Portal (NLSP): Supporting Scientific Transparency and Reproducibility

NASA’s Life Sciences Ports (NLSP) serves the scientific community by providing curated data from space life science experiment. The Human Research Program (HRP) with the help of NLSP is currently transforming their life sciences data archive systems and processes to improve compliance with the FAIR principles [1]. Some of these improvements will at the same time support the twin pillars of Open Science [2]: transparency of methods and reproducibility of results. Scientific transparency is marked by the easily intelligible communication of what has been investigated: what were the procedures for collecting sample and the characteristics of samples collected? what kinds of measurements were made, what were the environmental conditions of the measurements? What were the analysis techniques of the collected data? Reproducibility of the results and findings from the investigation requires a high level of transparency for all but the simplest investigations; the slightest deviation in communicating and replicating complex experimental procedures or data analyses can often yield quite different data and even findings, thwarting their validation. One of the ways the NLSP is aiming to improve the communication of scientific information is through the use of ontology-driven metadata. Ontologies are powerful, graph-based knowledge representation structures, which can be leveraged to increase data interoperability, the area of the FAIR principles in which many data systems most lack compliance. Over the past decade, there has been a concerted effort in the biomedical community to develop modular and narrowly focused domain and application-specific ontologies in a common, open-source framework, the Open Biological and Biomedical Ontology (OBO) Foundry [3]. The open sharing and modular nature of this effort promises huge increases in harmonized data sharing for systems that leverage these models. Which is in line with the FAIR Data Principles of Findability, Accessibility, Interoperability, and Reuse for scientific data management and stewardship.

Life Sciences data↗

NLSP: NASA Life Sciences Portal

NASA’s Life Sciences Ports (NLSP) serves the scientific community by providing curated data from space life science experiment. The Human Research Program (HRP) with the help of NLSP is currently transforming their life sciences data archive systems and processes to improve compliance with the FAIR principles. Some of these improvements will at the same time support the twin pillars of Open Science: transparency of methods and reproducibility of results. This video is a high level overview of the NLSP for existing and new users.

Life Sciences data↗

Forty-Year Calibrated Record of Earth-Surface Reflected Radiance from Landsat: A Review

Sensors on Landsat satellites have been collecting images of the Earth's surface for nearly 40 years. These images have been invaluable for characterizing and detecting changes in the land cover and land use of the world. Although initially conceived as primarily picture generating sensors, even the early sensors were radiometrically calibrated and spectrally characterized prior to launch and incorporated some capabilities to monitor their radiometric calibration once on orbit. Recently, as the focus of studies has shifted to monitoring Earth surface parameters over significant periods of time, serious attention has been focused toward bringing the data from all these sensors onto a common radiometric scale over this 40-year period. This effort started with the most recent systems and then was extended back in time. Landsat-7 ETM+, the best-characterized sensor of the series prior to launch and once on orbit, and the most stable system to date, was chosen to serve as the reference. The Landsat-7 project was the first of the series to build an image assessment system into its ground system, allowing systematic characterization of its sensors and data. Second, the Landsat-5 TM (still operating at the time of the Landsat-7 launch and continues to operate) calibration history was reconstructed based on its internal calibrator, vicarious calibrations, pseudo-invariant sites and a tie to Landsat-7 ETM+ at the time of the commissioning of Landsat-7. This process was performed in two iterations: the earlier one relied primarily on the TM internal calibrator. When this was found to have some deficiencies, a revised calibration was based more on pseudo-invariant sites, though the internal calibrator was still used to establish the short-term variations in response due to icing build up on the cold focal plane. As time progressed, a capability to monitor the Landsat-5 TM was added to the image assessment system. The Landsat-4 TM, which operated from 1982-1992, was the third system to which the radiometric scale was extended. The limited and broken use of the Landsat-4 TM made this analysis more difficult. Eight-day separated image pairs from Landsat-5 combined with analysis of pseudo invariant sites established this history. The fourth and most challenging effort was making the Landsat-1 to -5 MSS sensors' data internally radiometrically consistent. This effort was particularly complicated by the age of the MSS data, varying formats and processing levels in the archive, limited datasets, and limited documentation available. Ultimately, pseudo-invariant sites were identified in North America and used for this effort. Note that most of the Landsat-MSS archived data had already been calibrated using the MSS internal calibrators, so this processing was imbedded in the result. The final effort was developing an absolute scale for Landsat MSS similar to what was already established for the "TM" sensors. This was accomplished by using simultaneous data from Landsat-5 MSS and Landsat-5 TM, accounting for spectral differences between the sensors using EO-1 Hyperion data. The recalibrated history of the Landsat data and implications to users are discussed. The key result from this work is a consistently calibrated Landsat data archive that spans nearly 40 years with total uncertainties on the order of 10% or less for most sensors and bands.

Markham, Brian↗

Resiliency of the Multiscale Retinex Image Enhancement Algorithm

The multiscale retinex with color restoration (MSRCR) continues to prove itself in extensive testing to be very versatile automatic image enhancement algorithm that simultaneously provides dynamic range compression, color constancy, and color rendition, However, issues remain with regard to the resiliency of the MSRCR to different image sources and arbitrary image manipulations which may have been applied prior to retinex processing. In this paper we define these areas of concern, provide experimental results, and, examine the effects of commonly occurring image manipulation on retinex performance. In virtually all cases the MSRCR is highly resilient to the effects of both the image source variations and commonly encountered prior image-processing. Significant artifacts are primarily observed for the case of selective color channel clipping in large dark zones in a image. These issues are of concerning the processing of digital image archives and other applications where there is neither control over the image acquisition process, nor knowledge about any processing done on th data beforehand.

Rahman, Zia-Ur↗

Access to Archived Astronaut Data for Human Research Program Researchers: Update on Progress and Process Improvements

Since the 2010 NASA directive to make the Life Sciences Data Archive (LSDA) and Lifetime Surveillance of Astronaut Health (LSAH) data archives more accessible by the research and operational communities, demand for astronaut medical data has increased greatly. LSAH and LSDA personnel are working with Human Research Program on many fronts to improve data access and decrease lead time for release of data. Some examples include the following: Feasibility reviews for NASA Research Announcement (NRA) data mining proposals; Improved communication, support for researchers, and process improvements for retrospective Institutional Review Board (IRB) protocols; Supplemental data sharing for flight investigators versus purely retrospective studies; Work with the Multilateral Human Research Panel for Exploration (MHRPE) to develop acceptable data sharing and crew consent processes and to organize inter-agency data coordinators to facilitate requests for international crewmember data. Current metrics on data requests crew consenting will be presented, along with limitations on contacting crew to obtain consent. Categories of medical monitoring data available for request will be presented as well as flow diagrams detailing data request processing and approval steps.

Lee, L. R.↗

The NAS Computational Aerosciences Archive

In order to further the state-of-the-art in computational aerosciences (CAS) technology, researchers must be able to gather and understand existing work in the field. One aspect of this information gathering is studying published work available in scientific journals and conference proceedings. However, current scientific publications are very limited in the type and amount of information that they can disseminate. Information is typically restricted to text, a few images, and a bibliography list. Additional information that might be useful to the researcher, such as additional visual results, referenced papers, and datasets, are not available. New forms of electronic publication, such as the World Wide Web (WWW), limit publication size only by available disk space and data transmission bandwidth, both of which are improving rapidly. The Numerical Aerodynamic Simulation (NAS) Systems Division at NASA Ames Research Center is in the process of creating an archive of CAS information on the WWW. This archive will be based on the large amount of information produced by researchers associated with the NAS facility. The archive will contain technical summaries and reports of research performed on NAS supercomputers, visual results (images, animations, visualization system scripts), datasets, and any other supporting meta-information. This information will be available via the WWW through the NAS homepage, located at http://www.nas.nasa.gov/, fully indexed for searching. The main components of the archive are technical summaries and reports, visual results, and datasets. Technical summaries are gathered every year by researchers who have been allotted resources on NAS supercomputers. These summaries, together with supporting visual results and references, are browsable by interested researchers. Referenced papers made available by researchers can be accessed through hypertext links. Technical reports are in-depth accounts of tools and applications research projects performed by NAS staff members and collaborators. Visual results, which may be available in the form of images, animations, and/or visualization scripts, are generated by researchers with respect to a certain research project, depicting dataset features that were determined important by the investigating researcher. For example, script files for visualization systems (e.g. FAST, PLOT3D, AVS) are provided to create visualizations on the user's local workstation to elucidate the key points of the numerical study. Users can then interact with the data starting where the investigator left off. Datasets are intended to give researchers an opportunity to understand previous work, 'mine' solutions for new information (for example, have you ever read a paper thinking "I wonder what the helicity density looks like?"), compare new techniques with older results, collaborate with remote colleagues, and perform validation. Supporting meta-information associated with the research projects is also important to provide additional context for research projects. This may include information such as the software used in the simulation (e.g. grid generators, flow solvers, visualization). In addition to serving the CAS research community, the information archive will also be helpful to students, visualization system developers and researchers, and management. Students (of any age) can use the data to study fluid dynamics, compare results from different flow solvers, learn about meshing techniques, etc., leading to better informed individuals. For these users it is particularly important that visualization be integrated into dataset archives. Visualization researchers can use dataset archives to test algorithms and techniques, leading to better visualization systems, Management can use the data to figure what is really going on behind the viewgraphs. All users will benefit from fast, easy, and convenient access to CFD datasets. The CAS information archive hopes to serve as a useful resource to those interested in computational sciences. At present, only information that may be distributed internationally is made available via the archive. Studies are underway to determine security requirements and solutions to make additional information available. By providing access to the archive via the WWW, the process of information gathering can be more productive and fruitful due to ease of access and ability to manage many different types of information. As the archive grows, additional resources from outside NAS will be added, providing a dynamic source of research results.

Miceli, Kristina D.↗

On-orbit assembly/servicing task definition study

The OEXP vehicles being envisioned to carry out the Presidential space goals of a lunar outpost and human exploration of Mars will require on-orbit assembly, refurbishment, checkout, and launch. The On-orbit Assembly/Servicing Task Definition Study applies the space vehicle processing experience and procedures archives resident at NASA's Kennedy Space Center (KSC) to determine the task flows, and resources/facilities necessary to process the OEXP vehicles at Space Station Freedom (SSF). This data base is examined to find the closest analogies to OEXP vehicle components and assembly/refurbishment tasks. Transition tables are generated to provide traceability from KSC hardware processing experience to analogous on-orbit processing of the OEXP vehicles. Iterations in which the task flows are broken down into realistic extravehicular activity (EVA) primitive subtasks and times, and to apply automation and robotic technology to reduce crew risks and minimize EVA time, will enhance the value and accuracy of the predicted flows. These processing scenarios and the resulting resource/facility requirements are used to determine impacts of SSF, resulting in change requests to SSF requirements for provision of 'hooks and scars' to evolve the assembly complete Space Station into a transportation node. Study results to date include assembly analysis of the Martin Marietta Phobos Gateway Vehicle, refurbishment analysis of the Martin Marietta Lunar Evolution Piloted and Cargo Vehicles, and assembly analysis of the Boeing Mars Evolution Vehicle. The results of this study will be accumulated into the vehicle processing operations data base for subsequent modeling, life cycle cost, vehicle growth, and SSF impact analysis.

Vargo, Rick↗

Radiation Studies in Support of the CRYSTAL-FACE Project

As proposed, we successfully completed radiometric observations aboard the ER-2 and WB-57 platforms during the field phase of the CRYSTAL-FACE campaign. Quick look plots of the data were immediately archived after the missions and quality-controlled and completely processed find data products were archived in a timely manner to the CRYSTAL-FACE data archive. The specific radiometric instrumentation operated aboard the two NASA airborne platforms is summarized.

Valero, Francisco P. J.↗

Compton Observatory EGRET All-Sky Survey

We describe the EGRET data products which we anticipate will suffice for virtually all guest and archival investigations. The production process, content, availability, format, and the associated software of each product is described. This paper also supplies sufficient detail for the archival researcher to do analysis which is not supported by extant software. Where published references don't exist, the EGRET team documentation is cited.

Source record↗

Earth observation archive activities at DRA Farnborough

Space Sector, Defence Research Agency (DRA), Farnborough have been actively involved in the acquisition and processing of Earth Observation data for over 15 years. During that time an archive of over 20,000 items has been built up. This paper describes the major archive activities, including: operation and maintenance of the main DRA Archive, the development of a prototype Optical Disc Archive System (ODAS), the catalog systems in use at DRA, the UK Processing and Archive Facility for ERS-1 data, and future plans for archiving activities.

Palmer, M. D.↗

Construction of Polarimetric Radar-Based Reference Rain Maps for the Iowa Flood Studies Campaign

The Global Precipitation Measurement (GPM) Mission Iowa Flood Studies (IFloodS) campaign was conducted in central and northeastern Iowa during the months of April-June, 2013. Specific science objectives for IFloodS included quantification of uncertainties in satellite and ground-based estimates of precipitation, 4-D characterization of precipitation physical processes and associated parameters (e.g., size distributions, water contents, types, structure etc.), assessment of the impact of precipitation estimation uncertainty and physical processes on hydrologic predictive skill, and refinement of field observations and data analysis approaches as they pertain to future GPM integrated hydrologic validation and related field studies. In addition to field campaign archival of raw and processed satellite data (including precipitation products), key ground-based platforms such as the NASA NPOL S-band and D3R Ka/Ku-band dual-polarimetric radars, University of Iowa X-band dual-polarimetric radars, a large network of paired rain gauge platforms, and a large network of 2D Video and Parsivel disdrometers were deployed. In something of a canonical approach, the radar (NPOL in particular), gauge and disdrometer observational assets were deployed to create a consistent high-quality distributed (time and space sampling) radar-based ground "reference" rainfall dataset, with known uncertainties, that could be used for assessing the satellite-based precipitation products at a range of space/time scales. Subsequently, the impact of uncertainties in the satellite products could be evaluated relative to the ground-benchmark in coupled weather, land-surface and distributed hydrologic modeling frameworks as related to flood prediction. Relative to establishing the ground-based "benchmark", numerous avenues were pursued in the making and verification of IFloodS "reference" dual-polarimetric radar-based rain maps, and this study documents the process and results as they pertain specifically to efforts using the NPOL radar dataset. The initial portions of the "process" involved dual-polarimetric quality control procedures which employed standard phase and correlation-based approaches to removal of clutter and non-meteorological echo. Calculation of a scale-adaptive KDP was accomplished using the method of Wang and Chandrasekar (2009; J. Atmos. Oceanic Tech.). A dual-polarimetric blockage algorithm based on Lang et al. (2009; J. Atmos. Oceanic Tech.) was then implemented to correct radar reflectivity and differential reflectivity at low elevation angles. Next, hydrometeor identification algorithms were run to identify liquid and ice hydrometeors. After the quality control and data preparation steps were completed several different dual-polarimetric rain estimation algorithms were employed to estimate rainfall rates using rainfall scans collected approximately every two to three minutes throughout the campaign. These algorithms included a polarimetrically-tuned Z-R algorithm that adjusts for drop oscillations (via Bringi et al., 2004, J. Atmos. Oceanic Tech.), and several different hybrid polarimetric variable approaches, including one that made use of parameters tuned to IFloodS 2D Video Disdrometer measurements. Finally, a hybrid scan algorithm was designed to merge the rain rate estimates from multiple low level elevation angle scans (where blockages could not be appropriately corrected) in order to create individual low-level rain maps. Individual rain maps at each time step were subsequently accumulated over multiple time scales for comparison to gauge network data. The comparison results and overall error character depended strongly on rain event type, polarimetric estimator applied, and range from the radar. We will present the outcome of these comparisons and their impact on constructing composited "reference" rainfall maps at select time and space scales.

Radar↗

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗

Design, test, and applications of the Alaska SAR Facility

The key science requirements, the overall design, and the innovative testing approaches that have been used to ensure the functionality of the Alaska SAR Facility (ASF) are described. The facility is to play an important role in the remote sensing applications of Arctic oceanography, geology, glaciology, hydrology, and ecosystem processes. Attention is given to the ASF's three major components: the Receiving Ground Station, the SAR Processing System, and the Archive and Operations System. The ASF hardware configuration and software support, through extensive design and implementaton reviews, were shown to satisfy the initial memorandum of agreement first initiated by NASA for the establishment of a receiving ground station and image processing facility at the University of Alaska Fairbanks, and also to satisfy the science objectives formulated by the prelaunch Science Working team. The testing strategy and techniques used in the implementation of the ASF to assure functionality is outlined. The test structures, approach, and environment are considered.

Berwin, R. W.↗