Search NASA⌕ Search

SEARCH · Search NASA

Results for “data archiving”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Open Science for Plants in Space: Data Sharing, Standards, and Informatics for Reuse and Knowledge Discovery

Upcoming deep space missions will rely on plants for crew and ecosystem health. Open access space biology data enables scientists to examine the biological responses of plants to ionizing radiation, altered gravity, low atmospheric pressure, elevated CO2, altered photoperiods and many other abiotic stressors. Open Science is the practice of making research available to all, while respecting diverse cultures, to foster collaborations with equity. NASA has declared 2023 as the ‘Year of Open Science’ and created a 5-year Transform to Open Science (TOPS) initiative designed to rapidly transform the agency toward an inclusive culture of open science. NASA’s Open Science Data Repository (OSDR) within the Biological and Physical Sciences Division provides access to data from space-relevant biological experiments. OSDR combines two databases, GeneLab and Ames Life Sciences Data Archive (ALSDA) to maximize access to standardized ‘omics (e.g., transcriptomics, proteomics) and phenotypic data (e.g., microscopy, biomass), respectively. GeneLab started in 2014 with the creation of the first space-relevant FAIR (Findable, Accessible, Interoperable, Reusable) biological ‘omics repository, providing detailed metadata on investigation, sample, and assay levels. The addition of ALSDA to OSDR expands plant data analysis capabilities across both phenotypic and ‘omics data. Today, OSDR hosts 62+ plant datasets and has enabled 58 peer-reviewed publications. Most of these publications were collaboration efforts under the OSDR Analysis Working Groups (AWGs). AWGs provide great opportunities for investigators to collaborate with community members and set new standards for space-relevant data and metadata. The AWGs welcome any ASGSR members interested in contributing plant expertise for space biology, and to serve as subject matter experts as we establish the framework for modern plant data archiving. Investigators are encouraged to submit their space-relevant plant datasets to OSDR and visit the site to learn about the tools OSDR has to offer (osdr.nasa.gov/bio).

FAIR↗

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report October 1-December 31, 2016

Individual datastreams from instrumentation at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile research observatories (sites) are collected and routed to the ARM Data Center (ADC). The Data Management Facility (DMF), a component of the ADC, executes datastream processing in near-real time. Processed data are then delivered approximately daily to the ARM Data Archive, also a component of the ADC, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. DOE requires national user facilities to report time-based operating data.

54 ENVIRONMENTAL SCIENCES↗

A Support Database System for Integrated System Health Management (ISHM)

The development, deployment, operation and maintenance of Integrated Systems Health Management (ISHM) applications require the storage and processing of tremendous amounts of low-level data. This data must be shared in a secure and cost-effective manner between developers, and processed within several heterogeneous architectures. Modern database technology allows this data to be organized efficiently, while ensuring the integrity and security of the data. The extensibility and interoperability of the current database technologies also allows for the creation of an associated support database system. A support database system provides additional capabilities by building applications on top of the database structure. These applications can then be used to support the various technologies in an ISHM architecture. This presentation and paper propose a detailed structure and application description for a support database system, called the Health Assessment Database System (HADS). The HADS provides a shared context for organizing and distributing data as well as a definition of the applications that provide the required data-driven support to ISHM. This approach provides another powerful tool for ISHM developers, while also enabling novel functionality. This functionality includes: automated firmware updating and deployment, algorithm development assistance and electronic datasheet generation. The architecture for the HADS has been developed as part of the ISHM toolset at Stennis Space Center for rocket engine testing. A detailed implementation has begun for the Methane Thruster Testbed Project (MTTP) in order to assist in developing health assessment and anomaly detection algorithms for ISHM. The structure of this implementation is shown in Figure 1. The database structure consists of three primary components: the system hierarchy model, the historical data archive and the firmware codebase. The system hierarchy model replicates the physical relationships between system elements to provide the logical context for the database. The historical data archive provides a common repository for sensor data that can be shared between developers and applications. The firmware codebase is used by the developer to organize the intelligent element firmware into atomic units which can be assembled into complete firmware for specific elements.

FROM↗

Building a COTS archive for satellite data

The goal of the NOAA/NESDIS Active Archive was to provide a method of access to an online archive of satellite data. The archive had to manage and store the data, let users interrogate the archive, and allow users to retrieve data from the archive. Practical issues of the system design such as implementation time, cost and operational support were examined in addition to the technical issues. There was a fixed window of opportunity to create an operational system, along with budget and staffing constraints. Therefore, the technical solution had to be designed and implemented subject to constraint imposed by the practical issues. The NOAA/NESDIS Active Archive came online in July of 1994, meeting all of its original objectives.

Singer, Ken↗

Archiving Space Geodesy Data for 20+ Years at the CDDIS

Since 1982, the Crustal Dynamics Data Information System (CDDIS) has supported the archive and distribution of geodetic data products acquired by NASA programs. These data include GPS (Global Positioning System), GLONASS (GLObal NAvigation Satellite System), SLR (Satellite Laser Ranging), VLBI (Very Long Baseline Interferometry), and DORIS (Doppler Orbitography and Radiolocation Integrated by Satellite). The data archive supports NASA's space geodesy activities through the Solid Earth and Natural Hazards (SENH) program. The CDDIS data system and its archive have become increasingly important to many national and international programs, particularly several of the operational services within the International Association of Geodesy (IAG), including the International GPS Service (IGS), the International Laser Ranging Service (ILRS), the International VLBI Service for Geodesy and Astrometry (IVS), the International DORIS Service (IDS), and the International Earth Rotation Service (IERS). The CDDIS provides easy and ready access to a variety of data sets, products, and information about these data. The specialized nature of the CDDIS lends itself well to enhancement and thus can accommodate diverse data sets and user requirements. All data sets and metadata extracted from these data sets are accessible to scientists through ftp and the web; general information about each data set is accessible via the web. The CDDIS, including background information about the system and its user communities, the computer architecture, archive contents, available metadata, and future plans will be discussed.

Noll, Carey E.↗

Use of NASA Near Real-Time and Archived Satellite Data to Support Disaster Assessment

NASA's Short‐term Prediction Research and Transition (SPoRT) Center partners with the NWS to provide near realtime data in support of a variety of weather applications, including disasters. SPoRT supports NASA's Applied Sciences Program: Disasters focus area by developing techniques that will aid the disaster monitoring, response, and assessment communities. SPoRT has explored a variety of techniques for utilizing archived and near real‐time NASA satellite data. An increasing number of end‐users - such as the NWS Damage Assessment Toolkit (DAT) - access geospatial data via a Web Mapping Service (WMS). SPoRT has begun developing open‐standard Geographic Information Systems (GIS) data sets via WMS to respond to end‐user needs.

McGrath, Kevin M.↗

The ESIS query environment pilot project

The European Space Information System (ESIS) was originally conceived to provide the European space science community with simple and efficient access to space data archives, facilities with which to examine and analyze the retrieved data, and general information services. To achieve that ESIS will provide the scientists with a discipline specific environment for querying in a uniform and transparent manner data stored in geographically dispersed archives. Furthermore it will provide discipline specific tools for displaying and analyzing the retrieved data. The central concept of ESIS is to achieve a more efficient and wider usage of space scientific data, while maintaining the physical archives at the institutions which created them, and has the best background for ensuring and maintaining the scientific validity and interest of the data. In addition to coping with the physical distribution of data, ESIS is to manage also the heterogenity of the individual archives' data models, formats and data base management systems. Thus the ESIS system shall appear to the user as a single database, while it does in fact consist of a collection of dispersed and locally managed databases and data archives. The work reported in this paper is one of the results of the ESIS Pilot Project which is to be completed in 1993. More specifically it presents the pilot ESIS Query Environment (ESIS QE) system which forms the data retrieval and data dissemination axis of the ESIS system. The others are formed by the ESIS Correlation Environment (ESIS CE) and the ESIS Information Services. The ESIS QE Pilot Project is carried out for the European Space Agency's Research and Information center, ESRIN, by a Consortium consisting of Computer Resources International, Denmark, CISET S.p.a, Italy, the University of Strasbourg, France and the Rutherford Appleton Laboratories in the U.K. Furthermore numerous scientists both within ESA and space science community in Europe have been involved in defining the core concepts of the ESIS system.

Fuchs, Jens J.↗

The screwworm eradication data system archives

The archives accumulated during 1 year of operation of the Satellite Temperature-Monitoring System during development of the Screwworm Eradication Data System are reported. Brief descriptions of all the kinds of tapes, as well as their potential uses, are presented. Reference is made to other documents that explain the generation of these data.

Barnes, C. M.↗

Field and Model Data Associated with the Manuscript “Drivers of Streamflow Intermittency in Humid Regions: 2. Evaluating Controls on Flow Persistence in an Urbanized Catchment”

This package contains field data, modeling files, and scripts supporting the investigation of the drivers of streamflow intermittency in an urbanized catchment. It includes the field data collected from electrical resistivity tomography (ERT) surveys, distributed temperature sensing (DTS), continuous self-potential (SP) monitoring, groundwater and stilling well. In addition, it contains the data and results of the coupled water- and electrical-flow model developed using the COMSOL Multiphysics and Advanced Terrestrial Simulator (ATS), as well as software files and Jupyter notebooks used to process the data and generate figures in the manuscript submitted for peer review. The data archive is organized in the following directories: 1) Climate Includes hourly precipitation and daily evapotranspiration time series (2024 – 2025) provided as CSV files, alongside a text file detailing dataset units. 2) Coupled_model Field_Application subfolder contains the ATS XML input scripts, data files, output data for the SP site. It also contains the Jupyter notebook (Plot_final_calib.ipynb) to visualize the results of the modeled SP, stream-groundwater exchange and moisture content. The flow model simulation is executed using the ATS XML scripts and the included Python script (generate_data_set.py) to convert ATS output to COMSOL-ready input. COMSOL Multiphysics template (.m can only be used with COMSOL with MATLAB) is executed using the ATS output data to simulate the potential field. 3) Discharge Includes the electrical conductivity (EC) time series (provided as CSV files) from salt slug injections. It also includes the Jupyter notebook (Discharge_process.ipynyb) used to estimate discharge. All discharge measurements collated into rating_curve_processed.csv 4) DTS Contains collated DTS data including raw Stokes and anti-Stokes measurement (provided as .h5 file). It also includes DTS processing.ipynb, a Jupyter notebook for calibrating the DTS data using dts_calibration Python package. cooler_calibration.csv is the DTS calibration CSV used in the calibration sequence. 5) ERT Contains raw resistivity data (provided as CSV files), spatial location of each of the electrodes (provided as CSV files), and files used for the resistivity inversion. 6) Slug_test Includes the slug test data at all the groundwater wells provided as CSV files, as well as the Jupyter notebook (Slug_test.ipynb) for calculating hydraulic conductivity. 7) SP Contains the SP data collected in field at the SP sites (provided as CSV files). 8) Well_data Contains two subfolders: 1) Raw, which provides unprocessed pressure, electrical conductivity and temperature timeseries downloaded from the loggers in all the groundwater and stilling wells, and 2) Processed, which contains sorted, QA/QC timeseries data for each well. The data archive also contains data_process.ipynb, a Jupyter notebook used for field data analysis and generating figures (plotting well, SP, climate, and discharge data, as well as calculating head gradient at sites with nested groundwater wells). Note: Code files (.ipynb, .py, .xml) can be opened in any standard code editor, .exo file can be viewed using Paraview, .h5 files can be opened using HDFView software and h5py Python package, and .resipy file can be opened with the open-source ResIPy software.

ATS↗

SEARCHING FOR {gamma}-RAY BLAZAR CANDIDATES AMONG THE UNIDENTIFIED INTEGRAL SOURCES

The identification of low-energy counterparts for {gamma}-ray sources is one of the biggest challenges in modern {gamma}-ray astronomy. Recently, we developed and successfully applied a new association method to recognize {gamma}-ray blazar candidates that could be possible counterparts for the unidentified {gamma}-ray sources above 100 MeV in the second Fermi Large Area Telescope Catalog. This method is based on the infrared colors of the recent Wide-Field Infrared Survey Explorer (WISE) all-sky survey. In this Letter, we applied our new association method to the case of unidentified INTEGRAL sources (UISs) listed in the fourth soft gamma-ray source catalog. Only 86 UISs out of the 113 can be analyzed due to the sky coverage of the WISE Preliminary Data Release. Among these 86 UISs, we found that 18 appear to have a {gamma}-ray blazar candidate within their positional error region. Finally, we analyzed Swift archival data available for 10 out of these 18 {gamma}-ray blazar candidates, and we found that 7 out of 10 are clearly detected in soft X-rays and/or in the optical-ultraviolet band. We cannot confirm the associations between the UISs and the selected {gamma}-ray blazar candidates due to the discrepancies between the INTEGRAL and the soft X-ray spectra. However, the discovery of the soft X-ray counterparts for the selected {gamma}-ray blazar candidates adds an important clue to help us understand their origin and to confirm their blazar nature.

79 ASTRONOMY AND ASTROPHYSICS↗

Digital archives, big data and image-based culturomics for social impact assessment: Opportunities and challenges

Social impact assessment (SIA) is well-established but uses conventional approaches that have become less effective in recent decades, particularly in relation to declining survey response rates and a lack of youth engagement. Images from digital archives and social media sources are poised to advance the research and practice of SIA by transcending text-based methods with insights into changing landscapes, and human engagement with them. This viewpoint describes progress, challenges and cautions toward the development of such tools (defined as culturomics), using hydroelectricity cases to illustrate potential approaches. These tools build on foundational work in a range of disciplines, including the humanities and computer science. We describe necessary advances in machine learning, image digitization, and data aggregation and visualization techniques, as well as ways to ensure that such tools are carefully tested, applied and interpreted. Challenges include the automation, acquisition and management of datasets, and using these tools appropriately and equitably. Critically, culturomics of any kind must not be used as a replacement for engagement with people, but as complementary to inclusive stakeholder engagement. - Highlights: •Image-based digital archives and social media present opportunities for new SIA tools. •Application-ready big data approaches are emerging across many fields. •SIA scholars, practitioners and stakeholders should engage with culturomics. •Challenges include automation, digitization, interpretation and justice. •Culturomics of any kind must not replace engagement with people.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

ARM Operations and Engineering Procedure Mobile Facility Site Startup

This procedure exists to define the key milestones, necessary steps, and process rules required to commission and operate an Atmospheric Radiation Measurement (ARM) Mobile Facility (AMF), with a specific focus toward on-time product delivery to the ARM Data Archive. The overall objective is to have the physical infrastructure, networking and communications, and instrument calibration, grooming, and alignment (CG&A) completed with data products available from the ARM Data Archive by the Operational Start Date milestone.

Voyles, Jimmy W↗

A search for periodicity in the x ray spectrum of black hole candidate A0620-00

The archived data from the SAS-3 observations of the X-ray nova A0620-00, the best of the stellar blackhole candidates, were exhaustively examined for evidence of variable phenomena correlated with the orbital motion of the binary system of which it is a member. The original analysis of these data was completed before discovery of the binary companion and determination of the orbital period of the system. New interest was drawn to the task of a reexamination of the archive data by the recent discovery of the massive nature of the X-ray source through analysis of the Doppler variations and ellipsoidal light variations of the faint K-star companion by McClintock and Remillard. The archive research, carried out under the supervision of the principal investigator, was the topic of the thesis submitted to the MIT Department of Physics by Kenneth Plaks in partial fulfillment of the requirements for the degree of Master of Science. Plaks' effort was focused on the elimination of fluctuations in the data due to errors in attitude solutions and other extraneous causes. The first products of his work were long-term light curves of the X-ray intensities in the various energy channels as functions of time during the time from outbursts in August 1975 to quiescence approximately 6 months later. These curves, are refined versions of the preliminary results published in 1976 (Matilsky et al. 1976). Smooth exponentials were fitted to these long term light curves to provide the basis for detrending the data, thereby permitting a calculation of residuals derived by subtracting the fitted curve from the data. The residuals were then analyzed by Fourier analysis to search for variations with the period of the binary orbit, namely 7.75 hours. No evidence of an orbital periodicity was found. However, the refined light curve provides a much clearer picture of the outburst and subsequent decay of the X-ray luminosity. In fact, there were two outbursts, each followed by an exponential decay with similar time constants of about 25 days. Previous evidence of a three-oscillation variation with a 7.8 day period were confirmed. Substantial theoretical effort has been devoted to attempts to account for the decay characteristics as the result of the gradual eating up of an accretion disk by a stellar-mass blackhole (e.g., Huang and Wheeler 1989). The improved decay curves will provide significant new constraints on the theoretical analyses.

Clark, George W.↗

PG 1553+113: FIVE YEARS OF OBSERVATIONS WITH MAGIC

We present the results of five years (2005-2009) of MAGIC observations of the BL Lac object PG 1553+113 at very high energies (VHEs; E > 100 GeV). Power-law fits of the individual years are compatible with a steady mean photon index {Gamma} = 4.27 {+-} 0.14. In the last three years of data, the flux level above 150 GeV shows a clear variability (probability of constant flux < 0.001%). The flux variations are modest, lying in the range from 4% to 11% of the Crab Nebula flux. Simultaneous optical data also show only modest variability that seems to be correlated with VHE gamma-ray variability. We also performed a temporal analysis of (all available) simultaneous Fermi/Large Area Telescope data of PG 1553+113 above 1 GeV, which reveals hints of variability in the 2008-2009 sample. Finally, we present a combination of the mean spectrum measured at VHEs with archival data available for other wavelengths. The mean spectral energy distribution can be modeled with a one-zone synchrotron self-Compton model, which gives the main physical parameters governing the VHE emission in the blazar jet.

79 ASTRONOMY AND ASTROPHYSICS↗

Fiber-Optic Sensing for Earthquake Hazards Research, Monitoring, and Early Warning

The use of fiber‐optic sensing systems in seismology has exploded in the past decade. Despite an ever‐growing library of ground‐breaking studies, questions remain about the potential of fiber‐optic sensing technologies as tools for advancing if not revolutionizing earthquake‐hazards‐related research, monitoring, and early warning systems. A working group convened to explore these topics; we comprehensively examined the application of fiber optics in various aspects of earthquake hazards, encompassing earthquake source processes, crustal imaging, data archiving, and technological challenges. There is great potential for fiber‐optic systems to advance earthquake monitoring and understanding, but to fully unlock their capabilities requires continued progress in key areas of research and development, including instrument testing and validation, increased dynamic range for applications focused on larger earthquakes, and continued improvement in subsurface and source imaging methods. A key current stumbling block results from the lack of clear data archiving requirements, and we propose an initial strategy that balances data volume requirements with preserving key data for a broad range of future studies. In addition, we demonstrate the potential for fiber‐optic sensing to impact monitoring efforts by documenting the data completeness in a number of long‐term experiments. Finally, we outline the features of a instrument testing facility that would enable progress toward reliable and standardized distributed acoustic sensing data. Overcoming these current obstacles would facilitate progress in fiber‐optic sensing and unlock its potential application to a broad range of earthquake hazard problems.

58 GEOSCIENCES↗

Airborne Lidar measurements of aerosols, mixed layer heights, and ozone during the 1980 PEPE/NEROS summer field experiment

A detailed summary of the NASA Ultraviolet Differential Absorption Lidar (UV DIAL) data archive obtained during the EPA Persistent Elevated Pollution Episode/Northeast Regional Oxidant Study (PEPE/NEROS) Summer Field Experiment Program (July through August 1980) is presented. The UV dial data set consists of remote measurements of mixed layer heights, aerosol backscatter cross sections, and sequential ozone profiles taken during 14 long-range flights onboard the NASA Wallops Flight Center Electra aircraft. These data are presented in graphic and tabular form, and they have been submitted to the PEPE/NEROS data archive on digital magnetic tape. The derivation of mixing heights and ozone profiles from UV Dial signals is discussed, and detailed intercomparisons with measurements obtained by in situ sensors are presented.

Browell, E. V.↗

Reusing Data and Metadata to Create New Metadata Through Machine-Learning & Other Programmatic Methods

Recent improvements in natural language processing (NLP) enable metadata to be created programmatically from reused original metadata or even the dataset itself. Transfer-learning applied to NLP has greatly improved performance and reduced training data requirements. In this talk, we’ll compare machine-generated metadata to human-generated metadata and discuss characteristics of metadata and data archives that affect suitability for machine-learning reuse of metadata. Where as human-generated metadata is often populated once, populated from the perspective of data supplier, populated by many individuals with different words for the same thing, and limited in length, machine-generated metadata can be updated any number of times, generated from the perspective of any user, constrained to a standardized set of terms that can be evolved over time, and be any length required. Machine-learning generated metadata offers benefits but also additional needs in terms of version control, process transparency, human-computer interaction, and IT requirements. As a successful example, we’ll discuss how a dataset of abstracts and associated human-tagged keywords from a standardized list of several thousand keywords were used to create a machine-learning model that predicted keyword metadata for open-source code projects on code.nasa.gov. We’ll also discuss a less successful example from data.nasa.gov to show how data archive architecture and characteristics of initial metadata can be strong controls on how easy it is to leverage programmatic methods to reuse metadata to create additional metadata.

Gosses, Justin↗

Analyses and forecasts with LAWS winds

Horizontal fluxes of atmospheric water vapor are studied for summer months during 1989 and 1992 over North and South America based on analyses from European Center for Medium Range Weather Forecasts, US National Meteorological Center, and United Kingdom Meteorological Office. The calculations are performed over 20 deg by 20 deg box-shaped midlatitude domains located to the east of the Rocky Mountains in North America, and to the east of the Andes Mountains in South America. The fluxes are determined from operational center gridded analyses of wind and moisture. Differences in the monthly mean moisture flux divergence determined from these analyses are as large as 7 cm/month precipitable water equivalent over South America, and 3 cm/month over North America. Gridded analyses at higher spatial and temporal resolution exhibit better agreement in the moisture budget study. However, significant discrepancies of the moisture flux divergence computed from different gridded analyses still exist. The conclusion is more pessimistic than Rasmusson's estimate based on station data. Further analysis reveals that the most significant sources of error result from model surface elevation fields, gaps in the data archive, and uncertainties in the wind and specific humidity analyses. Uncertainties in the wind analyses are the most important problem. The low-level jets, in particular, are substantially different in the different data archives. Part of the reason for this may be due to the way the different analysis models parameterized physical processes affecting low-level jets. The results support the inference that the noise/signal ratio of the moisture budget may be improved more rapidly by providing better wind observations and analyses than by providing better moisture data.

Wang, Muyin↗