Search NASA⌕ Search

SEARCH · Search NASA

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Updates in Developing a Prototype Science Pipeline and Full-Volume, Global Hyperspectral Synthetic Data Sets for NASA’s Earth System Observatory’s Upcoming Surface, Biology and Geology Mission

The Surface Biology and Geology (SBG) mission recently passed mission confirmation review and has entered phase A – design and development. SBG will acquire high resolution solar-reflected spectroscopy and thermal infrared observations at a data rate of ~2.5 TB/day and generate products at ~40 TB/day. Given that the per-day volume is greater than NASA’s total extant airborne hyperspectral data collection, collecting, processing, disseminating, and exploiting the SBG data present new challenges. To meet these challenges, we have developed a prototype science pipeline and a full-volume global hyperspectral synthetic data set to help prepare for SBG’s flight (see poster GC42D-0730). Our science pipeline is based on the science processing technology developed for NASA’s Kepler and TESS planet-hunting missions. The pipeline infrastructure, Ziggy, provides a scalable architecture for robust, repeatable, and replicable science and application products that can be run on a range of systems from a laptop to the cloud or a supercomputer. Ziggy is compliant with NASA Procedural Requirement (NPR) 7150.2C, is at a technical readiness level (TRL) of 7 and has been released to github.com/nasa/ziggy. We integrated Ziggy with EO-1/Hyperion workflows to build a prototype pipeline and ingested the 17-year mission archive that provides globally sampled visible through shortwave infrared spectra that are representative of SBG data types and volumes. We fully implemented the first stage and processed the entire 55 TB Hyperion data set from the raw data (Level 0) to top-of-the-atmosphere radiance (Level 1R). We are currently evaluating the ISOFIT atmospheric correction module to convert the L1R data to surface reflectance (Level 2) before reprocessing the full data set to L2. Crosschecks are being performed with RadCalNet as well as with coincident observations by AVIRIS. We are also investigating modern methods for georectifying the Hyperion scenes. Finally, we describe an analysis of the cost to conduct forward processing and reprocessing campaigns for SBG on HECC with dedicated compute and storage resources using the resurrected Hyperion pipeline as a proxy for full-volume SBG data. The analysis demonstrates that SBG L0 data can be processed to L2 on HECC with full reprocessing campaigns every two years for ~$2.6M over a 7-year lifespan. Moreover, 69% of the system capacity would be available for other activities, possibly enabling future open-source science activities, including algorithm development, L3+ processing, .etc.

ESD↗
NASA NTRS2003

Automated Data Processing as an AI Planning Problem

NASA s vision for Earth Science is to build a "sensor web"; an adaptive array of heterogeneous satellites and other sensors that will track important events, such as storms, and provide real-time information about the state of the Earth to a wide variety of customers. Achieving his vision will require automation not only in the scheduling of the observations but also in the processing af tee resulting data. Ta address this need, we have developed a planner-based agent to automatically generate and execute data-flow programs to produce the requested data products. Data processing domains are substantially different from other planning domains that have been explored, and this has led us to substantially different choices in terms of representation and algorithms. We discuss some of these differences and discuss the approach we have adopted.

Golden, Keith↗
NASA NTRS2020

Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (LDAS) and Other Assimilated Hydrological Data at NASA GES DISC

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provides science support for several data sets relevant to agriculture and food security, including the Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (LDAS), or FLDAS data set. The GES DISC is one of twelve NASA Earth Observing System (EOS) data centers that process, archive, document, and distribute data from Earth science missions and related projects. The GES DISC hosts a wide range of remote sensing and model data, and provides reliable and robust data access and other services to users worldwide. Beyond data archive and access, the GES DISC offers many services to visualize and analyze the data. This presentation provides a summary of the hydrological data available at the GES DISC, along with an overview of related data services. Specifically, the FLDAS data set has been adapted to work with domains, data streams, and monitoring and forecast requirements associated with food security assessment in data-sparse, developing country settings. The FLDAS global monthly data have a 0.1 x 0.1 degree spatial resolution covering the period from January 1982 to present. Global FLDAS monthly anomaly and monthly climatology data are also available at the GES DISC to evaluate how current conditions compare to averages over the FLDAS 35-year period. Several case studies using the FLDAS soil moisture, evapotranspiration, rainfall, runoff, and surface temperature data will be presented.

Loeser, Carlee↗
NASA NTRS1984

Trends in Planetary Data Analysis. Executive summary of the Planetary Data Workshop

Planetary data include non-imaging remote sensing data, which includes spectrometric, radiometric, and polarimetric remote sensing observations. Also included are in-situ, radio/radar data, and Earth based observation. Also discussed is development of a planetary data system. A catalog to identify observations will be the initial entry point for all levels of users into the data system. There are seven distinct data support services: encyclopedia, data index, data inventory, browse, search, sample, and acquire. Data systems for planetary science users must provide access to data, process, store, and display data. Two standards will be incorporated into the planetary data system: Standard communications protocol and Standard format data unit. The data system configuration must combine a distributed system with those of a centralized system. Fiscal constraints have made prioritization important. Activities include saving previous mission data, planning/cost analysis, and publishing of proceedings.

Evans, N.↗
NASA NTRS2009

Improving Forecast Skill by Assimilation of Quality Controlled AIRS Version 5 Temperature Soundings

The AIRS Science Team Version 5 retrieval algorithm has been finalized and is now operational at the Goddard DAAC in the processing (and reprocessing) of all AIRS data. The AIRS Science Team Version 5 retrieval algorithm contains two significant improvements over Version 4: 1) Improved physics allows for use of AIRS observations in the entire 4.3 micron CO2 absorption band in the retrieval of temperature profile T(p) during both day and night. Tropospheric sounding 15 micron CO2 observations are now used primarily in the generation of cloud cleared radiances R(sub i). This approach allows for the generation of accurate values of R(sub i) and T(p) under most cloud conditions. 2) Another very significant improvement in Version 5 is the ability to generate accurate case-by-case, level-by-level error estimates for the atmospheric temperature profile, as well as for channel-by-channel error estimates for R(sub i). These error estimates are used for Quality Control of the retrieved products. We have conducted forecast impact experiments assimilating AIRS temperature profiles with different levels of Quality Control using the NASA GEOS-5 data assimilation system. Assimilation of Quality Controlled T(p) resulted in significantly improved forecast skill compared to that obtained from analyses obtained when all data used operationally by NCEP, except for AIRS data, is assimilated. We also conducted an experiment assimilating AIRS radiances uncontaminated by clouds, as done operationally by ECMWF and NCEP. Forecast resulting from assimilated AIRS radiances were of poorer quality than those obtained assimilating AIRS temperatures.

Susskind, Joel↗
NASA NTRS2015

Total and Spectral Solar Irradiance Sensor (TSIS) Project Overview

The main objective of the Total and Spectral solar Irradiance Sensor (TSIS) is to acquire measurements to determine the direct and indirect effects of solar radiation on climate. TSIS total solar irradiance measurements will extend a 37-year long uninterrupted measurement record of incoming solar radiation, the dominant energy source driving the Earths climate and the most precise indicator of changes in the Suns energy output. TSIS solar spectral irradiance measurements will determine the regions of the Earths multi-layered atmosphere that are affected by solar variability, from which the solar forcing mechanisms causing changes in climate can be quantified. TSIS includes two instruments: the Total Irradiance Monitor (TIM) and the Spectral Irradiance Monitor (SIM), integrated into a single payload. The TSIS TIM and SIM instruments are upgraded versions of the two instruments that are flying on the Solar Radiation and Climate Experiment (SORCE) mission launched in January 2003. TSIS was originally planned for the nadir-pointing National Polar-orbiting Operational Environmental Satellite System (NPOESS) spacecraft. The TSIS instrument passed a Critical Design Review (CDR) for NPOESS in December 2009. In 2010, TSIS was re-planned for the Joint Polar Satellite System (JPSS) Polar Free Flyer (PFF). The TSIS TIM, SIM, and associated electronics were built, tested, and successfully completed pre-ship review as of December 2013.In early 2014, NOAA and NASA agreed to fly TSIS on the International Space Station (ISS). In the FY16 Presidents Budget, NASA assumes responsibility for the TSIS mission on ISS. The TSIS project includes requirements, interface, design, build and test of the TSIS payload, including an updated pointing system, for accommodation on the ISS. It takes advantage of the prior development of the TSIS sensors and electronics. The International Space Station (ISS) program contributions include launch services and robotic installation of the TSIS payload onto an ISS Express Logistics Carrier, mission operations, and communications. Total and Spectral solar irradiance data products will be produced, calibrated, and made publically available through the Goddard Earth Science Data and Information Services Center (GES DISC).The NASA GSFC TSIS project at GSFC is responsible for project management, system engineering, safety and mission assurance, and engineering oversight for the TSIS payload. The TSIS project has contracted with the University of Colorado Laboratory for Atmospheric and Space Physics (LASP) for the design, development and testing of TSIS, support for ISS integration, science operations of the TSIS instrument, data processing, data evaluation and delivery to the GES DISC. TSIS will be delivered to Kennedy Space Center for integration in 2017, with launch and installation onto ISS planned for late 2017-early 2018. After a 90-day check-out period, NASA plans five years of TSIS operations.

spectral emission↗
NASA NTRS2018

The Importance of User Feedback in Sustaining Trusted Repositories

The NASA Earth Observation System Data and Information System (EOSDIS) has been operating since 1994 and is serving a global user community with well-managed Earth science data in a variety of scientific disciplines. EOSDIS processes, archives and distributes data and information products resulting from spaceborne and airborne instruments as well as in situ measurements from field campaigns. The Earth Science Data and Information System (ESDIS) Project at the NASA Goddard Space Flight Center manages EOSDIS with its 12 Distributed Active Archive Centers (DAACs) located across the United States. During the entire life of EOSDIS, the ESDIS Project and the DAACs have deployed many different mechanisms for user feedback, which have proven extremely valuable to their evolution and performance in their service to user communities. Some of the inputs from our user groups have resulted in fundamental changes in the architecture, design and operations of EOSDIS, while others have provided novel ideas for incremental changes. The EOSDIS DAACs have User Working Groups (UWGs) that represent broad user communities in the Earth science disciplines served by the DAACs. The UWGs meet periodically to assess and provide feedback on dataset and service priorities. As regular users of the data and services of the DAAC and experts in the scientific disciplines, the UWG members provide valuable inputs for planning and prioritizing the services, as well as addition of new datasets, for the benefit of the community. The EOSDIS is evaluated annually through an independently administered survey of its users resulting in the American Customer Satisfaction Index (ACSI). The survey provides an ACSI score as well as free-text suggestions from users, which are also helpful in making specific system improvements. In addition, each of the DAACs has a user services group that address on-going requests for help and other comments from users. The ESDIS Project has established a mechanism through the "earthdata" website (http://earthdata.nasa.gov) for users to provide feedback of any kind and these questions/comments are routed to the appropriate individuals in the Project or the DAACs. These various forms of receiving user feedback and responding to them continue to be extremely valuable in evolving and sustaining our Earth Science repository.

Behnke, Jeanne↗
NASA NTRS2018

Introduction to NASA Goddard Workshop on Artificial Intelligence

Artificial Intelligence (AI) is a collection of advanced technologies that allows machines to think and act, both humanly and rationally, through sensing, comprehending, acting and learning. AI's foundations lie at the intersection of several traditional fields Philosophy, Mathematics, Economics, Neuroscience, Psychology and Computer Science. Although the inception of AI started in the 1950's, it has recently made a strong comeback in all aspects of society and all over the world; this is mainly due to the timely combination of increased data volumes, advanced and mature algorithms, and improvements in computing power and storage. Current AI applications include big data analytics, robotics, intelligent sensing, assisted decision making, and speech recognition just to name a few.This workshop will be investigating how AI technologies can be adapted or developed to address the following challenges: Discover events of interest and correlations in large amounts of science data; improve the outcomes of science modeling and data assimilation using improved data processing, integration, and analysis. Design advisors for mission planning and operations, including anomaly detection and spacecraft health monitoring. Develop tools for engineering support, including advanced manufacturing, orbit determination, new component design and system engineering. Customize intelligent user interfaces, including visual analytics and natural language processing.

Le Moigne, Jacqueline↗
NASA NTRS2019

Uncertainty Quantification for JPL Retrievals

We define the notions of verification, validation, and uncertainty quantification (VVUQ), and place them in the context of retrievals of Earth science data. Uncertainty quantification (UQ) is the process of characterizing the uncertainty of a measurement system relative to the true, physical quantity it measures. UQ is needed when measurements are used for scientific inference, assimilated into models with other data, and used for decision-making and risk analysis. Many measurements come with measures of standard error and bias, but these uncertainty measures are often inaccurate, due to the operational need to assume crisp values for parameters which are in fact uncertain, as well as the failure of technical assumptions needed by operational error-estimation approaches. UQ provides a way to study which assumptions fail to hold, and a tool to improve the measurement. We describe a particular, broadly-applicable UQ setup that has been successful for JPL retrievals including OCO-2, and provide recommendations for furthering the UQ state of the practice at JPL.

Turmon, Michael↗
NASA NTRS1996

RADARSAT Processing System at ASF

This paper outlines the ASF (Alaska SAR[synthetic aperture radar] Facility) Radarsat data processing requirements as driven by the science users and describes the Radarsat processing system design and implementaiton approach to meet the challenge of providing ASF with and integrated operational SAR image production facility. Design and implementation attributes that facilitate syswtem growth in handling future SAR missions such as Envisat and HIROS are also addressed.

ASF↗
NASA NTRSDate not supplied

EOSDIS Archive & Data Stewardship

NASA’s Earth Observing System Data and Information System’s (EOSDIS) was built to archive and distribute earth science data from flight and research programs. At the close of FY2020, the data collection had grown to over 42 petabytes distributed across the US. This presentation describes fundamentals associated with managing a free and open archive of this size for a worldwide, multi-discipline user community. The presentation is prepared for the Committee on Earth Observation Satellites (CEOS), which strives to enhance international coordination and data exchange and to optimize societal benefit. The Working Group on Information System and Services (WGISS) is a forum within CEOS for the collaboration with other international and domestic agencies io the development of Earth observation data archives, systems and services. This presentation reviews the construct of the EOSDIS archives, formats for long term archive, preservation of appropriate data and documents, and challenges facing the community.

earth science↗
NASA NTRS2020

Mitigating Fading in Cislunar Communications: Application to the Human Landing System

NASA’s human exploration program is currently working towards landing astronauts on the surface of the Moon by 2024, close the lunar South Pole. To guarantee astronaut safety and maximize science data return, NASA is in the process of defining the communication architecture that will support all astronaut activities from launch to surface operations. Of particular interest to this paper are links from the lunar surface back to Earth without any intermediate relays. We show that the system geometry is such that antennas on the landing system will need to be pointed at low elevation angles, thus potentially causing multi-path fading effects not typically encountered in space communications. This paper is organized in three parts. First, we characterize the multi-path fading effects expected in links between the lunar South Pole and Earth and show that for moderate data rates (less than 1 Mbps) the links suffer from slow fading. We then show that for this operations regime the performance of forward error correction schemes is significantly worse for traditional Additive White Gaussian Noise channels. Finally, we investigate multi-copy mechanisms to mitigate the effects of fading, most notably repetition schemes and Automatic Repeat Request.

Sanchez Net, Marc↗
DOE OSTI2025

Euclid I. Overview of the Euclid mission

The current standard model of cosmology successfully describes a variety of measurements, but the nature of its main ingredients, dark matter and dark energy, remains unknown. Euclid is a medium-class mission in the Cosmic Vision 2015–2025 programme of the European Space Agency (ESA) that will provide high-resolution optical imaging, as well as near-infrared imaging and spectroscopy, over about 14 000 deg 2 of extragalactic sky. In addition to accurate weak lensing and clustering measurements that probe structure formation over half of the age of the Universe, its primary probes for cosmology, these exquisite data will enable a wide range of science. This paper provides a high-level overview of the mission, summarising the survey characteristics, the various data-processing steps, and data products. We also highlight the main science objectives and expected performance.

cosmology↗
NASA NTRS2002

Science Goal Driven Observing: A Step Towards Maximizing Science Returns and Spacecraft Autonomy

While recent missions have made great strides in the ability to autonomously monitor and react to changing health and physical status of spacecraft, little progress has been made in responding quickly to science driven events. Also, the new generation of space-based telescopes will generate data at an unprecedented rate. Yet, while on-board data processing and storage capability will increase rapidly, bandwidth for downloading data will not increase as fast and can become a significant cost of a science program. For observations of inherently variable targets and targets of opportunity, the ability to recognize early if an observation will not meet the science goals, and react accordingly, can have a major positive impact on the overall scientific returns of an observatory and on its operational costs. If the observatory can reprioritize the schedule to focus on alternate targets, discard uninteresting observations prior to downloading, or download them at a reduced resolution its overall efficiency will be dramatically increased. We are investigating and developing tools for a science goal monitoring (SGM) system. The SGM will have an interface to help capture higher-level science goals from the scientists and translate them into a flexible observing strategy that SGM can execute and monitor. SGM will then monitor the incoming data stream and interface with data processing systems to recognize significant events. When an event occurs, the system will use the science goals given it to reprioritize observations, and react appropriately and/or communicate with ground systems - both human and machine - for confirmation and/or further high priority analyses.

Jones, Jeremy↗
NASA NTRSDate not supplied

Best Practices from NASA's Open Science Response to the Satellite Needs Working Group (SNWG) Process

The Satellite Needs Working Group (SNWG) in the U.S. Group on Earth Observations (USGEO) provides dedicated analysis and advice to the Office of Science and Technology Policy (OSTP), and is charged with identifying satellite data needs across the U.S. Government agencies to which the National Aeronautics and Space Administration (NASA) responds with solutions aligning with its missions and goals. The SNWG puts out a biennial survey to the U.S. Government agencies asking a variety of questions aimed at gleaning their current needs for satellite data. NASA’s response to the SNWG since 2016 has been to serve the community at large with open science and open data products derived through the SNWG process. With the next SNWG cycle set to kick off in 2022, the NASA SNWG team has been actively working to incorporate lessons learned from the past three cycles into the NASA-side process and tools. We will discuss the best practices and tools NASA has developed in response to the SNWG survey assessment process. These assist NASA’s decisions on how best to utilize existing, and proposing new, products and services to address the needs of other U.S. agencies.

Cerese Albers↗
NASA NTRSDate not supplied

New developments in space radiation research at NASA: Annotating data using a novel radiation biology ontology

Like many interdisciplinary sciences, data producers and consumers in the field of radiation biology often use a wide variety of terminology to describe their experiments and data. Furthermore, space systems and technologies are rapidly evolving, and a shared understanding and common terminology for these is also lacking. The efficiency of research organizations can be enhanced by standardizing metadata through the use of knowledge resources like ontologies. Employing a sophisticated model such as a formal ontology to standardize metadata enables automated data acquisition processes and supports more complete, accurate meta-analysis through more efficient and complete data discovery and retrieval, particularly when using multiple data sources. Thus, we developed the Radiation Biology Ontology (RBO) in order to improved radiation biology metadata uniformity and transparency. We used open-source software (the Ontology Development Kit, Protégé and WebProtégé) and worked within the OBO Foundry framework, which includes a set of ontology development principles and practices for ontology consistency, uniformity, and accountability. The RBO has now been incorporated into two radiation research data repositories, NASA’s GeneLab omics database (https://genelab.nasa.gov), and the European Commission STORE database (https://www.storedb.org/). Continuous build integration tools allowed our international RBO collaboration to be more efficient and focus its efforts on semantic model design. Currently, the RBO contains over 300 annotated classes and individuals specific to the study of radiation on biological systems, as well as imports of many additional classes from other OBO Foundry ontologies that relate to and/or provide context for these RBO entities. We publish the RBO through the OBO Foundry, so that it is available for browsing, download, and querying through NCBI Bioportal web site and application programming interface. The NASA Ames Life Science Data Archive (ALSDA) is also in the process of adopting use of the RBO, taking NASA one step closer to a knowledge-based system for space biology data. It is our hope that the global communities of radiation research Investigators, data curators and data analysts can similarly leverage the RBO and will contribute to its further development.

radiation↗