Search NASA⌕ Search

SEARCH · Search NASA

Results for “Science Archive”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
NASA NTRS2002

Transport and Meteorological Analysis

The objectives of this work are twofold. First, to provide real-time meteorological satellite guidance to airborne field missions for NASA's Upper Atmosphere Research Program, the Global Tropospheric Experiment, and the Atmospheric Effects of Aviation Project. Extensive meteorological satellite datasets were provided for use by the mission scientist and by the science team. These same data were then archived for postdeployment data analysis by the science team. Second, to provide scientific analysis of the data from the airborne field missions supported. The results of these analyses were made public through peer-reviewed publications.

Pfister, Leonhard↗
DOE OSTI2021

Developing Bloom Filters for Web Archives’ Holdings (Final Project Report)

The main goal of the project was to develop a framework for web archives to create Bloom filters based on their holdings of archived web resources. A Bloom filter (BF) is a data structure that, in our scenario, contains hash values of all (or a subset of) URLs, of which an archive has one or more archival copies. Two main use cases fall in scope for this project and are supported by a BF implementation: 1) Sharing of an archive’s holdings (URLs) and 2) Querying the holdings of one or more archives. Since URL strings are hashed before ingested into the BF, the index of an archive is not shared in plain text when the BF is shared with trusted parties. On the other hand, a BF implementation does allow queries for a URL to confirm if an archive indeed has one or more archival copies of that URL. This collaborative project between Los Alamos National Laboratory (LANL) and the Croatian Web Archive (HAW), from the National and University Library in Zagreb (NSK), developed by NSK and University of Zagreb University Computing Center SRCE), aimed at developing software to create BFs, evaluate the scalability of the approach, pilot a search service based on BFs, and design a framework for archives to share their filters with trusted parties. In the remainder of this document, we will report on the work completed with respect to the individual deliverables, outline aspects of future work, and conclude with our recommendations for the use of BFs for the web archiving community.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1994

Architecture and evolution of Goddard Space Flight Center Distributed Active Archive Center

The Goddard Space Flight Center (GSFC) Distributed Active Archive Center (DAAC) has been developed to enhance Earth Science research by improved access to remote sensor earth science data. Building and operating an archive, even one of a moderate size (a few Terabytes), is a challenging task. One of the critical components of this system is Unitree, the Hierarchical File Storage Management System. Unitree, selected two years ago as the best available solution, requires constant system administrative support. It is not always suitable as an archive and distribution data center, and has moderate performance. The Data Archive and Distribution System (DADS) software developed to monitor, manage, and automate the ingestion, archive, and distribution functions turned out to be more challenging than anticipated. Having the software and tools is not sufficient to succeed. Human interaction within the system must be fully understood to improve efficiency to improve efficiency and ensure that the right tools are developed. One of the lessons learned is that the operability, reliability, and performance aspects should be thoroughly addressed in the initial design. However, the GSFC DAAC has demonstrated that it is capable of distributing over 40 GB per day. A backup system to archive a second copy of all data ingested is under development. This backup system will be used not only for disaster recovery but will also replace the main archive when it is unavailable during maintenance or hardware replacement. The GSFC DAAC has put a strong emphasis on quality at all level of its organization. A Quality team has also been formed to identify quality issues and to propose improvements. The DAAC has conducted numerous tests to benchmark the performance of the system. These tests proved to be extremely useful in identifying bottlenecks and deficiencies in operational procedures.

Bedet, Jean-Jacques↗
NASA NTRS2002

Global Change Data Center: Mission, Organization, Major Activities, and 2001 Highlights

Rapid efficient access to Earth sciences data is fundamental to the Nation's efforts to understand the effects of global environmental changes and their implications for public policy. It becomes a bigger challenge in the future when data volumes increase further and missions with constellations of satellites start to appear. Demands on data storage, data access, network throughput, processing power, and database and information management are increased by orders of magnitude, while budgets remain constant and even shrink. The Global Change Data Center's (GCDC) mission is to provide systems, data products, and information management services to maximize the availability and utility of NASA's Earth science data. The specific objectives are (1) support Earth science missions be developing and operating systems to generate, archive, and distribute data products and information; (2) develop innovative information systems for processing, archiving, accessing, visualizing, and communicating Earth science data; and (3) develop value-added products and services to promote broader utilization of NASA Earth Sciences Enterprise (ESE) data and information. The ultimate product of GCDC activities is access to data and information to support research, education, and public policy.

Wharton, Stephen W.↗
NASA NTRSDate not supplied

NASA’s Atmospheric Science Data Center’s Approach to a Cloud-Based Model of Ingest, Archival, and Distribution of TEMPO Data: Methods, Challenges, and Best Practices

The National Aeronautics and Space Administration's (NASA) Atmospheric Science Data Center (ASDC) at NASA Langley Research Center in Hampton, VA provides atmospheric science data products and services to the science community, including enhanced search and subsetting capabilities for numerous datasets. The ASDC is the official Distributed Active Archive Center (DAAC) of record for the upcoming Tropospheric Emissions: Monitoring of Pollution (TEMPO) instrument. TEMPO will be situated on a geostationary satellite positioned at a longitude near the center of the conterminous United States and focused on North America, making hourly swaths of its field of regard from east to west. ASDC’s data products are currently hosted locally and services (e.g., spatial and temporal subsetting) are managed on premises. The ASDC is planning to provide TEMPO data and services in the cloud through the Earthdata Search platform. This presentation will discuss the ASDC’s approach to a cloud-based model of ingest, archival, and distribution of TEMPO data. Methods, challenges, best practices, lessons learned, and future plans will be discussed.

Iman Nasif↗
NASA NTRS1990

Multi-terabyte image storage and distribution for NASA's Hubble Space Telescope

The modular architecture, functionality, and key components of the Hubble Space Telescope Data Archive Distribution Service (DADS) are presented. DADS functions comprise archive management, catalog management, and user interface. The distributed modular architecture utilized is made up of four subsystems, including the archive, host, catalog, and the Science Operations ground System/DADS Interface Processor. All data generated by the HST are archived in DADS on 12-in. optical disks. DADS is a permanent archive with a data capacity of 30 terabytes that can be expanded to 68 terabytes. Supplementary information and stellar observations will be instantly accessible through DADS, which can collect and archive more than 3 gigabytes per day of image and support data over the lifetime of the HST. Electronic and physical media will be accessible through 140 network connections, with a catalogue to assist in data set selection.

Weller, H. W., Jr.↗
NASA NTRS2019

Collecting and Processing Earth Science Data Metrics at NASA ESDIS

Since the launch of Terra satellite in 1999, the number of Earth Science remote sensing data products created and distributed by NASA's Earth Observing System (EOS) Data and Information System (EOSDIS) has increased from a few hundred to nearly ten thousand. NASA's Earth Science Data and Information System (ESDIS) Metrics System (EMS) collects metrics on data ingest, archive, and distribution by its Distributed Active Archive Centers (DAACs) and the Science Investigator-led Systems (SIPS), known as Data Providers. These metrics are critical in helping NASA management as well as data producers in resource planning and gaining a wide range of knowledge of data users and data usage.EMS receives flat files, or log files of data archive, ingest, and distribution either in their raw format, such as Apache web logs, or text files of log records formatted by the Data Providers. Tens of millions of records are processed each day to extract metrics on data products, user information, distribution protocols and services, and so on. The metrics are then made available to designated parties.This presentation provides an overview of the EMS processing workflow and improvement efforts made in recent years to handle ever-increasing number of data records and new metrics requirements, discusses several key steps including mapping log records to data products and identifying user communities along with geo-distribution, and demonstrates typical metrics capabilities produced by the EMS system. Challenges and potential approaches to improve the system are also discussed.

Pan, Jianfu↗
NASA NTRS2010

Photometric Analysis in the Kepler Science Operations Center Pipeline

We describe the Photometric Analysis (PA) software component and its context in the Kepler Science Operations Center (SOC) pipeline. The primary tasks of this module are to compute the photometric flux and photocenters (centroids) for over 160,000 long cadence (~thirty minute) and 512 short cadence (~one minute) stellar targets from the calibrated pixels in their respective apertures. We discuss the science algorithms for long and short cadence PA: cosmic ray cleaning; background estimation and removal; aperture photometry; and flux-weighted centroiding. We discuss the end-to-end propagation of uncertainties for the science algorithms. Finally, we present examples of photometric apertures, raw flux light curves, and centroid time series from Kepler flight data. PA light curves, centroid time series, and barycentric timestamp corrections are exported to the Multi-mission Archive at Space Telescope [Science Institute] (MAST) and are made available to the general public in accordance with the NASA/Kepler data release policy.

Twicken, Joseph D.↗
NASA NTRS2010

Photometric Analysis in the Kepler Science Operations Center Pipeline

We describe the Photometric Analysis (PA) software component and its context in the Kepler Science Operations Center (SOC) Science Processing Pipeline. The primary tasks of this module are to compute the photometric flux and photocenters (centroids) for over 160,000 long cadence (~thirty minute) and 512 short cadence (~one minute) stellar targets from the calibrated pixels in their respective apertures. We discuss science algorithms for long and short cadence PA: cosmic ray cleaning; background estimation and removal; aperture photometry; and flux-weighted centroiding. We discuss the end-to-end propagation of uncertainties for the science algorithms. Finally, we present examples of photometric apertures, raw flux light curves, and centroid time series from Kepler flight data. PA light curves, centroid time series, and barycentric timestamp corrections are exported to the Multi-mission Archive at Space Telescope [Science Institute] (MAST) and are made available to the general public in accordance with the NASA/Kepler data release policy.

photocenter↗
NASA NTRS2024

Tracking Community Building in Open Science

Open Science is enabled by a vibrant community of researchers who regularly engage with the data, from its production to its organization, curation, archiving, dissemination, analysis, and publication. This presentation will examine community building in open science. The NASA Open Science Data Repository (OSDR) makes data available to the public following the FAIR (Findability, Accessibility, Interoperability, and Reusability) principles. OSDR takes open science further with the OS Analysis Working Groups (AWGs) that facilitate community development and promotion. The primary activity of each AWG is to establish and validate analytical processes to generate higher-order data from data housed in OSDR. There are a number of these groups on various topics, including the Animal AWG, Plant AWG, Microbial AWG, Multi-Omics AWG, AI/ML AWG, and the Ames Life Sciences Data Archive (ALSDA) AWG. The international volunteers participating in these AWGs come from academia, citizen science initiatives, industry, and government. They include researchers, principal investigators, professors, trained hobbyists, and students from various domains and disciplines. Anyone may request to join the AWGs, and membership requests are vetted monthly by the group organizers before granting admission. Core to membership is demonstrated expertise through records of training, integrity, work in the professed domain(s), and good community standing. Regular virtual meetings are held for each AWG, with a varying cadence depending on the group's needs and goals. AWG communities share their expertise in research including cutting edge tools, software, frameworks, data formats, and libraries accelerating research collectively. This collaborative approach helps community members cross technology gaps and identify emerging challenges. These diverse communities encompass a wide range of individuals hailing from various sectors within the Science Mission Directorate and beyond. They serve as a means to promote and enhance transparency, accessibility, and inclusion. An annual AWG Symposium brings contributors together in person. Participation in AWGs can be synchronous or asynchronous, with some groups performing most of their work in off hours. Participants gain valuable skills and connections that allow them to add value to their communities and new organizations that they join, resulting in an expanded return on investment for the space life science community. Open science is increasingly a federal mandate and initiatives like NASA's Transform to Open Science and instruments like the Decadal Survey of Biological and Physical Sciences in Space demonstrate the need to carefully consider best practices in this domain. Here, we present greater detail about the makeup and participation metrics of the various AWGs affiliated with OSDR and details of successful peer-reviewed publication campaigns.

Christina M Johnson↗
NASA NTRSDate not supplied

Tracking Community Building in Open Science

Open Science is enabled by a vibrant community of researchers who regularly engage with the data, from its production to its organization, curation, archiving, dissemination, analysis, and publication. This presentation will examine community building in open science. The NASA Open Science Data Repository (OSDR) makes data available to the public following the FAIR (Findability, Accessibility, Interoperability, and Reusability) principles. OSDR takes open science further with the OS Analysis Working Groups (AWGs) that facilitate community development and promotion. The primary activity of each AWG is to establish and validate analytical processes to generate higher-order data from data housed in OSDR. There are a number of these groups on various topics, including the Animal AWG, Plant AWG, Microbial AWG, Multi-Omics AWG, AI/ML AWG, and the Ames Life Sciences Data Archive (ALSDA) AWG. The international volunteers participating in these AWGs come from academia, citizen science initiatives, industry, and government. They include researchers, principal investigators, professors, trained hobbyists, and students from various domains and disciplines. Anyone may request to join the AWGs, and membership requests are vetted monthly by the group organizers before granting admission. Core to membership is demonstrated expertise through records of training, integrity, work in the professed domain(s), and good community standing. Regular virtual meetings are held for each AWG, with a varying cadence depending on the group's needs and goals. AWG communities share their expertise in research including cutting edge tools, software, frameworks, data formats, and libraries accelerating research collectively. This collaborative approach helps community members cross technology gaps and identify emerging challenges. These diverse communities encompass a wide range of individuals hailing from various sectors within the Science Mission Directorate and beyond. They serve as a means to promote and enhance transparency, accessibility, and inclusion. An annual AWG Symposium brings contributors together in person. Participation in AWGs can be synchronous or asynchronous, with some groups performing most of their work in off hours. Participants gain valuable skills and connections that allow them to add value to their communities and new organizations that they join, resulting in an expanded return on investment for the space life science community. Open science is increasingly a federal mandate and initiatives like NASA's Transform to Open Science and instruments like the Decadal Survey of Biological and Physical Sciences in Space demonstrate the need to carefully consider best practices in this domain. Here, we present greater detail about the makeup and participation metrics of the various AWGs affiliated with OSDR and details of successful peer-reviewed publication campaigns.

Christina M Johnson↗
NASA NTRS2019

Improving Earth Science Data Literacy

The improvement of scientific literacy across the public can take on a myriad of forms and activities. The vast archives of NASA’s Earth science data, as one example, reflect the agency’s ongoing commitment to producing the highest quality data, services and tools intended for enabling the public to understand the complexity of Earth systems. The focus of this presentation is to explore and reveal the specific strategies the NASA Earth Science Data and Information System (ESDIS) Project uses to support our very large and diverse user communities access to and understanding of these science data and services. The diversity of our subject matter, spanning the whole Earth science domain, is mirrored by our user communities which are equally as broad in their needs and abilities. ESDIS and the supporting Communication Team leverages an array of internet-based tools and communication strategies to both understand actual user needs and develop optimum pathways for improving our users’ knowledge and understanding of the data. We will focus our limited time on a few of the high-impact activities including Webinars, or video-based, on-line, interactive discussions and presentations that since their introduction in 2013 have become a staple for user-instructor interaction via the internet. Here we discuss the types of content we produce and many lessons learned on how best to use this medium for improving user literacy on the subject at hand. In addition, we include discussion of our approach to using various social media platforms and tools to bolster the awareness of our users for data and services that are likely of interest. The ESDIS project remains active in various social media campaigns where our particular blend of science, data and tools engages new users curious of how to get their science or application started using NASA-available data. We anticipate that these examples may prove to be novel in their application to improving science literacy and skill development among the public.

Lindsay, Francis↗
NASA NTRS2003

Atmospheric products from the Upper Atmosphere Research Satellite (UARS)

This paper provides information on the products available at the NASA Goddard Earth Sciences (GES) Distributed Active Archive Center (DAAC) from the Upper Atmosphere Research Satellite (UARS) mission. The GES DAAC provides measurements from the primary UARS mission, which extended from launch in September 1991 through September 2001. The ten instruments aboard UARS provide measurements of atmospheric trace gas species, dynamical variables, solar irradiance input, and particle energy flux. All standard Level 3 UARS products from all ten instruments are offered free to the public and science user community. The Level 3 data are geophysical parameters, which have been transformed into a common format and equally spaced along the measurement trajectory. The UARS data have been reprocessed several times over the years following improvements to the processing algorithms. The UARS data offered from the GES DAAC are the latest versions of each instrument. The UARS data may be accessed through the GES DAAC website at

Ahmad, Suraiya P.↗
NASA NTRS2010

Presearch Data Conditioning in the Kepler Science Operations Center Pipeline

We describe the Presearch Data Conditioning (PDC) software component and its context in the Kepler Science Operations Center (SOC) pipeline. The primary tasks of this component are to correct systematic and other errors, remove excess flux due to aperture crowding, and condition the raw flux light curves for over 160,000 long cadence (~thirty minute) and 512 short cadence (~one minute) targets across the focal plane array. Long cadence corrected flux light curves are subjected to a transiting planet search in a subsequent pipeline module. We discuss the science algorithms for long and short cadence PDC: identification and correction of unexplained (i.e., unrelated to known anomalies) discontinuities; systematic error correction; and excess flux removal. We discuss the propagation of uncertainties from raw to corrected flux. Finally, we present examples of raw and corrected flux time series for flight data to illustrate PDC performance. Corrected flux light curves produced by PDC are exported to the Multi-mission Archive at Space Telescope [Science Institute] (MAST) and will be made available to the general public in accordance with the NASA/Kepler data release policy.

Twicken, Joseph D.↗
NASA NTRS2007

Earth Observations to Assess Impact of Hurricane Katrina on John C. Stennis Space Center

The peril from hurricanes to Space Operations Centers is real and is forecast to continue; Katrina, Rita, and Wilma of 2005 and Charley, Frances, Ivan, and Jeanne of 2004 are sufficient motivation for NASA to develop a multi-Center plan for preparedness and response. As was demonstrated at SSC (Stennis Space Center) in response to Hurricane Katrina, NASA Centers are efficiently activated as local command centers, playing host to Federal and State agencies and first responders to coordinate and provide evacuation, relocation, response, and recovery activities. Remote sensing decision support provides critical insight for managing NASA infrastructure and for assisting Center decision makers. Managers require geospatial information to manage the federal city. Immediately following Katrina, SSC s power and network connections were disabled, hardware was inoperative, technical staff was displaced and/or out of contact, and graphical decision support tools were non-existent or less than fully effective. Despite this circumstance, SSC EOC (Emergency Operations Center) implemented response operations to assess damage and to activate recovery plans. To assist Center Managers, the NASA ASP (Applied Sciences Program) made its archive of high-resolution data over the site available. In the weeks and months after the immediate crisis, NASA supplemented this data with high-resolution, post-Katrina imagery over SSC and much of the affected coastal areas. Much of the high-resolution imagery was made available through the Department of Defense Clear View contract and was distributed through U.S. Geological Survey Center for Earth Resources Observation and Science "Hurricane Katrina Disaster Response" Web site. By integrating multiple image data types with other information sources, ASP applied an all-source solutions approach to develop decision support tools that enabled managers to respond to critical issues, such as expedient access to infrastructure and deployment of resources, provision of temporary shelter, logistical control of critical supplies, and the mobilization and coordination of assets from ground crews to aircraft/airspace management. Furthermore, ASP developed information products that illustrate risks to SSC's infrastructure from surge, inundation, and flood. Current plans include developing wind-risk prototype products for refinement and adoption into EOC plans.

Graham, William D.↗
NASA NTRS2017

A-Train Datalist - A New GES DISC Service to Allow One-Stop Shopping for A-Train Data

The currently available services at the Goddard Earth Sciences Data Information Services Center (GES DISC) only allow users to select variables from a single data set at a time. Because entire variables from a data set are often displayed, user selection of variables of interest can be overwhelming. At the American Geophysical Union (AGU) 2016 Fall Meeting, GES DISC unveiled a new service called Datalist: a collection of predefined or user-defined data variables from one or more archived data sets. Our science support team has been curating Datalists and providing added value to the user community.Originally known as Afternoon Constellation, A-Train includes six currently on polar-orbiting Earth observation satellites: OCO-2, GCOM-W1, Aqua, CALIPSO, CloudSat, and Aura, which travel a few minutes apart from each other. This constellation arrangement has enabled coordinated science observations further forming comprehensive pictures of Earth weather and climate that are readily for use in crucial studies such as climate change.GES DISC Datalists are based on the software architecture of the new GES DISC website (also unveiled at the AGU 2016 Fall Meeting). The GES DISC science support team has created a Datalist to support the A-Train Data Depot (ATDD). Using pre-defined Datalist should hopefully save users significant effort in their data searches.

A-Train data ordering↗
NASA NTRSDate not supplied

Experience in Visualizing Satellite Data With AR/VR Technologies at NASA's GES-DISC

The Goddard Earth Sciences Data and Information Services Center (GES-DISC) at NASA plays a crucial role in archiving and disseminating vital Earth science data. In this project, we leverage immersive visualization technologies to reshape engagement with and comprehension of the intricate datasets of our planet. Through the adoption of immersive technologies, we are enhancing established methods, offering novel, intuitive experiences in visualizing and interacting with Earth science data. Our goal is to contribute to the ongoing evolution of data interaction, pushing the boundaries of what's possible in data interpretation and education.

Visualization↗