Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data access”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Framework for Processing Citizens Science Data for Applications to NASA Earth Science Missions

Citizen science (or crowdsourcing) has drawn much high-level recent and ongoing interest and support. It is poised to be applied, beyond the by-now fairly familiar use of, e.g., Twitter for natural hazards monitoring, to science research, such as augmenting the validation of NASA earth science mission data. This interest and support is seen in the 2014 National Plan for Civil Earth Observations, the 2015 White House forum on citizen science and crowdsourcing, the ongoing Senate Bill 2013 (Crowdsourcing and Citizen Science Act of 2015), the recent (August 2016) Open Geospatial Consortium (OGC) call for public participation in its newly-established Citizen Science Domain Working Group, and NASA's initiation of a new Citizen Science for Earth Systems Program (along with its first citizen science-focused solicitation for proposals). Over the past several years, we have been exploring the feasibility of extracting from the Twitter data stream useful information for application to NASA precipitation research, with both "passive" and "active" participation by the twitterers. The Twitter database, which recently passed its tenth anniversary, is potentially a rich source of real-time and historical global information for science applications. The time-varying set of "precipitation" tweets can be thought of as an organic network of rain gauges, potentially providing a widespread view of precipitation occurrence. The validation of satellite precipitation estimates is challenging, because many regions lack data or access to data, especially outside of the U.S. and in remote and developing areas. Mining the Twitter stream could augment these validation programs and, potentially, help tune existing algorithms. Our ongoing work, though exploratory, has resulted in key components for processing and managing tweets, including the capabilities to filter the Twitter stream in real time, to extract location information, to filter for exact phrases, and to plot tweet distributions. The key step is to process the "precipitation" tweets to be compatible with satellite-retrieved precipitation data. These key components for processing and managing "precipitation" tweets (and additional ones to be developed) are not limited to precipitation, nor are they limited to the Twitter social medium. Indeed, to maximize the value of our work for NASA earth science programs, these components should be generalized and be part of an overall framework for processing citizen science data for science research. In this paper, we outline such a framework.

earth science satellite data↗

So, How Much of the Earth's Surface Is Covered by Rain Gauges?

The measurement of global precipitation, both rainfall and snowfall, is critical to a wide range of users and applications. Rain gauges are indispensable in the measurement of precipitation, remaining the de facto standard for precipitation information across Earths surface for hydrometeorological purposes. However, their distribution across the globe is limited: over land their distribution and density is variable, while over oceans very few gauges exist and where measurements are made, they may not adequately reflect the rainfall amounts of the broader area. Critically, the number of gauges available, or appropriate for a particular study, varies greatly across the Earth owing to temporal sampling resolutions, periods of operation, data latency, and data access. Numbers of gauges range from a few thousand available in near real time to about 100,000 for all official gauges, and to possibly hundreds of thousands if all possible gauges are included. Gauges routinely used in the generation of global precipitation products cover an equivalent area of between about 250 and 3,000 sq m. For comparison, the center circle of a soccer pitch or tennis court is about 260 sq m. Although each gauge should represent more than just the gauge orifice, autocorrelation distances of precipitation vary greatly with regime and the integration period. Assuming each Global Precipitation Climatology Centre (GPCC) available gauge is independent and represents a surrounding area of 5-km radius, this represents only about 1% of Earths surface. The situation is further confounded for snowfall, which has a greater measurement uncertainty.

Rain gauge↗

Harvesting NASA's Common Metadata Repository (CMR)

As part of NASA's Earth Observing System Data and Information System (EOSDIS), the Common Metadata Repository (CMR) stores metadata for over 30,000 datasets from both NASA and international providers along with over 300M granules. This metadata enables sub-second discovery and facilitates data access. While the CMR offers a robust temporal, spatial and keyword search functionality to the general public and international community, it is sometimes more desirable for international partners to harvest the CMR metadata and merge the CMR metadata into a partner's existing metadata repository. This poster will focus on best practices to follow when harvesting CMR metadata to ensure that any changes made to the CMR can also be updated in a partner's own repository. Additionally, since each partner has distinct metadata formats they are able to consume, the best practices will also include guidance on retrieving the metadata in the desired metadata format using CMR's Unified Metadata Model translation software.

Earth Resources↗

Mining Twitter Data to Augment NASA GPM Validation

The Twitter data stream is an important new source of real-time and historical global information for potentially augmenting the validation program of NASA's Global Precipitation Measurement (GPM) mission. There have been other similar uses of Twitter, though mostly related to natural hazards monitoring and management. The validation of satellite precipitation estimates is challenging, because many regions lack data or access to data, especially outside of the U.S. and in remote and developing areas. The time-varying set of "precipitation" tweets can be thought of as an organic network of rain gauges, potentially providing a widespread view of precipitation occurrence. Twitter provides a large source of crowd for crowdsourcing. During a 24-hour period in the middle of the snow storm this past March in the U.S. Northeast, we collected more than 13,000 relevant precipitation tweets with exact geolocation. The overall objective of our project is to determine the extent to which processed tweets can provide additional information that improves the validation of GPM data. Though our current effort focuses on tweets and precipitation, our approach is general and applicable to other social media and other geophysical measurements. Specifically, we have developed an operational infrastructure for processing tweets, in a format suitable for analysis with GPM data; engaged with potential participants, both passive and active, to "enrich" the Twitter stream; and inter-compared "precipitation" tweet data, ground station data, and GPM retrievals. In this presentation, we detail the technical capabilities of our tweet processing infrastructure, including data abstraction, feature extraction, search engine, context-awareness, real-time processing, and high volume (big) data processing; various means for "enriching" the Twitter stream; and results of inter-comparisons. Our project should bring a new kind of visibility to Twitter and engender a new kind of appreciation of the value of Twitter by the science research communities.

validatio↗

Model Generation to Support Model-Based Testing Applied on NASA DAT - An Experience Report

Model-based Testing (MBT), where a model of the system under tests (SUT) behavior is used to automatically generate executable test cases, is a promising and versatile testing technology. Nevertheless, adoption of MBT technologies in industry is slow and many testing tasks are performed via manually created executable test cases (i.e. test programs such as JUnit). In order to adopt MBT, testers must learn how to construct models and use these models to generate test cases, which might be a hurdle. An interesting observation in our previous work is that the existing manually created test cases often provided invaluable insights for the manual creation of the testing models of the system. In this paper we present an approach that allows the tester to first create and debug a set of test cases. When the tester is happy with the test cases, the next step is to automatically generate a model from the test cases. The generated model is derived from the test cases, which are actions that the system can perform (e.g. a button clicks) and their expected outputs in form of assert statements (e.g. assert data entered). The model is a Finite State Machine (FSM) model that can be employed with little or no manual changes to generate additional test cases for the SUT. We successfully applied the approach in a feasibility study to the NASA Data Access Toolkit (DAT), which is a web-based GUI. One compelling finding is that the test cases that were generated from the automatically generated models were able to detect issues that were not detected by the original set of manually created test cases. We present the findings from the case study and discuss best practices for incorporating model generation techniques into an existing testing process.

State Machines↗

Evolving NASA's Data and Information Systems for Earth Science

The Earth Observing System Data and Information System (EOSDIS) project at GSFC (Goddard Space Flight Center) maintains and operates a data and information system for NASA's Science Mission Directorate (SMD) and its Earth Science Division (ESD) to support multidisciplinary research in Earth science and public data access.

Ramachandran, Rahul↗

Forming Aggregations using Virtual Sharding: Lessons Learned from Simple Scalable Storage (S3)

Data aggregation is the ability to combine separate datasets to form a single new logical dataset provides users with a powerful abstraction. The advantage of an aggregate dataset is that the users are freed from having to understand, and incorporate into their workflow, knowledge about the (ad hoc) organization of the constituent datasets. However, aggregating large numbers of files can be computationally complex with data server systems performing many repetitive operations. As part of the authors work on subsetting data stored on Amazon Web Service (AWS) Simple Storage Service (S3), we developed technology to read portions of otherwise monolithic data files. This enables the formation of virtual shards for user in subsetting data stored in HDF5 (hierarchical data format, version 5) files. This same tool can be used to form aggregations that combine data stored in many HDF5 files when those files are stored on S3. The nature of the virtual sharding and the algorithm that exploits it for subsetting is such that it can also be used for aggregation with the need for many of the repetitive operations required by the per file aggregation techniques. We will present timing information that demonstrates the flexibility of this approach. However, the lessons learned is that while this is a useful result in and of itself, these very same techniques can be applied in other contexts where data are stored in services and on media other than S3. For example, this same technique can be applied to data stored on spinning disk. Pushing the envelope for S3 forced a reexamination of our data access techniques which lead to unexpected positive benefits.

Gallagher, James↗

TPSAS-NF1676L-10829-DND

Galactic cosmic rays (GCR) and solar energetic particles (SEP) are the primary sources of human exposure to high linear energy transfer (LET) radiation in the atmosphere. High-LET radiation is effective at directly breaking DNA strands in biological tissue, or producing chemically active radicals in tissue that alter the cell function, both of which can lead to cancer or other adverse health effects. A prototype operational nowcast model of air-crew radiation exposure is currently under development and funded by NASA. The model predicts air-crew radiation exposure levels from both GCR and SEP that may accompany solar storms. The new air-crew radiation exposure model is called the Nowcast of Atmospheric Ionizing Radiation for Aviation Safety (NAIRAS) model. NAIRAS will provide global, data-driven, real-time exposure predictions of biologically harmful radiation at aviation altitudes. Observations are utilized from the ground (neutron monitors), from the atmosphere (the NCEP Global Forecast System), and from space (NASA/ACE and NOAA/GOES). Atmospheric observations characterize the overhead mass shielding and the ground- and space-based observations provide boundary conditions on the incident GCR and SEP particle flux distributions for transport and dosimetry calculations. Radiation exposure rates are calculated using the NASA physics-based HZETRN (High Charge (Z) and Energy TRaNsport) code. An overview of the NAIRAS model is given: the concept, design, prototype implementation status, data access, and example results. Issues encountered thus far and known and/or anticipated hurdles to research to operations transition are also discussed.

Christopher J Mertens↗

Space Radiation and Central Nervous System Impacts: NASA Standards and Evidence

It is well understood that large radiation localized doses to the brain cause clinically significant impacts to the central nervous system in human populations. However, the effects in adults exposed to lower doses remain unclear due to lack of data in relevant human cohorts. The impact of exposure to high-energy particles is even less understood. NASA’s Human Research Program relies heavily on model systems to characterize the impacts of the space radiation environment on the human brain and how potential changes may effect mission success and long term health and well-being. Animal, cellular, and molecular experiments implicate multiple – and possibly related – mechanisms that mediate impacts to the central nervous system in model systems including, but not limited to inflammation, immune responses, oxidative stress, metabolism, myelination, molecule transport, electrophysiology, and a variety of “omic” changes. While animal studies demonstrate potential changes across a number of cognitive and behavioral domains the direct applicability to the astronaut population remains unclear. Furthermore data access experiments and model systems can be inconsistent and dependent on multiple experimental variables indicating a clear need for robust validation. To minimize potential impacts to astronauts NASA limits dose to the CNS based on a combination of terrestrial epidemiology informed by experimental evidence in model systems. To date no recommendations have been provided by the National Committee on Radiation Protection and Measurements. This presentation will provide an overview of NASA’s current dose limits for CNS exposure to space radiation as well as highlights of the current state of evidence and ongoing research.

S Robin Elgart↗

Extreme Problem Solving: The New Challenges of Deep Space Exploration

On the International Space Station today, the crew has the near real-time support of a large group of system experts on the ground when dealing with problems on-board. For exploration beyond Low Earth Orbit, however, intermittent and delayed communication with ground will force small crews to take the lead in responding to vehicle anomalies. Enabling a flight crew of roughly four astronauts to perform the job that has traditionally been done by a ground crew of over 80 experts will require a fundamental rethinking of human-systems integration. Through observations of anomaly resolution processes, interviews with system experts and astronauts, and analyses of problem-solving models, we have identified the capabilities that are not currently available on-board but will be needed to enable safe exploration further away from Earth. These include increased data access, just-in-time training tools and technologies, and troubleshooting decision support. Important questions remain on how these technologies can be designed and implemented for increased crew autonomy. We present this critical challenge for deep space exploration to the human-computer interaction research community to reflect on the areas identified by our needs analysis and contemplate how they might be manifested as solutions.

autonomy↗

Altimetry for the Future: Building on 25 Years of Progress

In 2018 we celebrated 25 years of development of radar altimetry, and the progress achieved by this methodology in the fields of global and coastal oceanography, hydrology, geodesy and cryospheric sciences. Many symbolic major events have celebrated these developments, e.g., in Venice, Italy, the 15th (2006) and 20th (2012) years of progress and more recently, in 2018, in Ponta Delgada, Portugal, 25 Years of Progress in Radar Altimetry. On this latter occasion it was decided to collect contributions of scientists, engineers and managers involved in the worldwide altimetry community to depict the state of altimetry and propose recommendations for the altimetry of the future. This paper summarizes contributions and recommendations that were collected and provides guidance for future mission design, research activities, and sustainable operational radar altimetry data exploitation. Recommendations provided are fundamental for optimizing further scientific and operational advances of oceanographic observations by altimetry, including requirements for spatial and temporal resolution of altimetric measurements, their accuracy and continuity. There are also new challenges and new openings mentioned in the paper that are particularly crucial for observations at higher latitudes, for coastal oceanography, for cryospheric studies and for hydrology. The paper starts with a general introduction followed by a section on Earth System Science including Ocean Dynamics, Sea Level, the Coastal Ocean, Hydrology, the Cryosphere and Polar Oceans and the ‘‘Green” Ocean, extending the frontier from biogeochemistry to marine ecology. Applications are described in a subsequent section, which covers Operational Oceanography, Weather, Hurricane Wave and Wind Forecasting, Climate projection. Instruments’ development and satellite missions’ evolutions are described in a fourth section. A fifth section covers the key observations that altimeters provide and their potential complements, from other Earth observation measurements to in situ data. Section 6 identifies the data and methods and provides some accuracy and resolution requirements for the wet tropospheric correction, the orbit and other geodetic requirements, the Mean Sea Surface, Geoid and Mean Dynamic Topography, Calibration and Validation, data accuracy, data access and handling (including the DUACS system). Section 7 brings a transversal view on scales, integration, artificial intelligence, and capacity building (education and training). Section 8 reviews the programmatic issues followed by a conclusion.

Saleh Abdalla↗

Integrated support of NASA satellite and in situ oceanographic data via the PO.DAAC

The NASA Physical Oceanography DAAC (PO.DAAC) serves as one of the premier repositories for oceanographic satellite data. More recently, however, it is also increasingly archiving and distributing complementary in situ datasets from NASA-sponsored field campaigns. Here we present an overview of these projects, the complex multivariate data they produce, and some of the data interoperability challenges faced when dealing with such a heterogeneous suite of observations. We summarize the range of online tools and services currently available via the PODAAC, including data discovery services, web-services for subsetting/extraction, compliance checking and visualization. We also preview some new capabilities under development that may feature in future. These efforts are indicative of an evolution of DAAC services in pursuit of our broader vision: a more integrated approach to multi-sensor oceanographic data access and delivery spanning NASA satellite missions and field campaigns in support of science and applications for societal benefit.

Vannan, Suresh↗

The Scientific Legacy of NASA’s Operation IceBridge

The National Aeronautics and Space Administration (NASA)’s Operation IceBridge (OIB) was a 13-year (2009–2021) airborne mission to survey land and sea ice across the Arctic, Antarctic, and Alaska. Here, we review OIB’s goals, instruments, campaigns, key scientific results, and implications for future investigations of the cryosphere. OIB’s primary goal was to use airborne laser altimetry to bridge the gap in fine-resolution elevation measurements of ice from space between the conclusion of NASA’s Ice, Cloud, and land Elevation Satellite (ICESat; 2003–2009) and its follow-on, ICESat-2 (launched 2018). Additional scientific requirements were intended to contextualize observed elevation changes using a multisensor suite of radar sounders, gravimeters, magnetometers, and cameras. Using 15 different aircraft, OIB conducted 968 science flights, of which 42% were repeat surveys of land ice, 42% were surveys of previously unmapped terrain across the Greenland and Antarctic ice sheets, Arctic ice caps, and Alaskan glaciers, and 16% were surveys of sea ice. The combination of an expansive instrument suite and breadth of surveys enabled numerous fundamental advances in our understanding of the Earth’s cryosphere. For land ice, OIB dramatically improved knowledge of interannual outlet-glacier variability, ice-sheet, and outlet-glacier thicknesses, snowfall rates on ice sheets, fjord and sub-ice-shelf bathymetry, and ice-sheet hydrology. Unanticipated discoveries included a reliable method for constraining the thickness within difficult-to-sound incised troughs beneath ice sheets, the extent of the firn aquifer within the Greenland Ice Sheet, the vulnerability of many Greenland and Antarctic outlet glaciers to ocean-driven melting at their grounding zones, and the dominance of surface-melt-driven mass loss of Alaskan glaciers. For sea ice, OIB significantly advanced our understanding of spatiotemporal variability in sea ice freeboard and its snow cover, especially through combined analysis of fine-resolution altimetry, visible imagery, and snow radar measurements of the overlying snow thickness. Such analyses led to the unanticipated discovery of an interdecadal decrease in snow thickness on Arctic sea ice and numerous opportunities to validate sea ice freeboards from satellite radar altimetry. While many of its data sets have yet to be fully explored, OIB’s scientific legacy has already demonstrated the value of sustained investment in reliable airborne platforms, airborne instrument development, interagency and international collaboration, and open and rapid data access to advance our understanding of Earth’s remote polar regions and their role in the Earth system.

Joseph A. MacGregor↗

The GeoGLOWS Project: Essential Water Variables and Observations – Expected Value Chain, Products, Examples

Essential Water Variables (EWV) were developed over the last decade to ensure that key datasets were made available for closing the global water budget, and addressing the many international actions that require water data. Satellite, surface, and numerical model data all have a role in providing EWVs, and it is a key point that these data must be merged and then fed into decision support applications to answer all the needs of the panoply of user communities. The more specialized the applications become, the higher the demand for development and maintenance resources. Some examples of applications include the NASA Goddard Giovanni, which provides on-line data access and simple analysis; the Global Flood Monitor, which focuses on precipitation-driven flooding; the NASA Landslide Hazard Assessment for Situational Awareness, which similarly treats landslides; and the Global Streamflow Forecasting Project, which provides multiple decision support interfaces, as well as a general toolkit for building new interfaces.

Essential Water Variables↗

Louisiana Water Resources: Using NASA Earth Observations to Monitor Historical Changes in the Extension of Seagrass Meadows in the Breton National Wildlife Refuge in Louisiana

The barrier islands of Louisiana’s Breton National Wildlife Refuge (BNWR) are disappearing due to sea level rise, extreme hurricanes, sediment starvation, and the Deepwater Horizon oil spill. This decline in land area has damaged important bird habitat and reduced the islands’ ability to protect coastal Louisiana from storm surges. The persistence of the islands is synergetic to that of the surrounding seagrass beds; seagrass binds together land, protecting the islands from erosion, and the loss of land exposes the seagrass and accelerates its decline. Furthermore, seagrass is independently important, absorbing excess nutrients and providing habitat for marine ecosystems. Here we present the Tool for Coastal Remote Ecological Observations in Louisiana (Tool CREOL), a Google Earth Engine Tool built to easily access data from Landsat 5 TM, Landsat 7 ETM+, Landsat 8 OLI, and Aqua and Terra MODIS. We show, using time series and maps generated using the tool, how land area and seagrass have responded to destructive events from the past 36 years (1984-2021). In only 7 years, Hurricane Georges (1998), Ivan (2004), and Katrina (2005) reduced land area by approximately 85%, accompanied by a major decline in seagrass extent. Tool CREOL will have strategic utility in planning upcoming restoration and revegetation efforts planned by Louisiana’s Coastal Protection and Restoration Authority in the Breton National Wildlife Refuge and will provide up-to-date monitoring of the results of that project. The tool serves as a basic model which can be adapted to study similar coastal regions in the world.

Mariam Moeen↗

DIP - Digital Information Platform

Brief updates of Digital Information Platform (DIP) plans for platform-enabled sustainable aviation services. DIP will provide the capability to integrate key flight information from multiple sources and make it easier to access data critical to developing services using advanced techniques such as machine learning. NASA will share ML-based microservices on the platform for industry to use as reference implementations. The platform will support an ecosystem to share reusable services and promote innovation for digital information.

DIP update↗

Florida Water Resources: Assessing Coastal Resiliency Across Florida's Aquatic Preserves Response To Hurricane Forces

Intensifying weather events, sea level rise, and extensive coastal development in Southwestern Florida are escalating the need for Florida’s mangrove conservation. These mangroves are imperative for coastline stabilization, habitat provision for native species, and water quality management. Our partner, the Florida Department of Environmental Protection (FDEP), Office of Resilience and Coastal Protection is tasked with monitoring and conserving the Charlotte Harbor, Estero Bay, Rookery Bay, and Pinellas County Aquatic Preserves. We developed the Growth, Resilience, and Optical Vegetation Evaluator (GROVE) Google Earth Engine toolset for partners to determine mangrove forest extent through time, analyze mangrove forest health, and collect several water quality parameters within the preserves from January 2002–August 2022. The toolset provides easily accessible data from Landsat 7 Enhanced Thematic Mapper Plus (ETM+), Landsat 8 Operational Land Imager (OLI), Landsat 9 Operational Land Imager 2 (OLI-2), and the Shuttle Radar Topography Mission (SRTM). Using training datasets of known mangrove forest locations, we also established a machine learning approach to create mangrove extent maps. Maps from all four preserves indicated migration of mangrove forests inland as the greatest areas of change were transitional zones. Additionally, normalized difference vegetation index (NDVI), normalized difference turbidity index (NDTI), and chlorophyll-a maps were generated for the partners. This project provides decision makers with a useful tool for understanding temporal changes in Florida’s aquatic preserves, identifying areas of ecological stress, and providing actionable data to make informed plans for mangrove preservation.

Samuel Perrello↗

Florida Water Resources: Assessing Coastal Resiliency Across Florida's Aquatic Preserves in Response to Hurricane Forces

Intensifying weather events, sea level rise, and extensive coastal development in Southwestern Florida are escalating the need for Florida’s mangrove conservation. These mangroves are imperative for coastline stabilization, habitat provision for native species, and water quality management. Our partner, the Florida Department of Environmental Protection (FDEP), Office of Resilience and Coastal Protection is tasked with monitoring and conserving the Charlotte Harbor, Estero Bay, Rookery Bay, and Pinellas County Aquatic Preserves. We developed the Growth, Resilience, and Optical Vegetation Evaluator (GROVE) Google Earth Engine toolset for partners to determine mangrove forest extent through time, analyze mangrove forest health, and collect several water quality parameters within the preserves from January 2002–August 2022. The toolset provides easily accessible data from Landsat 7 Enhanced Thematic Mapper Plus (ETM+), Landsat 8 Operational Land Imager (OLI), Landsat 9 Operational Land Imager 2 (OLI-2), and the Shuttle Radar Topography Mission (SRTM). Using training datasets of known mangrove forest locations, we also established a machine learning approach to create mangrove extent maps. Maps from all four preserves indicated migration of mangrove forests inland as the greatest areas of change were transitional zones. Additionally, normalized difference vegetation index (NDVI), normalized difference turbidity index (NDTI), and chlorophyll-a maps were generated for the partners. This project provides decision makers with a useful tool for understanding temporal changes in Florida’s aquatic preserves, identifying areas of ecological stress, and providing actionable data to make informed plans for mangrove preservation.

Remote sensing↗