Search NASA⌕ Search

SEARCH · Search NASA

Results for “data sources”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Data management and scientific integration within the Atmospheric Radiation Measurement Program

The Atmospheric Radiation Measurement (ARM) Program has been developed by the U.S. Department of Energy with the goal to improve the predictive capabilities of General Circulation Models (GCM's) in their treatment of clouds and radiative transfer effects. To achieve this goal, three experimental testbeds were designed for the deployment of instruments that will collect atmospheric data used to drive the GCM's. Each site, known as a Cloud and Radiation Testbed (CART), consists of a highly available, redundant data system for the collection of data from a variety of instrumentation. The first CART site was deployed in April 1992 in the Southern Great Plains (SGP), Lamont, Oklahoma, with the other two sites to follow in September 1995 in the Tropical Western Pacific and in 1997 on the North Slope of Alaska. Approximately 400 MB of data are transferred per day via the Internet from the SGP site to the ARM Experiment Center at Pacific Northwest Laboratory in Richland, Washington. The Experiment Center is central to the ARM data path and provides for the collection, processing, analysis, and delivery of ARM data. Data are received from the CART sites from a variety of instrumentation, observational systems, amd external data sources. The Experiment Center processes these data streams on a continuous basis to provide derived data products to the ARM Science Team in near real-time while providing a three-month running archive of data. A primary requirement of the ARM Program is to preserve and protect all data produced or acquired. This function is performed at Oak Ridge National Laboratory where leading edge technology is employed for the long-term storage of ARM data. The ARM Archive provides access to data for participation outside of the ARM Program. The ARM Program involves a collaborative effort by teams from various DOE National Laboratories, providing multi-disciplinary areas of expertise. This paper will discuss the collaborative methods in which the ARM teams translate the scientific goals of the Program into data products. By combining atmospheric scientists, systems engineers, and software engineers, the ARM Program has successfully designed and developed an environment where advances in understanding the parameterizations of GCM's can be made.

Gracio, Deborah K.↗

Variations in Atmospheric Water Vapor as Seen in Satellite Data and Model Reanalysis Fields

New data sets used to describe components of the hydrologic and energy cycles of the Earth system are currently being produced and disseminated through the NASA EOS DAACs and several data assimilation centers supported by such organizations as NASA and NOAA. These data sets incorporate hybrid data analysis schemes and portray satellite and radiosonde data combined in a diagnostic sense and in a forecast mode. There is a need to develop a better understanding of the accuracy and utility of these global, relatively long-term, datasets to describe components of the hydrologic cycle and to understand atmospheric moisture variability and its relation to climatological significant events Much progress has been made in the last ten years in the development of global atmospheric models and analysis of satellite data for global studies. The atmospheric models have improved in their ability to predict both short term and longer term weather events. This has been possible through better understanding of atmosphere dynamics and very rapid advances in computer technology. Over the same period, data assimilation methods have advanced and unconventional data sources such as aircraft and satellite data, drifting buoys, etc., can be assimilated at non-synaptic times. As a result of these improvements, comprehensive global atmospheric fields based on four-dimensional data assimilation methods now provide one of the most reliable methods for studying dynamical and physical behavior in the atmosphere.

Jedlovec, Gary J.↗

A Gateway to Support Interoperability of OPeNDAP and OGC Protocols

Data access and analysis tools that are developed within specific disciplines and the protocols that they are built upon provide valuable services to their respective users but can actually be a barrier to the interation of data from a broad set of data sources. An example of this is data supported by OPeNDAP that is widely used in the ocean and atmospheric sciences, and data provided through the interface specifications of the Open Geospatial Consortium (OGC) that typically serves the land science community. This paper described a project that is developing a gateway to bridge these two data system infrastructures, in response to a specific need expressed by CEOP, an international science program.

McDonald, Kenneth↗

Centralized Alert-Processing and Asset Planning for Sensorwebs

A software program provides a Sensorweb architecture for alert-processing, event detection, asset allocation and planning, and visualization. It automatically tasks and re-tasks various types of assets such as satellites and robotic vehicles in response to alerts (fire, weather) extracted from various data sources, including low-level Webcam data. JPL has adapted cons iderable Sensorweb infrastructure that had been previously applied to NASA Earth Science applications. This NASA Earth Science Sensorweb has been in operational use since 2003, and has proven reliability of the Sensorweb technologies for robust event detection and autonomous response using space and ground assets. Unique features of the software include flexibility to a range of detection and tasking methods including those that require aggregation of data over spatial and temporal ranges, generality of the response structure to represent and implement a range of response campaigns, and the ability to respond rapidly.

Castano, Rebecca↗

The NASA Tournament Laboratory (NTL): Improving Data Access at PDS while Spreading Joy and Engaging Students through 16 Micro-Contests

NASA PDS hosts terabytes of valuable data from hundreds of data sources and spans decades of research. Data is stored on flat-file systems regulated through careful meta dictionaries. PDS's data is available to the public through its website which supports data searches through drill-down navigation. While the system returns data quickly, result sets in response to identical input differ depending on the drill-down path a user follows. To correct this Issue, to allow custom searching, and to improve general accessibility, PDS sought to create a new data structure and API, and to use them to build applications that are a joy to use and showcase the value of the data to students, teachers and citizens. PDS engaged TopCoder and Harvard Business School through the NTL to pursue these objectives in a pilot effort. Scope was limited to Small Bodies Node data. NTL analyzed data, proposed a solution, and implemented it through a series of micro-contests. Contest focused on different segments of the problem; conceptualization, architectural design, implementation, testing, etc. To demonstrate the utility of the completed solution, NTL developed web-based and mobile applications that can compare targets, regardless of mission. To further explore the potential of the solution NTL hosted "Mash-up" challenges that integrated the API with other publically available assets, to produce consumer and teaching applications, including an Augmented Reality iPad tool. Two contests were also posted to middle and high school students via the NoNameSite.com platform, and as a result of these contests, PDS/SBN has initiated a Facebook program. These contests defined and implemented a data warehouse with the necessary migration tools to transform legacy data, produced a public web interface for the new search, developed a public API, and produced four mobile applications that we expect to appeal to users both within and, without the academic community.

LaMora, Andy↗

The Relative Importance of Random Error and Observation Frequency in Detecting Trends in Upper Tropospheric Water Vapor

Recent published work assessed the amount of time to detect trends in atmospheric water vapor over the coming century. We address the same question and conclude that under the most optimistic scenarios and assuming perfect data (i.e., observations with no measurement uncertainty) the time to detect trends will be at least 12 years at approximately 200 hPa in the upper troposphere. Our times to detect trends are therefore shorter than those recently reported and this difference is affected by data sources used, method of processing the data, geographic location and pressure level in the atmosphere where the analyses were performed. We then consider the question of how instrumental uncertainty plays into the assessment of time to detect trends. We conclude that due to the high natural variability in atmospheric water vapor, the amount of time to detect trends in the upper troposphere is relatively insensitive to instrumental random uncertainty and that it is much more important to increase the frequency of measurement than to decrease the random error in the measurement. This is put in the context of international networks such as the Global Climate Observing System (GCOS) Reference Upper-Air Network (GRUAN) and the Network for the Detection of Atmospheric Composition Change (NDACC) that are tasked with developing time series of climate quality water vapor data.

Whiteman, David N.↗

Joint Assimilation of the Aura Microwave Limb Sounder and Ozone Mapping and Profiler Suite Limb Profiler Data: Towards a Reanalysis of Stratospheric Ozone for Trend Studies

The future trajectory of the stratospheric ozone recovery will be sensitive to greenhouse gas concentrations through thermal control of chemical loss and via stratospheric circulation changes. The latter in particular is subject to considerable uncertainty meriting continuing monitoring of the evolution of ozone throughout the depth of the stratosphere. Atmospheric reanalyses utilize the data assimilation methodology to obtain comprehensive representations of the state of the atmosphere, including its composition, on multidecadal scales by combining diverse measurements from satellite-borne and conventional data sources. Systematic biases among these various data types pose a challenge for assimilation by introducing spurious discontinuities that affect the utility of reanalyses for studies of long-term variability and trends.In this presentation we will outline an approach, developed at NASA's Global Modeling and Assimilation Office (GMAO), that allows joint assimilation of stratospheric ozone profiles from the Microwave Limb Sounder (MLS) on EOS Aura and the Ozone Mapping and Profiler Suite Limb Profiler (OMPS-LP) currently flying on the Suomi-NPP satellite with future missions projected into the 2030s. We will demonstrate that a simple offline correction significantly reduces biases between MLS and OMPS-LP ozone data providing a strategy for generating a long-term vertically resolved homogenized representation of stratospheric ozone in future reanalyses. One novel element of our approach compared to previous GMAO reanalysis is the use of a version of the Goddard Earth Observing System model with full stratospheric chemistry. We will show selected comparisons of MLS and OMPS-LP assimilation experiments with independent ozonesonde and satellite data as well as two examples of process-based evaluation focused on the 2016 QBO disruption and Arctic winter ozone loss focusing on the relative performance of the MLS and OMPS-LP analyses.

Wargan, K.↗

The NASA DEVELOP Model: Multidisciplinary Teams Conduct Interdisciplinary Projects to Produce Transdisciplinary Outcomes

The DEVELOP Program, part of NASA’s Earth Applied Sciences’ Capacity Building Program, conducts 50-70 feasibility studies each year that utilize Earth observations to address local decision-making challenges and help inform action. DEVELOP uses these projects as the mechanism to build skills in its participants and partner organizations to assess and apply satellite data insights to environmental decision-making processes. While organized by thematic focus (ex. water resource management, ecological forecasting, disaster management), projects use a multidisciplinary team approach with teams of students, recent graduates, early career professionals, and transitioning career professionals, bringing different disciplines, life experience, and perspectives to execute projects that have been collaboratively designed with end-user partner organizations (federal agencies, state and local governments, non-profit and for-profit organizations, and international organizations). Projects are interdisciplinary in nature as they integrate methods from multiple disciplines, with a focus on the incorporation of satellite data with other data sources such as socioeconomic and demographic data, in situ measurements, model outputs, and partners’ knowledge, and take place under the guidance of science advisors from NASA, academia, and other partner organizations. The culmination of these multidisciplinary teams working on projects that draw from interdisciplinary methods and approaches, is a transdisciplinary solution for the partner organizations to explore further for potential adoption. This presentation will highlight the DEVELOP model of co-production and collaboration, lessons learned integrating people and project methodologies, and impact assessment activities surrounding the program’s efforts.

Capacity Building↗

Hybrid Flush and Synthetic Air Data Filter for Entry Vehicle Atmospheric State Estimation

A hybrid flush/synthetic air data sensing filter utilizing Kalman-Schmidt and Rach-Tung-Striebel smoothers is developed to obtain entry vehicle atmosphere estimates. The filter/smoother blends information from pressure sensors distributed on the heatshield with measurements of the vehicle aerodynamic forces and moments computed from mass properties and inertial measurement unit data, and prior estimates of the atmosphere. The filter produces estimates of the atmospheric conditions along the entry trajectory, and systematic error estimates to reconcile differences between the pressure and aerodynamic data sources. The filter is applied to data acquired during the Mars Science Laboratory and Mars 2020 entry, descent, and landing at Gale crater and at Jezero crater, respectively. The results show that the hybrid filter produces estimates of the freestream flight condition with lower uncertainty than either the flush or synthetic air data algorithms. The filter accomplishes this result by incorporating additional data and computing estimates of systematic error parameters in the pressure data and the aerodynamic model to further reduce the uncertainties.

Christopher D. Karlgaard↗

Hybrid Flush and Synthetic Air Data Filter for Entry Vehicle Atmospheric State Estimation

A hybrid flush/synthetic air data sensing filter for entry vehicle atmosphere estimation is developed. The approach makes use of a Kalman-Schmidt and Rauch-Tung-Streibel smoother. The filter/smoother blends information from pressure sensors distributed on the heatshield with pseudo-measurements of the vehicle aerodynamic forces and moments computed from mass properties and inertial measurement unit data, and prior estimates of the atmosphere. The filter produces estimates of the atmospheric conditions along the entry trajectory, and systematic error estimates to reconcile differences between the pressure and aerodynamic data sources. The filter is applied to data acquired during the Mars 2020 entry, descent, and landing at Jezero crater on February 18th, 2021. The final paper will also include results from the Mars Science Laboratory entry, descent, and landing.

Chris D. Karlgaard↗

A Proposed Data Fusion Architecture for Micro-Zone Analysis and Data Mining

Data Fusion requires the ability to combine or “fuse” date from multiple data sources. Time Series Analysis is a data mining technique used to predict future values from a data set based upon past values. Unlike other data mining techniques, however, Time Series places special emphasis on periodicity and how seasonal and other time-based factors tend to affect trends over time. One of the difficulties encountered in developing generic time series techniques is the wide variability of the data sets available for analysis. This presents challenges all the way from the data gathering stage to results presentation. This paper presents an architecture designed and used to facilitate the collection of disparate data sets well suited to Time Series analysis as well as other predictive data mining techniques. Results show this architecture provides a flexible, dynamic framework for the capture and storage of a myriad of dissimilar data sets and can serve as a foundation from which to build a complete data fusion architecture.

97 MATHEMATICS AND COMPUTING↗

Correlated Statistical Uncertainties in Coded-Aperture Imaging

In nuclear security applications, coded-aperture imagers provide the opportu- nity for a wealth of information regarding the attributes of both the radioac- tive and non-radioactive components of the objects being imaged. However, for optimum benefit to the community, spatial attributes need to be deter- mined in a quantitative and statistically meaningful manner. To address the deficiency of quantifiable errors in coded-aperture imaging, we present uncer- tainty matrices containing covariance terms between image pixels for MURA mask patterns. We calculated these correlated uncertainties as functions of variation in mask rank, mask pattern over-sampling, and whether or not anti- mask data are included. Utilizing simulated point source data, we found that correlations (and inverse correlations) arose when two or more image pixels were summed. Furthermore, we found that the presence of correlations (and their inverses) was heightened by the process of over-sampling, while correla- tions were suppressed by the inclusion of anti-mask data and with increased mask rank. As an application of this result, we explore how statistics-based alarming in nuclear security is impacted.

Fleenor, Matthew C↗

Transfer Learning Trained LSTM Models for Household Load Profile Forecasting

Grid edge renewable energy resources, such as rooftop solar photovoltaics, closely interact with consumer load profiles. Therefore, forecasting future electricity demand, ideally at the individual household level, is indispensable. In this paper, we present a transfer learning enhanced household load profile forecasting method. First, we tune a long short-term memory forecasting model to perform day-ahead prediction of household electricity load profiles. Then we improve these individualized models using transfer learning, and we use k-means clustering to create optimal source data sets. We find average improvements of 4.38% (largest improvement of 10.71%) when the entire data set was used to train the source model and 2.45% (largest improvement of 11.57%) in the mean absolute error when households were first clustered and used to train separate source models for each cluster. We find that transfer learning with clustered data can effectively boost the forecasting performance of the LSTM models. We use realistic household power measurements for 148 real residential households in Austin, Texas.

deep learning↗

Comprehensive GOM Federal Waters Platform, Incident, Metocean, and Geohazard Dataset

The dataset contains integrated data from an array of disparate data sources, all spatially and temporally linked to platforms in the federal waters of the Gulf of Mexico (platform data from BSEE, 2020). Integrated data includes past reported incidents dating back to 1956 (BSEE, BOEM, MMS), metocean data (see Nelson et al. in review for source information), and geohazard data (see Nelson et al. in review for source information). Proprietary well production information was redacted from this dataset, but was used in resulting analytics.

Full System↗

On the design of prioritized multiplexing systems

Systems in which many data sources are multiplexed over a single communication channel are considered. Data from all the sources are generated in fixed-length packets, and are stored in a common buffer with finite capacity. Packets overflowed or removed from the buffer prior to transmission are lost. The system performance measure is the set of packet loss probabilities associated with the sources. Queueing disciplines vary depending on the stringency of prioritization and the utilization of system resources. The set of all possible performances is characterized as the set of all queueing disciplines is spanned. Whether a given performance is possible can be deduced. Strategies that achieve the minimum overall loss probability are identified. The extreme disciplines are specified, and their performances are calculable by means of a given algorithm.

Clare, L. P.↗

Performance boundaries for prioritized multiplexing systems

Systems in which many data sources are multiplexed over a single communication channel are considered. Data from all the sources are generated in fixed-length packets and are stored in a common buffer with finite capacity. Packets that overflowed or were removed from the buffer prior to transmission are lost. The system performance measure is the set of packet loss probabilities associated with the sources. Queueing disciplines vary depending on the stringency of prioritization and the utilization of the system resources. The set of all possible performances is characterized as the set of all queueing disciplines is spanned. Whether a given performance is possible can be deduced. Strategies that achieve the minimum overall loss probability are identified. The extreme disciplines are specified, and their performances are calculable by means of a given algorithm.

Clare, Loren P.↗

SIDDA: SInkhorn Dynamic Domain Adaptation for image classification with equivariant neural networks

Modern neural networks (NNs) often do not generalize well in the presence of a ‘covariate shift’; that is, in situations where the training and test data distributions differ, but the conditional distribution of classification labels given the data remains unchanged. In such cases, NN generalization can be reduced to a problem of learning more robust, domain-invariant features. Domain adaptation (DA) methods include a broad range of techniques aimed at achieving this; however, these methods have struggled with the need for extensive hyperparameter tuning, which then incurs significant computational costs. In this work, we introduce SInkhorn Dynamic Domain Adaptation (SIDDA), an out-of-the-box DA training algorithm built upon the Sinkhorn divergence, that can achieve effective domain alignment with minimal hyperparameter tuning and computational overhead. We demonstrate the efficacy of our method on multiple simulated and real datasets of varying complexity, including simple shapes, handwritten digits, real astronomical observations, and remote sensing data. These datasets exhibit covariate shifts due to noise, blurring, differences between telescopes, and variations in imaging wavelengths. SIDDA is compatible with a variety of NN architectures, and it works particularly well in improving classification accuracy and model calibration when paired with symmetry-aware equivariant NNs (ENNs). We find that SIDDA consistently enhances the generalization capabilities of NNs, achieving up to a ${\approx}40\%$ improvement in classification accuracy on unlabeled target data, while also providing a more modest performance gain of $\lesssim 1\%$ on labeled source data. We also study the efficacy of DA on ENNs with respect to the varying group orders of the dihedral group DN, and find that the model performance improves as the degree of equivariance increases. Finally, if SIDDA achieves proper domain alignment, it also enhances model calibration on both source and target data, with the most significant gains in the unlabeled target domain—achieving over an order of magnitude improvement in the expected calibration error and Brier score. SIDDA’s versatility across various NN models and datasets, combined with its automated approach to domain alignment, has the potential to significantly advance multi-dataset studies by enabling the development of highly generalizable models.

79 ASTRONOMY AND ASTROPHYSICS↗

Data and Tools for Energy Planning and Analysis

The National Renewable Energy Laboratory (NREL) creates widely used data and tools to facilitate energy system planning and analysis. These software tools have been developed for complex research problems and perfected over real-world applications and laboratory validations. Some tools are award winners, others are open-source data explorers, and all are rigorously designed to empower decision-makers with accurate and accessible information. This software selection shows how NREL resources can help stakeholders achieve a clean, just, and resilient energy transformation.

data↗