Search NASA⌕ Search

SEARCH · Search NASA

Results for “Building Dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Coupled fvGCM-GCE Modeling System, 3D Cloud-Resolving Model and Cloud Library

Recent GEWEX Cloud System Study (GCSS) model comparison projects have indicated that cloud- resolving models (CRMs) agree with observations better than traditional single-column models in simulating various types of clouds and cloud systems from different geographic locations. Current and future NASA satellite programs can provide cloud, precipitation, aerosol and other data at very fine spatial and temporal scales. It requires a coupled global circulation model (GCM) and cloud-scale model (termed a super-parameterization or multi-scale modeling framework, MMF) to use these satellite data to improve the understanding of the physical processes that are responsible for the variation in global and regional climate and hydrological systems. The use of a GCM will enable global coverage, and the use of a CRM will allow for better and more sophisticated physical parameterization. NASA satellite and field campaign cloud related datasets can provide initial conditions as well as validation for both the MMF and CRMs. A seed fund is available at NASA Goddard to build a MMF based on the 2D Goddard Cumulus Ensemble (GCE) model and the Goddard finite volume general circulation model (fvGCM). A prototype MMF in being developed and production runs will be conducted at the beginning of 2005. In this talk, I will present: (1) A brief review on GCE model and its applications on precipitation processes, ( 2 ) The Goddard MMF and the major difference between two existing MMFs (CSU MMF and Goddard MMF), (3) A cloud library generated by Goddard MMF, and 3D GCE model, and (4) A brief discussion on the GCE model on developing a global cloud simulator.

Tao, Wei-Kuo↗

UUI: Reusable Spatial Data Services in Unified User Interface at NASA GES DISC

Unified User Interface (UUI) is a next-generation operational data access tool that has been developed at Goddard Earth Sciences Data and Information Services Center(GES DISC) to provide a simple, unified, and intuitive one-stop shop experience for the key data services available at GES DISC, including subsetting (Simple Subset Wizard -SSW), granule file search (Mirador), plotting (Giovanni), and other legacy spatial data services. UUI has been built based on a flexible infrastructure of reusable web services self-contained building blocks that can easily be plugged into spatial applications, including third-party clients or services, to easily enable new functionality as new datasets and services become available. In this presentation, we will discuss our experience in designing UUI services based on open industry standards. We will also explain how the resulting framework can be used for a rapid development, deployment, and integration of spatial data services, facilitating efficient access and dissemination of spatial data sets.

EOSDIS↗

Merging Analytic Collaborative Frameworks with New Observing Strategies Toward a Digital Twin: Earth – Episodic Pulse Event Impacts on Ocean Carbon Cycle as an Example

Virtual representations of the Earth will allow us to address some of the most critical environmental issues of our time. Here, we show the first steps toward representation of riverine, estuarine, and coastal carbon processes to enable scenario driven “what-if” analyses of the carbon system and human footprint. Excess sediment and nutrient runoff from land-based human activities impact water quality and can pose serious threats to coastal and marine ecosystems. Episodic pulse events, such as extreme precipitation events, can increase the amount of nutrients entering estuaries and coastal regions, potentially leading to large phytoplankton blooms followed by anoxic conditions. Consequences of coastal runoff are predicted to increase with the higher intensity and frequency of extreme events. Beyond the threat to coastal ecosystems, recent findings suggest these episodic pulses might play a significant role for biological production influencing regional and global carbon fluxes and budgets. An improved understanding of these events through optimal, dynamic observing strategies will increase our knowledge of the land-ocean continuum and how regional events and nutrient fluxes affect the carbon cycle and ocean ecosystem. This conceptual framework enables focused science investigations by pairing data analytics and artificial intelligence tools (otherwise termed an Analytic Center Framework, ACF) with targeted measurement acquisition through distributed sensing and intelligent asset tasking (or New Observing Strategies, NOS). This NOS and ACF iterative approach acquires and integrates complementary and coincident satellite, in-situ and model data to build a more complete and in-depth picture of science phenomena. Specifically, Apache Science Data Analytic Platform (SDAP) is extended to incorporate relevant datasets for data access, harmonized analysis, and anomaly detection. When conditions are met for a likely pulse event, NASA’s D-SHIELD (Distributed Spacecraft with Heuristic Intelligence to Enable Logistical Decisions) tool is triggered to optimize asset overpass frequency and schedule observations for persistent monitoring. Targeted data is ingested by SDAP for enhanced investigation via iterative analysis until the trigger criteria is no longer met - steps toward a digital twin.

Laura Rogers↗

Raft River EGS Project: A GIS-Centric Review of Geology

The Raft River thermal anomaly is located on the northern margin of the Great Basin. This area has undergone numerous studies due its juxtaposition with the Raft River and Albion metamorphic core complexes, associated low-angle detachment faults, and the presence of the thermal anomaly. Miocene movement along the Raft River detachment displaced a large mass of Paleozoic and Mesozoic rock about 24 km to the east unroofing the shear zone and creating the Raft River Valley. The rocks in the Raft River detachment footwall/shear zone are Archean and Proterozoic in age and are overlain by late Miocene/Pliocene ash-flow tuff, tuffaceous sediments, rhyolite, and mixed Quaternary sediments. Work described here supports the DOE/U.S. Geothermal, Inc. supported Raft River EGS project which is aimed toward improving permeability in well RRG-9. A GIS data suite was developed from historical data and new data produced by this study to help underpin this project. The GIS includes well survey, lithologic, mineralogic, and geophysical data that were incorporated from disparate datasets ranging from scanned images to tabular data in spreadsheets. This data has been visualized and analyzed using GIS-based tools to help build a better understanding of the study area geology. Finally, this includes a possible structural explanation of ground water/geothermal fluid compartmentalization.

15 GEOTHERMAL ENERGY↗

SULI Oral Presentation

Furthering our understanding of the prevalence and severity of issues that customers face when charging their electric vehicles (EVs) is crucial in order to improve the charging experience across the United States. This project utilizes web-scraping, machine leaning (ML), and natural language processing (NLP) techniques to analyze and categorize user-generated reviews. Selenium was used to build a data collection tool that can scrape vast amounts of user review data from the PlugShare website. Sentiment analysis was employed on this dataset in order to filter out negative reviews for further analysis. NLP techniques such as tokenization and word embedding were then used to convert user-written comments into a numerical format that a ML model can interpret. Multiple ML approaches are currently being explored in order to identify and categorize the charging issues being talked about in each review. Ultimately, the results from the ML model will be visualized and explained in a report on customer pain points to be delivered to the ChargeX Consortium, therefore revealing specific areas for improvement in the customer charging experience.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

SULI Oral Presentation

Furthering our understanding of the prevalence and severity of issues that customers face when charging their electric vehicles (EVs) is crucial in order to improve the charging experience across the United States. This project utilizes web-scraping, machine leaning (ML), and natural language processing (NLP) techniques to analyze and categorize user-generated reviews. Selenium was used to build a data collection tool that can scrape vast amounts of user review data from the PlugShare website. Sentiment analysis was employed on this dataset in order to filter out negative reviews for further analysis. NLP techniques such as tokenization and word embedding were then used to convert user-written comments into a numerical format that a ML model can interpret. Multiple ML approaches are currently being explored in order to identify and categorize the charging issues being talked about in each review. Ultimately, the results from the ML model will be visualized and explained in a report on customer pain points to be delivered to the ChargeX Consortium, therefore revealing specific areas for improvement in the customer charging experience.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Accurate Fault Prediction of BlueGene/P RAS Logs Via Geometric Reduction

The authors are building two algorithms for fault prediction using raw system-log data. This work is preliminary, and has only been applied to a limited dataset, however the results seem promising. The conclusions are that: (1) obtaining useful data from RAS-logs is challenging; (2) extracting concentrated information improves efficiency and accuracy; and (3) function evaluation algorithms are fast and lend well to scaling.

97 MATHEMATICS AND COMPUTING↗

The future low-temperature geochemical data-scape as envisioned by the U.S. geochemical community

Data sharing benefits the researcher, the scientific community, and the public by allowing the impact of data to be generalized beyond one project and by making science more transparent. However, many scientific communities have not developed protocols or standards for publishing, citing, and versioning datasets. One community that lags in data management is that of low-temperature geochemistry (LTG). This paper resulted from an initiative from 2018 through 2020 to convene LTG and data scientists in the U.S. to strategize future management of LTG data. Through webinars, a workshop, a preprint, a townhall, and a community survey, the group of U.S. scientists discussed the landscape of data management for LTG – the data-scape. Currently this data-scape includes a “street bazaar” of data repositories. This was deemed appropriate in the same way that LTG scientists publish articles in many journals. The variety of data repositories and journals reflect that LTG scientists target many different scientific questions, produce data with extremely different structures and volumes, and utilize copious and complex metadata. Nonetheless, the group agreed that publication of LTG science must be accompanied by sharing of data in publicly accessible repositories, and, for sample-based data, registration of samples with globally unique persistent identifiers. LTG scientists should use certified data repositories that are either highly structured databases designed for specialized types of data, or unstructured generalized data systems. Recognizing the need for tools to enable search and cross-referencing across the proliferating data repositories, the group proposed that the overall data informatics paradigm in LTG should shift from “build data repository, data will come” to “publish data online, cybertools will find”. Funding agencies could also provide portals for LTG scientists to register funded projects and datasets, and forge approaches that cross national boundaries. Finally, the needed transformation of the LTG data culture requires emphasis in student education on science and management of data.

58 GEOSCIENCES↗

A Testbed Demonstration of an Intelligent Archive in a Knowledge Building System

The last decade's influx of raw data and derived geophysical parameters from several Earth observing satellites to NASA data centers has created a data-rich environment for Earth science research and applications. While advances in hardware and information management have made it possible to archive petabytes of data and distribute terabytes of data daily to a broad community of users, further progress is necessary in the transformation of data into information, and information into knowledge that can be used in particular applications in order to realize the full potential of these valuable datasets. In examining what is needed to enable this progress in the data provider environment that exists today and is expected to evolve in the next several years, we arrived at the concept of an Intelligent Archive in context of a Knowledge Building System (IA/KBS). Our prior work and associated papers investigated usage scenarios, required capabilities, system architecture, data volume issues, and supporting technologies. We identified six key capabilities of an IA/KBS: Virtual Product Generation, Significant Event Detection, Automated Data Quality Assessment, Large-Scale Data Mining, Dynamic Feedback Loop, and Data Discovery and Efficient Requesting. Among these capabilities, large-scale data mining is perceived by many in the community to be an area of technical risk. One of the main reasons for this is that standard data mining research and algorithms operate on datasets that are several orders of magnitude smaller than the actual sizes of datasets maintained by realistic earth science data archives. Therefore, we defined a test-bed activity to implement a large-scale data mining algorithm in a pseudo-operational scale environment and to examine any issues involved. The application chosen for applying the data mining algorithm is wildfire prediction over the continental U.S. This paper reports a number of observations based on our experience with this test-bed. While proof-of-concept for data mining scalability and utility has been a major goal for the research reported here, it was not the only one. The other five capabilities of an WKBS named above have been considered as well, and an assessment of the implications of our experience for these other areas will also be presented. The lessons learned through the testbed effort and presented in this paper will benefit technologists, scientists, and system operators as they consider introducing IA/KBS capabilities into production systems.

Ramapriyan, Hampapuram↗

Tsdat: An Open-Source Data Standardization Framework for Marine Energy and Beyond

Many organizations are tasked with the collection and processing of large quantities of data from various measurement devices. Data reported from these sources are often not interoperable with datasets and software used by analysts and other organizations in the same domain, introducing barriers for collaboration on large-scale projects. This poses a particular problem for cross-device comparisons and machine learning applications, which rely on large quantities of data from multiple sources. To address these challenges, the open-source Time-Series Data Pipelines (Tsdat) Python framework was developed by Pacific Northwest National Laboratory, with strategic guidance and direction provided by the National Renewable Energy Laboratory and Sandia National Laboratories to facilitate collaboration and accelerate advancements in the marine energy domain through the development of an open-source ecosystem of tools. This paper will describe the Tsdat framework and the data standards within which it operates. A beta version of Tsdat has been released and is being used by several projects in marine energy, wind energy, and building energy systems.

big data↗

A Markov framework for generalized post-event systems recovery modeling: From single to multihazards

State-dependent models can be used to represent the system recovery process as a series of stochastic transitions from lower to higher functional states. However, the applications of these models have been limited in scope and there is a lack of a generalized recovery modeling framework. A generalized framework would permit a robust forecasting of systems and system-of-systems recovery under multiple hazards, and more broadly, would contribute to community disaster preparedness. This paper develops a generalized post hazard-event recovery modeling framework based on state-dependent Markov-type processes. We then apply the proposed framework to solve a spectrum of problems that range from hind-casting single-system recovery following a single hazard event to forecasting post-event trajectories under multiple hazards and modeling the recovery of a system-of-systems. First, Markov chains are used to hind-cast the observed recovery for a portfolio of buildings affected by the 2014 South Napa, California, earthquake. Next, Markov processes are used to formulate a parametric post hazard-event recovery model, which can be updated using Bayesian statistics when relevant datasets become available. Semi-Markov processes are then used to develop a more general model of single hazard recovery, which accounts for the intensity of the loading and level of damage caused by the event. Semi-Markov processes with non-renewal features are then used to account for multihazard interactions in a post-event recovery model, and applied to a case study that involves a community in Charleston, South Carolina. Lastly, Markov-type processes are combined with Bayesian networks to model the recovery of residential, commercial, educational, and industrial buildings (system-of-systems) following a hazard event. Overall, these applications demonstrate the versatility of the Markov framework towards handling recovery problems with varying levels of complexity.

42 ENGINEERING↗

National Climate Database (NCDB)

The National Climate Database (NCDB) is a high resolution, bias-corrected climate dataset consisting of the three most widely used variables of solar radiation- global horizontal (GHI), direct normal (DNI), and diffuse horizontal irradiance (DHI)- as well as other meteorological data. The goal of the NCDB is to provide unbiased high temporal and spatial resolution climate data needed for renewable energy modeling. The NCDB is modeled using a statistical downscaling approach with Regional Climate Model (RCM)-based climate projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX; linked below). Daily climate projections simulated by the Canadian Regional Climate Model 4 (CanRCM4) forced by the second-generation Canadian Earth System Model (CanESM2) for two Representative Concentration Pathways (RCP4.5 or moderate emissions scenario and RCP8.5 or highest baseline emission scenario) are selected as inputs to the statistical downscaling models. The National Solar Radiation Database (NSRDB) is used to build and calibrate statistical models.

Array↗

A simple model for estimating changes in rainfall erosivity caused by variations in rainfall patterns

Highlights: • A simple relationship was developed for predicting daily erosivity in changing climates. • The relationship depends on precipitation amount and maximum 0.5-h intensity I{sub 0.5} . • The relationship was calibrated using measured climate data and had a R{sup 2} of 0.99. • Simulated daily and annual erosivities were predicted with a R{sup 2} of 0.99 using the relationship. • The relationship was tested using I{sub 24}, showing a R{sup 2} of 0.78 for the simulated data. A major challenge when coupling soil loss models with precipitation forecasts from Global Circulation Models (GCMs) is that their time resolutions do not generally agree. Precipitation forecasts from GCM must be scaled down; however, the distribution of the rainfall intensity, which can affect soil loss as much as precipitation amounts, is usually not considered in this process. Therefore, the objective of this study was to develop a statistical equation for computing event-based rainfall erosivity under changing precipitation patterns using the least amount of information possible. For this purpose, an empirical equation for predicting event-based rainfall erosivity was developed using the product of the total precipitation P and the maximum 0.5-h rainfall intensity, I{sub 0.5}. This equation was calibrated using measured precipitation data from 28 sites in Central Chile and then tested with simulated data with different rainfall patterns from the CLIGEN (CLImate GENerator) weather generator. More than 53,000 rainfall events were analyzed, where the equation consistently provided R{sup 2} values of 0.99 for every dataset used, revealing its robustness when used in potential climate change scenarios in the study site. However, because computing I{sub 0.5} requires estimating precipitation at a high time resolution, the relationship was recalibrated and tested using 1 through 24-h maximum rainfall intensities. Using these intensities, the equation provided erosivity estimates with R{sup 2} ranging from 0.78 to 0.99, where better results were obtained as the resolution of the data increased. This study provides the methodology for building and testing the proposed equation and discusses its advantages and limitations.

54 ENVIRONMENTAL SCIENCES↗

A novel improved model for building energy consumption prediction based on model integration

Building energy consumption prediction plays an irreplaceable role in energy planning, management, and conservation. Constantly improving the performance of prediction models is the key to ensuring the efficient operation of energy systems. Moreover, accuracy is no longer the only factor in revealing model performance, it is more important to evaluate the model from multiple perspectives, considering the characteristics of engineering applications. Based on the idea of model integration, this paper proposes a novel improved integration model (stacking model) that can be used to forecast building energy consumption. The stacking model combines advantages of various base prediction algorithms and forms them into “meta-features” to ensure that the final model can observe datasets from different spatial and structural angles. Two cases are used to demonstrate practical engineering applications of the stacking model. A comparative analysis is performed to evaluate the prediction performance of the stacking model in contrast with existing well-known prediction models including Random Forest, Gradient Boosted Decision Tree, Extreme Gradient Boosting, Support Vector Machine, and K-Nearest Neighbor. The results indicate that the stacking method achieves better performance than other models, regarding accuracy (improvement of 9.5%–31.6% for Case A and 16.2%–49.4% for Case B), generalization (improvement of 6.7%–29.5% for Case A and 7.1%-34.6% for Case B), and robustness (improvement of 1.5%–34.1% for Case A and 1.8%–19.3% for Case B). The proposed model enriches the diversity of algorithm libraries of empirical models.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Coupling a recurrent neural network to SPAD TCSPC systems for real-time fluorescence lifetime imaging

Fluorescence lifetime imaging (FLI) has been receiving increased attention in recent years as a powerful diagnostic technique in biological and medical research. However, existing FLI systems often suffer from a tradeoff between processing speed, accuracy, and robustness. Inspired by the concept of Edge Artificial Intelligence (Edge AI), we propose a robust approach that enables fast FLI with no degradation of accuracy. This approach couples a recurrent neural network (RNN), which is trained to estimate the fluorescence lifetime directly from raw timestamps without building histograms, to SPAD TCSPC systems, thereby drastically reducing transfer data volumes and hardware resource utilization, and enabling real-time FLI acquisition. We train two variants of the RNN on a synthetic dataset and compare the results to those obtained using center-of-mass method (CMM) and least squares fitting (LS fitting). Results demonstrate that two RNN variants, gated recurrent unit (GRU) and long short-term memory (LSTM), are comparable to CMM and LS fitting in terms of accuracy, while outperforming them in the presence of background noise by a large margin. To explore the ultimate limits of the approach, we derive the Cramer-Rao lower bound of the measurement, showing that RNN yields lifetime estimations with near-optimal precision. To demonstrate real-time operation, we build a FLI microscope based on an existing SPAD TCSPC system comprising a 32 x 32 SPAD sensor named Piccolo. Four quantized GRU cores, capable of processing up to 4 million photons per second, are deployed on the Xilinx Kintex-7 FPGA that controls the Piccolo. Powered by the GRU, the FLI setup can retrieve real-time fluorescence lifetime images at up to 10 frames per second. The proposed FLI system is promising and ideally suited for biomedical applications, including biological imaging, biomedical diagnostics, and fluorescence-assisted surgery, etc.

47 OTHER INSTRUMENTATION↗

Computational Analysis of Interactions of the Oral Microbiota

The human oral microbiome is a complex site containing many hundreds of species with the community response of this microbiome having a large effect on human health. The complexity of this site has spoken to the need for applying –omics techniques to better understand which microbial species are present, their contribution to the microbiome and how this may change as a function of disease. The kinds of datasets that emerge from these –omics studies require computational analysis to gain robust results. New research has also been focused on applying these methods to build computational networks and models that better describe the myriad of interactions between microbial species of the oral cavity and how this changes as a result of infection. In this work, I describe the state of the field at this point, what kinds of computational networks have been inferred and what they show. I also describe where the field is heading in the next few years and how more in depth –omics analysis can lead to more detailed models of interactions at this site and improve human health.

-omics↗

Methods for Determining Likelihood of Tweet Deletion

Few works exist that attempt to build predictive models for tweet deletion. Zhou et al. (2015) focus on a subset of deleted tweets – regrettable tweets. These are tweets that the authors believe to contain inappropriate content. Inappropriate can range from vulgar language to sharing private content such as a personal email address. The presence of inappropriate content doesn’t guarantee that a tweet will be deleted, however intuition dictates it can be in an important factor in the tweet being deleted. In their work, the authors create a predictive model for identifying regrettable tweets. It is important to note the authors focus on predicting regrettable tweets that are distinctly not spam and only written in English. Through manual investigation, the authors identify ten major topics including negative sentiment, cursing, and relationships that are prevalent in regrettable tweets. The authors then exploit WordNet and UrbanDictionary to create keyword lists related to the ten topics. Finally, using a combination of existing lexica and the topic keywords as features, the authors build classifiers to test the accuracy of their model. The authors complement 700 manually labeled regrettable tweets with 700 normal tweets to create their evaluation dataset. The authors’ best performance from 10-fold cross-validation was an f1 score of 0.85 using a J48 classifier on a balanced dataset of deleted and non-deleted tweets.

Source record↗