Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud database”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

174 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Assessment of the National Solar Radiation Database (NSRDB 1998-2016)

Applying traceable and standardized uncertainty characterization for solar resource data provides confidence in the dataset for use by financiers, developers and site operators of solar energy conversion systems, and ultimately reduces deployment cost. Performance guarantees of solar energy conversion systems are based on the available solar resource from measurement stations or modeled dataset such as the National Solar Radiation Database (NSRDB). In this study we implemented a comprehensive uncertainty determination approach [1]. The study also analyzed how the NSRDB (19982016) - Version 3 compares with the previous NSRDB (19982015) - Version 2. The study also attempted to estimate the uncertainty differences derived by comparing theNSRDB data to the seven measurement stations from the National Oceanic and Atmospheric Administration's Surface Radiation Budget Network (SURFRAD) and University of Oregon Solar Radiation Monitoring Laboratory (SRML). The evaluation was conducted for hourly values, daily totals, monthly mean daily totals, and annual mean monthly mean daily totals and demonstrate the qualityof the new datasets currently available from the NSRDB.

14 SOLAR ENERGY↗
DOE OSTI2025

Improving Cyber Situational Understanding

Effective cybersecurity operations require the ability to analyze large amounts of information to assess security risks and formulate defensive strategies against adversaries. This has become more complex in recent years as the sprawl and interconnectivity of devices grows through implementation of virtualization, cloud computing, and Internet of Things (IoT). The amount of data and analysis required for effective cybersecurity command and control decisions far exceeds humans’ capacity to perform manually. We characterize the analysis problem as cyber situational understanding. The research presented to improve cyber situational understanding focuses on vulnerability analysis and threat intelligence. Regarding vulnerabilities, entities must analyze and plan work for between thousands and tens of thousands of software vulnerabilities annually. Entities heavily use network firewalls to limit vulnerability exposure. As a result, some of these vulnerabilities permit exposure to adversarial exploitation, whereas others are inaccessible and therefore present negligible risk of exploitation. Distinguishing between high and low risk software vulnerabilities requires a deep understanding of the vulnerability, network firewall protection, and characteristics of the targeted device. This problem is solved by extracting network service features from vulnerability data features using both machine-learning and natural language processing. Then, the network firewall topology is parsed to determine which vulnerabilities are reachable by adversaries. Ultimately, a state-based safety analysis ascertains which vulnerabilities are unsafe. A related vulnerability analysis problem occurs in cybersecurity operations when associating an entity’s hardware and software assets to public vulnerability databases. Assets often reveal hardware and software through installation artifacts and network service identification, and entities store these artifacts in inventory databases. However, software and hardware vendors apply a standard Common Platform Enumeration (CPE) naming convention when publicly reporting vulnerabilities. Associating these two datasets often requires many hours to days of manual inspection. The proposed solution automates the mapping approach of human analysts using fuzzy matching techniques, natural language processing, and, ultimately, machine learning to present a small set of recommendations for mapping the two datasets. The result significantly reduces human analysis time and reduces the occurrence of false positives in vulnerability notifications. Finally, cyber threat intelligence (CTI) requires associating cyber observable artifacts, such as IP addresses, URIs, and file hashes, with cyber threat tactics, techniques, and procedures. Unfortunately, most CTI data is compartmentalized across multiple organizations and cannot be shared due to the legal and reputational risk with cyber threat being associated with the entity. The approach to solving this problem inovlves using a distributed ledger with anonymous token spending and authentication. This allows a consortium of semi-trusted entities to share the workload of curating CTI for a threat sharing community’s cooperative benefit.

Huff, Philip↗
DOE OSTI2016

Particle Number Concentrations for HI-SCALE Field Campaign Report

In support of the Holistic Interactions of Shallow Clouds, Aerosols, and Ecosystems (HI-SCALE) project to study new particle formation in the atmosphere, a pair of custom water condensation particle counters were provided to the second intensive field campaign, from mid-August through mid-September 2017, at the U.S. Department of Energy Southern Great Plains Atmospheric Radiation Measurement (ARM) Climate Research Facility observatory. These custom instruments were developed by Aerosol Dynamics, Inc. (Hering et al. 2017) to detect particles into the nanometer size range. Referred to as “versatile water condensation particle counter (vWCPC)”, they are water-based, laminar-flow condensational growth instruments whose lower particle size threshold can be set based on user-selected operating temperatures. For HI-SCALE, the vWCPCs were configured to measure airborne particle number concentrations in the size range from approximately 2nm to 2μm. Both were installed in the particle sizing system operated by Chongai Kuang of Brookhaven National Laboratory (BNL). One of these was operated in parallel to a TSI Model 3776, upstream of the mobility particle sizing system, to measure total ambient particle concentrations. The airborne particle concentration data from this “total particle number vWCPC” (Ntot-vWCPC) system has been reported to the ARM database. The data are reported with one-second resolution. The second vWCPC was operated in parallel with the BNL diethylene glycol instrument to count particles downstream of a separate differential mobility size analyzer. Data from this “DMA-vWCPC” system was logged by BNL, and will eventually be provided by that laboratory.

HI-SCALE, aerosol particle number concentration, v↗
DOE OSTI2019

The CHRS Data Portal, an easily accessible public repository for PERSIANN global satellite precipitation data

The Center for Hydrometeorology and Remote Sensing (CHRS) has created the CHRS Data Portal to facilitate easy access to the three open data licensed satellite-based precipitation datasets generated by our Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN) system: PERSIANN, PERSIANN-Cloud Classification System (CCS), and PERSIANN-Climate Data Record (CDR). These datasets have the potential for widespread use by various researchers, professionals including engineers, city planners, and so forth, as well as the community at large. Researchers at CHRS created the CHRS Data Portal with an emphasis on simplicity and the intention of fostering synergistic relationships with scientists and experts from around the world. The following paper presents an outline of the hosted datasets and features available on the CHRS Data Portal, an examination of the necessity of easily accessible public data, a comprehensive overview of the PERSIANN algorithms and datasets, and a walk-through of the procedure to access and obtain the data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Integration of a physics-based direct normal irradiance ($\mathrm{DNI}$) model to enhance the National Solar Radiation Database ($\mathrm{NSRDB}$)

The National Solar Radiation Database (NSRDB) is an extensively used dataset that furnishes satellite-retrieved solar resource data across the United States and an expanding list of other countries. Although the NSRDB uses a physical model to compute global horizontal irradiance (GHI), it currently employs an empirical approach based on surface observations to estimate cloudy-sky direct normal irradiance (DNI). Recently, a new physics-based approach, known as the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to improve DNI forecasting. FARMS-DNI integrates direct and scattered solar radiances within the circumsolar region, resulting in improved day-ahead forecasting of DNI by incorporating it into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study incorporates FARMS-DNI into the NSRDB algorithm to produce high-spatiotemporal-resolution DNI data from satellite data. The accuracy of the NSRDB based on FARMS-DNI is analyzed using surface observations from 19 sites situated within the National Oceanic and Atmospheric Administration (NOAA) Surface Radiation Budget (SURFRAD) and Solar Radiation (SOLRAD) networks, the University of Oregon (UO) network, the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) network, and at the National Renewable Energy Laboratory (NREL). The results demonstrate that FARMS-DNI reduces the significant overestimation of DNI in the conventional NSRDB at all surface sites, particularly in cloud overcast conditions classified using both satellite retrievals and surface observations. Consequently, this new model can effectively improve the overall accuracy of the NSRDB. The results also suggest that further improvement of DNI estimates at individual time steps, however, requires advanced satellite techniques and precise identification of clouds and retrieval of cloud properties.

14 SOLAR ENERGY↗
DOE OSTI2015

Analysis of Global Horizontal Irradiance in Version 3 of the National Solar Radiation Database

We report an analysis that compares global horizontal irradiance (GHI) estimates from version 3 of the National Solar Radiation Database (NSRDB v3) with surface measurements of GHI at a wide variety of locations over the period spanning from 2005 to 2012. The NSRDB v3 estimate of GHI are derived from the Physical Solar Model (PSM) which employs physics-based models to estimate GHI from measurements of reflected visible and infrared irradiance collected by Geostationary Operational Environment Satellites (GOES) and several other data sources. Because the ground measurements themselves are uncertain our analysis does not establish the absolute accuracy for PSM GHI. However by examining the comparison for trends and for consistency across a large number of sites, we may establish a level of confidence in PSM GHI and identify conditions which indicate opportunities to improve PSM. We focus our evaluation on annual and monthly insolation because these quantities directly relate to prediction of energy production from solar power systems. We find that generally, PSM GHI exhibits a bias towards overestimating insolation, on the order of 5% when all sky conditions are considered, and somewhat less (-3%) when only clear sky conditions are considered. The biases persist across multiple years and are evident at many locations. In our opinion the bias originates with PSM and we view as less credible that the bias stems from calibration drift or soiling of ground instruments. We observe that PSM GHI may significantly underestimate monthly insolation in locations subject to broad snow cover. We found examples of days where PSM GHI apparently misidentified snow cover as clouds, resulting in significant underestimates of GHI during these days and hence leading to substantial understatement of monthly insolation. Analysis of PSM GHI in adjacent pixels shows that the level of agreement between PSM GHI and ground data can vary substantially over distances on the order of 2 km. We conclude that the variance most likely originates from dramatic contrasts in the ground's appearance over these distances.

14 SOLAR ENERGY↗
DOE OSTI2021

Survival of Snow in the Melting Layer: Relative Humidity Influence

This study quantifies how far snow can fall into the melting layer (ML) before all snow has melted by examining a combination of in-situ observations from aircraft measurements in Lagrangian spiral descents from above through the ML and descents and ascents into the ML, as well as an extensive database of NOAA surface observer reports during the past 50 years. The airborne data contain information on the particle phase (solid, mixed, or liquid), population size distributions and shapes, along with temperature, relative humidity, and vertical velocity. A wide range of temperatures and ambient relative humidities are used for both the airborne and ground-based data. It is shown that an ice bulb temperature of 0°C, together with the air temperature and pressure (altitude), are good first order predictors of the highest temperature snowflakes can survive in the melting layer before completely melting. Particle size is also important, as is whether the particles are graupel or hail. If the relative humidity is too low, the particles will sublimate completely as they fall into the melting layer. Snow as warm as +7°C is observed from aircraft measurements and surface observations. Snow pellets survive to even warmer temperatures. Relationships are developed to represent the primary findings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2015

Reaction studies of neutral atomic C with H{sub 3}{sup +} using a merged-beams apparatus

We have investigated the chemistry of C+H{sub 3}{sup +} forming CH{sup +}, CH{sub 2}{sup +}, and CH{sub 3}{sup +}. These reactions are believed to be some of the key gas-phase astrochemical processes initiating the formation of organic molecules in molecular clouds. For this work, we have constructed a novel merged fast-beams apparatus which overlaps a beam of molecular ions onto a beam of ground-term neutral atoms. Here, we describe the apparatus in detail and present cross section data for forming CH{sup +} and CH{sub 2}{sup +} at relative energies from ≈9 meV to ≈20 and 3 eV, respectively. Measurements were performed for statistically populated C ({sup 3}P{sub J}) in the ground term reacting with hot H{sub 3}{sup +} (at an internal temperature of ∼2550 K). Using these data, we have derived rate coefficients for translational temperatures from ≈72 K to ∼2.3×10{sup 5} and 3.4×10{sup 4} K, respectively. For the formation of CH{sub 3}{sup +}, we are only able to place an upper limit on the rate coefficient. Our results for CH{sup +} and CH{sub 2}{sup +} are in good agreement with the mass-scaled results from a previous ion trap study of C + D{sub 3}{sup +}, at a translational temperature of ∼1000 K. That work also used statistically populated C ({sup 3}P{sub J}) but internally cold D{sub 3}{sup +} (∼77 K). The good agreement between the two experiments implies that the internal excitation of the H{sub 3}{sup +} is not significant so long as the reaction proceeds adiabatically. At 300 K, the C fine-structure levels are predicted to be essentially statistically populated, enabling us to compare our translational temperature results to thermal equilibrium calculations. At this temperature, our rate coefficient for forming CH{sup +} lies a factor of ≈2.9 below the Langevin rate coefficient currently given in astrochemical databases, and a factor of ∼1.8−3.3 below the published classical trajectory studies using quantum mechanical potential energy surfaces. Our results for CH{sub 2}{sup +} formation at 300 K are a factor of ≈26.7 above these semi-classical results. Astrochemical databases do not currently include this channel. We also present a method for converting our translational temperature results to thermal rate coefficients for temperatures below ∼300 K. The results indicated that CH{sub 2}{sup +} formation dominates over that of CH{sup +} at temperatures ≲50 K.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Web-based visual data exploration for improved radiological source detection

Radiation detection can provide a reliable means of detecting radiological material. Such capabilities can help to prevent nuclear and/or radiological attacks, but reliable detection in uncontrolled surroundings requires algorithms that account for environmental background radiation. The Berkeley Data Cloud (BDC) facilitates the development of such methods by providing a framework to capture, store, analyze, and share data sets. In the era of big data, both the size and variety of data make it difficult to explore and find data sets of interest and manage the data. Thus, in the context of big data, visualization is critical for checking data consistency and validity, identifying gaps in data coverage, searching for data relevant to an analyst's use cases, and choosing input parameters for analysis. Downloading the data and exploring it on an analyst's desktop using traditional tools are no longer feasible due to the size of the data. This study describes the design and implementation of a visualization system that addresses the problems associated with data exploration within the context of the BDC. Finally, the visualization system is based on a JavaScript front end communicating via REST with a back end web server.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2016

Enabling the democratization of the genomics revolution with a fully integrated web-based bioinformatics platform

Continued advancements in sequencing technologies have fueled the development of new sequencing applications and promise to flood current databases with raw data. A number of factors prevent the seamless and easy use of these data, including the breadth of project goals, the wide array of tools that individually perform fractions of any given analysis, the large number of associated software/hardware dependencies, and the detailed expertise required to perform these analyses. To address these issues, we have developed an intuitive web-based environment with a wide assortment of integrated and cutting-edge bioinformatics tools in pre-configured workflows. These workflows, coupled with the ease of use of the environment, provide even novice next-generation sequencing users with the ability to perform many complex analyses with only a few mouse clicks and, within the context of the same environment, to visualize and further interrogate their results. As a result, this bioinformatics platform is an initial attempt at Empowering the Development of Genomics Expertise (EDGE) in a wide range of applications for microbial research.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Evaluation of Mesoscale Convective Systems in Climate Simulations: Methodological Development and Results from MPAS-CAM over the U.S.

In this study, a process-oriented approach is developed to evaluate warm-season mesoscale convective system (MCS) precipitation and their favorable large-scale meteorological patterns (FLSMPs) over the U.S. This approach features a novel observation-driven MCS-tracking algorithm using infrared brightness temperature and precipitation feature at 12, 25 and 50 km resolution and metrics to evaluate the model large-scale environment favorable for MCS initiation. The tracking algorithm successfully reproduces the observed MCS statistics from a reference 4-km radar MCS database. To demonstrate the utility of the new methodologies in evaluating MCS in climate simulations with mesoscale resolution, the process-oriented approach is applied to two climate simulations produced by the Variable-Resolution Model for Prediction Across Scales coupled to the Community Atmosphere Model physics, with refined horizontal grid spacing at 50 km and 25 km over North America. With the tracking algorithm applied to simulations and observations at equivalent resolutions, the simulated number of MCS and associated precipitation amount, frequency and intensity are found to be consistently underestimated in the Central U.S., particularly from May to August. The simulated MCS precipitation shows little diurnal variation and lasts too long, while MCS precipitation area is too large and intensity is too weak. The model is able to simulate four types of observed FLSMP associated with frontal systems and low-level jets (LLJ) in spring, but the frequencies are underestimated because of low-level dry bias and weaker LLJ. Precipitation simulated under different FLSMPs peak during daytime, in contrast to the observed nocturnal peak. Implications of these findings for future model development and diagnostics are discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

WISP: Watching grid Infrastructure Stealthily through Proxies (Final Technical Report)

The complex interdependencies of cyber systems (sensors and communications), physical grids and associated electricity market operations make protecting electric power grids a significant challenge. The energy sector is constantly under new, targeted, advanced and dangerous cyber-attacks that have the potential to result in the loss of human life. These threats are further exacerbated by our need to modernize the grid. One focus of cyber security research in smart grids is the securing of the SCADA system through advanced intrusion detection systems (IDS) and bad data detection algorithms in state estimation. These methods either require full knowledge of the system topology and parameters or fail to understand the physical behaviors under attack. WISP (Watching grid Infrastructure Stealthily through Proxies) is designed to provide additional protection to the power grid using only publicly available data. In particular, WISP exploits the spatio-temporal nature of the real time locational marginal prices (LMPs), in conjunction with other information such as bids, weather, outages and load data to analyze anomalous power pricing behaviors and then correlate those observations to localize regions of interest and identify potential cyber events. WISP is non-intrusive as the tool is deployed as a service in the Cloud or on premise and provides reliable information to system operators for enhanced situational awareness, without impeding energy delivery functions. The WISP technology comprises three modules: the data-driven anomaly detection core, the vulnerability and risk analysis and the root cause analysis. The data-driven anomaly detection core performs the tasks of feature selection, anomaly detection and attack region localization. The vulnerability and risk analysis module provides system level information of the vulnerable variables and times, assisting the operators in selecting monitoring and protection nodes. The root cause analysis module takes the detection results and identifies potential operational conditions that contribute to the detected anomalies. In Phase I, we have demonstrated the feasibility and effectiveness of WISP. We developed a realistic electricity market simulator capable of generating normal and attack market data under various operational conditions. We developed a series of cyber-attack detection and analysis algorithms and evaluated them under multiple data sources. Finally, we integrated all modules into an end-to-end software, providing functions for data management, data analytics and visualization. Specifically, we have achieved: (i) real-time data acceptance from external utility interfaces with >99% acceptance rate; (ii) high performance anomaly detection algorithms with >98% detection accuracy and <0.1% false alarm rate; and (iii) ultra-low computing delay <50 milliseconds. Additionally, our team developed algorithms to identify the vulnerable variables in electricity market operations and root cause analysis functions to identify major contributors to the price spikes. These ancillary modules are necessary when deploying WISP in real world industry environment. In Phase II, we have demonstrated the effectiveness of WISP software on realistic largescale power systems. We performed red team testing for the Phase I WISP software and identified software vulnerabilities and implemented corresponding mitigation solutions. We adapted the electricity market simulator for the Texas synthetic 2000-bus system and generated datasets for the false data injection attacks. We created database and visualization interfaces for the Texas system and the ISO New England system. We performed software optimization in terms of operation efficiency, computing speed and detection accuracy. Finally, we tested the software on the Texas system and the ISO New England system and evaluated the detection performance. Overall, we achieved above 89% detection rate, below 3% false alarm rate and below 37 seconds of end-to-end detection delay.

24 POWER TRANSMISSION AND DISTRIBUTION↗