Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud database”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

New limits from microlensing on Galactic black holes in the mass range 10 M ⊙ < M < 1000 M ⊙

We searched for long-duration microlensing events originating from intermediate-mass black holes (BH) in the halo of the Milky Way, using archival data from the EROS-2 and MACHO photometric surveys towards the Large Magellanic Cloud (LMC). We combined data from these two surveys to create a common database of light curves for 14.1 million objects in the LMC, covering a total duration of 10.6 years, with flux series measured in four wide passbands. We carried out a microlensing search on these light curves, complemented by the light curves of 22.7 million objects, observed only by EROS-2 or only by MACHO, over about 7 years, with flux series measured in only two passbands. A likelihood analysis, taking into account the LMC self-lensing and Milky Way disk contributions, allows us to conclude that compact objects with masses in the range 10 – 100 M ⊙ cannot make up more than ~15% of a standard halo total mass (at a 95% confidence level). Our analysis sensitivity weakens for heavier objects, although we still rule out the possibility of ~50% of the halo being made of ~1000 M ⊙ BHs. Combined with previous EROS results, an upper limit of ~15% of the total halo mass can be obtained for the contribution of compact halo objects in the mass range 10 –6 – 10 2 M ⊙ .

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

SQL and NoSQL Databases for Cyber Physical Production Systems in Internet of Things for Manufacturing (IoTfM)

Abstract In this paper, the design and performance differences between Relational Database Management Systems (RDBMS) and NoSQL Database Systems are examined, with attention to their applicability for real-world Internet of Things for manufacturing (IoTfM) data. While previous work has extensively compared SQL and NoSQL for both generalized and IoT uses, this work specifically examines the tradeoffs and performance differences for manufacturing applications by using a high-fidelity data set collected from a large US manufacturing firm. Growing an IoT system beyond the pilot stage requires scalable data storage; this work seeks to determine the impact of selected database systems on data write performance at scale. Payload size and message frequency were used as the primary characteristics to maintain model fidelity in simulated clients. As the number of simulated asset clients grow, the data write latency was calculated to determine how both database systems’ performance were affected. To isolate the RDBMS and NoSQL differences, a cloud environment was created using Amazon Web Services (AWS) with two identical data ingestion pipelines: writing data to an RDMBS (1) using AWS Aurora MySQL, and (2) using AWS DynamoDB NoSQL. The findings may provide guidance for further experimentation in large-scale manufacturing IoT implementations.

Gamero, David↗
DOE OSTI2016

SU-F-P-10: A Web-Based Radiation Safety Relational Database Module for Regulatory Compliance

Purpose: Maintaining compliance with Radioactive Materials Licenses is inherently a time-consuming task requiring focus and attention to detail. Staff tasked with these responsibilities, such as the Radiation Safety Officer and associated personnel must retain disparate records for eventual placement into one or more annual reports. Entering results and records in a relational database using a web browser as the interface, and storing that data in a cloud-based storage site, removes procedural barriers. The data becomes more adaptable for mining and sharing. Methods: Web-based code was written utilizing the web framework Django, written in Python. Additionally, the application utilizes JavaScript for front-end interaction, SQL, HTML and CSS. Quality assurance code testing is performed in a sequential style, and new code is only added after the successful testing of the previous goals. Separate sections of the module include data entry and analysis for audits, surveys, quality management, and continuous quality improvement. Data elements can be adapted for quarterly and annual reporting, and for immediate notification of user determined alarm settings. Results: Current advances are focusing on user interface issues, and determining the simplest manner by which to teach the user to build query forms. One solution has been to prepare library documents that a user can select or edit in place of creation a new document. Forms are being developed based upon Nuclear Regulatory Commission federal code, and will be expanded to include State Regulations. Conclusion: Establishing a secure website to act as the portal for data entry, storage and manipulation can lead to added efficiencies for a Radiation Safety Program. Access to multiple databases can lead to mining for big data programs, and for determining safety issues before they occur. Overcoming web programming challenges, a category that includes mathematical handling, is providing challenges that are being overcome.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2022

The Ice Particle and Aggregate Simulator (IPAS). Part II: Analysis of a Database of Theoretical Aggregates for Microphysical Parameterization

Abstract Bulk ice-microphysical models parameterize the dynamic evolution of ice particles from advection, collection, and sedimentation through a cloud layer to the surface. Frozen hydrometeors can grow to acquire a multitude of shapes and sizes, which influence the distribution of mass within cloud systems. Aggregates, defined herein as the collection of ice particles, have a variety of formations based on initial ice particle size, shape, falling orientation, and the number of particles that collect. This work focuses on using the Ice Particle and Aggregate Simulator (IPAS) as a statistical tool to repetitively collect ice crystals of identical properties to derive bulk aggregate characteristics. A database of 9 744 000 aggregates is generated with resulting properties analyzed. After 150 single ice crystals (monomers) collect, the most extreme aggregate aspect ratio calculations asymptote toward and ϕ ca ≈ 0.50 for aggregates composed of quasi-horizontally oriented and randomly oriented monomers, respectively. The results presented are largely consistent with both a previous theoretical study and estimates derived from ground-based observations from two different geographic locations. Particle falling orientation highly influences newly formed aggregate aspect ratios from the collection of particles with extreme aspect ratios; quasi-horizontally oriented particles can produce aggregate aspect ratios an order of magnitude more extreme than randomly oriented particles but can also produce near-spherical aggregates as the number of monomers comprising the aggregate reach approximately 100. Finally, a majority of collections result in aggregates that are closer to prolate than oblate spheroids.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Improving the Accuracy of the National Solar Radiation Database (1998-2016): Preprint

The National Solar Radiation Database (NSRDB) provides gridded satellite-based data sets for the United States and other parts of North and South America using cloud properties retrieved from the Geostationary Operational Environmental (GOES) series of satellites. These cloud properties in combination with ancillary atmospheric parameters are used in the Physical Solar Model (PSM) to compute solar radiation. This paper seeks to 1) describe the changes made in the PSM for the recent update to the National Solar Radiation Database (NSRDB 1998-2016) and 2) examine the performance of this update by comparing it to high-quality ground-based measurements. We summarize the changes to the input data for the radiative transfer models as well as updates for the processing algorithms. We also analyze the performance and accuracy of the NSRDB across the United States. Additional details of the data set and model are described in (1), (2), (3), and (4).

14 SOLAR ENERGY↗
DOE OSTI2022

Using cloud radar to investigate the effect of rainfall on migratory insect flight

The fate of migrating insects that encounter rainfall in flight is a critical consideration when modelling insect movement, but few field observations of this common phenomenon have ever been collected due to the logistical challenges of witnessing these encounters. Operational cloud radars have been deployed around the world by meteorological agencies to study precipitation physics, and as a byproduct, provide a rich database of insect observations that is freely available to researchers. Although considered unwanted ‘clutter’ by the meteorologists who collect the data, the analysis method presented here enables ecologists to delineate co-occurring signals from insects and raindrops. We present a method that uses image processing techniques on cloud radar velocity spectra to examine the fate of migrating insects when they encounter precipitation. By analysing velocity spectra, we can distinguish flying insects from falling rain and compare the relative density of insects in flight before, during and after the rainfall. We demonstrate the method on a case of insect migration in Oklahoma, USA. Using this method, we show the first reconstructed images of migrating insect layers in flight during rainfall. Our analysis shows that mild to moderate rainfall diminishes the number of insects aloft but does not cause full termination of migratory flight, as has previously been suggested. We hope this technique will spur further investigations of how changing weather conditions impact insect migration, and enable some of the first of such studies in regions of the world that are underrepresented in the literature.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Building a Consistent and Reproducible Database for Adsorption Evaluation in Covalent–Organic Frameworks

We present a workflow that traces the path from the bulk structure of a crystalline material to assessing its performance in carbon capture from coal's postcombustion flue gases. This workflow is applied to a database of 324 covalent-organic frameworks (COFs) reported in the literature, to characterize their CO 2 adsorption properties using the following steps: (1) optimization of the crystal structure (atomic positions and unit cell) using density functional theory, (2) fitting atomic point charges based on the electron density, (3) characterizing the pore geometry of the structures before and after optimization, (4) computing carbon dioxide and nitrogen isotherms using grand canonical Monte Carlo simulations with an empirical interaction potential, and finally, (5) assessing the CO 2 parasitic energy via process modeling. The full workflow has been encoded in the Automated Interactive Infrastructure and Database for Computational Science (AiiDA). Both the workflow and the automatically generated provenance graph of our calculations are made available on the Materials Cloud, allowing peers to inspect every input parameter and result along the workflow, download structures and files at intermediate stages, and start their research right from where this work has left off. In particular, our set of CURATED (Clean, Uniform, and Refined with Automatic Tracking from Experimental Database) COFs, having optimized geometry and high-quality DFT-derived point charges, are available for further investigations of gas adsorption properties. We plan to update the database as new COFs are being reported.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Assessing the WRF-Solar Model Performance Using Satellite-Derived Irradiance from the National Solar Radiation Database

Abstract WRF-Solar is a numerical weather prediction model specifically designed to meet the increasing demand for accurate solar irradiance forecasting. The model provides flexibility in the representation of the aerosol–cloud–radiation processes. This flexibility can be argued to make it more difficult to improve the model’s performance because of the necessity of inspecting different configurations. To alleviate this situation, WRF-Solar has a reference configuration to use as a benchmark in sensitivity experiments. However, the scarcity of high-quality ground observations is a handicap to accurately quantify the model performance. An alternative to ground observations are satellite irradiance retrievals. Herein we analyze the adequacy of the National Solar Radiation Database (NSRDB) to validate the WRF-Solar performance using high-quality global horizontal irradiance (GHI) observations across the contiguous United States (CONUS). Based on the sufficient performance of NSRDB, we further analyze the WRF-Solar forecast errors across the CONUS, the growth of the forecasting errors as a function of the lead time, and sensitivities to the grid spacing and the representation of the radiative effects of unresolved clouds. Our results based on WRF-Solar forecasts spanning 2018 reveal a 7% median degradation of the mean absolute error (MAE) from the first to the second daytime period. Reducing the grid spacing from 9 to 3 km leads to a 4% improvement in the MAE, whereas activating the radiative effects of unresolved clouds is desirable over most of the CONUS even at 3 km of grid spacing. A systematic overestimation of the GHI is found. These results illustrate the potential of GHI retrievals to contribute to increasing the WRF-Solar performance.

14 SOLAR ENERGY↗
DOE OSTI2022

Development of an end state vision to implement digital monitoring in nuclear plants

Transitioning from an onsite Maintenance & Diagnostics Center to cloud-based services offers many new opportunities with computing power and storage, but also new challenges in terms of networking and security. This report will cover everything required for that transition including data processing and uploading to cloud services, feature selection, model creation, and result visualization for decision making. Although there are several other cloud-based services (e.g. Amazon Web Services and Google Cloud), this report explores Microsoft Azure to simplify nomenclature and maintain a consistent focus. Many of the services offered by Microsoft Azure are also available in the other cloud-based services, and their differences have been recorded in other literature. The Azure services most important to a nuclear power plant including networking & security, storage & databases, and Artificial Intelligence (AI) are reviewed here. Networking covers all aspects related to communication to Azure resources including security, privacy, and redundancy. Storage & databases includes data storage, upgrading, patching, backups, and monitoring. The AI services allows the user access to the machine learning (ML) techniques developed with Azure including automated ML, anomaly detection, computer vision, and natural language processing. This report summaries the features, capabilities, and challenges when using cloud-based services in a user-friendly manner.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Parametric, Frequency-Domain Approach for Clutter Analysis & Rejection in Remote Sensing

A novel approach is presented for parametric analysis of remotely-sensed ground and cloud clutter. A spatial-frequency-domain clutter model is generated from an extensive, one-year database of weather imagery and statistics are given for each spatial frequency. This approach is useful for the analysis and design of spatial and temporal clutter-rejection filters, which can also be analyzed in this domain.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Investigating the Impacts of Aqueous-Phase Processing on Organic Aerosol Chemical Climatology Using ARM and ASR Observations

This project improved understanding of how atmospheric aerosol particles form and evolve, with a focus on the role of water-driven (aqueous-phase) chemical reactions in the atmosphere. These processes occur in clouds, fog, and humid air and can significantly change the composition and properties of airborne particles, known as aerosols, which influence air quality and climate. By combining field measurements, laboratory experiments, and advanced analytical techniques, the project identified key chemical signatures that allow scientists to distinguish particles formed through aqueous processes from those formed in the gas phase. Observations from multiple environments, including wildfire smoke, urban regions, and cloud-influenced areas, show that aqueous chemistry is an important pathway for particle formation and aging. The project also developed new measurement approaches using uncrewed aerial systems (UAS) to capture how aerosol composition varies with altitude, providing critical insights into how particles interact with clouds. In addition, new data analysis frameworks were created to better interpret long-term aerosol measurements and improve characterization of particle sources and transformations. These results have been integrated into a global database of aerosol measurements and used to support atmospheric modeling efforts. Overall, the project provides important tools and knowledge to improve predictions of how aerosols affect climate and air quality, particularly through their interactions with radiation and clouds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Prediction of Solar Irradiance and Photovoltaic Solar Energy Product Based on Cloud Coverage Estimation Using Machine Learning Methods

Cloud cover estimation from images taken by sky-facing cameras can be an important input for analyzing current weather conditions and estimating photovoltaic power generation. The constant change in position, shape, and density of clouds, however, makes the development of a robust computational method for cloud cover estimation challenging. Accurately determining the edge of clouds and hence the separation between clouds and clear sky is difficult and often impossible. Toward determining cloud cover for estimating photovoltaic output, we propose using machine learning methods for cloud segmentation. We compare several methods including a classical regression model, deep learning methods, and boosting methods that combine results from the other machine learning models. To train each of the machine learning models with various sky conditions, we supplemented the existing Singapore whole sky imaging segmentation database with hazy and overcast images collected by a camera-equipped Waggle sensor node. We found that the U-Net architecture, one of the deep neural networks we utilized, segmented cloud pixels most accurately. However, the accuracy of segmenting cloud pixels did not guarantee high accuracy of estimating solar irradiance. We confirmed that the cloud cover ratio is directly related to solar irradiance. Additionally, we confirmed that solar irradiance and solar power output are closely related; hence, by predicting solar irradiance, we can estimate solar power output. This study demonstrates that sky-facing cameras with machine learning methods can be used to estimate solar power output. This ground-based approach provides an inexpensive way to understand solar irradiance and estimate production from photovoltaic solar facilities.

14 SOLAR ENERGY↗
DOE OSTI2023

Closed Loop Geothermal Working Group: GeoCLUSTER App, Subsurface Simulation Results, and Publications

To better understand the heat production, electricity generation performance, and economic viability of closed-loop geothermal systems in hot-dry rock, the Closed-Loop Geothermal Working Group -- a consortium of several national labs and academic institutions has tabulated time-dependent numerical solutions and levelized cost results of two popular closed-loop heat exchanger designs (u-tube and co-axial). The heat exchanger designs were evaluated for two working fluids (water and supercritical CO2) while varying seven continuous independent parameters of interest (mass flow rate, vertical depth, horizontal extent, borehole diameter, formation gradient, formation conductivity, and injection temperature). The corresponding numerical solutions (approximately 1.2 million per heat exchanger design) are stored as multi-dimensional HDF5 datasets and can be queried at off-grid points using multi-dimensional linear interpolation. A Python script was developed to query this database and estimate time-dependent electricity generation using an organic Rankine cycle (for water) or direct turbine expansion cycle (for CO2) and perform a cost assessment. This document aims to give an overview of the HDF5 database file and highlights how to read, visualize, and query quantities of interest (e.g., levelized cost of electricity, levelized cost of heat) using the accompanying Python scripts. Details regarding the capital, operation, and maintenance and levelized cost calculation using the techno-economic analysis script are provided. This data submission will contain results from the Closed Loop Geothermal Working Group study that are within the public domain, including publications, simulation results, databases, and computer codes. GeoCLUSTER is a Python-based web application created using Dash, an open-source framework built on top of Flask that streamlines the building of data dashboards. GeoCLUSTER provides users with a collection of interactive methods for streamlining the exploration and visualization of an HDF5 dataset. The GeoCluster app and database are contained in the compressed file geocluster_vx.zip, where the "x" refers to the version number. For example, geocluster_v1.zip is Version 1 of the app. This zip file also contains installation instructions. **To use the GeoCLUSTER app in the cloud, click the link to "GeoCLUSTER on AWS" in the Resources section below. To use the GeoCLUSTER app locally, download the geocluster_vx.zip to your computer and uncompress this file. When uncompressed this file comprises two directories and the geocluster_installation.pdf file. The geo-data app contains the HDF5 database in condensed format, and the GeoCLUSTER directory contains the GeoCLUSTER app in the subdirectory dash_app, as app.py. The geocluster_installation.pdf file provides instructions on installing Python, the needed Python modules, and then executing the app.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Privacy Preserving Federated Learning for Advanced Scientific Ecosystems

We present a framework to provide privacy preserving (PP) federating learning (FL) across multiple computational and experimental facilities. This work joins the compute capabilities of National Energy Research Scientific Computing Center (NERSC) and Oak Ridge National Laboratory Research Cloud (ORC) with simulated experimental data, such as those produced at the SLAC National Accelerator Laboratory and Spallation Neutron Source (SNS). We describe the software infrastructure developed to provide privacy for computational and experimental networks. We developed algorithmic privacy across the federated system by embedding database security, computation, and communication into the federation architecture, utilizing scientific tools developed by the experimental community.

Archibald, Rick [ORNL] (ORCID:0000000245389780)↗
DOE OSTI2020

Mean Estimate Distances for Galaxies with Multiple Estimates in NED-D

Numerous research topics rely on an improved cosmic distance scale (e.g., cosmology, gravitational waves) and the NASA/IPAC Extragalactic Database of Distances (NED-D) supports those efforts by tabulating multiple redshift-independent distances for 12,000 galaxies (e.g., Large Magellanic Cloud (LMC) zero-point). Six methods for securing a mean estimate distance (MED) from the data are presented (e.g., indicator and Decision Tree). All six MEDs yield surprisingly consistent distances for the cases examined, including for the key benchmark LMC and M106 galaxies. The results underscore the utility of the NED-D MEDs in bolstering the cosmic distance scale and facilitating the identification of systematic trends.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Performance analysis of data intensive cloud systems based on data management and replication: a survey

As we delve deeper into the ‘Digital Age’, we witness an explosive growth in the volume, velocity, and variety of the data available on the Internet. For example, in 2012 about 2.5 quintillion bytes of data was created on a daily basis that originated from myriad of sources and applications including mobiledevices, sensors, individual archives, social networks, Internet of Things, enterprises, cameras, software logs, etc. Such ‘Data Explosions’ has led to one of the most challenging research issues of the current Information and Communication Technology era: how to optimally manage (e.g., store, replicated, filter, and the like) such large amount of data and identify new ways to analyze large amounts of data for unlocking information. It is clear that such large data streams cannot be managed by setting up on-premises enterprise database systems as it leads to a large up-front cost in buying and administering the hardware and software systems. Therefore, next generation data management systems must be deployed on cloud. The cloud computing paradigm provides scalable and elastic resources, such as data and services accessible over the Internet Every Cloud Service Provider must assure that data is efficiently processed and distributed in a way that does not compromise end-users’ Quality of Service (QoS) in terms of data availability, data search delay, data analysis delay, and the like. In the aforementioned perspective, data replication is used in the cloud for improving the performance (e.g., read and write delay) of applications that access data. Through replication a data intensive application or system can achieve high availability, better fault tolerance, and data recovery. In this paper, we survey data management and replication approaches (from 2007 to 2011) that are developed by both industrial and research communities. The focus of the survey is to discuss and characterize the existing approaches of data replication and management that tackle the resource usage and QoS provisioning with different levels of efficiencies. Moreover, the breakdown of both influential expressions (data replication and management) to provide different QoS attributes is deliberated. Furthermore, the performance advantages and disadvantages of data replication and management approaches in the cloud computing environments are analyzed. Open issues and future challenges related to data consistency, scalability, load balancing, processing and placement are also reported.

Malik, Saif Ur Rehman↗
DOE OSTI2023

CASTLE: Conflict Analysis Strategy Testing Laboratory Environment v.1.0.0

SAND2024-01743O The Conflict Analysis Strategy Testing Laboratory Environment (CASTLE) is a software framework that enables and simplifies building a novel, turn-based strategy game in which it can define its own rules, maps, pieces, and interactions. The software is for novice to experienced programmers with some knowledge of Unity3D, a tool used in game production. CASTLE includes a library of common game mechanics used for strategic wargames and traditional board games, such as cards, tokens, dice, and grid maps. It follows design principles popularized by the video game industry and uses singletons for managing portions of the code. CASTLE builds on Unity's component-based design and can respond to engine events during execution. Among the numerous user-friendly features: Build games quickly and cost-effectively Network in real-time and apply data to new games developed on the framework Host multiple participants online Connect rule- or machine learning-based agents to a CASTLE game to serve as opponents or to simulate games Collect data collection from players and in-game behaviors Create a survey to gather demographics or opinions from players Store data locally or save it to an external database through Representational State Transfer (REST) functions CASTLE, which was prototyped using Microsoft Azure, is also designed for easily distributing online games using popular cloud services. The multiplayer functionality includes an agent interface, allowing developers to construct AI players that can substitute for humans in any of the games. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Fabian, Nathan↗
DOE OSTI2017

Disk and circumsolar radiances in the presence of ice clouds

The impact of ice clouds on solar disk and circumsolar radiances is investigated using a Monte Carlo radiative transfer model. The monochromatic direct and diffuse radiances are simulated at angles of 0 to 8° from the center of the sun. Input data for the model are derived from measurements conducted during the 2010 Small Particles in Cirrus (SPARTICUS) campaign together with state-of-the-art databases of optical properties of ice crystals and aerosols. For selected cases, the simulated radiances are compared with ground-based radiance measurements obtained by the Sun and Aureole Measurements (SAM) instrument. First, the sensitivity of the radiances to the ice cloud properties and aerosol optical thickness is addressed. The angular dependence of the disk and circumsolar radiances is found to be most sensitive to assumptions about ice crystal roughness (or, more generally, non-ideal features of ice crystals) and size distribution, with ice crystal habit playing a somewhat smaller role. Second, in comparisons with SAM data, the ice cloud optical thickness is adjusted for each case so that the simulated radiances agree closely (i.e., within 3 %) with the measured disk radiances. Circumsolar radiances at angles larger than ≈ 3° are systematically underestimated when assuming smooth ice crystals, whereas the agreement with the measurements is better when rough ice crystals are assumed. In conclusion, our results suggest that it may well be possible to infer the particle roughness directly from ground-based SAM measurements. In addition, the results show the necessity of correcting the ground-based measurements of direct radiation for the presence of diffuse radiation in the instrument's field of view, in particular in the presence of ice clouds.

54 ENVIRONMENTAL SCIENCES↗