Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed databases”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

ELM2.1-XGBfire1.0: improving wildfire prediction by integrating a machine learning fire model in a land surface model

Wildfires have shown increasing trends in both frequency and severity across the contiguous United States (CONUS). However, process-based fire models have difficulties in accurately simulating the burned area over the CONUS due to a simplification of the physical process and cannot capture the interplay among fire, ignition, climate, and human activities. The deficiency of burned area simulation deteriorates the description of fire impact on energy balance, water budget, and carbon fluxes in the Earth system models (ESMs). Alternatively, fire models based on machine learning (ML), which capture statistical relationships between the burned area and environmental factors, have shown promising burned area predictions and corresponding fire impact simulation. We develop a hybrid framework (ELM2.1-XGBFire1.0) that integrates an eXtreme Gradient Boosting (XGBoost) wildfire model with the Energy Exascale Earth System Model (E3SM) land model (ELM) version 2.1. A Fortran–C–Python deep learning bridge is adapted to support online communication between ELM and the ML fire model. Specifically, the burned area predicted by the ML-based wildfire model is directly passed to ELM to adjust the carbon pool and vegetation dynamics after disturbance, which are then used as predictors in the ML-based fire model in the next time step. Evaluated against the historical burned area from Global Fire Emissions Database 5 from 2001–2019, the ELM2.1-XGBFire1.0 outperforms process-based fire models in terms of spatial distribution and seasonal variations. The ELM2.1-XGBFire1.0 has proven to be a new tool for studying vegetation–fire interactions and, more importantly, enables seamless exploration of climate–fire feedback, working as an active component of E3SM.

54 ENVIRONMENTAL SCIENCES↗

The structure of the vorticity field in turbulent channel flow. Part 1: Analysis of instantaneous fields and statistical correlations

An investigation into the existence of hairpin vortices in turbulent channel flow is conducted using a database generated by the large eddy simulation technique. It is shown that away from the wall the distribution of the inclination angle of vorticity vector attains its maximum at about 45 deg to the wall. Two point correlations of velocity and vorticity fluctuations strongly support a flow model consisting of vortical structures inclined at 45 deg to the wall. The instantaneous vorticity vectors plotted in planes inclined at 45 deg show that the flow contains an appreciable number of hairpins. Vortex lines are used to display the three dimensional structure of hairpins, which are shown to be generated from deformation of transverse vortex filaments.

Moin, P.↗

The structure of the vorticity field in turbulent channel flow. I - Analysis of instantaneous fields and statistical correlations

An investigation into the existence of hairpin vortices in turbulent channel flow is conducted using a database generated by the large eddy simulation technique. It is shown that away from the wall the distribution of the inclination angle of vorticity vector attains its maximum at about 45 deg to the wall. Two point correlations of velocity and vorticity fluctuations strongly support a flow model consisting of vortical structures inclined at 45 deg to the wall. The instantaneous vorticity vectors plotted in planes inclined at 45 deg show that the flow contains an appreciable number of hairpins. Vortex lines are used to display the three dimensional structure of hairpins, which are shown to be generated from deformation of transverse vortex filaments.

Moin, P.↗

Cataloging and indexing - The development of the Space Shuttle mission data base and catalogs from earth observations hand-held photography

All earth-looking photographs acquired by Space Shuttle astronauts are identified, located, and catalogued after each mission. The photographs have been entered into a computerized database at the NASA Johnson Space Center. The database in its two modes - computer and catalog - is organized and presented to provide a scope and level of detail designed to be useful in Earth science activities, resource management, environmental studies, and public affairs. The computerized database can be accessed free through standard communication networks 24 hours a day, and the catalogs are distributed throughout the world. Photograph viewing centers are available in the United States, and photographic copies can be obtained through government-supported centers.

Nelson, Raymond M.↗

Calibration of the ROSAT HRI Spectral Response

The ROSAT High Resolution Imager has a limited (2-band) spectral response. This spectral capability can give X-ray hardness ratios on spatial scales of 5 arcseconds. The spectral response of the center of the detector was calibrated before the launch of ROSAT, but the gain decreases-with time and also is a function of position on the detector. To complicate matters further, the satellite is "wobbled", possibly moving a source across several spatial gain states. These difficulties have prevented the spectral response of the ROSAT HRI from being used for scientific measurements. We have used Bright Earth data and in-flight calibration sources to map the spatial and temporal gain changes, and written software which will allow ROSAT users to generate a calibrated XSPEC response matrix and hence determine a calibrated hardness ratio. In this report, we describe the calibration procedure and show how to obtain a response matrix. In Section 2 we give an overview of the calibration procedure, in Section 3 we give a summary of HRI spatial and temporal gain variations. Section 4 describes the routines used to determine the gain distribution of a source. In Sections 5 and 6, we describe in detail how the Bright Earth database and calibration sources are used to derive a corrected response matrix for a given observation. Finally, Section 7 describes how to use the software.

Prestwich, Andrea↗

Calibration of the ROSAT HRI Spectral Response

The ROSAT High Resolution Imager has a limited (2-band) spectral response. This spectral capability can give X-ray hardness ratios on spatial scales of 5 arcseconds. The spectral response of the center of the detector was calibrated before the launch of ROSAT, but the gain decreases with time and also is a function of position on the detector. To complicate matters further, the satellite is 'wobbled', possibly moving a source across several spatial gain states. These difficulties have prevented the spectral response of the ROSAT High Resolution Imager (HRI) from being used for scientific measurements. We have used Bright Earth data and in-flight calibration sources to map the spatial and temporal gain changes, and written software which will allow ROSAT users to generate a calibrated XSPEC (an x ray spectral fitting package) response matrix and hence determine a calibrated hardness ratio. In this report, we describe the calibration procedure and show how to obtain a response matrix. In Section 2 we give an overview of the calibration procedure, in Section 3 we give a summary of HRI spatial and temporal gain variations. Section 4 describes the routines used to determine the gain distribution of a source. In Sections 5 and 6, we describe in detail how, the Bright Earth database and calibration sources are used to derive a corrected response matrix for a given observation. Finally, Section 7 describes how to use the software.

Prestwich, Andrea H.↗

One-Dimensional Spontaneous Raman Measurements of Temperature Made in a Gas Turbine Combustor

The NASA Glenn Research Center is working with the aeronautics industry to develop highly fuel-efficient and environmentally friendly gas turbine combustor technology. This effort includes testing new hardware designs at conditions that simulate the high-temperature, high-pressure environment expected in the next-generation of high-performance engines. Glenn has the only facilities in which such tests can be performed. One aspect of these tests is the use of nonintrusive optical and laser diagnostics to measure combustion species concentration, fuel/air ratio, fuel drop size, and velocity, and to visualize the fuel injector spray pattern and some combustion species distributions. These data not only help designers to determine the efficacy of specific designs, but provide a database for computer modelers and enhance our understanding of the many processes that take place within a combustor. Until recently, we lacked one critical capability, the ability to measure temperature. This article summarizes our latest developments in that area. Recently, we demonstrated the first-ever use of spontaneous Raman scattering to measure combustion temperatures within the Advanced Subsonics Combustion Rig (ASCR) sector rig. We also established the highest rig pressure ever achieved for a continuous-flow combustor facility, 54.4 bar. The ASCR facility can provide operating pressures from 1 to 60 bar (60 atm). This photograph shows the Raman system setup next to the ASCR rig. The test was performed using a NASA-concept fuel injector and Jet-A fuel over a range of air inlet temperatures, pressures, and fuel/air ratios.

Hicks, Yolanda R.↗

Lunar Prospecting Using Thermal Wadis and Compact Rovers: Infrastructure for Surviving the Lunar Night - Part A

Recent missions have confirmed the existence of water and other volatiles on the Moon, both in permanently-shadowed craters and elsewhere. Non-volatile lunar resources may represent significant additional value as infrastructure or manufacturing feedstock. Characterization of lunar resources in terms of abundance concentrations, distribution, and recoverability is limited to in-situ Apollo samples and the expanding remote-sensing database. This paper introduces an approach to lunar resource prospecting supported by a simple lunar surface infrastructure based on the Thermal Wadi concept of thermal energy storage and using compact rovers equipped with appropriate prospecting sensors and demonstration resource extraction capabilities. Thermal Wadis are engineered sources of heat and power based on the storage and retrieval of solar-thermal energy in modified lunar regolith. Because Thermal Wadis keep compact prospecting rovers warm during periods of lunar darkness, the rovers are able to survive months to years on the lunar surface rather than just weeks without being required to carry the burdensome capability to do so. The resulting lower-cost, long-lived rovers represent a potential paradigm breakthrough in extra-terrestrial prospecting productivity and will enable the production of detailed resource maps. Integrating resource processing and other technology demonstrations that are based on the content of the resource maps will inform engineering economic studies that can define the true resource potential of the Moon. Once this resource potential is understood quantitatively, humans might return to the Moon with an economically sound objective including where to go, what to do upon arrival, and what to bring along.

Sacksteder, Kurt R.↗

Fireballs in the Sky: An Augmented Reality Citizen Science Program

Fireballs in the Sky is an innovative Australian citizen science program that connects the public with the research of the Desert Fireball Network (DFN). This research aims to understand the early workings of the solar system, and Fireballs in the Sky invites people around the world to learn about this science, contributing fireball sightings via a user-friendly augmented reality mobile app. Tens of thousands of people have downloaded the app world-wide and participated in the science of meteoritics. The Fireballs in the Sky app allows users to get involved with the Desert Fireball Network research, supplementing DFN observations and providing enhanced coverage by reporting their own meteor sightings to DFN scientists. Fireballs in the Sky reports are used to track the trajectories of meteors - from their orbit in space to where they might have landed on Earth. Led by Phil Bland at Curtin University in Australia, the Desert Fireball Network (DFN) uses automated observatories across Australia to triangulate trajectories of meteorites entering the atmosphere, determine pre-entry orbits, and pinpoint their fall positions. Each observatory is an autonomous intelligent imaging system, taking 1000 by 36 megapixel all-sky images throughout the night, using neural network algorithms to recognize events. They are capable of operating for 12 months in a harsh environment, and store all imagery collected. We developed a completely automated software pipeline for data reduction, and built a supercomputer database for storage, allowing us to process our entire archive. The DFN currently stands at 50 stations distributed across the Australian continent, covering an area of 2.5 million square kilometers. Working with DFN's partners at NASA's Solar System Exploration Research Virtual Institute, the team is expanding the network beyond Australia to locations around the world. Fireballs in the Sky allows a growing public base to learn about and participate in this exciting research.

Day, Brian↗

The AQUA-MER databases and aqueous speciation server: A web resource for multiscale modeling of mercury speciation

To assess the chemical reactivity, toxicity, and mobility of pollutants in the environment, knowledge of their species distributions is critical. Because their direct measurement is often infeasible, speciation modeling is widely adopted. Mercury (Hg) is a representative pollutant for which study of its speciation benefits from modeling. However, Hg speciation modeling is often hindered by a lack of reliable thermodynamic constants. Although computational chemistry (e.g., density functional theory [DFT]) can generate these constants, methods for directly coupling DFT and speciation modeling are not available. Here, we combine computational chemistry and continuum-scale modeling with curated online databases to ameliorate the problem of unreliable inputs to Hg speciation modeling. Our AQUA-MER databases and web server (https://aquamer.ornl.gov) provides direct speciation results by combining web-based interfaces to a speciation calculator, databases of thermodynamic constants, and a computational chemistry toolkit to estimate missing constants. Lastly, although Hg is presented as a concrete use case, AQUA-MER can also be readily applied to other elements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

FIRED (Fire Events Delineation): An Open, Flexible Algorithm and Database of US Fire Events Derived from the MODIS Burned Area Product (2001–2019)

Harnessing the fire data revolution, i.e., the abundance of information from satellites, government records, social media, and human health sources, now requires complex and challenging data integration approaches. Defining fire events is key to that effort. In order to understand the spatial and temporal characteristics of fire, or the classic fire regime concept, we need to critically define fire events from remote sensing data. Events, fundamentally a geographic concept with delineated spatial and temporal boundaries around a specific phenomenon that is homogenous in some property, are key to understanding fire regimes and more importantly how they are changing. Here, we describe Fire Events Delineation (FIRED), an event-delineation algorithm, that has been used to derive fire events (N = 51,871) from the MODIS MCD64 burned area product for the coterminous US (CONUS) from January 2001 to May 2019. The optimized spatial and temporal parameters to cluster burned area pixels into events were an 11-day window and a 5-pixel (2315 m) distance, when optimized against 13,741 wildfire perimeters in the CONUS from the Monitoring Trends in Burn Severity record. The linear relationship between the size of individual FIRED and Monitoring Trends in Burn Severity (MTBS) events for the CONUS was strong (R2 = 0.92 for all events). Importantly, this algorithm is open-source and flexible, allowing the end user to modify the spatio-temporal threshold or even the underlying algorithm approach as they see fit. We expect the optimized criteria to vary across regions, based on regional distributions of fire event size and rate of spread. We describe the derived metrics provided in a new national database and how they can be used to better understand US fire regimes. The open, flexible FIRED algorithm could be utilized to derive events in any satellite product. We hope that this open science effort will help catalyze a community-driven, data-integration effort (termed OneFire) to build a more complete picture of fire.

54 ENVIRONMENTAL SCIENCES↗

Comparison of Entry Descent and Landing Aerodynamic Databases with Uncertainty Quantification Developed Using Machine Learning Techniques

When developing the aerodynamic databases for use in trajectory simulations, it is important to develop a system of metrics to qualify which aerodynamic models are best to use. Since aerodynamics are just one input into trajectory simulations, the results of these simulations do not reflect on the quality of the aerodynamic database used. This means that aerodynamic database comparisons must be done offline. While traditional metrics that focus on mean/nominal predictions are a good first step, more robust estimates of the prediction interval become important as more focused uncertainty models are developed. We explore the limitations of evaluating aerodynamic models based purely on nominal-centered response surfaces. Before elaborating and evaluating metrics based on distributed models, the value of evaluating prediction interval and confidence interval are discussed to conclude that prediction intervals are more relevant to the use of trajectory analysis. Several metrics to evaluate the prediction interval are introduced with a focus on the standard calibration metric. Finally, we compare candidate models using both mean and distributed metrics. A finalized candidate model developed using state of the art machine learning methods is compared to a baseline model developed using traditional aerodynamic database modeling techniques.

Aerodynamic Database↗

Sources, Sinks, and the Distribution of OH in the Lower Stratosphere

Extensive measurement campaigns by the NASA ER-2 research aircraft have obtained a nearly pole-to-pole database of the species that control HOx (OH + HO2) chemistry. The wide dynamic range of these in situ measurements provides an opportunity to demonstrate empirically the mechanisms that control the HOx system. Measurements in the lower stratosphere show a remarkably tight correlation of OH concentration with the solar zenith angle (SZA). This correlation is nearly invariant over latitudes ranging from 70 S to 90 N and all seasons. An analysis of the production and loss of HOx in terms of the rate determining steps of reaction sequences developed by Johnston and Podolske and Johnston and Kinnison is used to clarify the behavior of the system and to directly test our understanding of the system with observations. Calculations using in situ measurements show that the production rate of HOx is proportional to O3 and ultraviolet radiation flux. The loss rate is proportional to the concentration and the partitioning of NOy (reactive nitrogen) and the concentration of HO2. In the absence of heterogeneous reactions, the partitioning of NOy is controlled by O3 and NOx and the concentration of HO2 is controlled by NOy and O3, so that the removal rate of OH is buffered against changes in the correlation of O3 and NOy. The heterogeneous conversion of NO2 to HNO3 is not an important net source of HO, because production and removal sequences are nearly balanced. Changes in NOy partitioning resulting from heterogeneous chemistry have a large effect on the loss rates of HOx, but little or no impact on the measured abundance of OH. The enhanced loss rates at high NO2/HNO3 are offset in the data set examined here by enhanced production rates resulting from increased photolysis rates resulting from the decreased O3 column above the ER-2.

Hanisco, T. F.↗

Profiling the BLAST bioinformatics application for load balancing on high-performance computing clusters

Abstract Background The Basic Local Alignment Search Tool (BLAST) is a suite of commonly used algorithms for identifying matches between biological sequences. The user supplies a database file and query file of sequences for BLAST to find identical sequences between the two. The typical millions of database and query sequences make BLAST computationally challenging but also well suited for parallelization on high-performance computing clusters. The efficacy of parallelization depends on the data partitioning, where the optimal data partitioning relies on an accurate performance model. In previous studies, a BLAST job was sped up by 27 times by partitioning the database and query among thousands of processor nodes. However, the optimality of the partitioning method was not studied. Unlike BLAST performance models proposed in the literature that usually have problem size and hardware configuration as the only variables, the execution time of a BLAST job is a function of database size, query size, and hardware capability. In this work, the nucleotide BLAST application BLASTN was profiled using three methods: shell-level profiling with the Unix “time” command, code-level profiling with the built-in “profiler” module, and system-level profiling with the Unix “gprof” program. The runtimes were measured for six node types, using six different database files and 15 query files, on a heterogeneous HPC cluster with 500+ nodes. The empirical measurement data were fitted with quadratic functions to develop performance models that were used to guide the data parallelization for BLASTN jobs. Results Profiling results showed that BLASTN contains more than 34,500 different functions, but a single function, RunMTBySplitDB, takes 99.12% of the total runtime. Among its 53 child functions, five core functions were identified to make up 92.12% of the overall BLASTN runtime. Based on the performance models, static load balancing algorithms can be applied to the BLASTN input data to minimize the runtime of the longest job on an HPC cluster. Four test cases being run on homogeneous and heterogeneous clusters were tested. Experiment results showed that the runtime can be reduced by 81% on a homogeneous cluster and by 20% on a heterogeneous cluster by re-distributing the workload. Discussion Optimal data partitioning can improve BLASTN’s overall runtime 5.4-fold in comparison with dividing the database and query into the same number of fragments. The proposed methodology can be used in the other applications in the BLAST+ suite or any other application as long as source code is available.

59 BASIC BIOLOGICAL SCIENCES↗

Let’s get our hands dirty: a comprehensive evaluation of DAQDB, key-value store for petascale hot storage

Data acquisition systems are a key component for successful data taking in any experiment. The DAQ is a complex distributed computing system and coordinates all operations, from the data selection stage of interesting events to storage elements. For the High Luminosity upgrade of the Large Hadron Collider, the experiments at CERN need to meet challenging requirements to record data with a much higher occupancy in the detectors. The DAQ system will receive and deliver data with a significantly increased trigger rate, one million events per second, and capacity, terabytes of data per second. An effective way to meet these requirements is to decouple real-time data acquisition from event selection. Data fragments can be temporarily stored in a large distributed key-value store. Fragments belonging to the same event can be then queried on demand, by the data selection processes. Implementing such a model relies on a proper combination of emerging technologies, such as persistent memory, NVMe SSDs, scalable networking, and data structures, as well as high performance, scalable software. In this paper, we present DAQDB (Data Acquisition Database) — an open source implementation of this design that was presented earlier, with an extensive evaluation of this approach, from the single node to the distributed performance. Furthermore, we complement our study with a description of the challenges faced and the lessons learned while integrating DAQDB with the existing software framework of the ATLAS experiment.

Abed Abud, Adam↗

A North Atlantic synthetic tropical cyclone track, intensity, and rainfall dataset

Tropical Cyclones (TCs) cause significant socio-economic damages to the US and Caribbean coastal regions annually, making it important to understand TC risk at the local-to-regional scales. However, the short length of the observed record and the substantial computational expense associated with high-resolution climate models make it difficult to assess TC risk using either approach. To overcome these challenges, we developed a database of synthetic TCs using the Risk Analysis Framework for Tropical Cyclones (RAFT). The database includes 40,000 synthetic TC tracks, along-track intensities and storm-induced precipitation. TC tracks generated in RAFT are in reasonable agreement with the observed spatial distribution of TC tracks and basin-scale TC statistics. Specifically, along the coast, spatial variations in TC crossing probability and extreme winds upon landfall are well-reproduced by RAFT with R-squared values of 0.81 and 0.73, respectively. In summary, the synthetic TC database constructed with RAFT provides a reasonable pathway for the robust assessment of North Atlantic TC wind and rainfall risks.

54 ENVIRONMENTAL SCIENCES↗

The Third Data Release of the KODIAQ Survey

We present and make publicly available the third data release (DR3) of the Keck Observatory Database of Ionized Absorption toward Quasars (KODIAQ) survey. KODIAQ DR3 consists of a fully reduced sample of 727 quasars at 0.1 < z {sub em} < 6.4 observed with the Echellette Sepctrograph and Imager at moderate resolution (4000 ≤ R ≤ 10,000). DR3 contains 872 spectra available in flux calibrated form, representing a sum total exposure time of ∼2.8 megaseconds. These coadded spectra arise from a total of 2753 individual exposures of quasars taken from the Keck Observatory Archive (KOA) in raw form and uniformly processed using a data reduction package made available through the XIDL distribution. DR3 is publicly available to the community, housed as a higher level science product at the KOA and in the igmspec database.

74 ATOMIC AND MOLECULAR PHYSICS↗

ELECTRON ENERGY AND MAGNETIC FIELD DERIVED FROM SOLAR MICROWAVE BURST SPECTRA

Microwave bursts during solar flares are known to be sensitive to high-energy electrons and magnetic field, both of which are important ingredients of solar flare physics. This paper presents such information derived from the microwave bursts of the 412 flares that were measured with the Owens Valley Solar Array. We assumed that these bursts are predominantly due to gyrosynchrotron radiation by nonthermal electrons in a single power-law energy distribution to use the simplified formulae for gyrosynchrotron radiation in the data analysis. A second major assumption was that statistical properties of flare electrons derived from this microwave database should agree with an earlier result based on the hard X-ray burst spectrometer on Solar Maximum Mission. Magnetic field information was obtained in the form of a scaling law between the average magnetic field and the total source area, which turns out to be a narrow distribution around {approx}400 G. The derived nonthermal electron energy is related to the peak flux, peak frequency, and spectral index, through a multistep regression fit, which can be used for a quick estimate for the nonthermal electron energy from spatially integrated microwave spectral observations.

99 GENERAL AND MISCELLANEOUS↗