Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cloud Implementation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Earth Observing System (EOS) Terra Spacecraft 120 Volt Power Subsystem: Requirements, Development and Implementation

Built by the Lockheed-Martin Corporation, the Earth Observing System (EOS) TERRA spacecraft represents the first orbiting application of a 120 Vdc high voltage spacecraft electrical power system implemented by the National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC). The EOS TERRA spacecraft's launch provided a major contribution to the NASA Mission to Planet Earth program while incorporating many state of the art electrical power system technologies to achieve its mission goals. The EOS TERRA spacecraft was designed around five state-of-the-art scientific instrument packages designed to monitor key parameters associated with the earth's climate. The development focus of the TERRA electrical power system (EPS) resulted from a need for high power distribution to the EOS TERRA spacecraft subsystems and instruments and minimizing mass and parasitic losses. Also important as a design goal of the EPS was maintaining tight regulation on voltage and achieving low conducted bus noise characteristics. This paper outlines the major requirements for the EPS as well as the resulting hardware implementation approach adopted to meet the demands of the EOS TERRA low earth orbit mission. The selected orbit, based on scientific needs, to achieve the EOS TERRA mission goals is a sun-synchronous circular 98.2degree inclination Low Earth Orbit (LEO) with a near circular average altitude of 705 kilometers. The nominal spacecraft orbit is approximately 99 minutes with an average eclipse period of about 34 minutes. The scientific goal of the selected orbit is to maintain a repeated 10:30 a.m. +/- 15 minute descending equatorial crossing which provides a fairly clear view of the earth's surface and relatively low cloud interference for the instrument observation measurements. The major EOS TERRA EPS design requirements are single fault tolerant, average orbit power delivery of 2, 530 watts with a defined minimum lifetime of five years (EOL). To meet these mission requirements, while minimizing mass and parasitic power losses, the EOS TERRA project relies on 36, 096 high efficiency Gallium Arsenide (GaAs) on Germanium solar cells adhered to a deployable flexible solar array designed to provide over 5,000 watts of power at EOL. To meet the eclipse power demands of the spacecraft, EOS TERRA selected an application of two 54-cell series connected Individual Pressure Vessel (IPV) Nickel-Hydrogen (NiH2) 50 Ampere-Hour batteries. All of the spacecraft observatory electrical power is controlled via the TERRA Power Distribution Unit (PDU) which is designed to provide main bus regulation of 120 Vdc +/- -4% at all load interfaces through the implementation of majority voter control of both the spacecraft's solar array sequential shunt unit (SSU) and the two battery bi-directional charge and discharge regulators. This paper will review the major electrical power system requirement drivers for the EOS TERRA mission as well as some of the challenges encountered during the development, testing, and implementation of the power system. In addition, spacecraft test and early on orbit performance results will also be covered.

Keys, Denney J.↗

Accelerating Control Systems with GitOps: A Path to Automation and Reliability

GitOps is a foundational approach for modernizing infrastructure by leveraging Git as the single source of truth for declarative configurations. The poster explores how GitOps transforms traditional control system infrastructure, services and applications by enabling fully automated, auditable, and version-controlled infrastructure management. Cloud-native and containerized environments are shifting the ecosystem not only in the IT industry but also within the computational science field, as is the case of CERN and Diamond Light Source among other Accelerator/Science facilities which are slowly shifting towards modern software and infrastructure paradigms. The ACORN project, which aims to modernize Fermilab’s control system infrastructure and software is implementing proven best-practices and cutting-edge technology standards including GitOps, containerization, infrastructure as code and modern data pipelines for control system data acquisition and the inclusion of AI/ML in our accelerator complex.

Gonzalez, M. [Fermilab]↗

High-resolution Interferometer Sounder (HIS), phase 2

The High-resolution Interferometer Sounder (HIS) was successfully built, tested, and flight proven on the NASA U-2/ER-2 high altitude aircraft. The HIS demonstration has shown that, by using the technology of Fourier Transform Spectroscopy (FTS), it is possible to measure the spectrum of upwelling infrared radiance needed for temperature and humidity sounding with high spectral resolution and high radiometric precision. By resolving individual carbon dioxide lines, the retrieved temperature profiles have vertical resolutions of 1 to 2 km and RMS errors less than 1 C, about 2 to 4 times better than possible with current sounders. Implementing this capability on satellite sounders will greatly enhance the dynamical information content of temperature measurements from space. The aircraft model HIS is now a resource which should be used to support field experiments in mesoscale meteorology, to monitor trace gas concentrations and to better understand their effects on climate, to monitor the surface radiation budget and the radiative effects of clouds, and to collect data for research into retrieval techniques, especially under partially cloudy conditions.

Source record↗

NASA Tech Briefs, July 2011

Topics covered include: 1) Collaborative Clustering for Sensor Networks; 2) Teleoperated Marsupial Mobile Sensor Platform Pair for Telepresence Insertion Into Challenging Structures; 3) Automated Verification of Spatial Resolution in Remotely Sensed Imagery; 4) Electrical Connector Mechanical Seating Sensor; 5) In Situ Aerosol Detector; 6) Multi-Parameter Aerosol Scattering Sensor; 7) MOSFET Switching Circuit Protects Shape Memory Alloy Actuators; 8) Optimized FPGA Implementation of Multi-Rate FIR Filters Through Thread Decomposition; 9) Circuit for Communication Over Power Lines; 10) High-Efficiency Ka-Band Waveguide Two-Way Asymmetric Power Combiner; 11) 10-100 Gbps Offload NIC for WAN, NLR, and Grid Computing; 12) Pulsed Laser System to Simulate Effects of Cosmic Rays in Semiconductor Devices; 13) Flight Planning in the Cloud; 14) MPS Editor; 15) Object-Oriented Multi Disciplinary Design, Analysis, and Optimization Tool; 16) Cryogenic-Compatible Winchester Connector Mount and Retaining System for Composite Tubes; 17) Development of Position-Sensitive Magnetic Calorimeters for X-Ray Astronomy; 18) Planar Rotary Piezoelectric Motor Using Ultrasonic Horns; 19) Self-Rupturing Hermetic Valve; 20) Explosive Bolt Dual-Initiated from One Side; 21) Dampers for Stationary Labyrinth Seals; 22) Two-Arm Flexible Thermal Strap; 23) Carbon Dioxide Removal via Passive Thermal Approaches; 24) Polymer Electrolyte-Based Ambient Temperature Oxygen Microsensors for Environmental Monitoring; 25) Pressure Shell Approach to Integrated Environmental Protection; 26) Image Quality Indicator for Infrared Inspections; 27) Micro-Slit Collimators for X-Ray/Gamma-Ray Imaging; 28) Scatterometer-Calibrated Stability Verification Method; 29) Test Port for Fiber-Optic-Coupled Laser Altimeter; 30) Phase Retrieval System for Assessing Diamond Turning and Optical Surface Defects; 31) Laser Oscillator Incorporating a Wedged Polarization Rotator and a Porro Prism as Cavity Mirror; 32) Generic, Extensible, Configurable Push-Pull Framework for Large-Scale Science Missions; 33) Dynamic Loads Generation for Multi-Point Vibration Excitation Problems; 34) Optimal Control via Self-Generated Stochasticity; 35) Space-Time Localization of Plasma Turbulence Using Multiple Spacecraft Radio Links; 36) Surface Contact Model for Comets and Asteroids; 37) Dust Mitigation Vehicle; 38) Optical Coating Performance for Heat Reflectors of the JWST-ISIM Electronic Component; 39) SpaceCube Demonstration Platform; 40) Aperture Mask for Unambiguous Parity Determination in Long Wavelength Imagers; 41) Spaceflight Ka-Band High-Rate Radiation-Hard Modulator; 42) Enabling Disabled Persons to Gain Access to Digital Media; 43) Cytometer on a Chip; 44) Principles, Techniques, and Applications of Tissue Microfluidics; and 45) Two-Stage Winch for Kites and Tethered Balloons or Blimps.

Source record↗

Multi-Angle Implementation of Atmospheric Correction (MAIAC) Algorithm

Multi-Angle Implementation of Atmospheric Correction (MAIAC) is a new algorithm developed for MODIS. MAIAC uses a time series analysis and processing of groups of pixels to perform simultaneous retrievals of aerosol properties and surface bidirectional reflectance without typical assumptions about the surface. It is a generic algorithm which works over both dark and bright land surfaces, including deserts. MAIAC has an internal Cloud Mask, a dynamic land-water-snow classification and a surface change mask which allows it to flexibly choose processing path over different surfaces. A distinct feature of MAIAC is a high 1 km resolution of aerosol retrievals which is required in different applications including the air quality analysis. The novel features of MAIAC include the high quality cloud mask, discrimination of aerosol type, including biomass burning smoke and dust, and detection of surface change - all required for high quality aerosol retrievals. An overview of the algorithm, results of AERONET validation, and examples of comparison with MODIS Collection 5 aerosol product and Deep Blue algorithm for different parts of the world, will be presented.

Lyapustin, A.↗

The Multiple Altimeter Beam Experimental Lidar (MABEL), an Airborne Simulator for the ICESat-2 Mission

The Ice, Cloud, and land Elevation Satellite-2 (ICESat-2) mission is currently under development by NASA. The primary mission of ICESat-2 will be to measure elevation changes of the Greenland and Antarctic ice sheets, document changes in sea ice thickness distribution, and derive important information about the current state of the global ice coverage. To make this important measurement, NASA is implementing a new type of satellite-based surface altimetry based on sensing of laser pulses transmitted to, and reflected from, the surface. Because the ICESat-2 measurement approach is different from that used for previous altimeter missions, a high-fidelity aircraft instrument, the Multiple Altimeter Beam Experimental Lidar (MABEL), was developed to demonstrate the measurement concept and provide verification of the ICESat-2 methodology. The MABEL instrument will serve as a prototype for the ICESat-2 mission and also provides a science tool for studies of land surface topography. This paper outlines the science objectives for the ICESat-2 mission, the current measurement concept for ICESat-2, and the instrument concept and preliminary data from MABEL.

McGill, Matthew↗

Using Deep Learning to Automate Inference of Meteoroid Pre-Entry Properties

Properly assessing the asteroid threat depends on the knowledge of asteroid pre-entry parameters, such as size, velocity, mass, density, and strength. Although a vast number of possible bodies to study exist, such characterization of asteroid populations is currently limited by substantial costs associated with space rendezvous missions and rare meteorite findings. As asteroids fragment, ablate, and decelerate in the atmosphere, they emit light detectable by ground-based and space-borne instruments. Earth’s atmosphere, thus, becomes an accessible laboratory that enables impactor risk assessments by facilitating inference of the pre-entry parameters. These asteroid pre-entry conditions are typically deduced by modeling the entry and breakup physics that best reproduce the observed light or energy deposition curve. However, this process requires extensive manual trial-and-error of uncertain modeling parameters. Automating meteor modeling and inference would improve property distributions used in risk assessments and enable population characterization as more light curves become more readily available through the presence of space assets and ground-based camera networks. We previously developed a genetic algorithm to automate meteor modeling by using the fragment-cloud model (FCM) to search for the values of the FCM input parameters (e.g., diameter) that generate energy deposition profiles that match the observed one. Now, we apply deep learning to infer asteroid diameter, velocity, and density from observed energy deposition curves. We trained and tested our neural network models with synthetic energy deposition curves modeled using the FCM rubble pile implementation. We present an application of a 1D convolutional neural network and compare its performance to other attempted regressors and machine learning techniques, such as a fully connected neural network and Random Forest regression, to demonstrate its capabilities. We validate our model weights and approach using the Chelyabinsk, Tagish Lake, Benešov, Košice, and Lost City meteors.

Tarano, Ana Maria↗

Recent Results From The Nasa Earth Science Terra Mission and Future Possibilities

The NASA Earth Sciences Enterprise has made some remarkable strides in recent times in using developing, implementing, and utilizing spaceborne observations to better understand how the Earth works as a coupled, interactive system of the land, ocean, and atmosphere. Notable examples include the Upper Atmosphere Research (UARS) Satellite, the Topology Ocean Experiment (TOPEX) mission, Landsat-7, SeaWiFS, the Tropical Rainfall Monitoring Mission (TRMM), Quickscatt, the Shuttle Radar Topography Mission (SRTM), and, quite recently, the Terra'/Earth Observing System-1 mission. The Terra mission, for example, represents a major step forward in providing sensors that offer considerable advantages and progress over heritage instruments. The Moderate Resolution Imaging Spectrometer (MODIS), the Multi-angle Imaging SpectroRadiometer (MISR), the Measurements of Pollution in the Troposphere (MOPITT), the Advanced Spaceborne Thermal Emissions and Reflections (ASTER) radiometer, and the Clouds and Earth's Radiant Energy System (CERES) radiometer are the instruments involved. Early indications in March indicate that each of these instruments are working well and will be augmenting data bases from heritage instruments as well as producing new, unprecedented observations of land, ocean, and atmosphere features. Several missions will follow the Terra mission as the Earth Observing mission systems complete development and go into operation. These missions include EOS PM-1/'Aqua', Icesat, Vegetation Canopy Lidar (VCL), Jason/TOPEX Follow-on, the Chemistry mission, etc. As the Earth Observing systems completes its first phase in about 2004 a wealth of data enabling better understanding of the Earth and the management of its resources will have been provided. Considerable thought is beginning to be placed on what advances in technology can be implemented that will enable further advances in the early part of the 21st century; e.g., in the time from of 2020. Concepts such as 'constellation' missions or 'formation flying' with 'sensorcraft', 'sensor webs', autonomous operation of satellites, more on-board processing and delivery to individual users, data synthesis and analysis in real-time, etc. are being considered. With the data now having been and soon to be received plus the very real possibilities of further advances in use and applicability of data the potential for very significant gains in knowledge for Earth studies and applications looks quite high in the next decade or two.

Salomonson, Vincent V.↗

A Novel Machine Learning-Based Gap-Filling of Fine-Resolution Remotely Sensed Snow Cover Fraction Data By Combining Downscaling and Regression

Satellite-based remotely sensed observations of snow cover fraction (SCF) can have data gaps in spatially distributed coverage from sensor and orbital limitations. We mitigate these limitations in the example fine-resolution Moderate Resolution Imaging Spectroradiometer (MODIS) data by gap-filling using auxiliary 1-km datasets that either aid in downscaling from coarser-resolution (5 km) MODIS SCF wherever not fully covered by clouds, or else by themselves via regression wherever fully cloud covered. This study’s prototype predicts a 1-km version of the 500-m MOD10A1 SCF target. Due to noncollocatedness of spatial gaps even across input and auxiliary datasets, we consider a recent gap-agnostic advancement of partial convolution in computer vision for both training and predictive gap-filling. Partial convolution accommodates spatially consistent gaps across the input images, effectively implementing a two-dimensional masking. To overcome reduced usable data from noncollocated spatial gaps across inputs, we innovate a fully generalized three-dimensional masking in this partial convolution. This enables a valid output value at a pixel even if only a single valid input variable and its value exist in the neighborhood covered by the convolutional filter zone centered around that pixel. Thus, our gap-agnostic technique can use significantly more examples for training (∼67%) and prediction (∼100%), instead of only less than 10% for the previous partial convolution. We train an example simple three-layer legacy super-resolution convolutional neural network (SRCNN) to obtain downscaling and regression component performances that are better than baseline values of either climatology or MOD10C1 SCF as relevant. Our generalized partial convolution can enable multiple Earth science applications like downscaling, regression, classification, and segmentation that were hindered by data gaps.

Soni Yatheendradas↗

Simulations of divertor designs that spatially separate power and particle exhaust using mid-leg divertor particle pumping

Predictive design modeling of a Dissipation-Focused Divertor for future operation in DIII-D reveals that increasing the poloidal distance of the pump duct entrance from the target surface along the low-field side divertor baffle increases neutral compression and modifies the spatial distribution of power dissipation. With a divertor pump located mid-leg between the target and the X-point, SOLPS-ITER boundary plasma simulations without drifts predict the formation of a dense neutral cloud near the target with > 30x higher neutral compression in detachment, a more stable detachment front located further from the target, and ~25% lower outer midplane separatrix density required for detachment onset, compared to a pump located in the scrape-off layer at the target surface. Up to 19 MW of power flowing into the divertors is modeled using the following two numerical implementations for particle pumping: a specified fraction of particles incident on variable wall sections of the plasma grid is removed from the computational domain (so-called albedo pumping), and a pump duct is modeled which includes dynamics of kinetic neutrals in the duct. The simulations show that the detachment front is located between the divertor target and the X-point and is relatively stable near the pump entrance, without a strong dependence on gas puff rate or injected power. The mid-leg pump design spatially separates the two primary functions of a divertor (power handling and particle exhaust), with the majority of power dissipation occurring near the target plate and particle exhaust taking place further upstream. The benefit of enhanced dissipation using mid-leg pumping comes at the cost of a higher outer midplane separatrix density for a given amount of particle injection.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Improved Intraseasonal Variability in the NASA GEOS AGCM with 2-moment Microphysics and a Shallow Cumulus Parameterization

Weather and climate models have long struggled to realistically simulate the Madden-Julian Oscillation (MJO). Here we present a significant improvement in MJO simulation in NASA's GEOS atmospheric model with the implementation of 2-moment microphysics and the UW shallow cumulus parameterization. Comparing ten-year runs (2007-2016) with the old (1mom) and updated (2mom+shlw) model physics, the updated model has increased intra-seasonal variance with increased coherence. Surface fluxes and OLR are found to vary more realistically with precipitation, and a moisture budget suggests that changes in rain reevaporation and the cloud longwave feedback help support heavy precipitation. Preliminary results also show improved MJO hindcast skill.

Madden-Julian Oscillatio↗

Contributions to the implementation of the Arakawa-Schubert cumulus parameterization in the GLA GCM

The AS scheme in the Goddard Laboratory for Atmospheres General Circulation Model is used to address two fundamental problems of simulated cumulus convection and rainfall. The first problem is that of too much rainfall in the tropics at initial time and the second is the problem of too vigorous a hydrologic cycle in the tropics even after the initial adjustment period. A number of experiments were performed, including an investigation of the influence of the prescribed limiting values of critical cloud work formation (CCWF). It is concluded that the CCWF plays a useful role in the apportionment of the rainfall into convective and large-scale components. Related experiments reveal the nature of the interaction between atmospheric circulation and the cumulus processes.

Sud, Y. C.↗

Preliminary design for Arctic atmospheric radiative transfer experiments

If current plans are realized, within the next few years, an extraordinary set of coordinated research efforts focusing on energy flows in the Arctic will be implemented. All are motivated by the prospect of global climate change. SHEBA (Surface Energy Budget of the Arctic Ocean), led by the National Science Foundation (NSF) and the Office of Naval Research (ONR), involves instrumenting an ice camp in the perennial Arctic ice pack, and taking data for 12-18 months. The ARM (Atmospheric Radiation Measurement) North Slope of Alaska and Adjacent Arctic Ocean (NSA/AAO) Cloud and Radiation Testbed (CART) focuses on atmospheric radiative transport, especially in the presence of clouds. The NSA/AAO CART involves instrumenting a sizeable area on the North Slope of Alaska and adjacent waters in the vicinity of Barrow, and acquiring data over a period of about 10 years. FIRE (First ISCCP (International Satellite Cloud Climatology Program) Regional Experiment) Phase 3 is a program led by the National Aeronautics and Space Administration (NASA) which focuses on Arctic clouds, and which is coordinated with SHEBA and ARM. FIRE has historically emphasized data from airborne and satellite platforms. All three program anticipate initiating Arctic data acquisition during spring, 1997. In light of his historic opportunity, the authors discuss a strawman atmospheric radiative transfer experimental plan that identifies which features of the radiative transport models they think should be tested, what experimental data are required for each type of test, the platforms and instrumentation necessary to acquire those data, and in general terms, how the experiments could be conducted. Aspects of the plan are applicable to all three programs.

Zak, B. D.↗

Sensitivity Studies for Space-based Measurements of Atmospheric Total Column Carbon Dioxide Using Reflected Sunlight

A series of sensitivity studies is carried out to explore the feasibility of space-based global carbon dioxide (CO2) measurements for global and regional carbon cycle studies. The detection method uses absorption of reflected sunlight in the CO2 vibration-rotation band at 1.58 micron. The sensitivities of the detected radiances are calculated using the line-by-line model (LBLRTM), implemented with the DISORT (Discrete Ordinates Radiative Transfer) model to include atmospheric scattering in this band. The results indicate that (a) the small (approx.1%) changes in CO2 near the Earth's surface are detectable in this CO2 band provided adequate sensor signal-to-noise ratio and spectral resolution are achievable; (b) the effects of other interfering constituents, such as water vapor, aerosols and cirrus clouds, on the radiance are significant but the overall effects of the modification of light path length on total back-to-space radiance sensitivity to CO2 change are minor for general cases, which means that generally the total column CO2 can be derived in high precision from the ratio of the on-line center to off-line radiances; (c) together with CO2 gas absorption aerosol/cirrus cloud layer has differential scattering which may result in the modification of on-line to off-line radiance ratio which could lead a large bias in the total column CO2 retrieval. Approaches to correct such bias need further investigation. (d) CO2 retrieval requires good knowledge of the atmospheric temperature profile, e.g. approximately 1K RMS error in layer temperature, which is achievable from new atmospheric sounders in the near future; (e) the atmospheric path length, over which the CO2 absorption occurs, should be known in order to correctly interpret horizontal gradients of CO2 from the total column CO2 measurement; thus an additional sensor for surface pressure measurement needs to be attached for a complete measurement package.

Mao, Jianping↗

The Crustal Dynamics Data Information System (CDDIS) – Updates and Future Developments

As earth observing services and techniques have flourished, data and products have exponentially grown, like the proliferation of GNSS stations capable of providing real-time data, SLR stations shifting to kHz lasers, and VLBI’s implementation of VGOS telescopes. The CDDIS is continually evolving to fulfill the new storage, quality check, and latency requirements that these changes bring, as well as meet new standards such as the shift toward FAIR and open science. These have shaped how the CDDIS develops new software and resources. Beginning next year, the CDDIS will begin to transition their data and products to the AWS cloud, beginning with DORIS data. This poster will highlight the CDDIS’s recently updated processing system, new data and products available, and future work.

Justine Woo↗

Standalone Hazard Evaluation and Refinement From Instrument Findings (S.H.E.R.I.F.)

The Standalone Hazard Evaluation From Instrument Findings (SHERIF) system is a set of novel algorithms and associated framework designed to support the generation of Digital Elevation Maps (DEMs) from multiple LiDAR scans and perform Hazard Detection (HD) and Safe Site Identification (SSI) with no dependencies on other onboard systems. SHERIF can employ several techniques to perform robust 3D keypoint extraction and Point Cloud registration (PCR) on disparate LiDAR scans of a planetary surface to generate a DEM which evolves over the course of a trajectory. The framework also supports a variety of Hazard Detection and Safe Site Identification algorithms which can be applied to the evolving DEM being produced. SHERIF features a robust and modular construction, allowing the user a high degree of flexibility in selecting and implementing whichever keypoint identificaiton, PCR and HD/SSI algorithms they may prefer, while maintaining the data products and sensor independence of the core SHERIF framework. SHERIF was recently evaluated via simulation and hardware-in-the-loop experimental testing at NASA Johnson Space Center.

hazard detection↗

Standalone Hazard Evaluation and Refinement From Instrument Findings (S.H.E.R.I.F.)

The Standalone Hazard Evaluation From Instrument Findings (SHERIF) system is a set of novel algorithms and associated framework designed to support the generation of Digital Elevation Maps (DEMs) from multiple LiDAR scans and perform Hazard Detection (HD) and Safe Site Identification (SSI) with no dependencies on other onboard systems. SHERIF can employ several techniques to perform robust 3D keypoint extraction and Point Cloud registration (PCR) on disparate LiDAR scans of a planetary surface to generate a DEM which evolves over the course of a trajectory. The framework also supports a variety of Hazard Detection and Safe Site Identification algorithms which can be applied to the evolving DEM being produced. SHERIF features a robust and modular construction, allowing the user a high degree of flexibility in selecting and implementing whichever keypoint identificaiton, PCR and HD/SSI algorithms they may prefer, while maintaining the data products and sensor independence of the core SHERIF framework. SHERIF was recently evaluated via simulation and hardware-in-the-loop experimental testing at NASA Johnson Space Center.

hazard detection↗

Fostering Geothermal Machine Learning Success: Elevating Big Data Accessibility and Automated Data Standardization in the Geothermal Data Repository

The Department of Energy's (DOE's) Geothermal Data Repository (GDR) has implemented improvements to both its data lakes and its data standards and automated data pipelines. The GDR data lakes have reduced storage and compute-related barriers to using large geothermal datasets, enabling these large datasets to be accessed by anyone with a modern computer and internet access. More recently, the GDR has been working to further reduce barriers through streamlining the data intake process, educating users on the process and requirements, and helping users access data from the data lakes. These improvements have augmented the quantity of datasets the GDR is able to accept into its data lakes and have enabled users who are new to cloud tools to access these datasets more easily, overall increasing the accessibility of big geothermal data for use in machine learning and other projects. In addition, the GDR now has built-in data standards and pipelines for drilling data, geospatial data, and distributed acoustic sensing (DAS) data. These standardization efforts aim to enhance the real-world applicability of geothermal machine learning outcomes by improving the quality of training data. Specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, thus allowing more time for actual research. By automating this process, the burden of standardization is lifted from the user, ultimately increasing the availability of standardized data. This paper provides an update on recent improvements made to the GDR's data lakes and automated data pipelines, including: (1) streamlining the data lake intake process, (2) better educating users on the process and requirements through a new data lakes page, (3) adding data lake direct access links to GDR data lake submission pages, (4) implementing a DAS data pipeline to convert DAS data uploaded in SEG-Y format to a standardized hierarchical data format v5 (HDF5), (5) extending this pipeline to encompass data in the GDR data lake, (6) adding metadata requirements for geospatial data, (7) making user interface/user experience (UX) enhancements to the data pipelines' documentation pages, and (8) improving the GDR's data standards and pipelines pages to better guide users in ensuring that their data is standardized by the GDR's automated data pipelines. 2024 Geothermal Resources Council. All rights reserved.

accessibility↗