Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing, data cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Low Latency Flux and Concentration Datasets in Support of Greenhouse Gas Monitoring Based on NASA's GEOS Modeling and Data Assimilation System

We present efforts to develop space-based greenhouse gas monitoring systems that can provide low latency information and traceability to independent observations. Through support from its Carbon Monitoring System program, NASA has developed the capability to assimilate XCO2 retrievals from the Orbiting Carbon Observatory, 2 (OCO-2) into the Goddard Earth Observing System (GEOS) Constituent Data Assimilation System (CoDAS) to create gap-filled, three-dimensional (3D) estimates of CO2 mixing ratio. When OCO-2 data are not available, concentration fields are further informed by a bottom-up flux package based on remotely sensed fire radiative power, nighttime lights, and vegetation reflectance combined with estimates of atmospheric growth rate based on surface in situ data. The 3D nature of this dataset supports evaluation with independent aircraft data, helping to ensure transparency of remotely sensed data products. These quasi-operational data are currently produced 2-3 months behind real time and are distributed via NASA and international dashboard services to a variety of end users. In this presentation, we provide an overview of the system as well as remaining data gaps and modeling challenges. We also highlight the application of this dataset for detecting emissions anomalies associated with COVID-19 and comparing against independent emissions estimates. Finally, we highlight a new NASA initiative called the Earth Information System (EIS), which aims to support open science and applications by leveraging emerging cloud computing capabilities to increase access to NASA’s greenhouse gas datasets, opportunities for co-development, and transparency in methods for analysis and flux attribution.

Lesley Ott↗

Developing Open-Source Training Materials for AI/ML and Space Biological Sciences Using NASA Cloud-Based Data

Artificial Intelligence (AI) and Machine Learning (ML) has gained significant traction in the biological and biomedical research fields in the last two decades, in part thanks to an increasing culture of open data sharing and reuse. Due to its capability for identifying complex relationships and patterns, AI/ML methodology is particularly well suited to recognize and predict biological patterns from high-dimensional next-generation sequencing data (e.g. whole genome sequencing, transcriptomic sequencing), as well as from biological or medical imaging data (e.g. microscopy, computed tomography, ultrasound, magnetic resonance imaging, radiography). These methodologies hold particular promise for space biosciences research and automated space health monitoring systems. However, there are many key considerations for properly training, validating, and testing a machine learning model in biological research or clinical application. Even with the positive culture of Open Science and data sharing, inexperienced researchers working quickly without proper checks can produce models that perform poorly outside of the immediate training dataset. Lessons learned from biological AI/ML research indicate that Open Science principles such as data sharing and open-source code must go hand-in-hand with publicly available, high-quality training curricula in best practices, with modules centered on real-life scientific use cases and data so future AI/ML practitioners gain experience on real problems. Here we present the development of open-source training materials for AI/ML and space biosciences, as part of the NASA Transform to Open Science Training (TOPST) initiative. We develop 4 independent training programs, focused on the following topics: 1) Fundamentals of Machine Learning and Space Biosciences Domain, 2) Open Science, Artificial Intelligence, and Ethical Best Practices for Data Sharing and Analysis, 3) Using AI/ML Classification to Identify Gene Networks Affected By Space Exposure in Mouse Liver, and 4) Using Neural Networks to Find DNA Damage Patterns in Immune Cells after Radiation. All programs leverage cloud-based NASA biological datasets. The curriculum we present will enable worldwide access to training in AI/ML and scientific analysis.

James Andrew Casaletto↗

Radar Reflectivity Simulated by a 2-D Spectra Bin Model: Sensitivity of Cloud-aerosol Interaction

The Goddard Cumulus Ensemble (GCE) model with bin spectra microphysics is used to simulate mesoscale convective systems.The model uses explicit bins to represent size spectra of cloud nuclei, water drops, ice crystals, snow and graupel. Each hydrometeorite category is described by 33 mass bins. The simulations provide a unique data set of simulated raindrop size distribution in a realistic dynamic frame. Calculations of radar parameters using simulated drop size distribution serve as an evaluation of numerical model performance. In addition, the GCE bin spectra modes is a very useful tool to study uncertainties related to radar observations; all the environmental parameters are precisely known. In this presentation, we concentrate on the discussion of Z-R (ZDR-R) relation in the simulated systems. Due to computational limitations, the spectra bin model has been run in two dimensions with 31 stretched vertical layers and 1026 horizontal grid points (1 km resolution). Two different cases, one in midlatitude continent, the other in tropical ocean, have been simulated. The continental case is a strong convection which lasted for two hours. The oceanic case is a persistent system with more than 10 hours' life span. It is shown that the simulated Z-R (ZDR-R) relations generally agree with observations using radar and rain gauge data. The spatial and temporal variations of Z-R relation in different locations are also analyzed. Impact of aerosols on cloud formation and raindrop size distribution was studied. Both clean (low CCN) and dirty (high CCN) cases are simulated. The Z-R relation is shown to vary considerable in the initial CCN concentrations.

Li, Kiaowen↗

NASA/NOAA/USAID implementation of the South Pacific severe storm detection and warning system project

Implementation by NASA of the South Pacific severe storm detection and warning system project for the Fiji Meteorological Service (FMS) in Nadi, Fiji, is discussed. A description of the need and use of the system by the FMS, of data reception, of interactive computer techniques, of training, and of the benefits to be derived from implementation of the system is given. The project allows precise tracking of all South Pacific tropical cyclones with frequent high-resolution reception of both the Japanese GMS and the U.S. GOES-West visible and IR cloud images.

Dodge, J.↗

Parameter Estimation in Atmospheric Data Sets

In this study the structure tensor technique is used to estimate dynamical parameters in atmospheric data sets. The structure tensor is a common tool for estimating motion in image sequences. This technique can be extended to estimate other dynamical parameters such as diffusion constants or exponential decay rates. A general mathematical framework was developed for the direct estimation of the physical parameters that govern the underlying processes from image sequences. This estimation technique can be adapted to the specific physical problem under investigation, so it can be used in a variety of applications in trace gas, aerosol, and cloud remote sensing. As a test scenario this technique will be applied to modeled dust data. In this case vertically integrated dust concentrations were used to derive wind information. Those results can be compared to the wind vector fields which served as input to the model. Based on this analysis, a method to compute atmospheric data parameter fields will be presented. .

Wenig, Mark↗

Retrieving Atmospheric Temperature and Moisture Profiles from NPP CRIS/ATMS Sensors Using Crimss EDR Algorithm

The Joint Polar Satellite System (JPSS) is a U.S. National Oceanic and Atmospheric Administration (NOAA) mission in collaboration with the U.S. National Aeronautical Space Administration (NASA) and international partners. The NPP Cross-track Infrared Microwave Sounding Suite (CrIMSS) consists of the infrared (IR) Crosstrack Infrared Sounder (CrIS) and the microwave (MW) Advanced Technology Microwave Sounder (ATMS). The CrIS instrument is hyperspectral interferometer, which measures high spectral and spatial resolution upwelling infrared radiances. The ATMS is a 22-channel radiometer similar to Advanced Microwave Sounding Units (AMSU) A and B. It measures top of atmosphere MW upwelling radiation and provides capability of sounding below clouds. The CrIMSS Environmental Data Record (EDR) algorithm provides three EDRs, namely the atmospheric vertical temperature, moisture and pressure profiles (AVTP, AVMP and AVPP, respectively), with the lower tropospheric AVTP and the AVMP being JPSS Key Performance Parameters (KPPs). The operational CrIMSS EDR an algorithm was originally designed to run on large IBM computers with dedicated data management subsystem (DMS). We have ported the operational code to simple Linux systems by replacing DMS with appropriate interfaces. We also changed the interface of the operational code so that we can read data from both the CrIMSS science code and the operational code and be able to compare lookup tables, parameter files, and output results. The detail of the CrIMSS EDR algorithm is described in reference [1]. We will present results of testing the CrIMSS EDR operational algorithm using proxy data generated from the Infrared Atmospheric Sounding Interferometer (IASI) satellite data and from the NPP CrIS/ATMS data.

Liu, X.↗

The Parallel System for Integrating Impact Models and Sectors (pSIMS)

We present a framework for massively parallel climate impact simulations: the parallel System for Integrating Impact Models and Sectors (pSIMS). This framework comprises a) tools for ingesting and converting large amounts of data to a versatile datatype based on a common geospatial grid; b) tools for translating this datatype into custom formats for site-based models; c) a scalable parallel framework for performing large ensemble simulations, using any one of a number of different impacts models, on clusters, supercomputers, distributed grids, or clouds; d) tools and data standards for reformatting outputs to common datatypes for analysis and visualization; and e) methodologies for aggregating these datatypes to arbitrary spatial scales such as administrative and environmental demarcations. By automating many time-consuming and error-prone aspects of large-scale climate impacts studies, pSIMS accelerates computational research, encourages model intercomparison, and enhances reproducibility of simulation results. We present the pSIMS design and use example assessments to demonstrate its multi-model, multi-scale, and multi-sector versatility.

crop modeling↗

Leveraging Data Intensive Computing to Support Automated Event Services

A large portion of Earth Science investigations is phenomenon- or event-based, such as the studies of Rossby waves, mesoscale convective systems, and tropical cyclones. However, except for a few high-impact phenomena, e.g. tropical cyclones, comprehensive records are absent for the occurrences or events of these phenomena. Phenomenon-based studies therefore often focus on a few prominent cases while the lesser ones are overlooked. Without an automated means to gather the events, comprehensive investigation of a phenomenon is at least time-consuming if not impossible. An Earth Science event (ES event) is defined here as an episode of an Earth Science phenomenon. A cumulus cloud, a thunderstorm shower, a rogue wave, a tornado, an earthquake, a tsunami, a hurricane, or an EI Nino, is each an episode of a named ES phenomenon," and, from the small and insignificant to the large and potent, all are examples of ES events. An ES event has a finite duration and an associated geolocation as a function of time; its therefore an entity in four-dimensional . (4D) spatiotemporal space. The interests of Earth scientists typically rivet on Earth Science phenomena with potential to cause massive economic disruption or loss of life, but broader scientific curiosity also drives the study of phenomena that pose no immediate danger. We generally gain understanding of a given phenomenon by observing and studying individual events - usually beginning by identifying the occurrences of these events. Once representative events are identified or found, we must locate associated observed or simulated data prior to commencing analysis and concerted studies of the phenomenon. Knowledge concerning the phenomenon can accumulate only after analysis has started. However, except for a few high-impact phenomena. such as tropical cyclones and tornadoes, finding events and locating associated data currently may take a prohibitive amount of time and effort on the part of an individual investigator. And even for these high-impact phenomena, the availability of comprehensive records is still only a recent development. A major reason for the lack of comprehensive ,records for the majority of the ES phenomena is the perception that they do not pose immediate and/or severe threat to life and property and are thus not consistently tracked. monitored, and catalogued. Many phenomena even lack commonly accepted criteria for definitions. However. the lack of comprehensive records is also due to the increasingly prohibitive volume of observations and model data that must be examined. NASA Earth Observing System Data Information System (EOSDIS) alone archives several petabytes (PB) of satellite remote sensing data and steadily increases. All of these factors contribute to the difficulty of methodically identifying events corresponding to a given phenomenon and significantly impede systematic investigations. In the following we present a couple motivating scenarios, demonstrating the issues faced by Earth scientists studying ES phenomena.

Clune, Thomas L.↗

Solar radiation measurement - Techniques and instrumentation

A general survey is presented of solar radiation measurement, techniques, and instrumentation. The importance of determining the total and spectral irradiance of the sun is examined in the context of the energy crisis and utilization of solar energy. The survey includes the extraterrestrial solar fluxes, their possible variations, problems relating to energy received by collecting surfaces on the ground, major types of instrumentation, and the radiation scales to which the measurements are referred. The type of insolation data available is reviewed. Alternate techniques of deriving insolation data with high space-time resolution are discussed with reference to solar energy conversion requirements. Energy received on the ground can be computed from known values of the extraterrestrial solar spectrum and of the spectral absorption parameters of the atmosphere. Another technique is based on measurements made by meteorological satellites of the cloud-cover and of the solar energy reflected and scattered back to space by the earth-atmosphere system.

Thekaekara, M. P.↗

Scene identification probabilities for evaluating radiation flux errors due to scene misidentification

The scene identification probabilities (Pij) are fundamentally important in evaluations of the top-of-the-atmosphere (TOA) radiation-flux errors due to the scene misidentification. In this paper, the scene identification error probabilities were empirically derived from data collected in 1985 by the Earth Radiation Budget Experiment (ERBE) scanning radiometer when the ERBE satellite and the NOAA-9 spacecraft were rotated so as to scan alongside during brief periods in January and August 1985. Radiation-flux error computations utilizing these probabilities were performed, using orbit specifications for the ERBE, the Cloud and Earth's Radiant Energy System (CERES), and the SCARAB missions for a scene that was identified as partly cloudy over ocean. Typical values of the standard deviation of the random shortwave error were in the order of 1.5-5 W/sq m, but could reach values as high as 18.0 W/sq m as computed from NOAA-9.

Manalo, Natividad D.↗

A Balloon-Borne Cloud Condensation Nuclei Counter

A balloon-borne instrument was constructed for observations of vertical profiles of cloud condensation nucleus (CCN) concentrations, active at 1% supersaturation. Droplet concentration in the static thermal-gradient diffusion chamber is deduced from the amount of scattered laser light detected by a photodetector. The photodetector is calibrated using a video camera and computer system to count the number of droplets produced from NaCl aerosol. Preliminary data are available from nine early morning profiles obtained at Laramie, Wyoming, between June 1995 and January 1997. To complement the CCN measurements, instruments that measure condensation nuclei (CN) and aerosols with diameter greater than 0.30 micrometers (D(sub 0.3) were also included on the balloon package. CCN concentrations exhibited a general decrease from the surface to the top of the boundary layers, were generally uniform through well-mixed layers, and show variability above well-mixed layers. In general, the structure of the CCN profile appears to be closely related to the structure in the CN and D(sub 0.3) profiles. Summer profiles generally have CCN concentration greater than 200/cu cm up to 500 mbar, whereas winter profiles are less than 200/cu cm at all levels.

Delene, David J.↗

Global Aerosol Climatology Project: An Update

This paper outlines the methodology of interpreting channe1 1 and 2 AVHRR (Advanced Very High Resolution Radiometer) radiance data over the oceans and describes a detailed analysis of the sensitivity of monthly averages of retrieved aerosol parameters to the assumptions made in different retrieval algorithms. The analysis is based on using real AVHRR data and exploiting accurate numerical techniques for computing single and multiple scattering and spectral absorption of light in the vertically inhomogeneous atmospheric-ocean system. We show that two-channel algorithms can be expected tp provide significantly more biased retrievals of the aerosol optical thickness than one-channel algorithms and that imperfect cloud screening and calibration uncertainties are by far the largest sources of errors in the retrieved aerosol parameters. Both underestimating and overestimating aerosol absorption as well as the potentially strong variability of the real part of the aerosol refractive index may lead to regional and/or seasonal biases in optical thickness retrievals. The Angstrom exponent appears to be the most invariant aerosol size characteristic and should be retrieved along with optical thickness as the second aerosol parameter.

Mishchenko, Michael I.↗

Observations on the Application of Machine Learning Techniques to Aviation Operations

There is an increasing interest in applying methods based on Machine Learning Techniques (MLT) to problems in aviation operations. The current interest is based on developments in Cloud Computing, the availability of open software and the success of MLT in automation, consumer behavior and finance involving large database. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. This talk describes issues to be addressed in applying either model-driven or data-driven methods. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and a rich historical database are prime candidates for analysis using data-driven methods. The issues are illustrated by a detailed example and summary of current research in the area. The application of MLT to aviation operations falls into two categories: (a) based on the lack of a physics-based model, MLT is the favored approach and (b) marginal difference between regression methods using physics-based models and MLT. Further research is needed in the selection of MLT to critical aviation operations. As always, the best approach depends on the task, the physical understanding of the problem and the quality and quantity of the available data.

Sridhar, Banavar↗

Application of Machine Learning Techniques to Aviation Operations: A Case Study

There is an increasing interest in applying methods based on Machine Learning Techniques (MLT) to problems in aviation operations. The current interest is based on developments in Cloud Computing, the availability of open software and the success of MLT in automation, consumer behavior and finance involving large database. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. This talk describes issues to be addressed in applying either model-driven or data-driven methods. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and a rich historical database are prime candidates for analysis using data-driven methods. The issues are illustrated by a detailed example and summary of current research in the area. The application of MLT to aviation operations falls into two categories 58; (a) based on the lack of a physics-based model, MLT is the favored approach and (b) marginal difference between regression methods using physics-based models and MLT. Further research is needed in the selection of MLT to critical aviation operations. As always, the best approach depends on the task, the physical understanding of the problem and the quality and quantity of the available data.

Sridhar, Banavar↗

Application of Machine Learning Techniques to Aviation Operations: NASA Case Studies

There is an increasing interest in applying methods based on Machine Learning Techniques(MLT) to problems in aviation operations. The current interest is based on developments in Cloud Computing, the availability of open software and the success of MLT in automation, consumer behavior and finance involving large database. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. This talk describes issues to be addressed in applying either model-driven or data-driven methods. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and a rich historical database are prime candidates for analysis using data-driven methods. The issues relating to data, feature selection and validation of the models are illustrated by examining case studies of the application of MLT to problems in air traffic management at NASA. Further research is needed in the application of MLT to critical aviation operations. As always, the best approach depends on the task, the physical understanding of the problem and the quality and quantity of the available data.

Sridhar, Banavar↗

Automated cloud base height determination from high resolution Landsat data - A Hough transform approach

A direct method for determining the cloud base height derived from the displacement of the shadow from the cloud, and the solar azimuth and zenith angle is presented. Cumulus cloud scenes over land from Landsat MSS imagery are considered. The clouds are first matched with the corresponding shadows; the pixel distance of a reference point in the cloud is computed from the corresponding reference point in the shadow; and then the solar zenith angle is used to compute the cloud base height. Observations indicate that the cloud base height appears to be size-dependent with larger clouds generally associated with higher cloud bases and that clouds within the same size range and within the same scene region are approximately of the same height.

Sengupta, S. K.↗

Land utilization and ecological aspects in the Sylhet-Mymensingh Haor Region of Bangladesh: An analysis of LANDSAT data

The use of remote sensing data from LANDSAT (ERTS) imageries in identifying, evaluating and mapping land use patterns of the Haor area in Bangladesh was investigated. Selected cloud free imageries of the area for the period 1972-75 were studied. Imageries in bands 4, 5 and 7 were mostly used. The method of analysis involved utilization of both human and computer services of information from ground, aerial photographs taken during this period and space imageries.

Chowdhury, M. I.↗

Results from Global Land-Surface Data Assimilation Methods

Realistic representation of the land surface is crucial in global climate modeling (GCM). Recently, the Mosaic land-surface Model (LSM) has been driven off-line using GEOS DAS (Goddard Earth Observing System Data Assimilation System) atmospheric forcing, forming the Off-line Land-surface Global Assimilation (OLGA) system. This system provides a computationally efficient test bed for land surface data assimilation. Here, we validate the OLGA simulation of surface processes and the assimilation of ISCCP surface temperatures. Another component of this study as the incorporation of the Physical-space Statistical Analysis System (PSAS) into OLGA, in order to assimilate surface temperature observations from the International Satellite Cloud Climatology Project (ISCCP). To counteract the subsequent forcing of the analyzed skin temperature back to the initial state following the analysis. incremental bias correction (IBC) was included in the assimilation. The IBC scheme effectively removed the time mean bias, but did not remove him in the mean diurnal cycle. Therefore, a diurnal him correction (DBC) scheme was developed, where the time-dependent bias was modeled with a sine wave parameterization. In addition, quality control of the ISCCP data and anisotropic temperature correction were implemented in PSAS. Preliminary results showed a substantial impact from the inclusion of PSAS and DBC that was visible in the surface meteorology fields and energy budget. Also, the monthly mean diurnal cycle from the experiment closely matched the diurnal cycle from the observations.

Radakovich, Jon D.↗