SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This package implements configuration and orchestration of Spark clusters with standalone cluster managers. This is useful in environments like HPCs where the infrastructure implemented by cloud providers, such as AWS, is not available. It is particularly helpful when users want to deploy Spark but do not have administrative control of the servers.
NOvA is a long-baseline neutrino experiment studying neutrino oscillations by detecting neutrinos from the NuMI beam at Fermilab. Its physics analysis relies on accurate prong segmentation, which involves matching each hit to its source particle and identifying the particle type. This task has commonly been addressed using a combination of traditional clustering algorithms and convolutional neural networks (CNNs). However, NOvA’s detector design presents data as two sparse and decoupled 2D images (XZ and YZ views) rather than a native 3D representation, posing a significant challenge for traditional CNN-based models. In this talk, we propose a novel neural network based on the Point Set Transformer. By treating detector hits as sparse point clouds and implementing a cross-view attention mechanism, our model enables efficient information mixing between both views. Evaluated on NOvA simulated data, our model achieves superior accuracy while requiring significantly fewer computational resources compared to other models. Furthermore, the model demonstrates great performance when applied to Liquid Argon Time Projection Chamber (LArTPC) data, which shows its potential as a universal prong segmentation algorithm for multiple view neutrino detectors.
Giovanni (Geospatial Interactive Online Visualization and Analysis Infrastructure), developed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), has established a reputation among NASA users for easy access, analysis, and visualization of NASA Earth science data. Currently, Giovanni supports over 1900 variables in eight disciplinary areas. Like any other enterprise application, Giovanni faces big data challenges, such as servicing increasingly large data volumes and more complex data types, while at the same time addressing the demands of a more diverse user community, e.g., placing requests for long-term time series from multiple spatially and temporally dense data records. I will present how Giovanni has been evolving from an on-premises, monolithic software application towards a cloud-enabled implementation to address these challenges.
With the ability to observe the entire sunlit side of the Earth, EPIC data have become an important resource for studying cloud daily variability. Inaccurate cloud masking is a great source of uncertainty. One main region that is prone to error in cloud masking is the sunglint area over ocean surfaces. Cloud detection over these regions is challenging for the EPIC instrument because of its limited spectral channels. Clear sky ocean surface reflectance from visible channels over sunglint is much larger than that over the non-glint areas and can exceed reflectance from thin clouds. This paper presents an improved EPIC ocean cloud masking algorithm (Version 3). Over sunglint regions (glint angle ≤ 25°), the algorithm utilizes EPIC’s oxygen (O2) A-band ratio (764nm to 780 nm) in addition to the 780 nm reflectance observations in masking tests. Outside the sunglint regions, a dynamic reflectance threshold for the Rayleigh corrected 780 nm reflectance is applied. The thresholds are derived as a function of glint angle. When compared with co-located data from the geosynchronous Earth orbit (GEO) and the low Earth orbit (LEO) observations, the consistency of the new ocean cloud mask algorithm has increased by 4~10% and 4~6% in the glint center and granule edges respectively. The false positive rate is reduced by 10~17%. Overall global ocean cloud detection consistency increases by 2%. This algorithm, along with other improvements to the EPIC cloud masks, has been implemented in the EPIC cloud products Version 3. This algorithm will improve the cloud daily variability analysis by removing the artificial peak at local noon time in the glint center latitudes and reducing biases in the early morning and late afternoon cloud fraction over ocean surfaces.
Active sensors provide vertically resolved atmospheric and cloud information, however the assimilation of such observations into NWP models has been limited for several reasons including lack of reliable forward model. We present the development of CRTM active sensor module including its adjoint and tangent linear by taking advantage of current CRTM modules for calculating atmospheric transmittance and cloud absorption and scattering. Current CRTM cloud coefficients lack cloud backscattering information, thus we have implemented a new cloud scattering database generated using the discrete dipole technique that include backscattering coefficients. The radar simulator is currently being tested within the JEDI/GEOS data assimilation framework to facilitate the assimilation of radar measurements such as CloudSat CPR and GPM DPR into the NASA GEOS model.
NASA’s priorities for Earth Science are informed by the 2017-2027 Decadal Survey for Earth Science and Applications from Space of the National Academies of Sciences, Engineering and Medicine. In that document, five Designated Observables are identified as priorities for implementation: Aerosols, Cloud-Convection-Precipitation, Surface Biology, Mass Change, and Surface Deformation Change. In 2019, NASA initiated four multi-year studies to formulate, assess, and recommend potential Observing System concepts that are responsive to the recommendations of the Earth Science Decadal Survey. The Aerosols, Clouds, Convection, and Precipitation (ACCP) study investigates opportunities for synergistic science resulting from implementations that combine both Aerosols science objectives and Clouds, Convection, and Precipitation science objectives. For the ACCP study, a Value Framework was designed to introduce structure, transparency, and traceability in the mission down-select decision process. This paper presents a sensitivity analysis that was conducted to characterize the behavior of the science benefit score of the ACCP Value Framework. it includes derivations of the sensitivity analysis equations, numerical analyses of the behavior of the combined benefit score, and the conclusions drawn from the results of the work that was conducted. The results of this analysis were key to ensuring that the aggregated science benefit scores would enable the team to differentiate and contrast across concepts.
A reasonably accurate and noniterative saturation adjustment scheme is proposed to calculate: (1) the amount of condensation and/or deposition necessary to remove any supersaturated vapor, or (2) the amount of evaporation and/or sublimation necessary to remove any subsaturation in the presence of cloud droplets and/or cloud ice. This proposed scheme can be implemented for a nonhydrostatic cloud model. The derivation of the scheme, an evaluation of its performance, and tests for sensitivity to variations in a few key parameters are presented.
Cloud Computing has been implemented in several commercial arenas. The NASA Nebula Cloud Computing platform is an Infrastructure as a Service (IaaS) built in 2008 at NASA Ames Research Center and 2010 at GSFC. Nebula is an open source Cloud platform intended to: a) Make NASA realize significant cost savings through efficient resource utilization, reduced energy consumption, and reduced labor costs. b) Provide an easier way for NASA scientists and researchers to efficiently explore and share large and complex data sets. c) Allow customers to provision, manage, and decommission computing capabilities on an as-needed bases
As part of the Game Changing Development (GCD) Program, funded by NASA’s Space Technology Mission Directorate (STMD), the development of simulation capability for the prediction of extra-terrestrial Plume Surface Interaction (PSI) environments has been undertaken by the Fluid Dynamics Branch at NASA/MSFC. The GCD PSI Project, planned to be completed over a four year period, contains a Predictive Simulation Capability (PSC) Element focused on creating simulation capability for the reliable and accurate prediction of PSI in Martian (~650 Pa) and Lunar (vacuum) ambient environments. In addition to the PSC Element, the GCD Program also contains a companion Ground Testing Element for development of focused datasets for validation of predictive capability as well as a Flight-focused Instrumentation Element. This paper describes the activities and accomplishments of the past year in the gas-particle interaction modeling portion of the GCD PSI project. The objectives of this task are to investigate and construct models of particle drag and gas-particle cloud interactions leading to what is known as particle turbulent kinetic energy (PTKE). While drag on a lone particle suspended in a flow gas of gas is well-known, the drag and drag-induced dynamics of a cloud of particles in a gas flow are not. The PSC element of the PSI project requires models of gas-particle cloud interactions to implement in the Gas Granular Flow Solver (GGFS) in order to arrive at a predictive simulation capability for PSI-induced soil erosion, cratering and ejecta transport. Experiments of dilute mixtures of soil particles in supersonic gas flow are being conducted at Johns Hopkins University in order to provide a dataset describing gas-particle cloud interactions. Augmented by a separate funding source are efforts to perform small-scale particle-resolved direct numerical simulations (PR-DNS) and larger scale Eulerian-Lagrangian simulations. Together, these experiments and simulations are being used to devise models of particle cloud drag and particle cloud drag-induced dynamics. The final product of these efforts will be particle drag models suitable for implementation into the GGFS application and a PTKE model suitable for the same purpose.
In this project, we sought to develop new cloud and rain microphysics frameworks within the Energy Exascale Earth System Model (E3SM). This work encompassed two primary avenues of research: 1) Further development of a Bayesian-based scheme called BOSS (Bayesian Observationally-constrained Statistical-physical Scheme) to represent cloud and rain microphysics, testing it in realistic high-resolution cloud models, and implementing it in E3SM; 2) Development of a methodology utilizing machine learning to enable computationally tractable use of tractable use of Markov chain Monte Carlo sampling for Bayesian parameter estimation in Earth system and cloud models. In this project, we adapted the BOSS microphysics scheme, originally formulated for rain-only, to include all liquid-phase microphysical processes for cloud and rain, in particular the processes that mediate between these two categories, for example the conversion from cloud to rain through collision and coalescence of drops. We constrained the scheme via comparison and testing against a detailed model that explicitly represents the evolution of cloud and rain particles, called a bin microphysics scheme.
Geostationary satellites provide continuous cloud and meteorological observations over a fixed portion of the Earth’s surface, allowing them to monitor the movement of storm systems and their diurnal variation. For climate studies, geostationary observations provide valuable insight of cloud formation and evolution and how they influence the Earth’s radiation budget. The Geo-Satellite Edition 4 cloud mask (GEO Ed4) is used operationally in NASA’s Cloud and Earth’s Radiant Energy System (CERES) project to help account for diurnal variations in cloudiness on Earth’s radiation budget. The Ed4 cloud mask was applied to imager data on MSG (MeteoSat Second Generation), Himawari, GOES-West, and GOES-East satellites using as much spectral information as possible. That approach led to some discontinuities when a more modern satellite replaced an older satellite with less spectral information. A different strategy is being investigated for the CERES GEO Ed5 cloud mask that only uses spectral channels common on every satellite. Thus, a 3-channel (0.6, 3.9, 11 µm) algorithm for daytime cloud detection, and a 2-channels (3.9 and 11 µm) algorithm for nighttime cloud detection have been implemented and tested for Ed5. The goal of Ed5 cloud mask is to achieve global cloud amount consistency across five geo-satellites, and a smooth transition from an old satellite to a new satellite over each geo-location. This paper compares cloud mask results between Ed4 and a preliminary Ed5 version over the GOES-East region, using GOES-8, GOES-13, and GOES-16 satellites, each with a different spectral channel complement. Instantaneous and monthly regional mean inter-comparisons are performed and evaluated with CALIPSO cloud products to assess the accuracy and consistency of the Ed5 approach relative to that taken in Ed4. Results will be presented and discussed at the conference.
This study constrains the lower bound of the scattering phase function of Martian water ice clouds (WICs) throughthe implementation of a new observation aboard the Mars Science Laboratory (MSL). The Phase Function SkySurvey (PFSS) was a multiple pointing all-sky observation taken with the navigation cameras (Navcam) aboardMSL. The PFSS was executed 35 times during the Aphelion Cloud Belt (ACB) season of Mars Year 34 over a solarlongitude range of Ls = 61:4 156:5. Twenty observations occurred in the morning hours between 06:00 and 09:30 LTST, and 15 runs occurred in the evening hours between 14:30 and 18:00 LTST, with an operationallyrequired 2.5 h gap on either side of local noon due the sun being located near zenith. The resultant WIC phasefunction was derived over an observed scattering angle range of 18.3-152.61, normalized, and compared with 9modeled phase functions: seven ice crystal habits and two Martian WIC phase functions currently being implementedin models. Through statistical chi-squared probability tests, the five most probable ice crystal geometriesobserved in the ACB WICs were aggregates, hexagonal solid columns, hollow columns, plates, and bullet rosetteswith p-values greater than or equal to 0.60, 0.57,0.56,0.56, and 0.55, respectively. Droxtals and spheres had pvaluesof 0.35, and 0.2, making them less probable components of Martian WICs, but still statistically possibleones. Having a better understanding of the ice crystal habit and phase function of Martian water ice cloudsdirectly benefits Martian climate models which currently assume spherical and cylindrical particles.
Distributed energy resources (DERs) are becoming increasingly important to the electric grid, including solar energy systems. However, DERs also introduce new cybersecurity risks, including those posed by cloud computing. Standards harmonization is essential for ensuring that DERs are secure and can be safely integrated into the grid. This panel will discuss cyber standards harmonization for solar security. The panel will feature experts from the S2G Program, National Labs and Industry who will discuss the following topics: the cybersecurity risks and future benefits posed by ubiquitous solar energy systems, the development and implementation of cloud-based security solutions for DERs, including solar energy systems, the challenges and opportunities for harmonizing DER cybersecurity standards, and Cyber Informed Engineering and the solar security implementations The panel will also discuss the following specific initiatives: the S2G Program's DER Cybersecurity Framework, UL's DER Cybersecurity Certification Program, and IEEE 1547 Updates. The panel will conclude with a discussion of the future of standards harmonization for DER cybersecurity.
This letter assesses the performance on Landsat-7 images of a modified version of a cloud masking algorithm originally developed for clear-sky compositing of Moderate Resolution Imaging Spectroradiometer (MODIS) images at northern mid-latitudes. While data from recent Landsat missions include measurements at thermal wavelengths, and such measurements are also planned for the next mission, thermal tests are not included in the suggested algorithm in its present form to maintain greater versatility and ease of use. To evaluate the masking algorithm we take advantage of the availability of manual (visual) cloud masks developed at USGS for the collection of Landsat scenes used here. As part of our evaluation we also include the Automated Cloud Cover Assesment (ACCA) algorithm that includes thermal tests and is used operationally by the Landsat-7 mission to provide scene cloud fractions, but no cloud masks. We show that the suggested algorithm can perform about as well as ACCA both in terms of scene cloud fraction and pixel-level cloud identification. Specifically, we find that the algorithm gives an error of 1.3% for the scene cloud fraction of 156 scenes, and a root mean square error of 7.2%, while it agrees with the manual mask for 93% of the pixels, figures very similar to those from ACCA (1.2%, 7.1%, 93.7%).
In the year 2001, NASA will launch the satellite TRIANA that will be the first Earth observing mission to provide a continuous, full disk view of the sunlit Earth. As a part of the HPCC Program at NASA GSFC, we have started a project whose objectives are to develop and implement a 3D cloud data assimilation system, by combining TRIANA measurements with model simulation, and to produce accurate statistics of global cloud coverage as an important element of the Earth's climate. For simulation of the atmosphere within this project we are using the NCEP/NOAA operational Eta model. In order to compare TRIANA and the Eta model data on approximately the same grid without significant downscaling, the Eta model will be integrated at a resolution of about 15 km. The integration domain (from -70 to +70 deg in latitude and 150 deg in longitude) will cover most of the sunlit Earth disc and will continuously rotate around the globe following TRIANA. The cloud data assimilation is supposed to run and produce 3D clouds on a near real-time basis. Such a numerical setup and integration design is very ambitious and computationally demanding. Thus, though the Eta model code has been very carefully developed and its computational efficiency has been systematically polished during the years of operational implementation at NCEP, the current MPI version may still have problems with memory and efficiency for the TRIANA simulations. Within this work, we optimize a parallel version of the Eta model code on a Cray T3E and a network of PCs (theHIVE) in order to improve its overall efficiency. Our optimization procedure consists of introducing dynamically allocated arrays to reduce the size of static memory, and optimizing on a single processor by splitting loops to limit the number of streams. All the presented results are derived using an integration domain centered at the equator, with a size of 60 x 60 deg, and with horizontal resolutions of 1/2 and 1/3 deg, respectively. In accompanying charts we report the elapsed time, the speedup and the Mflops as a function of the number of processors for the non-optimized version of the code on the T3E and theHIVE. The large amount of communication required for model integration explains its poor performance on theHIVE. Our initial implementation of the dynamic memory allocation has contributed to about 12% reduction of memory but has introduced a 3% overhead in computing time. This overhead was removed by performing loop splitting in some of the high demanding subroutines. When the Eta code is fully optimized in order to meet the memory requirement for TRIANA simulations, a non-negligeable overhead may appear that may seriously affect the efficiency of the code. To alleviate this problem, we are considering implementation of a new algorithm for the horizontal advection that is computationally less expensive, and also a new approach for marching in time.
Geospatial resource assessments frequently require timely geospatial data processing that involves large multivariate remote sensing data sets. In particular, for disasters, response requires rapid access to large data volumes, substantial storage space and high performance processing capability. The processing and distribution of this data into usable information products requires a processing pipeline that can efficiently manage the required storage, computing utilities, and data handling requirements. In recent years, with the availability of cloud computing technology, cloud processing platforms have made available a powerful new computing infrastructure resource that can meet this need. To assess the utility of this resource, this project investigates cloud computing platforms for bulk, automated geoprocessing capabilities with respect to data handling and application development requirements. This presentation is of work being conducted by Applied Sciences Program Office at NASA-Stennis Space Center. A prototypical set of image manipulation and transformation processes that incorporate sample Unmanned Airborne System data were developed to create value-added products and tested for implementation on the "cloud". This project outlines the steps involved in creating and testing of open source software developed process code on a local prototype platform, and then transitioning this code with associated environment requirements into an analogous, but memory and processor enhanced cloud platform. A data processing cloud was used to store both standard digital camera panchromatic and multi-band image data, which were subsequently subjected to standard image processing functions such as NDVI (Normalized Difference Vegetation Index), NDMI (Normalized Difference Moisture Index), band stacking, reprojection, and other similar type data processes. Cloud infrastructure service providers were evaluated by taking these locally tested processing functions, and then applying them to a given cloud-enabled infrastructure to assesses and compare environment setup options and enabled technologies. This project reviews findings that were observed when cloud platforms were evaluated for bulk geoprocessing capabilities based on data handling and application development requirements.
A computer program which implements the use of worldwide cloud-cover distribution data is discussed. This program was prepared for use on the NASA Manned Spacecraft Center Univac 1108 computer.