Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing; data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Preliminary Evaluation of Influence of Aerosols on the Simulation of Brightness Temperature in the NASA's Goddard Earth Observing System Atmospheric Data Assimilation System

This document reports on preliminary results obtained when studying the impact of aerosols on the calculation of brightness temperature (BT) for satellite infrared (IR) instruments that are currently assimilated in a 3DVAR configuration of Goddard Earth Observing System (GEOS)-atmospheric data assimilation system (ADAS). A set of fifteen aerosol species simulated by the Goddard Chemistry Aerosol Radiation and Transport (GOCART) model is used to evaluate the influence of the aerosol fields on the Community Radiative Transfer Model (CRTM) calculations taking place in the observation operators of the Gridpoint Statistical Interpolation (GSI) analysis system of GEOSADAS. Results indicate that taking aerosols into account in the BT calculation improves the fit to observations over regions with significant amounts of dust. The cooling effect obtained with the aerosol-affected BT leads to a slight warming of the analyzed surface temperature (by about 0:5oK) in the tropical Atlantic ocean (off northwest Africa), whereas the effect on the air temperature aloft is negligible. In addition, this study identifies a few technical issues to be addressed in future work if aerosol-affected BT are to be implemented in reanalysis and operational settings. The computational cost of applying CRTM aerosol absorption and scattering options is too high to justify their use, given the size of the benefits obtained. Furthermore, the differentiation between clouds and aerosols in GSI cloud detection procedures needs satisfactory revision.

3DVAR↗

Non-LTE modelling of cyanoacetylene: evidence for isomer-specific excitation

ABSTRACT Cyanoacetylene molecules are widespread in the interstellar medium (ISM) and several of its isomers have been detected in cold molecular clouds and circumstellar gas. Accurate estimates of the abundance ratio of cyanoacetylene isomers may provide deep insight into their environment. Such knowledge requires rigorous modelling of the emission spectra based on non-local thermodynamic equilibrium (LTE) radiative transfer calculations. To this end, we computed excitation cross-sections of HC2NC and HNC3 induced by collision with para- and ortho-H2, using a quantum mechanical close-coupling method. Then, by thermally averaging these data, we derived rate coefficients for the first 31 low-lying rotational levels of each isomer for temperatures up to 80 K. For the para-H2 collider, the propensity rules are in favour of rotational transitions involving Δj1 = 2 for both isomers, while for the ortho-H2 collider, Δj1 = 2 and Δj1 = 1 rotational transitions are favoured for HC2NC and HNC3, respectively. A comparison of rate coefficients for the HC3N isomers shows differences up to an order of magnitude, especially at low temperatures. Finally, we performed non-LTE radiative transfer calculations to assess the impact of such variations in the analysis of observations. Our simulation suggests that the lack of collisional data specific to each isomer could lead to errors up to a factor of 2–3 in the excitation temperatures. We expect that these data could help in better understanding the cyanoacetylene chemistry and constraining the nitrogen chemistry in the ISM.

79 ASTRONOMY AND ASTROPHYSICS↗

An Adaptive Tracking Algorithm for Convection in Simulated and Remote Sensing Data

A robust and computationally efficient object tracking algorithm is developed by incorporating various tracking techniques. Physical properties of the objects, such as brightness temperature or reflectivity, are not considered. Therefore, the algorithm is adaptable for tracking convection-like features in simulated data and remotely sensed two-dimensional images. In this algorithm, a first guess of the motion, estimated using the Fourier phase shift, is used to predict the candidates for matching. A disparity score is computed for each target–candidate pair. The disparity also incorporates overlapping criteria in the case of large objects. Then the Hungarian method is applied to identify the best pairs by minimizing the global disparity. The high-disparity pairs are unmatched, and their target and candidate are declared expired and newly initiated objects, respectively. They are tested for merger and split on the basis of their size and overlap with the other objects. The sensitivity of track duration is shown for different disparity and size thresholds. The report highlights the algorithm’s ability to study convective life cycles using radar and simulated data over Darwin, Australia. The algorithm skillfully tracks individual convective cells (a few pixels in size) and large convective systems. The duration of tracks and cell size are found to be lognormally distributed over Darwin. The evolution of size and precipitation types of isolated convective cells is presented in the Lagrangian perspective. This algorithm is part of a vision for a modular platform [viz., TINT is not TITAN (TINT) and Tracking and Object-Based Analysis of Clouds (tobac)] that will evolve into a sustainable choice to analyze atmospheric features.

54 ENVIRONMENTAL SCIENCES↗

Comparisons of Upper Tropospheric Humidity Retrievals from TOVS and METEOSAT

Two different methods for retrieving Upper Tropospheric Humidities (UTH) from the TOVS (TIROS Operational Vertical Sounder) instruments aboard NOAA polar orbiting satellites are presented and compared. The first one, from the Environmental Technology Laboratory, computed by J. Bates and D. Jackson (hereafter BJ method), estimates UTH from a simplified radiative transfer analysis of the upper tropospheric infrared water vapor channel at wavelength measured by HIRS (6.3 micrometer). The second one results from a neural network analysis of the TOVS (HIRS and MSU) data developed at, the Laboratoire de Meteorologie Dynamique (hereafter the 3I (Improved Initialization Inversion) method). Although the two methods give very similar retrievals in temperate regions (30-60 N and S), an absolute bias up to 16% appears in the convective zone of the tropics. The two datasets have also been compared with UTH retrievals from infrared radiance measurements in the 6.3 micrometer channel from the geostationary satellite METEOSAT (hereafter MET method). The METEOSAT retrievals are systematically drier than the TOVS-based results by an absolute bias between 5 and 25%. Despite the biases, the spatial and temporal correlations are very good. The purpose of this study is to explain the deviations observed between the three datasets. The sensitivity of UTH to air temperature and humidity profiles is analysed as are the clouds effects. Overall, the comparison of the three retrievals gives an assessment of the current uncertainties in water vapor amounts in the upper troposphere as determined from NOAA and METEOSAT satellites.

Escoffier, C.↗

Incorporating Endmember Variability into Spectral Mixture Analysis Through Endmember Bundles

Variation in canopy structure and biochemistry induces a concomitant variation in the top-of-canopy spectral reflectance of a vegetation type. Hence, the use of a single endmember spectrum to track the fractional abundance of a given vegetation cover in a hyperspectral image may result in fractions with considerable error. One solution to the problem of endmember variability is to increase the number of endmembers used in a spectral mixture analysis of the image. For example, there could be several tree endmembers in the analysis because of differences in leaf area index (LAI) and multiple scatterings between leaves and stems. However, it is often difficult in terms of computer or human interaction time to select more than six or seven endmembers and any non-removable noise, as well as the number of uncorrelated bands in the image, limits the number of endmembers that can be discriminated. Moreover, as endmembers proliferate, their interpretation becomes increasingly difficult and often applications simply need the aerial fractions of a few land cover components which comprise most of the scene. In order to incorporate endmember variability into spectral mixture analysis, we propose representing a landscape component type not with one endmember spectrum but with a set or bundle of spectra, each of which is feasible as the spectrum of an instance of the component (e.g., in the case of a tree component, each spectrum could reasonably be the spectral reflectance of a tree canopy). These endmember bundles can be used with nonlinear optimization algorithms to find upper and lower bounds on endmember fractions. This approach to endmember variability naturally evolved from previous work in deriving endmembers from the data itself by fitting a triangle, tetrahedron or, more generally, a simplex to the data cloud reduced in dimension by a principal component analysis. Conceptually, endmember variability could make it difficult to find a simplex that both surrounds the data cloud and has vertices that are realistic endmember spectra with reflectances between 0 and 1. In this paper, we create endmember bundles and bounding fraction images for an AVIRIS subscene simulated with a plant canopy radiative transfer model. The simulated subscene is spatially patterned after a subscene from the AVIRIS image acquired August, 1993 over La Copita, Texas. In addition, for comparison, we performed a traditional unmixing with image endmembers.

Bateson, C. Ann↗

A Quantum Annealing Computer Team Addresses Climate Change Predictability

The near confluence of the successful launch of the Orbiting Carbon Observatory2 on July 2, 2014 and the acceptance on August 20, 2015 by Google, NASA Ames Research Center and USRA of a 1152 qubit D-Wave 2X Quantum Annealing Computer (QAC), offered an exceptional opportunity to explore the potential of this technology to address the scientific prediction of global annual carbon uptake by land surface processes. At UMBC,we have collected and processed 20 months of global Level 2 light CO2 data as well as fluorescence data. In addition we have collected ARM data at 2sites in the US and Ameriflux data at more than 20 stations. J. Dorband has developed and implemented a multi-hidden layer Boltzmann Machine (BM) algorithm on the QAC. Employing the BM, we are calculating CO2 fluxes by training collocated OCO-2 level 2 CO2 data with ARM ground station tower data to infer to infer measured CO2 flux data. We generate CO2 fluxes with a regression analysis using these BM derived weights on the level 2 CO2 data for three Ameriflux sites distinct from the ARM stations. P. Gentine has negotiated for the access of K34 Ameriflux data in the Amazon and is applying a neural net to infer the CO2 fluxes. N. Talik validated the accuracy of the BM performance on the QAC against a restricted BM implementation on the IBM Softlayer Cloud with the Nvidia co-processors utilizing the same data sets. G. Nearing and K. Harrison have extended the GSFC LIS model with the NCAR Noah photosynthetic parameterization and have run a 10 year global prediction of the net ecosystem exchange. C. Pellisier is preparing a BM implementation of the Kalman filter data assimilation of CO2 fluxes. At UMBC, R. Prouty is conducting OSSE experiments with the LISNoah model on the IBM iDataPlex to simulate the impact of CO2 fluxes to improve the prediction of global annual carbon uptake. J. LeMoigne and D. Simpson have developed a neural net image registration system that will be used for MODIS ENVI and will be converted to a BM algorithm implementation on the QAC. The first integer adder has been implemented on the D-Wave 2X by A. Shehab that will perform HAAR wavelets for image compression of MODIS scenes. Finally, based on the next generations of QACs, we are preparing a 5-year performance road map on the scalability of the current QAC algorithms.

Science Data Processing↗

Comparing Mapper Graphs of Artificial Neuron Activations

The mapper graph is a popular tool from topological data analysis that provides a graphical summary of point cloud data. It has been used to study data from cancer research, sports analytics, neurosciences, and machine learning. In particular, mapper graphs have been used recently to visualize the topology of high-dimensional artificial neural activations from convolutional neural networks and large language models. However, a key question that arises from using mapper graphs across applications is how to compare mapper graphs to study their structural differences. In this paper, we introduce a distance between mapper graphs using tools from optimal transport. We demonstrate the utility of such a distance by studying the topological changes of neural activations across convolutional layers in deep learning, as well as by capturing the loss of structural information for multiscale mapper.

mapper graphs, computational topology, machine lea↗

A2Cloud‐RF : A random forest based statistical framework to guide resource selection for high‐performance scientific computing on the cloud

Summary This article proposes a random‐forest based A2Cloud framework to match scientific applications with Cloud providers and their instances for high performance. The framework leverages four engines for this task: PERF engine, Cloud trace engine, A2Cloud‐ext engine, and the random forest classifier (RFC) engine. The PERF engine profiles the application to obtain performance characteristics, including the number of single‐precision (SP) floating‐point operations (FLOPs), double‐precision (DP) FLOPs, x87 operations, memory accesses, and disk accesses. The Cloud trace engine obtains the corresponding performance characteristics of the selected Cloud instances including: SP floating point operations per second (FLOPS), DP FLOPS, x87 operations per second, memory bandwidth, and disk bandwidth. The A2Cloud‐ext engine uses the application and Cloud instance characteristics to generate objective scores that represent the application‐to‐Cloud match. The RFC engine uses these objective scores to generate two types of random forests to assist users with rapid analysis: application‐specific random forests (ARF) and application‐class based random forests. The ARF consider only the input application's characteristics to generate a random forest and provide numerical ratings to the selected Cloud instances. To generate the application‐class based random forests, the RFC engine downloads the application profiles and scores of previously tested applications that perform similar to the input application. Using these data, the RFC engine creates a random forest for instance recommendation. We exhaustively test this framework using eight real‐world applications across 12 instances from different Cloud providers. Our tests show significant statistical agreement between the instance ratings given by the framework and the ratings obtained via actual Cloud executions.

Samuel, David↗

Models, data, and scripts associated with “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning”

This data package is associated with the publication “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning’’ submitted to the Journal of Geophysical Research: Machine Learning and Computation (Scheibe et al. 2024). River sediment respiration observations are expensive and labor intensive to obtain and there is no physical model for predicting this quantity. The Worldwide Hydrobiogeochemisty Observation Network for Dynamic River Systems (WHONDRS) observational data set (Goldman et al.; 2020) is used to train machine learning (ML) models to predict respiration rates at unsampled sites. This repository archives training data, ML models, predictions, and model evaluation results for the purposes of reproducibility of the results in the associated manuscript and community reuse of the ML models trained in this project. One of the key challenges in this work was to find an optimum configuration for machine learning models to work with this feature-rich (i.e. 100+ possible input variables) data set. Here, we used a two-tiered approach to managing the analysis of this complex data set: 1) a stacked ensemble of ML models that can automatically optimize hyperparameters to accelerate the process of model selection and tuning and 2) feature permutation importance to iteratively select the most important features (i.e. inputs) to the ML models. The major elements of this ML workflow are modular, portable, open, and cloud-based, thus making this implementation a potential template for other applications. This data package is associated with the GitHub repository found at Please see the file level metadata (flmd; “sl-archive-whondrs_flmd.csv”) for a list of all files contained in this data package and descriptions for each. Please see the data dictionary (dd; “sl-archive-whondrs_dd.csv”) for a list of all column headers contained within comma separated value (csv) files in this data package and descriptions for each. The GitHub repository is organized into five top-level directories: (1) “input_data” holds the training data for the ML models; (2) “ml_models” holds machine learning models trained on the data in “input_data”; (3) “scripts” contains data preprocessing and postprocessing scripts and intermediate results specific to this data set that bookend the ML workflow; (4) “examples” contains the visualization of the results in this repository including plotting scripts for the manuscript (e.g., model evaluation, FPI results) and scripts for running predictions with the ML models (i.e., reusing the trained ML models); (5) “output_data” holds the overall results of the ML model on that branch. Each trained ML model resides on its own branch in the repository; this means that inputs and outputs can be different branch-to-branch. Furthermore, depending on the number of features used to train the ML models, the preprocessing and postprocessing scripts, and their intermediate results, can also be different branch-to-branch. The “main-*” branches are meant to be starting points (i.e. trunks) for each model branch (i.e. sprouts). Please see the Branch Navigation section in the top-level README.md in the GitHub repository for more details. There is also one hidden directory “.github/workflows”. This hidden directory contains information for how to run the ML workflow as an end-to-end automated GitHub Action but it is not needed for reusing the ML models archived here. Please the top-level README.md in the GitHub repository for more details on the automation.

13C↗

Forward and Inverse Models for Satellite Remote Sensors using Principal Component Analysis

Satellite remote sensors such as AIRS on Aqua, CrIS on S-NPP, NOAA20 and JPSS-2, IASI on Metop A, B, and C make millions of observations each day with thousands of spectral channels for each observation; this poses challenges for efficiently inversion of the inherently large dataset as needed to retrieve atmospheric and surface properties. This presentation will illustrate the use of Principal Component Analysis (PCA) to speed up radiative transfer forward model calculations and to stabilize the inversion algorithms. A Principal Component-based radiative transfer model (PCRTM) developed at NASA Langley Research Center can simulate top of atmosphere (TOA) radiance or reflectance spectra from 50 cm-1 to 50000 cm-1 (200 m to 0.20 m quickly and accurately. PCRTM demonstrated very high accuracy relative to reference line-by-line radiative transfer models and it saves orders of magnitude computational time. Examples of the PCRTM model developed for hyperspectral sensors such as AIRS, CrIS, IASI, NAST-I, SHIS, CPF, TEMPO, SBG, OMI, and SCIAMACHY will be presented. In addition to using the PCRTM as forward model, the NASA Langley developed inversion algorithm also uses PCA to compress the state vector into a compressed dimension to speed up and stabilize the inversion process. Examples of retrieved atmospheric temperature, water vapor, CO2, CO, CH4, N2O, and O3 profiles, cloud properties (optical depth, size, phase, and height), and surface properties (surface emissivity spectra and skin temperatures) will be presented. This algorithm is being transitioned to the NASA Sounder SIPS and NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC).

forward model↗

A Redetermination of the Dissociation Energy of MgO(+)

In 1986, we reported a dissociation energy (D(sub 0) of 2.31 eV for the X(sup 2)Pi ground state of MgO(+). This value was determined by computing the dissociation energy to the Mg(2+) + O(-) limit and adjusting the value to the Mg(+) + O limit using the experimental Ionization Potential (IP) of Mg(+) and the Electron Affinity (EA) of O. The success of this method relies on the assumption that there is little covalent contribution to the bonding. The very small (0.04 eV) correlation contribution to the binding energy was taken as corroboration for the validity of this approach. Our earlier theoretical value was estimated to be accurate to at least 0.2 eV. It is in excellent agreement with the subsequent value of 2.30 +/- 0.13 eV determined by Freiser and co-workers from photodissociation experiments. It is also consistent with the upper (less than 3.1 eV) and lower (greater than 1.1 eV) bounds determined by Rowe obtained by studying the reactions of Mg(+) with 03 and NO2. However, it is inconsistent with an upper bound of 1.7 eV reported by Kappes and Staley based on their failure to observe MgO(+) in the reaction of Mg(+) with N2O. The picture became somewhat clouded, however, by the recent guided-ion beam mass spectrometric studies of Dalleska and Armentrout. Their initial analysis of the reaction data for Mg(+) + O2 lead to a bond dissociation energy of 2.92 +/- 0.25 eV, which is considerably larger than the value of 2.47 +/- 0.06 eV deduced from their studies of the Mg(+)+NO2 reaction.

Bauschlicher, Charles W., Jr.↗

The alpha Centauri Line of Sight: D/H Ratio, Physical Properties of Local Interstellar Gas, and Measurement of Heated Hydrogen (The 'Hydrogen Wall') Near the Heliopause

We analyze high-resolution spectra of the nearby (1.34 pc) stars alpha Cen A (G2 V) and alpha Cen B (K1 V), which were obtained with the Goddard High Resolution Spectrograph on the Hubble Space Telescope. The observations consist of echelle spectra of the Mg II 2800 A and Fe II 2599 A resonance lines and the Lyman-alpha lines of hydrogen and deuterium. The interstellar gas has a velocity (v = - 18.0 +/- 0.2 km/s) consistent with the local flow vector proposed for this line of sight by Lailement & Berlin (1992). The temperature and nonthermal velocity inferred from the Fe II, Mg II, and D I line profiles are T = 5400 +/- 500 K and xi = 1.20 +/- 0.25 km/s, respectively. However, single-component fits to the H I Lyman-alpha lines yield a Doppler parameter (b(sub HI) = 11.80 km/s) that implies a significantly warmer temperature of 8350 K, and the velocity of the H I absorption (v = - 15.8 +/- 0.2 km/s) is redshifted by about 2.2 km/s with respect to the Fe II, Mg II, and D I lines. The one-component model of the interstellar gas suggests natural logarithm N base HI = 18.03 +/- 0.01 and D/H = (5.7 +/- 0.2) x 10(exp -6) . These parameters lead to a good fit to the observed spectra, but this model does not explain the higher temperature and redshift of H I relative to the other interstellar lines. The most sensible way to resolve the discrepancy between H(I) and the other lines is to add a second absorption component to the H(I) lines. This second component is hotter (T approx. equals 30,000 K), is redshifted relative to the primary component by 2-4 km/s, and has a column density too low to be detected in the Fe(II), Mg(II), and D(I) lines. We propose that the gas responsible for this component is located near the heliopause, consisting of the heated H I gas from the interstellar medium that is compressed by the solar wind. This so-called 'hydrogen wall' is predicted by recent multifluid gasdynamical models of the interstellar gas and solar wind interaction. Our data provide the first measurements of the temperature and column density of H(I) in the hydrogen wall. After considering the effects that a corresponding hydrogen wall around alpha Cen would have on our analysis, our best estimates for the parameters of the solar hydrogen wall are natural log N(sup (2))(H(I)) = 14.74 +/- 0.24, b(sup (2))(H(I)) = 21.9 +/- 1.7 km/s (corresponding to T = 29,000 +/- 5000 K), and v(sup (2))(H(I)) greater than -16km/s. Unfortunately, the existence of this heated H(I) reduces our ability to compute the H(I) column density of the interstellar medium accurately because, with slight alterations to our assumed stellar Lyman-alpha profiles, we discovered that acceptable two-component fits also exist with natural log N(H(I))approx. 17.6. We, therefore, quote large error bars for the H I column density along the alpha Cen line of sight, natural log N(H(I)) = 17.80 +/- 0.30. For this range in N(H(I)), n(H(I)) = 0.15 /cu.cm (+/- a factor of 2) and D/H = (0.5-1.9) x 10(exp -5). This is the first direct measurement of the H(I) density in a local cloud and allows us to predict the distance from the Sun to the edge of the local cloud along various lines of sight. This range in D/H is consistent with the value D/H = 1.6 x 10(exp -5) previously derived for the Capella and Procyon lines of sight. We cannot tell whether D/H ratio varies or is constant in the local interstellar medium, but we do find that the D(I)/Mg(II) ratio for the alpha Cen line of sight is about 4 times smaller than for the Capella and Procyon lines of sight. Therefore, either D/H or the Mg depletion varies significantly over distance scales of only a few parsecs.

Linsky, Jeffrey L.↗

A combined experimental and computational study on the reaction dynamics of the 1-propynyl (CH 3 CC, X 2 A 1 ) – propylene (CH 3 CHCH 2 , X 1 A') system: formation of 1,3-dimethylvinylacetylene (CH 3 CCCHCHCH 3 , X 1 A') under single collision conditions

The reaction of the 1-propynyl radical (CH 3 CC; X 2 A 1 ) with propylene (CH 3 CHCH 2 ; X 1 A') was studied in a crossed molecular beam machine at a collision energy of 37 ± 1 kJ mol –1 . Experimental data combined with high-level electronic structure (CCSD(T)-F12/cc-pVTZ-F12//ωB97X-D/6-311G(d,p)) and RRKM calculations reveal the reaction mechanism. Here, the overall barrierless and exoergic reaction involves indirect reaction dynamics and commences preferentially with addition of 1-propynyl with its radical centre to the carbon–carbon double bond at the terminal carbon atom of propylene. This work focuses on molecular mass growth process (hydrogen loss channels) although theory suggests methyl loss as a prevalent channel. In these processes, the C6H9 collision complexes either emit atomic hydrogen or undergo isomerisation followed by atomic hydrogen loss to preferentially yield the cis/trans isomers of 1,3-dimethylvinylacetylene (2-hexen-4-yne) as the primary product. Analysis of reaction dynamics of 1-propynyl and ethynyl radicals with propylene along with their fractional abundance in deep space suggests formation of methyl- and dimethyl derivatives of vinylacetylene in cold molecular clouds. Once formed they may engage in fundamental molecular mass growth processes via the barrierless Hydrogen Abstraction Vinylacetylene Addition mechanism that leads to the formation of methyl- and dimethylnaphthalenes thus providing a versatile route to methyl-substituted PAHs in interstellar medium.

1-propynyl↗

Prototype Integrated Hydrogen Fuel Cell Powered Data Center (Cooperative Research and Development Final Report)

Data centers are the backbone of the modern economy-from the server rooms that power small- to medium-sized organizations, to the enterprise-class data centers that support American corporations, and the server farms that run cloud computing services. Rather than a traditional grid-centric data center approach, work under the CRADA will be directed towards implementing a proof-of-concept "hydrogen-based" data center utilizing hydrogen fuel cells, electrolyzers, and solar photovoltaics as key building blocks. This integrated proof-of-concept builds on preliminary work done by HPE and its partners Mercedes-Benz Research & Development North America, Inc. (MBRDNA) and Power Innovations, to dramatically simplify the electrical infrastructure in the data center, leverage the latest automotive-scale hydrogen fuel cell technologies, and tightly couple renewably generated DC power directly to the Information Technology (IT). While some limited aspects of this concept have been demonstrated previously the entire integrated proof of concept proposed here has not yet been realized.

08 HYDROGEN↗

Expected Performance of Ozone Climate Data Records from Ozone Mapping and Profiler Suite Limb Profiler

The Ozone Mapping and Profiler Suite Limb Profiler (OMPS/LP) was launched on board of the Soumi NPP space platform in late October 2011. It provides ozone-profiling capability with high-vertical resolution from 60 Ian to cloud top. In this study, an end-to-end Observing System Simulation Experiment (OSSE) of OMPS/LP ozone is discussed. The OSSE was developed at NASA's Global Modeling and Assimilation Office (GMAO) using the Goddard Earth Observing System (GEOS-5) data assimilation system. The "truth" for this OSSE is built by assimilating MLS profiles and OMI ozone columns, which is known to produce realistic three-dimensional ozone fields in the stratosphere and upper troposphere. OMPS/LP radiances were computed at tangent points computed by an appropriate orbital model. The OMPS/LP forward RT model, Instrument Models (IMs) and EDR retrieval model were introduced and pseudo-observations derived. The resultant synthetic OMPS/LP observations were evaluated against the "truth" and subsequently these observations were assimilated into GEOS-5. Comparison of this assimilated dataset with the "truth" enables comparisons of the likely uncertainties in 3-D analyses of OMPS/LP data. This study demonstrated the assimilation capabilities of OMPS/LP ozone in GEOS-5, with the monthly, zonal mean (O-A) smaller than 0.02ppmv at all levels, the nns(O-A) close to O.lppmv from 100hPa to 0.2hPa; and the mean(O-B) around the 0.02ppmv for all levels. The monthly zonal mean analysis generally agrees to within 2% of the truth, with larger differences of 2-4% (0.1-0.2ppmv) around 10hPa close to North Pole and in the tropical tropopause region, where the difference is above 20% due to the very low ozone concentrations. These OSSEs demonstrated that, within a single data assimilation system and the assumption that assimilated MLS observations provide a true rendition of the stratosphere, the OMPS/LP ozone data are likely to produce accurate analyses through much of the stratosphere. Additional studies are needed to evaluate the importance of the extremely high vertical resolution of the OMPS/LP ozone data

Xu, P. Q.↗

Forecasting Lightning at Kennedy Space Center/Cape Canaveral Air Force Station, Florida

The Applied Meteorology Unit (AMU) developed a set of statistical forecast equations that provide a probability of lightning occurrence on Kennedy Space Center (KSC) I Cape Canaveral Air Force Station (CCAFS) for the day during the warm season (May September). The 45th Weather Squadron (45 WS) forecasters at CCAFS in Florida include a probability of lightning occurrence in their daily 24-hour and weekly planning forecasts, which are briefed at 1100 UTC (0700 EDT). This information is used for general scheduling of operations at CCAFS and KSC. Forecasters at the Spaceflight Meteorology Group also make thunderstorm forecasts for the KSC/CCAFS area during Shuttle flight operations. Much of the current lightning probability forecast at both groups is based on a subjective analysis of model and observational data. The objective tool currently available is the Neumann-Pfeffer Thunderstorm Index (NPTI, Neumann 1971), developed specifically for the KSCICCAFS area over 30 years ago. However, recent studies have shown that 1-day persistence provides a better forecast than the NPTI, indicating that the NPTI needed to be upgraded or replaced. Because they require a tool that provides a reliable estimate of the daily thunderstorm probability forecast, the 45 WS forecasters requested that the AMU develop a new lightning probability forecast tool using recent data and more sophisticated techniques now possible through more computing power than that available over 30 years ago. The equation development incorporated results from two research projects that investigated causes of lightning occurrence near KSCICCAFS and over the Florida peninsula. One proved that logistic regression outperformed the linear regression method used in NPTI, even when the same predictors were used. The other study found relationships between large scale flow regimes and spatial lightning distributions over Florida. Lightning, probabilities based on these flow regimes were used as candidate predictors in the equation development. Fifteen years (1 989-2003) of warm season data were used to develop the forecast equations. The data sources included a local network of cloud-to-ground lightning sensors called the Cloud-to-Ground Lightning Surveillance System (CGLSS), 1200 UTC Florida synoptic soundings, and the 1000 UTC CCAFS sounding. Data from CGLSS were used to determine lightning occurrence for each day. The 1200 UTC soundings were used to calculate the synoptic-scale flow regimes and the 1000 UTC soundings were used to calculate local stability parameters, which were used as candidate predictors of lightning occurrence. Five logistic regression forecast equations were created through careful selection and elimination of the candidate predictors. The resulting equations contain five to six predictors each. Results from four performance tests indicated that the equations showed an increase in skill over several standard forecasting methods, good reliability, an ability to distinguish between non-lightning and lightning days, and good accuracy measures and skill scores. Given the overall good performance the 45 WS requested that the equations be transitioned to operations and added to the current set of tools used to determine the daily lightning probability of occurrence.

Lambert, Winfred↗

WISP: Watching grid Infrastructure Stealthily through Proxies (Final Technical Report)

The complex interdependencies of cyber systems (sensors and communications), physical grids and associated electricity market operations make protecting electric power grids a significant challenge. The energy sector is constantly under new, targeted, advanced and dangerous cyber-attacks that have the potential to result in the loss of human life. These threats are further exacerbated by our need to modernize the grid. One focus of cyber security research in smart grids is the securing of the SCADA system through advanced intrusion detection systems (IDS) and bad data detection algorithms in state estimation. These methods either require full knowledge of the system topology and parameters or fail to understand the physical behaviors under attack. WISP (Watching grid Infrastructure Stealthily through Proxies) is designed to provide additional protection to the power grid using only publicly available data. In particular, WISP exploits the spatio-temporal nature of the real time locational marginal prices (LMPs), in conjunction with other information such as bids, weather, outages and load data to analyze anomalous power pricing behaviors and then correlate those observations to localize regions of interest and identify potential cyber events. WISP is non-intrusive as the tool is deployed as a service in the Cloud or on premise and provides reliable information to system operators for enhanced situational awareness, without impeding energy delivery functions. The WISP technology comprises three modules: the data-driven anomaly detection core, the vulnerability and risk analysis and the root cause analysis. The data-driven anomaly detection core performs the tasks of feature selection, anomaly detection and attack region localization. The vulnerability and risk analysis module provides system level information of the vulnerable variables and times, assisting the operators in selecting monitoring and protection nodes. The root cause analysis module takes the detection results and identifies potential operational conditions that contribute to the detected anomalies. In Phase I, we have demonstrated the feasibility and effectiveness of WISP. We developed a realistic electricity market simulator capable of generating normal and attack market data under various operational conditions. We developed a series of cyber-attack detection and analysis algorithms and evaluated them under multiple data sources. Finally, we integrated all modules into an end-to-end software, providing functions for data management, data analytics and visualization. Specifically, we have achieved: (i) real-time data acceptance from external utility interfaces with >99% acceptance rate; (ii) high performance anomaly detection algorithms with >98% detection accuracy and <0.1% false alarm rate; and (iii) ultra-low computing delay <50 milliseconds. Additionally, our team developed algorithms to identify the vulnerable variables in electricity market operations and root cause analysis functions to identify major contributors to the price spikes. These ancillary modules are necessary when deploying WISP in real world industry environment. In Phase II, we have demonstrated the effectiveness of WISP software on realistic largescale power systems. We performed red team testing for the Phase I WISP software and identified software vulnerabilities and implemented corresponding mitigation solutions. We adapted the electricity market simulator for the Texas synthetic 2000-bus system and generated datasets for the false data injection attacks. We created database and visualization interfaces for the Texas system and the ISO New England system. We performed software optimization in terms of operation efficiency, computing speed and detection accuracy. Finally, we tested the software on the Texas system and the ISO New England system and evaluated the detection performance. Overall, we achieved above 89% detection rate, below 3% false alarm rate and below 37 seconds of end-to-end detection delay.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Geospatial Data Workflow Orchestration and Architecture

In an era characterized by explosive growth in geospatial data, the selection of appropriate technologies for data storage, processing, and orchestration is critical for organizations aiming to maintain competitive advantages. This white paper provides a comprehensive analysis of how Oak Ridge National Laboratory (ORNL) has effectively employed various cloud technologies, including containerized applications, container orchestrators, and workflow orchestrators, to develop robust geospatial data processing solutions. We explore the fundamental concepts behind these technologies and compare multiple deployment models tailored to diverse use cases. Our findings conclude that while Kubernetes has emerged as the preferred platform for truly scalable and fault-tolerant production workflows, the choice of workflow orchestration tool requires careful consideration of team needs, pipeline complexity, and deployment environments. This paper aims to serve as a strategic guide for organizations leveraging geospatial data, articulating the balance between technology choices and practical implementation to enhance workflow efficacy and scalability.

97 MATHEMATICS AND COMPUTING↗