Space Development Grid Portal
This viewgraph presentation provides information on the development of a portal to provide secure and distributed grid computing for Payload Operations Integrated Center and Mission Control Center ground services.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This viewgraph presentation provides information on the development of a portal to provide secure and distributed grid computing for Payload Operations Integrated Center and Mission Control Center ground services.
The Atmospheric Infrared Sounder (AIRS) is the hyperspectral infrared sounder onboard NASA's Aqua satellite, launched in 2002. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), in collaboration with NASA Sounder Team at JPL, provides processing, archiving, and distribution services for NASA sounders: the Aqua AIRS mission and the subsequent Suomi-National Polar-orbiting Partnership Cross-track Infrared Sounder (CrIS) mission. The Planetary Boundary Layer (PBL) Height is a new variable added in the AIRS Version 6 support product. It is derived based on gradients of the retrieved atmospheric thermodynamic profile, and gives the pressure at the top of PBL over the ocean. The GES DISC also provides services for the second Modern-Era Retrospective analysis for Research and Applications (MERRA-2) product generated by the Goddard Earth Observing System Model, Version 5 (GEOS-5) data assimilation system. The monthly PBL Height variable has been available in the Giovanni system, which is a Web-based application developed by the GES DISC providing a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data. In this work, we will present the monthly PBL Height data from AIRS and MERRA-2 and the services to support data intercomparison, such as access, plotting, subsetting, re-gridding, and generation of a multi-year monthly mean. We will also show intercomparison results, and evaluate whether (over the ocean) AIRS can observe PBL features similar to the reanalysis product at monthly and longer-term scales.
Phase-change material (PCM) thermal-energy storage (TES) integrated with HVAC and domestic hot water (DHW) can shift a large share of building thermal loads. By flattening and shifting loads, PCM TES reduces peak electricity use, eases stress on local and grid infrastructure, and lowers costs. It can also defer costly upgrades to service panels, distribution, and transmission. Higher energy density relative to chilled or hot water storage makes PCM TES practical for small, space limited, and retrofit projects, while packaged HVAC-integrated systems expand cost-effective load shifting to commercial buildings that previously lacked options. Despite this promise, deployment faces barriers. This paper presents challenges, opportunities, and lessons learned from lab and field integrations of PCM TES with packaged HVAC systems. Key challenges include misalignment between default heat pump controls tuned for direct-to-load operation and TES charge/discharge objectives, PCM properties that diverge from manufacturer claims and evolve with cycling, and high integration and deployment costs with off-the-shelf products. These studies underscore the need for factory built, integrated systems that arrive as prepackaged modules with proven controls, reducing design and installation effort and delivering predictable performance across projects. The paper outlines steps to enable viable and scalable PCM TES HVAC and DHW systems, including 1) validated methods that can be used to characterize PCM properties and TES system performance, 2) supervisory controls that optimize charge/discharge scheduling, and 3) factory integrated packaging that eliminates bespoke field engineering.
Here, the low inertia characteristics of the power electronics dominated grid (PEDG) introduces challenges while restoring voltage and frequency to their nominal values. These stability challenges create new cybersecurity vulnerabilities that are not thoroughly discussed in the literature. Cyber events such as false data injection (FDI), denial of service (DoS), man-in-the-middle attacks, stealthy attacks, and advanced persistent threats target PEDG to disrupt grid stability or gain financial benefits. The low inertia of PEDG (< 2s) compared to traditional grids (~10s) exacerbates these vulnerabilities. In response to stealthy attacks on state variables that supervisory layers cannot detect until significant harm occurs, the low inertia characteristics of PEDG offer substantial stealthy attack surfaces. To counteract such threats, PEDG must be equipped with ultra-fast real-time anomaly detection system and trajectory prediction mechanism to achieve effective cyberattack resiliency.
A recent trend in distributed computing is the construction of high-performance distributed systems called computational grids. One difficulty we have encountered is that there is no standard format for the representation of performance information and no standard protocol for transmitting this information. This limits the types of performance analysis that can be undertaken in complex distributed systems. To address this problem, we present an XML-based protocol for transmitting performance events in distributed systems and evaluate the performance of this protocol.
A government, university, and industry alliance has joined forces to transition total lightning observations from ground-based research networks and NASA satellites (LIS/TRMM) to improve the short range prediction of severe weather. This interest builds on the desire of the U.S Weather Research Program to foster a national Nowcasting Test Bed, with this specific transition activity initiated through the NASA short-term Prediction Research and Transition (SPoRT) Center in Huntsville, AL. A kick-off national workshop sponsored by the SPoRT Center was held in Huntsville April 1-2 to identify the common goals and objectives of the research and operational community, and to assign roles and responsibilities within the alliance. The workshop agenda, presentations, and summary are available at the SPoRT Center Web site ( h h under the "Meetings" tab. The next national workshop is planned for 2005 in Dallas, TX. The NASA North Alabama regional Lightning Mapping Array &MA) has been operational in the Huntsville area for 3 years, and has continuously sampled a variety of severe weather systems during that period. A gridded version of the LMA total lightning data is currently being supplied to National Weather Service offices in Huntsville, Nashville and Birmingham through the NWS AWES decision support system, for the purposes of assessing the utility of the data in the nowcasting of severe weather such as tornadoes, damaging straight line winds, flash flooding and other weather hazards (lightning induced forest fires, microbursts). While the raw LMA data have been useful to NWS forecasters, even greater utility would be realized if higher-order data products could be supplied through AWIPS along with the gridded data over a larger domain. In 2003-2004 additional LMA systems have been deployed across the southern US. from Florida to New Mexico, providing an opportunity for more than 20 NWS forecast offices to evaluate the incremental value of total lightning data in the warning decision making process.
As renewable energy technologies are increasingly adopted, they pose an opportunity to improve the sustainability and resilience of distributed grids, especially when their design and operation is coordinated as a hybrid power plant. When included in hybrid power plants, distributed wind turbines in particular have the potential to enhance the resilience of distributed grids in areas with good wind resource, due to their ability to provide more consistent generation and ancillary services as compared to photo-voltaic (PV) solar panels. Despite this benefit, U.S. distributed wind adoption is lower than other comparable renewable energy technologies. In this study, we seek to demonstrate how hybrid power plants that include distributed wind turbines can contribute to distribution grid resilience by meeting loads (especially critical loads) more consistently, increasing reserve capacity, and providing value to customers during outages. To demonstrate these contributions, we integrate three separate frameworks and apply them to a case study in a rural electric cooperative in Iowa. Through this case study, we simulate and compare hybrid power plant design and operation during two hazard events: a tornado that causes a 48-hour distribution outage and a winter weather event that causes a 6-hour generation outage. The inclusion of a hybrid power plant that leverages 1) increased battery duration and 2) advanced forecasting and dispatch strategies that reserve capacity leading up to a hazard event best reduce lost loads as well as diesel consumption that would otherwise be used to meet those loads during short- and long-duration hazard events. Depending on the hybrid power plant capacity and operation, we find that the outage mitigation value of a hybrid power plant (measured in value to customers to avoid an outage and avoided lost revenues for the utility) is significant in both hazard events; adding wind, solar, and battery assets to the existing system adds about $50-$100M in avoided lost load and at least $4-$8k in utility value in the tornado hazard event, and $570k-$2.2M in avoided lost load and at least $220-$650 in utility value in the winter hazard scenario. In both the tornado and winter hazard scenarios, optimizing the operation of the hybrid system for resilience can lend similar value as increasing battery duration by 5 MWh for the lower capacity systems considered.
Earth Science data are available in many file formats (NetCDF, HDF, GRB, etc.) and in a wide range of sizes, from kilobytes to gigabytes. These properties have become a challenge to users if they are not familiar with these formats or only want a small region of interest (ROI) from a specific dataset. At NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we have developed and implemented a multipurpose subset service to ease user access to Earth Science data. Our Level 3 & 4 Regridder is capable of subsetting across multiple parameters (spatially, temporally, by level, and by variable) as well as having additional beneficial features (temporal means, regridding to target grids, and file conversion to other data formats). In this presentation, we will demonstrate how users can use this service to better access only the data they need in the form they require.
Satellite cloud retrieval algorithms generally require atmospheric temperature and humidity profiles to determine such cloud properties as pressure and height. For instance, the CO2 slicing technique called the ratio method requires the calculation of theoretical upwelling radiances both at the surface and a prescribed number (40) of atmospheric levels. This technique has been applied to data from, for example, the High Resolution Infrared Radiometer Sounder (HIRS/2, henceforth HIRS) flown aboard the NOAA series of polar orbiting satellites and the High Resolution Interferometer Sounder (HIS). In this particular study, four NOAA-11 HIRS channels in the 15-micron region are used. The ratio method may be applied to various channel combinations to estimate cloud top heights using channels in the 15-mu m region. Presently, the multispectral, multiresolution (MSMR) scheme uses 4 HIRS channel combination estimates for mid- to high-level cloud pressure retrieval and Advanced Very High Resolution Radiometer (AVHRR) data for low-level (is greater than 700 mb) cloud level retrieval. In order to determine theoretical upwelling radiances, atmospheric temperature and water vapor profiles must be provided as well as profiles of other radiatively important gas absorber constituents such as CO2, O3, and CH4. The assumed temperature and humidity profiles have a large effect on transmittance and radiance profiles, which in turn are used with HIRS data to calculate cloud pressure, and thus cloud height and temperature. For large spatial scale satellite data analysis, atmospheric parameterization schemes for cloud retrieval algorithms are usually based on a gridded product such as that provided by the European Center for Medium Range Weather Forecasting (ECMWF) or the National Meteorological Center (NMC). These global, gridded products prescribe temperature and humidity profiles for a limited number of pressure levels (up to 14) in a vertical atmospheric column. The FIRE IFO 2 experiment provides an opportunity to investigate current atmospheric profile parameterization schemes, compare satellite cloud height results using both gridded products (ECMWF) and high vertical resolution sonde data from the National Weather Service (NWS) and Cross Chain Loran Atmospheric Sounding System (CLASS), and suggest modifications in atmospheric parameterization schemes based on these results.
Flexible loads like smart thermostats and water heaters can shift energy consumption and provide flexibility to the grid. However, this flexibility is dependent on occupant behavior and can lead to delivery risk, which causes utilities and grid operations to consider them as unreliable for purposes of grid operation. To date, they have not been well integrated into wholesale electricity markets or ancillary service offerings. With proper consideration of uncertainty and risk, these resources can be one of the most cost-effective sources of flexibility. This work uses stochastic optimization to quantify and bid flexibility from a fleet of flexible resources while considering their delivery risk.
The File Transfer Service (FTS3) is a distributed data movement service developed at CERN and widely used to transfer data across the Worldwide LHC Computing Grid (WLCG). At Fermilab, FTS3 supports data transfers for multiple experiments, including Intensity Frontier experiments such as DUNE, enabling reliable data movement between WebDAV endpoints in Europe and the Americas. At CHEP 2021, we reported on the initial containerized deployment of FTS3 on OKD, the community Kubernetes distribution of Red Hat OpenShift. In this work, we present the subsequent evolution of this deployment, focusing on new operational capabilities introduced to improve scalability, robustness, and long-term maintainability. We describe the adoption of more secure and reproducible container build workflows, the integration of DevOps-driven operational practices, and enhancements in monitoring and automation. A key new result is the introduction of horizontal scaling and elastic resource management, allowing FTS3 components to dynamically adapt to workload variations while maintaining service reliability. We also discuss improvements in fault tolerance and operational procedures derived from production experience. Finally, we summarize lessons learned from operating FTS3 as a Kubernetes-native service and outline how these developments have improved the resilience and efficiency of data movement operations at Fermilab.
SPoRT (NASA's Short-term Prediction Research and Transition Center) has collaboratively worked with Alaska WFOs (Weather Forecast Offices) to introduce RGB (Red/Green/Blue false color image) imagery to prepare for NOAA-20 (National Oceanic and Atmospheric Administration, JPSS (Joint Polar Satellite System) series-20 satellite) VIIRS (Visible Infrared Imaging Radiometer Suite) and improve forecasting aviation-related hazards. Last R2O/O2R (Research-to-Operations/Operations-to-Research) steps include incorporating NOAA-20 VIIRS in RGB suite and fully transitioning client-side RGB processing to GINA (Geographic Information Network of Alaska) and Alaska Region. Alaska Region WFOs have been part of the successful R2O/O2R story to assess the use of NESDIS (National Environmental Satellite, Data, and Information Service) Snowfall Rate product in operations. SPoRT introduced passive microwave rain rate and IMERG (Integrated Multi-satellitE Retrievals for GPM (Global Precipitation Measurement)) (IMERG) to Alaska WFOs for use in radar-void areas and assessing flooding potential. SPoRT has been part of the multi-organization collaborative effort to introduce Gridded NUCAPS (NOAA Unique CrIS/ATMS (Crosstrack Infrared Sounder/Advanced Technology Microwave Sounder) Processing System) to the Anchorage CWSU (Center Weather Service Unit) to assess Cold Air Aloft events, [and as part of NOAA's PG (Product Generation) effort].
Construction and deployment of the experimental testbed encountered scheduling delays, and completion was subsequently further delayed by curtailment of LANL operations due to the COVID-19 pandemic. Between March and October, LANL was in a state of “Limited Operations” such that only certain “mission-critical” work was performed with approximately 25% on-site staffing. In spite of this, much of the lab space preparation was executed and the five initial model house” units were constructed and installed during this period. Still, the pace of construction was impacted by difficulty in coordinating personnel and minimizing contact between workers. Currently, LANL is in the mode of “Normal Operations with Maximum Telework,” which continues to limit the availability of on-site personnel. Nevertheless, Milestone 3 is now complete. This document describes the experiment as it is deployed and provides status for each task for this milestone.
Milestone 4 is given in the SOPO as being due in quarter 5 (ending 9/11/2020) and is described thus: Milestone 4: Enhanced Simulation Testbed Validated with Experimental Data (UM, Mathieu) Simulation testbed validated with data obtained from experimental testbed, specifically, nonlinear load behaviors and communication network issues observed in the experimental testbed will be modeled in the simulation testbed. The simulation testbed should accurately capture TCL real and reactive power consumption (including during extreme events associated with nonlinear behaviors and communication network failures) to within 5% RMSE error with respect to data obtained from the experimental testbed.
We are developing a system to combine the Web Enabled Source Identification with X-Matching (WESIX) web service, which emphasizes source detection on optical images,with the XAssist program that automates the analysis of X-ray data. XAssist is continuously processing archival X-ray data in several pipelines. We have established a workflow in which FITS images and/or (in the case of X ray data) an X-ray field can be input to WESIX. Intelligent services return available data (if requested fields have been processed) or submit job requests to a queue to be performed asynchronously. These services will be available via web services (for non-interactive use by Virtual Observatory portals and applications) and through web applications (written in the Django web application framework). We are adding web services for specific XAssist functionality such as determining .the exposure and limiting flux for a given position on the sky and extracting spectra and images for a given region. We are improving the queuing system in XAssist to allow for "watch lists" to be specified by users, and when X-ray fields in a user's watch list become publicly available they will be automatically added to the queue. XAssist is being expanded to be used as a survey planning 1001 when coupled with simulation software, including functionality for NuStar, eRosita, IXO, and the Wide Field Xray Telescope (WFXT), as part of an end to end simulation/analysis system. We are also investigating the possibility of a dedicated iPhone/iPad app for querying pipeline data, requesting processing, and administrative job control.
By developing and enhancing various services and tools, the GES DISC provides users with the capability to access and visualize data, and to make comparisons of data from multiple sensor and models via a number of cross-discipline projects. Discovering Data via Faceted Web Interface Web interface to data products and services Search and Download mechanisms Dataset Landing Pages Accessing Data through Interoperable Services: GDS – GrADS Data Server OPeNDAP - Open-source Project for a Network Data Access Protocol WMS – OGC service GIS connector – allowing IS tools to access data easier (coming soon) HTTPS -- direct online access Downloading Data Basics: Subset and egridding Service – Parameter, Spatial, Time, Vertical, Mean averaging, format conversion, and regridding for L3/L4 gridded data Swath Data Subsetter – Parameter, spatial subset of L2 /L1 data. Visualizing Data Online: Giovanni –Visualization and Analysis L3/L4 gridded data AIRS NRT Viewer – AIRS near-real-time DQVis – L2 data quality visualization
Hydropower is a critical source of affordable and reliable electricity and energy system stability services in the United States. Opportunities to expand US hydropower production include retrofitting existing non-powered dams to produce power, retrofitting existing hydropower dams to improve efficiency or increase capacity, or constructing new hydropower infrastructure on currently unregulated river reaches. We created the HydroBio Dataset, which summarizes existing and potential hydropower capacity and freshwater biodiversity at the sub-basin scale in the conterminous US to contextualize existing and potential grid contributions with the freshwater ecosystems in which dams are situated. We demonstrate a use-case of this dataset by rescaling and comparing potential non-powered dam nominal capacity to rarity-threat-weighted freshwater species richness for sub-basins where both types of data exist. On average, normalized freshwater biodiversity exceeded normalized potential non-powered dam nominal capacity in these sub-basins. Potential non-powered dam nominal capacity was concentrated in sub-basins in the Upper Mississippi and Ohio hydrologic regions while freshwater biodiversity was concentrated in the South Atlantic-Gulf, Ohio, and Tennessee hydrologic regions. Additionally, non-powered dams and existing hydropower dams are located in sub-basins with similar indices of freshwater biodiversity. The HydroBio Dataset adds an additional ecological dimension of context to our understanding of current and potential future US hydropower capabilities and is a valuable decision support tool for stakeholders tasked with balancing gains in services to the US power grid with the public and environmental benefits of freshwater ecosystems.
Working with Level 2 satellite swath data can prove challenging for many users. The variety of metadata, high resolution, and orbit-based nature of such data makes it difficult to acquire and manage. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has developed a general-purpose Level 2 Subsetting service that facilitates access to Level 2 data products. The Level 2 Subsetter enables users to sub-sample swath and gridded data in a variety of ways: by location (in a lat/lon box, within a circle of given radius, or at a specific point), by time (via swath segments or collections of granules), by any nonspatial dimension, or by selecting specific variables. The Level 2 Subsetting service also allows users to specify output data configuration and file format. In this presentation, we will detail and demonstrate the capabilities of this new service.