Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Distribution Service”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Containerization in ATLAS Software Development and Data Production

The ATLAS experiment's software production and distribution on the grid benefits from a semi-automated infrastructure that provides up-to-date information about software usability and availability through the CVMFS dis-tribution service for all relevant systems. The software development process uses a Continuous Integration pipeline involving testing, validation, packag-ing and installation steps. For opportunistic sites that can not access CVMFS, containerized releases are needed. These standalone containers are currently created manually to support Monte-Carlo data production at such sites. In this paper we will describe an automated procedure for the containerization of AT-LAS software releases in the existing software development infrastructure, its motivation, integration and testing in the distributed computing system.

97 MATHEMATICS AND COMPUTING↗

FL‐ADS: Federated learning anomaly detection system for distributed energy resource networks

Abstract With the ongoing development of Distributed Energy Resources (DER) communication networks, the imperative for strong cybersecurity and data privacy safeguards is increasingly evident. DER networks, which rely on protocols such as Distributed Network Protocol 3 and Modbus, are susceptible to cyberattacks such as data integrity breaches and denial of service due to their inherent security vulnerabilities. This paper introduces an innovative Federated Learning (FL)‐based anomaly detection system designed to enhance the security of DER networks while preserving data privacy. Our models leverage Vertical and Horizontal Federated Learning to enable collaborative learning while preserving data privacy, exchanging only non‐sensitive information, such as model parameters, and maintaining the privacy of DER clients' raw data. The effectiveness of the models is demonstrated through its evaluation on datasets representative of real‐world DER scenarios, showcasing significant improvements in accuracy and F1‐score across all clients compared to the traditional baseline model. Additionally, this work demonstrates a consistent reduction in loss function over multiple FL rounds, further validating its efficacy and offering a robust solution that balances effective anomaly detection with stringent data privacy needs.

Purohit, Shaurya [Iowa State University Ames Iowa ↗

Kepler + MeDICi - Service-Oriented Scientific Workflow Applications

Scientific applications are often structured as workflows that execute a series of interdependent, distributed software modules to analyze large data sets. The order of execution of the tasks in a workflow is commonly controlled by complex scripts, which over time become difficult to maintain and evolve. In this paper, we describe how we have integrated the Kepler scientific workflow platform with the MeDICi Integration Framework, which has been specifically designed to provide a standards-based, lightweight and flexible integration platform. The MeDICi technology provides a scalable, component-based architecture that efficiently handles integration with heterogeneous, distributed software systems. This paper describes the MeDICi Integration Framework and the mechanisms we used to integrate MeDICi components with Kepler workflow actors. We illustrate this solution with a workflow application for an atmospheric sciences application. The resulting solution promotes a strong separation of concerns, simplifying the Kepler workflow description and promoting the creation of a reusable collection of components available for other workflow applications in this domain.

99 GENERAL AND MISCELLANEOUS↗

A Science Data Gateway for Environmental Management

Science data gateways are effective in providing complex science data collections to the world-wide user Q1 communities. In this paper we describe a gateway for the Advanced Simulation Capability for Environmental Management (ASCEM) framework. Built on top of established web service technologies, the ASCEM data gateway is specifically designed for environmental modeling applications. Its key distinguishing feature sinclude (1) handling of complex spatiotemporal data, (2) offering a variety of selective data access mechanisms, (3) providing state-of-the-art plotting and visualization of spatiotemporal data records, and (4) integrating seamlessly with a distributed workflow system using a RESTful interface. ASCEM projectscientists have been using this data gateway since 2011.

ASCEM, Akuna, Database Management↗

LDM-612: Plans and Policies for LSST Alert Distribution

A major product of the nightly processing of LSST images is a world-public stream of alerts from transient, variable, and moving sources. Science users will access these alerts through community brokers or through a simple filtering service provided by LSST. This document provides a guide to the plans and policies for the alert distribution system to aid science users, broker developers, funding agencies, and LSST Project personnel. It describes the components of the alert distribution system and the data rights required to access specific scientific products. It provides guidelines for organizations developing community brokers and describes the planned capabilities of the LSST simple alert filtering service and Science Platform to aid science users in planning for LSST science.

79 ASTRONOMY AND ASTROPHYSICS↗

Energetic Potential for Demand Response in Detached Single Family Homes in Austin, TX

This study builds a generalized tool to quantify the maximum peak load reduction achievable with residential demand response and distributed energy resources (DERs). The tool is demonstrated by using empirical energy usage data from detached single family households within the service territory of Austin Energy - the local municipal utility in Austin, TX. The demand response optimization algorithm shifts energy usage of four controllable, high-consumption residential devices to off-peak hours: HVAC (heating, ventilation, and air conditioning) systems, electric water heaters, electric vehicles, and pool pumps. In addition, rooftop solar generation on individual residences is considered to reduce net load to the utility, and an energy storage system optimization model performing energy arbitrage further reduces peak demand. Results from the aggregate demand response and battery optimization study indicate that peak demand for the 2017 summer peak in Austin Energy could have been reduced by 26 MW or 2.9%. Here, by considering the combined effect of controllable consumer loads, solar generation, and energy storage systems, this study highlights the potential of strategic demand response and energy arbitrage to reduce peak demand at the distribution level.

14 SOLAR ENERGY↗

A SOAP Web Service for accessing MODIS land product subsets

Remote sensing data from satellites have provided valuable information on the state of the earth for several decades. Since March 2000, the Moderate Resolution Imaging Spectroradiometer (MODIS) sensor on board NASA s Terra and Aqua satellites have been providing estimates of several land parameters useful in understanding earth system processes at global, continental, and regional scales. However, the HDF-EOS file format, specialized software needed to process the HDF-EOS files, data volume, and the high spatial and temporal resolution of MODIS data make it difficult for users wanting to extract small but valuable amounts of information from the MODIS record. To overcome this usability issue, the NASA-funded Distributed Active Archive Center (DAAC) for Biogeochemical Dynamics at Oak Ridge National Laboratory (ORNL) developed a Web service that provides subsets of MODIS land products using Simple Object Access Protocol (SOAP). The ORNL DAAC MODIS subsetting Web service is a unique way of serving satellite data that exploits a fairly established and popular Internet protocol to allow users access to massive amounts of remote sensing data. The Web service provides MODIS land product subsets up to 201 x 201 km in a non-proprietary comma delimited text file format. Users can programmatically query the Web service to extract MODIS land parameters for real time data integration into models, decision support tools or connect to workflow software. Information regarding the MODIS SOAP subsetting Web service is available on the World Wide Web (WWW) at http://daac.ornl.gov/modiswebservice.

99 GENERAL AND MISCELLANEOUS↗

Automation of User Analysis Workflow in CMS

CMS has a distributed computing model, based on a hierarchy of tiered regional computing centres. However, the end physicist is not interested in the details of the computing model nor the complexity of the underlying infrastructure, but only to a ccess and use efficiently and easily the remote services. The CMS Remote Analysis Builder (CRAB) is the official CMS tool that allows the access to the distributed data in a transparent way. We present the current development direction, which is focused o n improving the interface presented to the user and adding intelligence to CRAB such that it can be used to automate more and more the work done on behalf of user. We also present the status of deployment of the CRAB system and the lessons learnt in deplo ying this tool to the CMS collaboration.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Enhancing Cloud Cybersecurity: Prescriptive Controls for Operational Technology

This whitepaper provides strategic insights and recommendations into security cloud-based solutions for electric utilities, encompassing operational technology (OT), virtual power plants (VPP), distributed energy resources (DERs), applications, networks, and data storage as they transition to and leverage cloud infrastructure through managed service providers (MSPs) and cloud service providers (CSPs). Principles derived from established frameworks serve as a foundation for best practices across cybersecurity projects and remove the constraints of settling on a single framework. For organizations that prefer not to integrate a specific framework altogether, elements of the proposed approach could be adopted or tailored to best fit defined requirements and expected functionalities. The Cirrus assessment, a utility cloud feasibility tool, and the roadmap it provides serve as a precursor to this paper, which seeks to be a valuable resource for defining next steps following cloud technology integration feasibility appraisal. With its comprehensive approach to adoption, the Cirrus framework offers strategic guidance on responsibly preparing for or deploying a utility cloud solution. The previously published whitepaper, “Use Case-Informed Framework for Utility Cloud Migration,” details the guiding strategy, research, and deployment of cloud solutions within electric and interconnected grid systems. Before implementing the controls suggested in this document, it is recommended that stakeholders complete Cirrus's cloud integration assessment and pair the results with their unique cybersecurity controls to form a comprehensive cloud-based utility cybersecurity plan. The Cirrus outcome will consider a series of future architectures for the grid before and after the energy transition and evaluate the arguments for and against cloud applications for each electric and interconnected grid layer. This document is a companion to the original whitepaper, "Use Case-Informed Framework for Utility Cloud Migration" to further identify and recommend security controls based on Cirrus’s cloud integration assessment output. The following whitepaper outlines the cybersecurity controls that secure cloud-service models pertinent to the electric sector using the predefined categories identify, protect, detect, and respond and recover. The objective is to outline prescriptive security controls based on the type of architecture and data stored in the cloud. The focus includes dissecting the shared responsibility model and elucidating what on-premises Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS) entail. A pivotal consideration in this context is allocating responsibility for foundational cybersecurity aspects—having used Cirrus for the cloud integration assessment. The ensuing controls detailed herein also represent a checklist of controls necessary for a secure cloud transition, equipping utilities with the knowledge to navigate this digital transformation with confidence and strategic foresight in a safe and responsible manner.

42 ENGINEERING↗

238 PuO 2 In Vitro Lung Dissolution Rate and Particle Size Determination for Material Involved in the June 8, 2020 Incident at the Los Alamos National Laboratory PF-4 Facility

As part of the LANL response to the June 8, 2020 238 PuO 2 inhalation exposure incident in PF-4, the Nuclear and Radiochemistry Group (C-NR) was asked to assist in determining the lung dissolution rate and particle size distribution of the airborne material. These material characteristics, along with urine and fecal bioassay data, are used by the Radiation Protection Services (RP-SVS) internal dosimetrists to refine dose estimates for exposed workers. Similar to previous studies, an in vitro lung dissolution rate study was performed to assess how fast 238 Pu is cleared from the lungs. Given that PuO 2 is a relatively insoluble material, it dissolves very slowly and requires in vitro studies of 100 or more days to estimate dissolution rates. This report details the results of a 100 day in vitro dissolution rate study and the particle size characteristics of 238 PuO 2 collected on an air filters during the incident. Results show that the 238 PuO 2 involved in this incident has behavior comparable to PuO 2 from previous in vitro studies, with approximately 1% of material dissolving quickly, and 99% of the material dissolving very slowly, with a half-time of approximately 120 years. This is somewhat slower than what was determined in a previous study of LANL 238 PuO 2 , which had an experimental dissolution half-time of 3 years, but significantly faster than 3000 years measured for 239 PuO 2 . Particle size distribution measurements indicate that particle sizes range from 0.10 µm – 6 µm, with most < 2 µm, which is reasonable based on our understanding of the process history of the 238 PuO 2 . Particle size, specific surface area, calcining temperature, specific activity, and age all are known factors that can impact the dissolution rate of refractory materials, however, there are too few studies to quantify the exact influence of these parameters on a measured dissolution rate. The results of this study add to that knowledge base, and provide new insights into the dissolution rates for this LANL process-specific 238 PuO 2 material.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

Commercial Building Planning and Retrofitting Strategy for Grid Services

The increasing integration of distributed energy resources (DERs) plays an important role in improving energy consumption efficiency. In September 2020, the Federal Energy Regulatory Commission (FERC) approved Order 2222 which opens wholesale electricity markets to small capacity DERs. The benefit of this new FERC Order 2222 is that DERs, such as rooftop solar panels and batteries, will be able to participate in regional electricity markets and provide grid services. Meanwhile, the planning and operation strategies of DERs are facing new challenges to account for the impact of the wholesale market with numerous uncertainty factors. Therefore, in this paper, we propose a new planning and retrofitting model for long-term commercial buildings that considers both DER investment and market participation. Specifically, we explore the capability of implementing DERs for grid services. The effectiveness of the proposed model is validated using real-world data. Simulation results also validate that participating in grid services can significantly increase revenues through appropriate building energy management and shorten the payback period of DER investments.

building energy management↗

DISTRIBUTION TRANSFORMER ASSET MONITORING ON THE GRID EDGE USING SMART SENSOR DATA

As new loads such as rooftop photovoltaics, electric vehicles and other distributed energy resources become commonplace on the distribution grid, the stress on already aging assets begins to escalate. This increased loading and changing dynamics can exacerbate failure rates. While traditional monitoring efforts focus on transmission and generation assets, utilities are now beginning to pay close attention to distribution assets in order to increase reliability indices and reduce cost from unexpected outages. This research develops low-cost and scalable methods to monitoring the health of a critical distribution grid asset: the service transformer. Existing methods in literature are either invasive and thus difficult to implement or require the device to be tested offline in an expensive lab setting. Data from the ubiquitous smart meter as well as a novel Bluetooth based transformer monitor are leveraged to automatically notify the utility of deteriorating or damaged transformers. Voltage, temperature, and vibration are some of the signals measured and analyzed by the proposed algorithms to predict transformer failures. Furthermore, these algorithms are designed to keep the implementation and processing costs low by taking advantage of edge computing where possible.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Jamaica National Net-Billing Pilot Program Evaluation

This technical report discusses the effectiveness of the Jamaica Public Service Company Limited Net-Billing Pilot Program. The National Renewable Energy Laboratory (NREL) collected and analyzed data from a wide range of stakeholders, conducted in-country research, and compared program elements to common interconnection practices to form programmatic recommendations for the Jamaica context. NREL finds that the net-billing pilot program has successfully contributed to the support of the emerging solar market in Jamaica with the interconnection of 80 systems under the program for a total of 1.38 megawatts (MW) at the time of original analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Service Oriented Architecture for Exploring High Performance Distributed Power Models

Power grids are increasingly incorporating high quality, high throughput sensor devices inside power distribution networks. These devices are driving an unprecedented increase in the volume and rate of available information. The real-time requirements for handling this data are beyond the capacity of conventional power models running in central utilities. Hence, we are exploring distributed power models deployed at the regional scale. The connection of these models for a larger geographic region is supported by a distributed system architecture. This architecture is built in a service oriented style, whereby distributed power models running on high performance clusters are exposed as services. Each service is semantically annotated and therefore can be discovered through a service catalog and composed into workflows. The overall architecture has been implemented as an integrated workflow environment useful for power researchers to explore newly developed distributed power models.

Service oriented architecture, high performance co↗

iDDS: intelligent distributed dispatch and scheduling for workflow orchestration

The intelligent distributed dispatch and scheduling (iDDS) service is a versatile workflow orchestration system designed for large-scale, distributed scientific computing. iDDS extends traditional workload and data management by integrating data-aware execution, conditional logic, and programmable workflows, enabling automation of complex and dynamic processing pipelines. Originally developed for the ATLAS experiment at the large hadron collider, iDDS has evolved into an experiment-agnostic platform that supports both template-driven workflows and a Function-as-a-Task model for Python-based orchestration. This paper presents the architecture and core components of iDDS, highlighting its scalability, modular message-driven design, and integration with systems such as PanDA and Rucio. We demonstrate its versatility through real-world use cases: fine-grained tape resource optimization for ATLAS, orchestration of large Directed Acyclic Graph (DAG) workflows for the Rubin Observatory, distributed hyperparameter optimization for machine learning applications, active learning for physics analyses, and AI-assisted detector design at the electron–ion collider. By unifying workload scheduling, data movement, and adaptive decision-making, iDDS reduces operational overhead and enables reproducible, high-throughput workflows across heterogeneous infrastructures. We conclude with current challenges and future directions, including interactive, cloud-native, and serverless workflow support.

97 MATHEMATICS AND COMPUTING↗

Behavioral and Population Data-Driven Distribution System Load Modeling

Distribution system residential load modeling and analysis for different geographic areas within a utility or an independent system operator territory are critical for enabling small-scale, aggregated distributed energy resources to participate in grid services under Federal Energy Regulatory Commission Order No. 2222 [1]. In this study, we develop a methodology of modeling residential load profiles in different geographic areas with a focus on human behavior impact. First, we construct a behavior-based load profile model leveraging state-of-the-art appliance models. We simulate human activity and occupancy using Markov chain Monte Carlo methods calibrated with the American Time Use Survey data set. Second, we link our model with cleaned Current Population Survey data from the U.S. Census Bureau. Finally, we populate two sets of 500 households using California and Texas census data, respectively, to perform an initial analysis of the load in different geographic areas with various group features (e.g., different income levels). To distinguish the effect of population behavior differences on aggregated load, we simulate load profiles for both sets assuming fixed physical household parameters and weather data. Analysis shows that average daily load profiles vary significantly by income and income dependency varies by locality.

American Time Use Survey↗

DGaaS: GPU as a Service on Distributed Computing System

In the rapidly evolving landscape of scientific computing, Graphics Processing Units (GPUs) have become indispensable for their unparalleled ability to handle parallel tasks in complex calculations, simulations, and data analysis. Their utility is further magnified in machine learning and AI applications, where they significantly accelerate model training and predictive analytics. Within this context, the Triton Inference Server emerges as a pivotal open-source tool, specializing in AI inferencing and optimizing GPU utilization across various platforms and frameworks. This paper presents an in-depth study on distributed High Throughput Computing (HTC), specifically focusing on the HTCondor framework and its resource provisioning tools, GlideinWMS and HEPCloud. These systems enable large-scale scientific experiments like CMS and DUNE to efficiently access and utilize vast computational resources. The paper explores the core architectural components of GlideinWMS, including jobs, user pools, and worker nodes, and discusses their integration with GPUs and the Triton server. The primary aim of this research is to develop a solution that optimizes GPU utilization by leveraging Glideins and containers. This approach allows computational jobs, particularly those involving AI models, to use GPUs only when essential, thereby facilitating efficient sharing of limited GPU resources. To validate this architecture, the study conducted three key tests involving custom scripts, container-based servers, and Triton server deployments. However, the study faces challenges, notably in locating the Triton server and ensuring secure remote access. To address these issues, future work will focus on developing a proxy mechanism and enhancing security protocols. In conclusion, this study offers a comprehensive roadmap for effective and efficient GPU utilization in distributed High Throughput Computing. It aims to contribute significantly to the scientific community by solving pressing problems and implementing robust solutions in collaboration with the GlideinWMS and HEPCloud teams. The research sets the stage for a more efficient, scalable, and cost-effective paradigm in scientific computing.

97 MATHEMATICS AND COMPUTING↗