Search NASA⌕ Search

SEARCH · Search NASA

Results for “data integrity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

GEWEX SRB Release 4: Public Release

The NASA/GEWEX Surface Radiation Budget (SRB) project produces 3-hourly shortwave and longwave surface and top of atmosphere radiative fluxes for the 1983-nearpresent time period. Here we announce the public availability of the new Release 4 Integrated data product (R4-IP). R4-IP uses the newly recalibrated and processed ISCCP HXS product as its primary input for cloud and radiance data, replacing ISCCP DX with a ninefold increase in pixel count (10km instead of 30km). This version retains a 1°x1° resolution but benefits from a much larger number of samples per grid box than the SRB Release 3. ISCCP also provides an atmospheric temperature and moisture dataset known as nnHIRS which we use here, along with Seaflux and Landflux surface and near-surface meteorological parameters constituting an “Integrated Product” for energy and water cycle studies. In addition to the input data improvements, several important algorithm improvements have been made since Release 3. These include recalculated shortwave (SW or solar wavelengths) atmospheric transmissivities and reflectivities yielding a somewhat less transmissive atmosphere. Both SW and LW (longwave or thermal infrared) also include variable aerosol composition and radiative properties, allowing for the use of a detailed aerosol history from the Max Planck Institute Aerosol Climatology (MAC). Both LW and SW algorithms now produce pristine sky fluxes, allowing the aerosol flux effects to be quantified. For SW, ocean albedo and snow/ice albedo are improved from Release 3. Total solar irradiance is now variable, and reduced to an average of 1361 Wm-2. The radiative treatment of ice cloud is improved. For the LW, a climatological monthly varying spectral surface emissivity is added.Here we analyze the new SW SRB datasets, comparing them to the previous Release 3, BSRN and PMEL surface measurements. Validation results show improved agreement compared to Release 3. Comparisons to ERBE and CERES TOA and surface satellite datasets before and after overlap periods show the long-term agreement with radiometric uncertainty. Monthly anomalies at global and zonal regions show very good correlation with the shorter ERBE and CERES flux anomalies linking those to the longer term. The uncertainties are discussed and periods of potential issues in inputs and/or algorithms are identified.

Earth energy budget↗

GEWEX SRB Release 4: Public Release

The NASA/GEWEX Surface Radiation Budget (SRB) project produces 3-hourly shortwave and longwave surface and top of atmosphere radiative fluxes for the 1983-near present time period. Here we announce the public availability of the new Release 4 Integrated data product (R4-IP). R4-IP uses the newly recalibrated and processed ISCCP HXS product as its primary input for cloud and radiance data, replacing ISCCP DX with a ninefold increase in pixel count (10km instead of 30km). This version retains a 1°x1° resolution but benefits from a much larger number of samples per grid box than the SRB Release 3. ISCCP also provides an atmospheric temperature and moisture dataset known as nnHIRS which we use here, along with Seaflux and Landflux surface and near-surface meteorological parameters constituting an “Integrated Product” for energy and water cycle studies. In addition to the input data improvements, several important algorithm improvements have been made since Release 3. These include recalculated shortwave (SW or solar wavelengths) atmospheric transmissivities and reflectivities yielding a somewhat less transmissive atmosphere. Both SW and LW (longwave or thermal infrared) also include variable aerosol composition and radiative properties, allowing for the use of a detailed aerosol history from the Max Planck Institute Aerosol Climatology (MAC). Both LW and SW algorithms now produce pristine sky fluxes, allowing the aerosol flux effects to be quantified. For SW, ocean albedo and snow/ice albedo are improved from Release 3. Total solar irradiance is now variable, and reduced to an average of 1361 Wm-2. The radiative treatment of ice cloud is improved. For the LW, a climatological monthly varying spectral surface emissivity is added. Here we analyze the new SW SRB datasets, comparing them to the previous Release 3, BSRN and PMEL surface measurements. Validation results show improved agreement compared to Release 3. Comparisons to ERBE and CERES TOA and surface satellite datasets before and after overlap periods show the long-term agreement with radiometric uncertainty. Monthly anomalies at global and zonal regions show very good correlation with the shorter ERBE and CERES flux anomalies linking those to the longer term. The uncertainties are discussed and periods of potential issues in inputs and/or algorithms are identified.

Earth Radiation Budget↗

Using Information Automation and Human Technology Integration to Implement Integrated Operations for Nuclear

The purpose of the research effort described in this report is to develop and demonstrate an approach to the design and implementation of advanced, automated systems intended to increase operational efficiencies at nuclear power plants. In particular, we describe methods for considering human-technology integration (HTI) issues throughout the various phases of system design, test, and implementation and how these considerations help promote effective design. This research project will develop planning tools and comprehensive guidance on how HTI principles and methods, in combination with information automation technologies, can enable effective data integration and coordination for full nuclear plant modernization. Specifically, this research project will develop an approach to automate the mapping of data from plant systems and processes to application needs, thereby significantly reducing the amount of human workload currently required for the execution of these tasks. In addition to developing an automated solution as a replacement for these tasks, this research will also analyze digitalization’s effectiveness in reducing operational costs of compliance related activities. Compliance activities are estimated to account for as much as 50% of operations and maintenance (i.e., non-fuel and non-capital) costs of plant operation.

97 MATHEMATICS AND COMPUTING↗

Standardization of computer compatible tape formats for remote sensing data

Standards and guidelines being developed for future CCT formats for use in Landsat receiving stations are presented, in order to solve the data compatability problem, and to consider user community requirements. Data exchange at the local, regional, national, or international level is an important user requirement, and data integration from various sources should be possible. The tape super structure allows various formats to be implemented. A volume directory identifies the volume, and a file descriptor confirms it. The data is then filed, and it is determined whether the data files are appropriate to already defined file classes. If not, a new class is established. Applications of this format are in three areas: satellite imagery, geocoded polygon data, and airborne remote sensing data.

Thomas, V. L.↗

A development of logistics management models for the Space Transportation System

A new analytic queueing approach was described which relates stockage levels, repair level decisions, and the project network schedule of prelaunch operations directly to the probability distribution of the space transportation system launch delay. Finite source population and limited repair capability were additional factors included in this logistics management model developed specifically for STS maintenance requirements. Data presently available to support logistics decisions were based on a comparability study of heavy aircraft components. A two-phase program is recommended by which NASA would implement an integrated data collection system, assemble logistics data from previous STS flights, revise extant logistics planning and resource requirement parameters using Bayes-Lin techniques, and adjust for uncertainty surrounding logistics systems performance parameters. The implementation of these recommendations can be expected to deliver more cost-effective logistics support.

Carrillo, M. J.↗

SEDAC data and applications development plan V(1)

This Data and Applications Development Plan describes how the Socioeconomic Data and Applications Center (SEDAC) at the Consortium for International Earth Science Information Network (CIESIN) is responding to SEDAC's mission to develop new applications and information products that synthesize earth science and socioeconomic data in ways that support decision making. The SEDAC data and applications development effort is a primary means by which the Earth Observing System Data and Information System (EOSDIS) program can help to ensure that the scientific investment embodied in NASA's Mission to Planet Earth (MTPE) program leads to tangible benefits to the American people. The Plan describes the major issues concerned with global climate change, identifies important decision makers and other users who would benefit from improved data and information, and assesses key opportunities for responding to the needs of these users and the scientists who work with them. It then details specific plans for developing selected integrated data products and services and for making them available to the target users on an operational basis. This report provides a summary of the activities performed in connection with NASA/GSFC Letter Contract NAS5-3263 for the period shown.

Chen, Robert S.↗

Dataset for 'Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning', Water 2022

This data package presents forcing data, model code, and model output for classical machine learning models that predict monthly stream water temperature as presented in the manuscript ‘Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning’, Water (Weierbach et al., 2022). Specifically, for input forcing datasets we include two files each generated using the BASIN-3D data integration tool (Varadharajan et al., 2022) for stations in the Pacific Northwest and Mid Atlantic Hydrologic regions. Model code (written in python with the use of jupyter notebooks) includes codes for data preprocessing, training Multiple Linear Regression, Support Vector Regression, and Extreme Gradient Boosted Tree models, and additional notebooks for analysis of model output. We include specific model output files which represent modeling configurations presented in the manuscript also presented in an hdf5 format. Together, these data make up the workflow for predictions across three scenarios (single station, regional, and predictions in unmonitored basins) presented in the manuscript and allow for reproducibility of modeling procedures.

54 ENVIRONMENTAL SCIENCES↗

A versatile nondestructive evaluation imaging workstation

Ultrasonic C-scan and eddy current imaging systems are of the pointwise type evaluation systems that rely on a mechanical scanner to physically maneuver a probe relative to the specimen point by point in order to acquire data and generate images. Since the ultrasonic C-scan and eddy current imaging systems are based on the same mechanical scanning mechanisms, the two systems can be combined using the same PC platform with a common mechanical manipulation subsystem and integrated data acquisition software. Based on this concept, we have developed an IBM PC-based combined ultrasonic C-scan and eddy current imaging system. The system is modularized and provides capacity for future hardware and software expansions. Advantages associated with the combined system are: (1) eliminated duplication of the computer and mechanical hardware, (2) unified data acquisition, processing and storage software, (3) reduced setup time for repetitious ultrasonic and eddy current scans, and (4) improved system efficiency. The concept can be adapted to many engineering systems by integrating related PC-based instruments into one multipurpose workstation such as dispensing, machining, packaging, sorting, and other industrial applications.

Chern, E. James↗

A Causal Approach to Integrate Component Health Data into System Reliability Models

Two of the challenges of current plant reliability approaches are the ability to integrate plant health data, and to support decision making. Condition based data and diagnostic/prognostic information are in fact not considered into plant reliability models to inform system engineers on the most critical components. Currently, the propagation of quantitative health data from the component to the system level is a challenge given the diverse nature/structure of the data. On the other hand, plant reliability methods (which are typically based on fault-trees or reliability block diagrams) can effectively propagate data from the component to the system level, but values of failure rates or failure probabilities are an approximated integral representation of the past industry-wide operational experience, and it neglects the present component health status (e.g., diagnostic and condition-based data) and health projection (when available from prognostic data). Our first claim is that system reliability models should propagate health information from the component to the system/plant level in order to provide a quantitative snapshot of system/plant health and identify the most critical components. Our second claim is that component health should be informed solely by that specific component current and historical performance data and should not be an approximated integral representation of the past industry-wide operational experience. This paper is directly supporting these two claims by proposing a different approach to perform reliability modeling which relies on available component diagnostic, prognostic and condition-based data to measure component health, and it propagates this information through fault tree models. The propagation of health data from the component to the system level is performed not in terms of probability, but in terms of margins where margin is defined as the “distance” between the present actual status and an undesired event (e.g., failure or unacceptable performance). Through a cause-effect lens, while classical reliability models target the effect associated to a component performance, a margin-based approach focuses on the cause of an undesired component performance (i.e., component health). Hence, thinking of reliability in terms of margins implies decision making based on causal reasoning. We will show how fault tree models can be solved using a margin language and how this process can effectively assist system engineers to identify the most critical components.

97 MATHEMATICS AND COMPUTING↗

The Space Station software support environment - Not just what, but why

The NASA environment is described with attention given to mission data systems in NASA and the strategic view. Space Station data systems are characterized into the following: distributed data systems, functionality and complexity, session oriented user interface, and distributed software development. The concept of a support software environment within the Space Station Program is elucidated and a strategic model for integrated data processing is presented.

Garman, John R.↗

Space-based Sensor for Extreme Fire Weather Events

Catastrophic bushfires are becoming increasingly prevalent as climate change advances. Impacts extend beyond national borders. Multinational efforts can inform new science and management practices. Space-based sensors and integrated data facilities will play an important role. This paper describes a collaborative project between a consortium of Australian universities and NASA Centers to develop and implement a small satellite platform comprising highly integrated thermal and lightning sensors coupled with AI-based edge computing to help predict, detect, and track bushfires, supporting mitigation activities. This will fill an important capability gap since Australia does not currently have any sovereign Earth observation satellites. This program is enabled by and builds on Australia-NASA collaboration and will also support fire science and management activities in the broader global context.

wildfire↗

A Novel Architecture for Attack-Resilient Wide-Area Protection and Control System in Smart Grid

Wide-area protection and control (WAPAC) systems are widely applied in the energy management system (EMS) that rely on a wide-area communication network to maintain system stability, security, and reliability. As technology and grid infrastructure evolve to develop more advanced WAPAC applications, however, so do the attack surfaces in the grid infrastructure. This paper presents an attack-resilient system (ARS) for the WAPAC cybersecurity by seamlessly integrating the network intrusion detection system (NIDS) with intrusion mitigation and prevention system (IMPS). In particular, the proposed NIDS utilizes signature and behavior-based rules to detect attack reconnaissance, communication failure, and data integrity attacks. Further, the proposed IMPS applies state transition-based mitigation and prevention strategies to quickly restore the normal grid operation after cyberattacks. As a proof of concept, we validate the proposed generic architecture of ARS by performing experimental case study for wide-area protection scheme (WAPS), one of the critical WAPAC applications, and evaluate the proposed NIDS and IMPS components of ARS in a cyber-physical testbed environment. Our experimental results reveal a promising performance in detecting and mitigating different classes of cyberattacks while supporting an alert visualization dashboard to provide an accurate situational awareness in real-time.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The need for an integrated multi-OMICs approach in microbiome science in the food system

Microbiome science as an interdisciplinary research field has evolved rapidly over the past two decades, becoming a popular topic not only in the scientific community and among the general public, but also in the food industry due to the growing demand for microbiome-based technologies that provide added-value solutions. Microbiome research has expanded in the context of food systems, strongly driven by methodological advances in different -omics fields that leverage our understanding of microbial diversity and function. However, managing and integrating different complex -omics layers are still challenging. Within the Coordinated Support Action MicrobiomeSupport (https://www.microbiomesupport.eu/), a project supported by the European Commission, the workshop “Metagenomics, Metaproteomics and Metabolomics: the need for data integration in microbiome research” gathered 70 participants from different microbiome research fields relevant to food systems, to discuss challenges in microbiome research and to promote a switch from microbiome-based descriptive studies to functional studies, elucidating the biology and interactive roles of microbiomes in food systems. A combination of technologies is proposed. This will reduce the biases resulting from each individual technology and result in a more comprehensive view of the biological system as a whole. Although combinations of different datasets are still rare, advanced bioinformatics tools and artificial intelligence approaches can contribute to understanding, prediction, and management of the microbiome, thereby providing the basis for the improvement of food quality and safety.

60 APPLIED LIFE SCIENCES↗

ZFS Interface For Accelerators

As data volume increases in HPC centers, storing data in reasonable amounts of space and time while maintaining data integrity and recoverability becomes ever more difficult. ZFS is a filesystem that provides these features, among many others, that make it attractive for usage in HPC environments. It has the ability to compress data, compute checksums, and compute redundancy codes within the same runtime, rather than compute each separately, without knowledge of the underlying structure of the filesystem. However, measurements have shown that compression on CPUs can be incredibly inefficient and significantly reduce the performance of ZFS. The ZFS Interface for Accelerators (Z.I.A.) was developed to provide an interface to route data to accelerators while being processed by ZFS, so that the ZFS infrastructure and features are maintained, while allowing for ZFS administrators to provide faster implementations of compression, or other features, to their instance of ZFS.

Lee, Jason↗

MyCrunchGPT: A LLM Assisted Framework for Scientific Machine Learning

Scientific machine learning (SciML) has advanced recently across many different areas in computational science and engineering. Here, the objective is to integrate data and physics seamlessly without the need of employing elaborate and computationally taxing data assimilation schemes. However, preprocessing, problem formulation, code generation, postprocessing, and analysis are still time- consuming and may prevent SciML from wide applicability in industrial applications and in digital twin frameworks. Here, we integrate the various stages of SciML under the umbrella of ChatGPT, to formulate MyCrunchGPT, which plays the role of a conductor orchestrating the entire workflow of SciML based on simple prompts by the user. Specifically, we present two examples that demonstrate the potential use of MyCrunchGPT in optimizing airfoils in aerodynamics, and in obtaining flow fields in various geometries in interactive mode, with emphasis on the validation stage. To demonstrate the flow of the MyCrunchGPT, and create an infrastructure that can facilitate a broader vision, we built a web app based guided user interface, that includes options for a comprehensive summary report. The overall objective is to extend MyCrunchGPT to handle diverse problems in computational mechanics, design, optimization and controls, and general scientific computing tasks involved in SciML, hence using it as a research assistant tool but also as an educational tool. While here the examples focus on fluid mechanics, future versions will target solid mechanics and materials science, geophysics, systems biology, and bioinformatics.

97 MATHEMATICS AND COMPUTING↗

NASA Life Sciences Portal (NLSP): Supporting Scientific Transparency and Reproducibility

NASA’s Life Sciences Ports (NLSP) serves the scientific community by providing curated data from space life science experiment. The Human Research Program (HRP) with the help of NLSP is currently transforming their life sciences data archive systems and processes to improve compliance with the FAIR principles [1]. Some of these improvements will at the same time support the twin pillars of Open Science [2]: transparency of methods and reproducibility of results. Scientific transparency is marked by the easily intelligible communication of what has been investigated: what were the procedures for collecting sample and the characteristics of samples collected? what kinds of measurements were made, what were the environmental conditions of the measurements? What were the analysis techniques of the collected data? Reproducibility of the results and findings from the investigation requires a high level of transparency for all but the simplest investigations; the slightest deviation in communicating and replicating complex experimental procedures or data analyses can often yield quite different data and even findings, thwarting their validation. One of the ways the NLSP is aiming to improve the communication of scientific information is through the use of ontology-driven metadata. Ontologies are powerful, graph-based knowledge representation structures, which can be leveraged to increase data interoperability, the area of the FAIR principles in which many data systems most lack compliance. Over the past decade, there has been a concerted effort in the biomedical community to develop modular and narrowly focused domain and application-specific ontologies in a common, open-source framework, the Open Biological and Biomedical Ontology (OBO) Foundry [3]. The open sharing and modular nature of this effort promises huge increases in harmonized data sharing for systems that leverage these models. Which is in line with the FAIR Data Principles of Findability, Accessibility, Interoperability, and Reuse for scientific data management and stewardship. 1. Wilkinson, M.D., et al., The FAIR Guiding Principles for scientific data management and stewardship. Sci Data, 2016. 3: p. 160018. 2. National Academies of Sciences, E. and Medicine, Open Science by Design: Realizing a Vision for 21st Century Research. 2018, Washington, DC: The National Academies Press. 232. 3. Smith, B., et al., The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol, 2007. 25(11): p. 1251-5.

Life Sciences data↗

Rapid Detection of Anomalies in Battery Energy Storage System Data

Data analytics is pivotal in assessing the technical characteristics and performance of Battery Energy Storage Systems (BESS), underpinning BESS modeling, optimization, and control. However, raw datasets frequently harbor anomalies from measurement errors and equipment malfunctions, impacting BESS reliability and analysis accuracy To address the challenge, this paper presents a novel methodology for the rapid detection of anomalous charge or discharge cycles within BESS operational data, expediting the cleaning process while ensuring data integrity. We’ve collected diverse and comprehensive real-world BESS operational datasets in collaboration with the Electric Power Research Institute and multiple Washington State utilities. These datasets serve dual roles: enabling comprehensive data exploration and analysis for understanding underlying challenges and method development, while also acting as a vital validation resource, demonstrating practical effectiveness. The proposed method detects anomalies and aids in their resolution, improving system performance characterization precision. It also reveals recurring data anomaly sources, offering insights for data collection and handling enhancement. Practitioners can gain valuable insights from the identified anomalous cycles in the real-world datasets along with the investigative process for root cause analyses and essential data cleaning steps.

Crawford, Aladsair J.↗

FL‐ADS: Federated learning anomaly detection system for distributed energy resource networks

Abstract With the ongoing development of Distributed Energy Resources (DER) communication networks, the imperative for strong cybersecurity and data privacy safeguards is increasingly evident. DER networks, which rely on protocols such as Distributed Network Protocol 3 and Modbus, are susceptible to cyberattacks such as data integrity breaches and denial of service due to their inherent security vulnerabilities. This paper introduces an innovative Federated Learning (FL)‐based anomaly detection system designed to enhance the security of DER networks while preserving data privacy. Our models leverage Vertical and Horizontal Federated Learning to enable collaborative learning while preserving data privacy, exchanging only non‐sensitive information, such as model parameters, and maintaining the privacy of DER clients' raw data. The effectiveness of the models is demonstrated through its evaluation on datasets representative of real‐world DER scenarios, showcasing significant improvements in accuracy and F1‐score across all clients compared to the traditional baseline model. Additionally, this work demonstrates a consistent reduction in loss function over multiple FL rounds, further validating its efficacy and offering a robust solution that balances effective anomaly detection with stringent data privacy needs.

Purohit, Shaurya [Iowa State University Ames Iowa ↗