Search NASA⌕ Search

SEARCH · Search NASA

Results for “data integration.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Acquisition of and Access to Research Omics Data

Omics data are essential for understanding the myriad and complex effects of space environments on humans. To assure maximum benefit from these kinds of data, the NASA Human Research Program Data Management Plan stipulates that human omics data should be archived within and accessed through the NASA Life Sciences Portal (NLSP). The NLSP has the capability to acquire and provision access to omics (and other kinds of) research results for individual and ad-hoc groups of subjects at the direction of institutional review boards, or other authorizing bodies or individuals, per institutional, program and investigation-specific policies and procedures. However, because some single-subject omics data, like CT scans and other kinds of large, complex biomedical data, could be used to identify heretofore unknown risks to the subject’s health, or, in certain cases, be used to identify a subject, NASA Policy Directive 7170.1 describes various policies regarding the management of and access to “research genetic testing” data, which includes many kinds of omics data. For example, NPD 7170.1 prohibits access to human research genetic data by NASA personnel who make employment decisions for the subjects from whom the data were obtained. To meet the objective of acquiring research omics data for NLSP in compliance with the policies in NPD 7170.1 and other applicable NASA policies, we designed NOMADS (the NLSP Omics Multimodal Acquisition of Data System), a new component that supports the transfer of large research data files, including research genetic testing data, using one of several different transfer mechanisms. The choice of mechanism is made by the submitter of the data, with guiding information from the system, and is likely to often be determined in large part by the nature and source location of the data. For example, for small files where the source data files are not already stored in a cloud storage system, users are likely to prefer to transfer their data to the NLSP via a web browser. Conversely, for large sets of files already organized and stored in a cloud storage system, users may opt for NOMAD’s cloud-to-cloud transfer method. All omics datasets targeted for the NASA Life Sciences Data Archive must pass a variety of quality checks to ensure data integrity and adherence to the standards defined by the LSDA Data Submission Guidelines (DSG) (see https://nlsp.nasa.gov/explore/lsdahome/datasubmit). These include requirements that data are consistent with open standards established by the omics community. Non-compliant data will not be accepted however archivists are available to advise submitters on how to revise data submissions and re-submit until compliance is achieved. Following compliance with the LSDA DSG, omics data next undergo a variety of additional quality checks to ensure the data meet omics community standards. Domain specific Omics data quality control tools and techniques are continually evolving and linked to the advancements in omics assays utilized and thus, the tools and techniques utilized by the LSDA for data quality control and validation will need to be sustained accordingly. All human omics data will be access controlled according to the policies described above, and requiring IRB approval for any additional access grants once the data are acquired (including access for analysis using the NLSP workspace tools).

Omics↗
NASA NTRS2024

Acquisition of and Access to Research Omics Data

Omics data are essential for understanding the myriad and complex effects of space environments on humans. To assure maximum benefit from these kinds of data, the NASA Human Research Program Data Management Plan stipulates that human omics data should be archived within and accessed through the NASA Life Sciences Portal (NLSP). The NLSP has the capability to acquire and provision access to omics (and other kinds of) research results for individual and ad-hoc groups of subjects at the direction of institutional review boards, or other authorizing bodies or individuals, per institutional, program and investigation-specific policies and procedures. However, because some single-subject omics data, like CT scans and other kinds of large, complex biomedical data, could be used to identify heretofore unknown risks to the subject’s health, or, in certain cases, be used to identify a subject, NASA Policy Directive 7170.1 describes various policies regarding the management of and access to “research genetic testing” data, which includes many kinds of omics data. For example, NPD 7170.1 prohibits access to human research genetic data by NASA personnel who make employment decisions for the subjects from whom the data were obtained. To meet the objective of acquiring research omics data for NLSP in compliance with the policies in NPD 7170.1 and other applicable NASA policies, we designed NOMADS (the NLSP Omics Multimodal Acquisition of Data System), a new component that supports the transfer of large research data files, including research genetic testing data, using one of several different transfer mechanisms. The choice of mechanism is made by the submitter of the data, with guiding information from the system, and is likely to often be determined in large part by the nature and source location of the data. For example, for small files where the source data files are not already stored in a cloud storage system, users are likely to prefer to transfer their data to the NLSP via a web browser. Conversely, for large sets of files already organized and stored in a cloud storage system, users may opt for NOMAD’s cloud-to-cloud transfer method. All omics datasets targeted for the NASA Life Sciences Data Archive must pass a variety of quality checks to ensure data integrity and adherence to the standards defined by the LSDA Data Submission Guidelines (DSG) (see https://nlsp.nasa.gov/explore/lsdahome/datasubmit). These include requirements that data are consistent with open standards established by the omics community. Non-compliant data will not be accepted however archivists are available to advise submitters on how to revise data submissions and re-submit until compliance is achieved. Following compliance with the LSDA DSG, omics data next undergo a variety of additional quality checks to ensure the data meet omics community standards. Domain specific Omics data quality control tools and techniques are continually evolving and linked to the advancements in omics assays utilized and thus, the tools and techniques utilized by the LSDA for data quality control and validation will need to be sustained accordingly. All human omics data will be access controlled according to the policies described above, and requiring IRB approval for any additional access grants once the data are acquired (including access for analysis using the NLSP workspace tools).

Omics↗
NASA NTRS1983

The Integrated Sensor System Data Enhancement Package

The purpose of the Integrated Sensor System (ISS) Data Enhancement Package (DEP) is to improve the accuracies of the data obtained from the inflight tests performed on aircraft. The DEP is a microprocessor-based, flight-qualified electronics package that assimilates data from a Ring Laser Gyro (RGL) system, a standard NASA air data package, and other inputs. The DEP then processes these inputs in real-time to obtain optimal estimates of the aircraft velocity, attitude, and altitude. These estimates can be passed to the flight crew, downlinked, and/or stored on a mass storage medium. The DEP is now being built for the NASA Dryden Flight Research Center. Completion is anticipated in early 1984. A primary use of the ISS/DEP will be for the collection of quality data for the estimation of aircraft aerodynamic coefficients, including stability derivatives, using system identification methods. Initial anticipated applications will be on the AV-8B, F-14, and X-29 test aircraft.

Trankle, T. L.↗
DOE OSTI2015

Comparing probabilistic and descriptive analyses of time–dose–toxicity relationship for determining no-observed-adverse-effect level in drug development

The no-observed-adverse-effect level (NOAEL) of a drug defined from animal studies is important for inferring a maximal safe dose in human. However, several issues are associated with its concept, determination and application. It is confined to the actual doses used in the study; becomes lower with increasing sample size or dose levels; and reflects the risk level seen in the experiment rather than what may be relevant for human. We explored a pharmacometric approach in an attempt to address these issues. We first used simulation to examine the behaviour of the NOAEL values as determined by current common practice; and then fitted the probability of toxicity as a function of treatment duration and dose to data collected from all applicable toxicology studies of a test compound. Our investigation was in the context of an irreversible toxicity that is detected at the end of the study. Simulations illustrated NOAEL's dependency on experimental factors such as dose and sample size, as well as the underlying uncertainty. Modelling the probability as a continuous function of treatment duration and dose simultaneously to data from multiple studies allowed the estimation of the dose, along with its confidence interval, for a maximal risk level that might be deemed as acceptable for human. The model-based data integration also reconciled between-study inconsistency and explicitly provided maximised estimation confidence. Such alternative NOAEL determination method should be explored for its more efficient data use, more quantifiable insight to toxic doses, and the potential for more relevant animal-to-human translation. - Highlights: • Simulations revealed issues with NOAEL concept, determination and application. • Probabilistic modelling was used to address these issues. • The model integrated time-dose-toxicity data from multiple studies. • The approach uses data efficiently and may allow more meaningful human translation.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2015

SOAREX-8 Suborbital Experiments 2015 - A New Paradigm for Small Spacecraft Communication

In 2015 NASA plans to launch a payload to 280 Km altitude on a sounding rocket from the Wallops Flight Facility. This payload will contain several novel technologies that work together to demonstrate methodologies for space sample return missions and for nanosatellite communications in general. The payload will deploy and test an Exo-Brake, which slows the payload aerodynamically, providing eventual de-orbit and recovery of future ISS samples through a Small Payload Quick Return project. In addition, this flight addresses future Mars mission entry technology, space-to-space communications using the Iridium Short Messaging Service (SMS), GPS tracking, and wireless sensors using the ZigBee protocol. SOAREX-8 is being assembled and tested at Ames Research Center (ARC) and the NASA Engineering and Safety Center (NESC) is funding sensor and communications work. Open source Arduino technology and software are used for system control. The ZigBee modules used are XBee units that connect analog sensors for temperature, air pressure and acceleration measurement wirelessly to the payload telemetry system. Our team is developing methods for power distribution and module mounting, along with software for sensor integration, data assembly and downlink. We have demonstrated relaying telemetry to the ground using the Iridium satellite constellation on a previous flight, but the upcoming flight will be the first time we integrate useful flight test data from a ZigBee wireless sensor network. Wireless sensor data will measure the aerodynamic efficacy of the Exo-Brake permitting further on orbit flight tests of improved designs. The Exo-Brake is 5 sq m in area and will be stored in a container and deployed during ascent once the payload is jettisoned from the launch vehicle. We intend to further refine the hardware and continue testing on balloon launches, future sounding rocket flights and on nanosatellite missions. The use of standards-based and open source hardware/software has allowed for this project to be completed with a very modest budget and a challenging schedule. There is a wealth of hardware and software available for both the Arduino platform and the XBee, all low-cost or open-source. Along with the Exo-Brake hardware and deployment discussion, this paper will describe in detail the system architecture emphasizing the successful use of open source hardware and software to minimize effort and cost. Testing procedures, radio frequency interference (RFI) mitigation, success criteria and expected results will also be discussed. The use of Iridium short messaging capability for space-to-space links, standards-based wireless sensor networks, and other innovative communications technology are also presented.

aerobrake↗
NASA NTRS2010

Cross-Characterization of Aerosol Properties from Multiple Spaceborne Sensors Facilitated by Regional Ground-Based Observations

Aerosol observations from space have become a standard source for retrieval of aerosol properties on both regional and global scales. Indeed, the large number of currently operational spaceborne sensors provides for unprecedented access to the most complete set of complimentary aerosol measurements ever to be available. Nonetheless, this resource remains under-utilized, largely due to the discrepancies and differences existing between the sensors and their aerosol products. To characterize the inconsistencies and bridge the gap that exists between the sensors, we have designed and implemented an online Multi-sensor Aerosol Products Sampling System (MAPSS) that facilitates the joint sampling of aerosol data from multiple sensors. MAPSS consistently samples aerosol products from multiple spaceborne sensors using a unified spatial and temporal resolution, where each dataset is sampled over Aerosol Robotic Network (AERONET) locations together with coincident AERONET data samples. In this way, MAPSS enables a direct cross-characterization and data integration between aerosol products from multiple sensors. Moreover, the well-characterized co-located ground-based AERONET data provides the basis for the integrated validation of these products.

Petrenko, Maksym↗
NASA NTRS2003

SemanticOrganizer Brings Teams Together

SemanticOrganizer enables researchers in different locations to share, search for, and integrate data. Its customizable semantic links offer fast access to interrelated information. This knowledge management and information integration tool also supports real-time instrument data collection and collaborative image annotation.

Laufenberg, Lawrence↗
DOE OSTI2025

Postearthquake Damage Mapping via Remote Sensing: Lessons From the 2023 Türkiye Disaster

This review addresses the urgent need for scalable, accurate, and reproducible remote sensing solutions following the February 2023 Türkiye earthquakes. It synthesizes the contributions of five peer-reviewed studies published in the IEEE JSTARS Special Issue on postearthquake damage and risk assessment. These studies cover areas such as damage classification with deep learning, fusion of multisource remote sensing data, creation of benchmark datasets, detailed damage mapping, and analysis of geophysical signals using outgoing longwave radiation. The article summarizes the methodological approaches and the practical relevance of the reviewed studies for detecting, evaluating, and quantifying damage, and outlines key challenges, including model generalization, class ambiguity, and data integration. It also discusses emerging trends, including explainable artificial intelligence, multimodal data fusion, and open-data platforms. This synthesis provides a foundation for building robust, interpretable, and real-time disaster response systems and aims to guide future research in earthquake-related Earth observation and rapid damage assessment.

Taskin, Gulsen [Istanbul Technical University] (OR↗
DOE OSTI2019

Description of the ARM Large-Scale Forcing Data from the Constrained Variational Analysis (VARANAL) Version 2

This technical report represents an update of the previous technical report written by Zhang et al., which described the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility constrained variational analysis (VARANAL) that is used to develop the large-scale forcing data for driving single-column models (SCMs), cloud-resolving models (CRMs), and large-eddy simulation models (LES). The VARANAL algorithm was originally developed by Zhang and Lin and Zhang et al. at Stony Brook University and was migrated to the Lawrence Livermore National Laboratory (LLNL) as the ARM operational objective analysis system in May 1999. Since then, the algorithm has been evolved with time along with the availability of new observations and techniques to meet various modeling needs. Major updates include: 1. The method used to develop multi-year continuous forcing data, 2. The incorporation of eddy correlation flux measurement system (ECOR) turbulent fluxes into the analysis, and 3. Improvements to the workflow (e.g., implementing part of the code into the ARM Data Integrator [ADI]) to increase efficiency. The ARM large-scale forcing data have been widely used for SCM/CRM/LES to understand and improve physical processes in models. Zhang et al. has provided a comprehensive review of the SCM concept, early efforts to derive forcing data for SCM studies, efforts of the ARM constrained variational analysis, and previous SCM studies using ARM cases. This technical report focuses on the constrained variational analysis algorithm and the introduction of the ARM VARANAL products. We also extended the VARANAL algorithm into a three-dimensional constrained variational analysis (3DCVA) and designed an ensemble framework to address the forcing uncertainty. The 3D large-scale forcing data are released as another datastream named “varanal3d”. Please refer to the ARM varanal3d technical report for more information.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Description of the ARM Large-Scale Forcing Data from the Constrained Variational Analysis (VARANAL) Version 2

This technical report represents an update of the previous technical report written by Zhang et al. (2001a) (available at http://www.arm.gov/publications/tech_reports/arm-tr-005.pdf), which described the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility constrained variational analysis (VARANAL) that is used to develop the large-scale forcing data for driving single-column models (SCMs), cloud-resolving models (CRMs), and large-eddy simulation models (LES). The VARANAL algorithm was originally developed by Zhang and Lin (1997) and Zhang et al. (2001b) at Stony Brook University and was migrated to the Lawrence Livermore National Laboratory (LLNL) as the ARM operational objective analysis system in May 1999. Since then, the algorithm has been evolved with time along with the availability of new observations and techniques to meet various modeling needs. Major updates include: (1) The method used to develop multi-year continuous forcing data (Xie et al. 2004), (2) The incorporation of eddy correlation flux measurement system (ECOR) turbulent fluxes into the analysis (Tang et al. 2019), and (3) Improvements to the workflow (e.g., implementing part of the code into the ARM Data Integrator [ADI]) to increase efficiency. The ARM large-scale forcing data have been widely used for SCM/CRM/LES to understand and improve physical processes in models. Zhang et al. (2016) has provided a comprehensive review of the SCM concept, early efforts to derive forcing data for SCM studies, efforts of the ARM constrained variational analysis, and previous SCM studies using ARM cases. This technical report focuses on the constrained variational analysis algorithm and the introduction of the ARM VARANAL products.

58 GEOSCIENCES↗
DOE OSTI2022

Discovery of Signatures, Anomalies, and Precursors in Synchrophasor Data with Matrix Profile and Deep Recurrent Neural Networks (Final Project Report)

The widespread deployment of phasor measurement unit (PMU) across the U.S. together with the burgeoning machine learning technology made it possible to develop data-driven PMU data analytics to improve grid security and reliability in a more insightful and effective manner. Although PMU applications have been explored for over a decade, the representative PMU usage is limited to the bulk power system monitoring mainly due to the data integrity issues associated with PMUs (typically missing, fragmented, and wrongly amplified data). To forge a breakthrough on this stalemate and embrace PMUs for power system control and protection as well, we applied various advanced machine learning and big data analysis technology to the power system event detection and classification as the first step toward the power system control and protection pertaining to grid security enhancement.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Generalized Bayesian Monte Carlo Evaluation [Slides]

Bayesian Monte Carlo is a tool to address imperfect data & models, non-linear models, non-normal PDFs, and integration of differential and integral data. Simple propagation to criticality shows effects of new $\mathcal{L}$($β|z,γ$).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Core Model Proposal #410: Updates to Socioeconomic and Macroeconomic Data, Processing Structure, and Visualization

This Core Model Proposal (CMP) comprehensively restructures and updates the macroeconomic and socioeconomic modules in gcamdata. It includes visualizations of key data inputs, accounting identities, and data flows in the context of GCAM-Macro-KLEM. Major improvements include: (1) updating the Penn World Table (PWT) to version 10 and incorporating a new source, the Global Macro Database (GMD); (2) updating the SSP socioeconomics database from version 3.0.1 to 3.2; (3) introducing SSP-specific differentiation of employment and labor force data; (4) improving data integration between national accounts (from PWT, GMD, and GTAP) and GDP/population data from external sources; and (5) general data cleaning and structural refinements. We document the data sources and key assumptions used throughout the processing. These updates establish the foundation for the forthcoming KLEAM version of GCAM-macro.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1995

Selecting a general-purpose data compression algorithm

The National Space Science Data Center's Common Data Formate (CDF) is capable of storing many types of data such as scalar data items, vectors, and multidimensional arrays of bytes, integers, or floating point values. However, regardless of the dimensionality and data type, the data break down into a sequence of bytes that can be fed into a data compression function to reduce the amount of data without losing data integrity and thus remaining fully reconstructible. Because of the diversity of data types and high performance speed requirements, a general-purpose, fast, simple data compression algorithm is required to incorporate data compression into CDF. The questions to ask are how to evaluate and compare compression algorithms, and what compression algorithm meets all requirements. The object of this paper is to address these questions and determine the most appropriate compression algorithm to use within the CDF data management package that would be applicable to other software packages with similar data compression needs.

Mathews, Gary Jason↗
NASA NTRS2017

Take-off Engine Particle Emission Indices for In-Service Aircraft at Los Angeles International Airport

We present ground‐based, advected aircraft engine emissions from flights taking off at Los Angeles International Airport. 275 discrete engine take‐off plumes were observed on 18 and 25 May 2014 at a distance of 400 m downwind of the runway. CO2 measurements are used to convert the aerosol data into plume‐average emissions indices that are suitable for modelling aircraft emissions. Total and non‐volatile particle number EIs are of order 1016‐1017 kg‐1 and 1014‐1016 kg‐1, respectively. Black‐carbon‐equivalent particle mass EIs vary between 175‐941 mg kg‐1 (except for the GE GEnx engines at 46 mg kg‐1). Aircraft tail numbers recorded for each take‐off event are used to incorporate aircraft‐ and engine‐specific parameters into the data set. Data acquisition and processing follow standard methods for quality assurance. A unique aspect of the data set is the mapping of aerosol concentration time series to integrated plume EIs, aircraft and engine specifications, and manufacturer‐reported engine emissions certifications. The integrated data enable future studies seeking to understand and model aircraft emissions and their impact on air quality.

Richard H Moore↗
NASA NTRS2019

A Web of Data Analytics Services

Cloud Computing has become the ubiquitous approach to our Big Data challenge. However, one will quickly discover that moving (a.k.a. forklifting) existing on-premise data analytics solutions to the Cloud doesn’t always translate to costing saving and performance boost. The Cloud’s elasticity, its availability, and its wide selection of computing options and selections of costing models making Cloud an attractive environment to tackle our Big Data challenge. The fact is Cloud, on its own, is not the silver bullet to our daunting challenge need for analyze and derive scientific inferences through vast collections of multi-sensor measurements. We would like to have all scientific data in one easy to access environment, but getting the world of scientific data in one analytic system is immensely difficult to achieve. This paper describes the data analytics web architecture NASA is developing by infusing instances of Integrated Data Analytics systems next to the data. The goal is to minimize unnecessary data movement through collection of data access and analytics webservices for researchers to interact with and analyze measurements without have to download data to their local computer. These services are RESTful and provisioned by the data centers with the help from subject matter and science experts. These services encapsulate the physical computing infrastructure, which could local computing cluster, on-premise or public Cloud environment.

Huang, Thomas↗
DOE OSTI2022

Module-OT: A Turnkey Solution for Securing Energy Systems

The Modular Security Apparatus for Managing Distributed Cryptography for Command-and-Control Messages on Operational Technology Networks (Module-OT) is a flexible and lightweight solution for grid-edge devices focusing on end-to-end security. It is a bump- in- the-wire solution acting as a secure conduit for data between devices or systems across a network. It improves the cybersecurity posture of DER systems by providing authentication, authorization, and data integrity to secure DER communications. Additionally, it performs key management, provides data security through whitelisting Internet Protocol addresses and ports, blocks unauthorized connections, controls user access, and allows serial or Ethernet connections for added flexibility. The core software is portable to various Linux-based operating systems and is developed to be customized by the developer and researcher communities. Module-OT has been validated in the lab, has been demonstrated at a 500-KW PV-plus-storage site, and has been proven ready to secure operational technology devices. Its core functionality meets current standards, including validation procedures of the NIST Cryptographic Algorithm Validation Program (CAVP) and the Federal Information Processing Standard (FIPS 140-2). Because of its capability to provide an accessible and affordable option for stepping up security across modern energy systems, Module-OT can serve as an effective technological option to standardize cybersecurity moving forward.

cryptography↗