Search NASA⌕ Search

SEARCH · Search NASA

Results for “data access”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

End-to-End Data Movement Using MPI-IO Over Routed Terabots Infrastructures

Scientific discovery is nowadays driven by large-scale simulations running on massively parallel high-performance computing (HPC) systems. These applications each generate a large amount of data, which then needs to be post-processed for example for data mining or visualization. Unfortunately, the computing platform used for post processing might be different from the one on which the data is initially generated, introducing the challenge of moving large amount of data between computing platforms. This is especially challenging when these two platforms are geographically separated since the data needs to be moved between computing facilities. This is even more critical when scientists tightly couple their domain specific applications with a post processing application. The paper presents a solution for the data transfer between MPI applications using a dedicated wide area network (WAN) terabit infrastructure. The proposed solution is based on parallel access to data files and the Message Passing Interface (MPI) over the Common Communication Infrastructure (CCI) for the data transfer over a routed infrastructure. In the context of this research, the Energy Sciences Network (ESnet) of the U.S. Department of Energy (DOE) is targeted for the transfer of data between DOE national laboratories.

Vallee, Geoffroy R↗

Agilent CRADA (Abstract)

The CRADA between Agilent Technologies Inc. and Battelle will focus on five software components as listed below: Prototype 4D Feature Finding functionality with a particular focus on recovering low level features and extending the bottom end dynamic range of IM-MS technology. Compare and contrast developments to current 4D Feature Finding capabilities. Highlight important algorithmic aspects employed. Implement the PNNL saturation correction algorithm. Agilent will give PNNL the needed data file access API and assistance in understanding it implementation and any needed instrumental aspects. Supported high resolution products to include Agilent’s TOF, QTOF and IM-QTOF mass spectrometers. PNNL will then work with Agilent to benchmark performance. Implementation of the PNNL Hadamard de-multiplexing algorithm. Agilent will give provide PNNL the needed date file access API access and as needed assistance in understanding the current Agilent multiplexed IM offering. PNNL will then work with Agilent on benchmark performance. Add ion mobility collision cross sections to existing and new metabolomic libraries for data analysis with Agilent’s informatics program MPP/ID Browser. PNNL will work with Agilent to create a software pipeline that takes data from chemical and metabolic standards and properly formats it for inclusion in MPP accessible libraries, using the collision cross section as a new separation dimension. Improvements of MPP multidimensional matching to identify metabolomic features using multiple characteristics beyond retention time and accurate mass. Most significantly matching will include analyte collision cross section with proposed support for sample fraction or RapidFire cartridge and fragmentation spectra. PNNL will work with Agilent to modify and improve the current MPP analysis pipeline to allow for creating, aligning, and identifying MS features defined by accurate mass, collision cross section and chromatographic retention time. As additional criteria such as fraction or RapidFire cartridge type are supported in the identification process, then they also will become part of the automation workflow. This includes the automation of said system to work with command line program (i.e. not a GUI) sufficient for programmatic execution in a pipeline.

97 MATHEMATICS AND COMPUTING↗

SU-D-BRD-01: An Automated Physics Weekly Chart Checking System Supporting ARIA

Purpose: A software tool was developed in this study to perform automatic weekly physics chart check on the patient data in ARIA. The tool accesses the electronic patient data directly from ARIA server and checks the accuracy of treatment deliveries, and generates reports which summarize the delivery history and highlight the errors. Methods: The tool has four modules. 1) The database interface is designed to directly access treatment delivery data from the ARIA database before reorganizing the data into the patient chart tree (PCT). 2) PCT is a core data structure designed to store and organize the data in logical hierarchies, and to be passed among functions. 3) The treatment data check module analyzes the organized data in PCT and stores the checking results into PCT. 4) Report generation module generates reports containing the treatment delivery summary, chart checking results and plots of daily treatment setup parameters (couch table positions, shifts of image guidance). The errors that are found by the tool are highlighted with colors. Results: The weekly check tool has been implemented in MATLAB and clinically tested at two major cancer centers. Javascript, cascading style sheets (CSS) and dynamic HTML were employed to create the user-interactive reports. It takes 0.06 second to search the delivery records of one beam with PCT and compare the delivery records with beam plan. The reports, saved in the HTML files on shared network folder, can be accessed by web browser on computers and mobile devices. Conclusion: The presented weekly check tool is useful to check the electronic patient treatment data in Varian ARIA system. It could be more efficient and reliable than the manually check by physicists. The work was partially supported by a research grant from Varian Medical System.

60 APPLIED LIFE SCIENCES↗

Missile Captive Carry Monitoring and Helicopter Identification Using a Capacitive Microelectromechanical Systems Accelerometer

Military missiles are exposed to many sources of mechanical vibration that can affect system reliability, safety, and mission effectiveness. The U. S. Army Aviation and Missile Research Development and Engineering Center (AMRDEC) has been developing missile health monitoring systems to assess and improve reliability, reduce life cycle costs, and increase system readiness. One of the most significant exposures to vibration occurs when the missile is being carried by a helicopter or other aviation platform, which is a condition known as captive carry. Recording the duration of captive carry exposure during the missile’s service life can enable the implementation of predictive maintenance and resource management programs. Since the vibration imparted by each class of helicopter varies in frequency and amplitude, tracking the vibration exposure from each helicopter separately can help quantify the severity and harmonic content of the exposure. Under the direction of AMRDEC staff, engineers at the Pacific Northwest National Laboratory have developed a Captive Carry Health Monitor (CCHM) for the Hellfire II missile. The CCHM is an embedded usage monitoring device installed on the outer skin of the Hellfire II missile to record the cumulative hours the host missile has been in captive carry mode. To classify the vibration by class of helicopter, the CCHM analyzes the amplitude and frequency content of the vibration with the Goertzel algorithm to detect the presence of distinctive rotor harmonics. Cumulative usage data are accessible in theater from an external display; monthly usage histograms are accessible through an internal download connector. This paper provides an overview of the CCHM electrical and package design, describes field testing and data analysis techniques used to monitor captive carry identify and the class of helicopter, and discusses the potential application of missile health and usage data for real-time reliability analysis and fleet management.

Goertzel, HUMS↗

OEDI—Solar Grid Integration Data and Analytics Library

As a part of the Open Energy Data Initiative, this effort aims to develop and demonstrate novel distribution state estimation, control optimization, and transient analysis as well as provide access to data, data integration, and mapping information. More specifically, the focus of the effort will be on physics-based distribution system state estimation, hybrid (physics-based and machine learning) distribution optimal power flow, and event detection/analysis for solar integration and analytics. This work will enable reproducible, robust, replicable, and generalizable R&D in simulation and emulation of solar system integration. These test models and datasets will provide an integrated library for developing and testing power system operation technologies. To make the library user-friendly, this project will provide data curation tools such as data translators, mapping scripts and APIs, database schemas and metadata, interfaces and user dashboard, source code for the reference algorithms, description of the use-cases/scenarios, and comprehensive information on all the assumptions.

14 SOLAR ENERGY↗

Volatile Organic Compounds and Meteorological Conditions in the Missouri Ozark AmeriFlux (MOFLUX) Site, 2023

This data set contains measurements of atmospheric components and meteorological conditions of central Missouri, United States during the summer of 2023. Data serve to examine the impact of meteorological conditions relevant to future climate on the emission and transformation of volatile organic compounds (VOCs). During the field campaign, researchers were also able to incorporate opportunistic analyses of the long-range transport of smoke plumes generated from extreme forest fire activities in Canada. VOC measurements were conducted at the Missouri Ozark AmeriFlux (MOFLUX) site (latitude 38.7441, longitude −92.2000) using a proton transfer reaction time of flight mass spectrometer (PTR-ToF-MS 6000 X2). The sampling campaign was conducted during the summer of 2023 (2023-06-25 to 2023-08-12) with measurements being taken at high temporal resolution (1 hour). Particular VOCs analyzed include: Methanol, Acetonitrile, Acetone, Isoprene, Methylvinyl ketone (MVK) and methacrolein (MACr), Benzene, Toluene, Catechol, and Monoterpene. Meteorological parameters included in this dataset were collected from a nearby Columbia Regional Airport (~10 km). Global solar radiation data were measured at a weather site in Ashland, MO, 5.22 km from the MOFLUX tower. The data were accessed using the MesoWest online website (https://mesowest.utah.edu/) provided by the Department of Atmospheric Sciences, University of Utah. Discussion of the data providers, database, and dissemination were highlighted in prior studies (Horel et al., 2002a; Horel et al., 2002b) . Smoke mixing ratios (in mg m−3) were estimated from the High-Resolution Rapid Refresh (HRRR) 3 km weather model for Missouri at 6-hour intervals (Dowell et al., 2022). This dataset contains three data files in comma separate (*.csv) format. Additional metadata are provided: three data dictionaries and a file-level metadata file in comma separate (*.csv) format and a user guide in PDF (*.pdf) format.

Acetone↗

Data catalog project—A browsable, searchable, metadata system

Modern experiments are typically conducted by large, extended groups, where researchers rely on other team members to produce much of the data they use. The experiments record very large numbers of measurements that can be difficult for users to find, access and understand. Here. we are developing a system for users to annotate their data products with structured metadata, providing data consumers with a discoverable, browsable data index. Machine understandable metadata captures the underlying semantics of the recorded data, which can then be consumed by both programs, and interactively by users. Collaborators can use these metadata to select and understand recorded measurements. The data catalog project is a data dictionary and index which enables users to record general descriptive metadata, use cases and rendering information as well as providing them a transparent data access mechanism (URI). Users describe their diagnostic including references, text descriptions, units, labels, example data instances, author contact information and data access URIs. The list of possible attribute labels is extensible, but limiting the vocabulary of names increases the utility of the system. The data catalog is focused on the data products and complements process-based systems like the Metadata Ontology Provenance project [Greenwald, 2012; Schissel, 2015]. This system can be coupled with MDSplus to provide a simple platform for data driven display and analysis programs. Sites which use MDSplus can describe tree branches, and if desired create ‘processed data trees’ with homogeneous node structures for measurements. Sites not currently using MDSplus can either use the database to reference local data stores, or construct an MDSplus tree whose leaves reference the local data store. A data catalog system can provide a useful roadmap of data acquired from experiments or simulations making it easier for researchers to find and access important data and understand the meaning of the data and how it was obtained. This is particularly useful in research facilities that study the results of many different experiments or simulations and may not know the intricacies of the data organization in use where the data was generated. It is also possible to store a local copy of key data items in local MDSplus trees and then add processed data to the local catalog.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A product data network to enable faster, easier, and better planning of building envelopes

The building envelopes contributes significantly to the energy-efficiency of the building. Building performance simulation has made it possible to compare façade technologies regarding energy demand, daylighting, thermal and visual comfort in detail. Planners, such as architects and engineers, need experience to find product data with the right quality and level of detail, and to process the data to fit the calculation and the application. In the available time, planners can compare only a limited number of products, which means that better solutions could go unnoticed. This paper presents a new concept for making product data easily accessible for building façade planning. The concept consists of a network of databases for the efficient exchange and use of optical and calorimetric data of glazing units, shading devices, and combinations of both. The paper presents the research questions, an analysis of the current challenges, six design goals for the product data network and its implementation together with a discussion. Many product data sources can be connected to many planning software applications via the specified application programming interface. When planning software connects to the product data network, the planning of building envelopes can be much faster because planners do not need to spend so much time to search and process product data manually. The planning of building envelopes can also become much easier, especially for planners with limited experience. They do not need to understand all the details about which data fits which calculation if the software company implements this. The planning of building envelopes can become much more reliable when software companies validate their use of the product data network, because the current manual process is prone to errors. The planning of building envelopes can also improve because more products can be compared in the available time, allowing better solutions to be found.

Maurer, Christoph↗

Automated frequency standard stability data reduction

A design using a medium sized computer, a fiber optic communication link, and a desk top computer to reduce data collected at a remote site for analysis of frequency standard tests is described. Data generated at the Interim Frequency Standards Test Facility is collected on magnetic tape, which is then transported to a Sigma 5 computer. An Allan variance (two sample variance) is then calculated. The Allan variance (sigma vs tau) is then written to a data file in the Sigma 5. A fiber optic communication link between the Sigma 5 and a desk top computer was designed to transmit data in the Sigma 5 file to the desk top computer. A program was written for the desk top computer that will automatically access the data file in the Sigma 5, process the data and provide a data plot.

Knapp, L. J.↗

Registratiom of TM data to digital elevation models

Several problems arise when attempting to register LANDSAT thematic mapper data to U.S. B Geological Survey digital elevation models (DEMs). The TM data are currently available only in a rotated variant of the Space Oblique Mercator (SOM) map projection. Geometric transforms are thus; required to access TM data in the geodetic coordinates used by the DEMs. Due to positional errors in the TM data, these transforms require some sort of external control. The spatial resolution of TM data exceeds that of the most commonly DEM data. Oversampling DEM data to TM resolution introduces systematic noise. Common terrain processing algorithms (e.g., close computation) compound this problem by acting as high-pass filters.

Source record↗

PDS Lunar Data Node Restoration of Apollo In-Situ Surface Data

The Apollo missions between 1969 and 1972 deployed scientific instruments on the Moon's surface which made in-situ measurements of the lunar environment. Apollo II had the short-term Early Apollo Surface Experiments Package (EASEP) and Apollos 12, 14, 15, 16, and 17 each set up an Apollo Lunar Surface Experiments Package (ALSEP). Each ALSEP package contained a different suite of instruments which took measurements and radioed the results back to Earth over periods from 5 to 7 years until they were turned off on 30 September 1977. To this day the ALSEP data remain the only long-term in-situ information on the Moon's surface environment. The Lunar Data Node (LDN) has been formed under the auspices of the Planetary Data System (PDS) Geosciences Node to put relevant, scientifically important Apollo data into accessible digital form for use by researchers and mission planners. We will report on progress made since last year and plans for future data restorations.

Williams, David R.↗

NASA's Earth Science Data Systems - Lessons Learned and Future Directions

In order to meet the increasing demand for Earth Science data, NASA has significantly improved the Earth Science Data Systems over the last two decades. This improvement is reviewed in this slide presentation. Many Earth Science disciplines have been able to access the data that is held in the Earth Observing System (EOS) Data and Information System (EOSDIS) at the Distributed Active Archive Centers (DAACs) that forms the core of the data system.

Ramapriyan, Hampapuram K.↗

Benefits of International Collaboration on the International Space Station

The International Space Station is a valuable platform for research in space, but the benefits are limited if research is only conducted by individual countries. Through the efforts of the ISS Program Science Forum, international science working groups, and interagency cooperation, international collaboration on the ISS has expanded as ISS utilization has matured. Members of science teams benefit from working with counterparts in other countries. Scientists and institutions bring years of experience and specialized expertise to collaborative investigations, leading to new perspectives and approaches to scientific challenges. Combining new ideas and historical results brings synergy and improved peer-reviewed scientific methods and results. World-class research facilities can be expensive and logistically complicated, jeopardizing their full utilization. Experiments that would be prohibitively expensive for a single country can be achieved through contributions of resources from two or more countries, such as crew time, up- and down mass, and experiment hardware. Cooperation also avoids duplication of experiments and hardware among agencies. Biomedical experiments can be completed earlier if astronauts or cosmonauts from multiple agencies participate. Countries responding to natural disasters benefit from ISS imagery assets, even if the country has no space agency of its own. Students around the world participate in ISS educational opportunities, and work with students in other countries, through open curriculum packages and through international competitions. Even experiments conducted by a single country can benefit scientists around the world, through specimen sharing programs and publicly accessible "open data" repositories. For ISS data, these repositories include GeneLab, the Physical Science Informatics System, and different Earth data systems. Scientists can conduct new research using ISS data without having to launch and execute their own experiments. Multilateral collections of research results publications, maintained by the ISS international partnership and accessible via nasa.gov, make ISS results available worldwide, and encourage new users, ideas and research.

Hasbrook, Pete↗

Benefits of International Collaboration on the International Space Station

The International Space Station is a valuable platform for research in space, but the benefits are limited if research is only conducted by individual countries. Through the efforts of the ISS Program Science Forum, international science working groups, and interagency cooperation, international collaboration on the ISS has expanded as ISS utilization has matured. Members of science teams benefit from working with counterparts in other countries. Scientists and institutions bring years of experience and specialized expertise to collaborative investigations, leading to new perspectives and approaches to scientific challenges. Combining new ideas and historical results brings synergy and improved peer-reviewed scientific methods and results. World-class research facilities can be expensive and logistically complicated, jeopardizing their full utilization. Experiments that would be prohibitively expensive for a single country can be achieved through contributions of resources from two or more countries, such as crew time, up- and downmass, and experiment hardware. Cooperation also avoids duplication of experiments and hardware among agencies. Biomedical experiments can be completed earlier if astronauts or cosmonauts from multiple agencies participate. Countries responding to natural disasters benefit from ISS imagery assets, even if the country has no space agency of its own. Students around the world participate in ISS educational opportunities, and work with students in other countries, through open curriculum packages and through international competitions. Even experiments conducted by a single country can benefit scientists around the world, through specimen sharing programs and publicly accessible "open data" repositories. For ISS data, these repositories include GeneLab and the Physical Science Informatics System. Scientists can conduct new research using ISS data without having to launch and execute their own experiments. Multilateral collections of research results publications, maintained by the ISS international partnership and accessible via nasa.gov, make ISS results available worldwide, and encourage new users, ideas and research. The paper explores international collaboration history, its evolution and maturation, change of focus during its different phases, and growth of its effectiveness (in accordance with the especially established criteria) in the light of benefits for the entire ISS community. With the International Space Station extended through at least 2024, more crew time becoming available and new facilities arriving on board the ISS, these benefits of international scientific collaboration on the ISS can only increase.

Hasbrook, Pete↗

Benefits of International Collaboration on the International Space Station

The International Space Station is a valuable platform for research in space, but the benefits are limited if research is only conducted by individual countries. Through the e orts of the ISS Program Science Forum, international science working groups, and interagency cooperation, international collaboration on the ISS has expanded as ISS utilization has matured. Members of science teams benefit from working with counterparts in other countries. Scientists and institutions bring years of experience and specialized expertise to collaborative investigations, leading to new perspectives and approaches to scientific challenges. Combining new ideas and historical results brings synergy and improved peer-reviewed scientific methods and results. World-class research facilities can be expensive and logistically complicated, jeopardizing their full utilization. Experiments that would be prohibitively expensive for a single country can be achieved through contributions of resources from two or more countries, such as crew time, up- and downmass, and experiment hardware. Cooperation also avoids duplication of experiments and hardware among agencies. Biomedical experiments can be completed earlier if astronauts or cosmonauts from multiple agencies participate. Countries responding to natural disasters benefit from ISS imagery assets, even if the country has no space agency of its own. Students around the world participate in ISS educational opportunities, and work with students in other countries, through open curriculum packages and through international competitions. Even experiments conducted by a single country can benefit scientists around the world, through specimen sharing programs and publicly accessible \open data" repositories. For ISS data, these repositories include GeneLab, the Physical Science Informatics System, and different Earth science data systems. Scientists can conduct new research using ISS data without having to launch and execute their own experiments. Multilateral collections of research results publications, maintained by the ISS international partnership and accessible via nasa.gov, make ISS results available worldwide, and encourage new users, ideas and research. The paper explores effectiveness of international collaboration in the course of the ISS Program execution. The collaboration history, its evolution and maturation, change of focus during its different phases, and growth of its effectiveness (in accordance with the especially established criteria) are also considered in the paper in the light of benefits for the entire ISS community. With the International Space Station extended through at least 2024, more crew time becoming available and new facilities arriving on board the ISS, these benefits of international scientific collaboration on the ISS can only increase.

Robinson, Julie A.↗

Fostering Remote Visualization: Experiences in Two Different HPC Sites

Visualization of scientific data is crucial for scientific discovery to gain insight into the results of simulations and experiments. Remote visualization is of crucial importance to access infrastructure, data and computational resources and, to avoid data movement from where data is produced and to where data will be analyzed. Remote visualization enables geographically diverse collaboration and enhances user experience through graphical user interfaces. This paper presents two approaches deployed by two different HPC centers: The SC3 - Supercomputación y Cálculo Científico Center in Colombia and the Oak Ridge Leadership Computing Facility in USA. We overview our remote visualization experiences, adopted technologies, use cases, and challenges encountered. Our contribution is to signal the commonality between approaches in terms of the end goal, showing their fitness for their contexts, while not focusing only on attempting to provide a general picture of remote visualization, given the differences between centers in terms of purposes, needs, resources, and national impact.

Gelvez Cortes, Sergio Augusto↗

Exploiting Internal Parallelism for Address Translation in Solid-State Drives

Solid-state Drives (SSDs) have changed the landscape of storage systems and present a promising storage solution for data-intensive applications due to their low latency, high bandwidth, and low power consumption compared to traditional hard disk drives. SSDs achieve these desirable characteristics using internal parallelism—parallel access to multiple internal flash memory chips—and a Flash Translation Layer (FTL) that determines where data are stored on those chips so that they do not wear out prematurely. However, current state-of-the-art cache-based FTLs like the Demand-based Flash Translation Layer (DFTL) do not allow IO schedulers to take full advantage of internal parallelism, because they impose a tight coupling between the logical-to-physical address translation and the data access. In this study to address this limitation, we introduce a new FTL design called Parallel-DFTL that works with the DFTL to decouple address translation operations from data accesses. Parallel-DFTL separates address translation and data access operations into different queues, allowing the SSD to use concurrent flash accesses for both types of operations. We also present a Parallel-LRU cache replacement algorithm to improve the concurrency of address translation operations. To compare Parallel-DFTL against existing FTL approaches, we present a Parallel-DFTL performance model and compare its predictions against those for DFTL and an ideal page-mapping approach. We also implemented the Parallel-DFTL approach in an SSD simulator using real device parameters, and used trace-driven simulation to evaluate Parallel-DFTL’s efficacy. Our evaluation results show that Parallel-DFTL improved the overall performance by up to 32% for the real IO workloads we tested, and by up to two orders of magnitude with synthetic test workloads. Finally, we also found that Parallel-DFTL is able to achieve reasonable performance with a very small cache size and that it provides the best benefit for those workloads with large request size or with high write ratio.

97 MATHEMATICS AND COMPUTING↗

Implementation of the Boston University Space Physics Acquisition Center

The tasks carried out during this grant achieved the goals as set forth in the initial proposal. The Boston University Space Physics Acquisition CEnter (BUSPACE) now provides World Wide Web access to data from a large suite of both space-based and ground-based instruments, archived from different missions, experiments, or campaigns in which researchers associated with the Center for Space Physics (CSP) at Boston University have been involved. These archival data sets are in digital form and are valuable for retrospective data analysis studies of magnetospheric as well as ionospheric, thermospheric, and mesospheric physics. We have leveraged our grass-roots effort with the NASA seed money to establish dedicated hardware (computer and hard disk augmentation) and student support to grow and maintain the system. This leveraging of effort now permits easy access by the space physics community to many underutilized, yet important data sets, one example being that of the SCATHA satellite.

Spence, Harlan E.↗