Search NASA⌕ Search

SEARCH · Search NASA

Results for “Relational data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Slycat™ User Manual

Slycat™ is a web-based system for performing data analysis and visualization of potentially large quantities of remote, high-dimensional data. Slycat™ specializes in working with ensemble data. An ensemble is a group of related data sets, which typically consists of a set of simulation runs exploring the same problem space. An ensemble can be thought of as a set of samples within a multi-variate domain, where each sample is a vector whose value defines a point in high-dimensional space. To understand and describe the underlying problem being modeled in the simulations, ensemble analysis looks for shared behaviors and common features across the group of runs. Additionally, ensemble analysis tries to quantify differences found in any members that deviate from the rest of the group. The Slycat™ system integrates data management, scalable analysis, and visualization. Results are viewed remotely on a user’s desktop via commodity web clients using a multi-tiered hierarchy of computation and data storage, as shown in Figure 1. Our goal is to operate on data as close to the source as possible, thereby reducing time and storage costs associated with data movement. Consequently, we are working to develop parallel analysis capabilities that operate on High Performance Computing (HPC) platforms, to explore approaches for reducing data size, and to implement strategies for staging computation across the Slycat™ hierarchy. Within Slycat™, data and visual analysis are organized around projects, which are shared by a project team. Project members are explicitly added, each with a designated set of permissions. Although users sign-in to access Slycat™, individual accounts are not maintained. Instead, authentication is used to determine project access. Within projects, Slycat™ models capture analysis results and enable data exploration through various visual representations. Although for scientists each simulation run is a model of real-world phenomena given certain conditions, we use the term model to refer to our modeling of the ensemble data, not the physics. Different model types often provide complementary perspectives on data features when analyzing the same data set. Each model visualizes data at several levels of abstraction, allowing the user to range from viewing the ensemble holistically to accessing numeric parameter values for a single run. Bookmarks provide a mechanism for sharing results, enabling interesting model states to be labeled and saved.

97 MATHEMATICS AND COMPUTING↗

Application of a Prize Mechanism to Address Data Utilization Challenges at Utilities

The electric industry sector is facing an “explosion” of data from a variety of sources. Electric sector stakeholders need to define how to capitalize on large datasets, both those they create and those from other sources (like data on weather, buildings, electric vehicles, etc.), to improve reliability and resilience and meet the changing system dynamics from renewable integration. For the electricity sector to fully utilize these vast new datasets, it must undergo a transformation in how it manages data quality, storage, and processing. The U.S. Department of Energy (DOE) Office of Electricity (OE) is committed to accelerating research, development, and demonstration of new technologies and tools within the electricity sector to advance reliability, resilience, and affordable operation of the power system. Through the prize mechanism, OE identified two widespread data-related challenges for utilities—load modeling and data analysis automation—and offered an opportunity for utilities and teams of software engineers to identify additional challenges faced by utilities. After completing one round of the American-Made Digitizing Utilities Prize, OE, the National Renewable Energy Laboratory (NREL) as the prize administrator, and Pacific Northwest National Laboratory (PNNL) as the domain experts have compiled the results and lessons learned to feed into the second round of the prize.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Transient Data Library of Solar Grid Integrated Distributed System

This submission contains an open-source library of transient events in distributed system with high solar PV. The library includes the collected data, related documents and scripts for loading the data. The data library is built for transient event detection and machine learning based analysis algorithm development. The data was collected via both field test and software simulation. The units for the data are included in the data file headers for each data series. A text editor or spreadsheet software, such as Excel, and Matlab is required to view the data.

algorithms↗

SPRUCE Peat Mercury, Methylmercury and Sulfur Concentrations from Experimental Plot Cores, 2012

This data set reports the results of analyses of peat core samples for total mercury and methylmercury, as well as carbon, nitrogen and sulfur. Samples were collected as part of a larger sampling campaign from the SPRUCE experimental study plots located in the S1-Bog. From 2012-08-13 to 2012-10-15, a team of SPRUCE investigators and collaborators collected core samples of peat in the SPRUCE experimental plots. The goal was to characterize the biological, physical, and chemical characteristics of peat, and how those characteristics changed throughout the depth profile of the bog, prior to the initialization of the SPRUCE experimental warming and CO2 treatments. Cores were collected from 16 experimental plots; peat cores were collected from the hummock and hollow surfaces to depths of 300 cm in 10 cm, 25, and 50 cm increments (Pierce et al, 2022). Three replicate cores were collected from both hummock and hollow locations in each plot. The coring locations within each plot were mapped. This dataset contains one file in comma separated (*.csv) format. User Note: The coring descriptions and some reported data are the same as in the related data set, Iverson et al. (2014). Samples for mercury and carbon, nitrogen and sulfur analyses by the University of Minnesota were collected as part of this sampling campaign.

54 ENVIRONMENTAL SCIENCES↗

Correlation of new hypervelocity impact data by threshold penetration relations

Threshold penetration data are established by impacting spherical projectiles onto 2024 aluminum single-wall targets. Nylon and cadmium projectiles were used at impacting velocities from 3.0 to 6.8 km/s and 7.9 to 8.5 km/s respectively. These data are combined with existing data and compared with three threshold relations to assess their respective validities over a wide range of projectile densities. Two of these relations were validated over the extended range of projectile densities.

Hayduk, R. J.↗

The integrated analysis capability (IAC Level 2.0)

The critical data management issues involved in the development of the integral analysis capability (IAC), Level 2, to support the design analysis and performance evaluation of large space structures, are examined. In particular, attention is given to the advantages and disadvantages of the formalized data base; merging of the matrix and relational data concepts; data types, query operators, and data handling; sequential versus direct-access files; local versus global data access; programming languages and host machines; and data flow techniques. The discussion also covers system architecture, recent system level enhancements, executive/user interface capabilities, and technology applications.

Frisch, Harold P.↗

Heterogeneous Data Fusion via Space Alignment Using Nonmetric Multidimensional Scaling

Heterogeneous data sets are typically represented in different feature spaces, making it difficult to analyze relationships spanning different data sets even when they are semantically related. Data fusion via space alignment can remedy this task by integrating multiple data sets lying in different spaces into one common space. Given a set of reference correspondence data that share the same semantic meaning across different spaces, space alignment attempts to place the corresponding reference data as close together as possible, and accordingly, the entire data are aligned in a common space. Space alignment involves optimizing two potentially conflicting criteria: minimum deformation of the original relationships and maximum alignment between the different spaces. To solve this problem, we provide a novel graph embedding framework for space alignment, which converts each data set into a graph and assigns zero distance between reference correspondence pairs resulting in a single graph. We propose a graph embedding method for fusion based on nonmetric multidimensional scaling (MDS). Its criteria using the rank order rather than the distance allows nonmetric MDS to effectively handle both deformation and alignment. Experiments using parallel data sets demonstrate that our approach works well in comparison to existing methods such as constrained Laplacian eigenmaps, Procrustes analysis, and tensor decomposition. We also present standard cross-domain information retrieval tests as well as interesting visualization examples using space alignment.

Alignment↗

Rdesign: A data dictionary with relational database design capabilities in Ada

Data Dictionary is defined to be the set of all data attributes, which describe data objects in terms of their intrinsic attributes, such as name, type, size, format and definition. It is recognized as the data base for the Information Resource Management, to facilitate understanding and communication about the relationship between systems applications and systems data usage and to help assist in achieving data independence by permitting systems applications to access data knowledge of the location or storage characteristics of the data in the system. A research and development effort to use Ada has produced a data dictionary with data base design capabilities. This project supports data specification and analysis and offers a choice of the relational, network, and hierarchical model for logical data based design. It provides a highly integrated set of analysis and design transformation tools which range from templates for data element definition, spreadsheet for defining functional dependencies, normalization, to logical design generator.

Lekkos, Anthony A.↗

Leaf gas exchange and fitted parameters, San Lorenzo, Panama, 2020

This data package contains photosynthetic CO2 response curves (ACi curves), light response curves (AQ curves), dark adapted dark respiration, conductance curves, and survey measurements for leaves measured at the San Lorenzo forest canopy crane site, Panama (PA-SLZ) from January to March 2020. Leaves were sampled from both the top of the canopy and multiple heights within the canopy from 10 vertical profiles and included around 50 species. In addition, six core species were also measured, from the top of the canopy. Fitted maximum carboxylation rate (Vcmax), maximum electron transport rate (Jmax), and triose phosphate utilization rate (TPU) were derived from measured data as well as the convexity, light use efficiency, apparent quantum yield, and Rdark. The measurements can also be used to derive the conductance parameters g0 and g1 of stomatal model. All the gas exchange data and metadata are presented in .csv files and complete instrument output are included in .zip folders. Data and metadata meet the ESS-DIVE leaf-level gas exchange reporting format requirements. The protocol details are provided as pdf documents. In addition to gas exchange data described here these samples were also used for measurement of leaf optical properties, carbon and nitrogen content, and leaf mass per unit leaf area (LMA) these data can be cross linked using the unique sample ID and are provided in separate related data packages. Sample information including canopy elevation and leaf area index (LAI) can be found in the related “Leaf and canopy traits” data package.

54 ENVIRONMENTAL SCIENCES↗

Climate data for bioclimate research of Amazon Basin central region near the city of Manaus

The current research/data set deals with environmental data related to the region around the city of Manaus, Brazil, located in the Amazon Basin central region. The research problem encompasses the answers to the questions: 'What correlations can arise from the data of climate and fauna in the Amazon Basin?" "How useful is the data from instrumented stations related to that area, related to the fauna and climatic conditions?" To answer these questions, an initial data set was generated, taking into account the main pollutants with sources from NASA satellites, the Amazon Tall Tower Observatory (ATTO) experiment, and the GOAmazon project, from 2014 to 2015, along with other local data, such as the position of thermal electric power stations. It has been worth noting the data available was not coherent among the sources, due to different measuring time intervals, heights, and geographical locations. Equally important, for future bioclimatic research, a grid space of 5-km interval and a 30-minute time period was considered within the data set, covering a surface area within the boundaries of Latitude 2.00 S to 4.25 S and Longitude 59.00 to 61.25 W. The data from NASA satellites, ATTO, and GOAmazon do not have this kind of detailed grid and time mesh. To carry on, the machine learning (ML) Random Forest (RF) algorithm was selected and used, among other ML algorithms, to fill in the data into this new grid. The features considered were: data from NASA satellites and from the two projects above, covering the pollutants: ozone, NOx, particulates with diameter down to 10 nanometers, isoprene, CO, and acetonitrile. Moreover, distances and bearings to Manaus and 11 thermal power stations nearby, night and day time periods, dry and wet seasons, were also considered to compose the features. The interpolation produced by the Random Forest algorithm aimed at the pollutants: acetonitrile, ozone, NOx, Particulate N, isoprene, and CO, which are related to bioclimatic research commonly. In total, a data set was created with 51,148,800 rows, with 44 columns, 38 for the features and 6 for the targets.

54 ENVIRONMENTAL SCIENCES↗

Operation of the Australian Store.Synchrotron for macromolecular crystallography

The Store.Synchrotron service, a fully functional, cloud computing-based solution to raw X-ray data archiving and dissemination at the Australian Synchrotron, is described. The Store.Synchrotron service, a fully functional, cloud computing-based solution to raw X-ray data archiving and dissemination at the Australian Synchrotron, is described. The service automatically receives and archives raw diffraction data, related metadata and preliminary results of automated data-processing workflows. Data are able to be shared with collaborators and opened to the public. In the nine months since its deployment in August 2013, the service has handled over 22.4 TB of raw data (∼1.7 million diffraction images). Several real examples from the Australian crystallographic community are described that illustrate the advantages of the approach, which include real-time online data access and fully redundant, secure storage. Discoveries in biological sciences increasingly require multidisciplinary approaches. With this in mind, Store.Synchrotron has been developed as a component within a greater service that can combine data from other instruments at the Australian Synchrotron, as well as instruments at the Australian neutron source ANSTO. It is therefore envisaged that this will serve as a model implementation of raw data archiving and dissemination within the structural biology research community.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

IBEX: An open infrastructure software platform to facilitate collaborative work in radiomics

Purpose: Radiomics, which is the high-throughput extraction and analysis of quantitative image features, has been shown to have considerable potential to quantify the tumor phenotype. However, at present, a lack of software infrastructure has impeded the development of radiomics and its applications. Therefore, the authors developed the imaging biomarker explorer (IBEX), an open infrastructure software platform that flexibly supports common radiomics workflow tasks such as multimodality image data import and review, development of feature extraction algorithms, model validation, and consistent data sharing among multiple institutions. Methods: The IBEX software package was developed using the MATLAB and C/C++ programming languages. The software architecture deploys the modern model-view-controller, unit testing, and function handle programming concepts to isolate each quantitative imaging analysis task, to validate if their relevant data and algorithms are fit for use, and to plug in new modules. On one hand, IBEX is self-contained and ready to use: it has implemented common data importers, common image filters, and common feature extraction algorithms. On the other hand, IBEX provides an integrated development environment on top of MATLAB and C/C++, so users are not limited to its built-in functions. In the IBEX developer studio, users can plug in, debug, and test new algorithms, extending IBEX’s functionality. IBEX also supports quality assurance for data and feature algorithms: image data, regions of interest, and feature algorithm-related data can be reviewed, validated, and/or modified. More importantly, two key elements in collaborative workflows, the consistency of data sharing and the reproducibility of calculation result, are embedded in the IBEX workflow: image data, feature algorithms, and model validation including newly developed ones from different users can be easily and consistently shared so that results can be more easily reproduced between institutions. Results: Researchers with a variety of technical skill levels, including radiation oncologists, physicists, and computer scientists, have found the IBEX software to be intuitive, powerful, and easy to use. IBEX can be run at any computer with the windows operating system and 1GB RAM. The authors fully validated the implementation of all importers, preprocessing algorithms, and feature extraction algorithms. Windows version 1.0 beta of stand-alone IBEX and IBEX’s source code can be downloaded. Conclusions: The authors successfully implemented IBEX, an open infrastructure software platform that streamlines common radiomics workflow tasks. Its transparency, flexibility, and portability can greatly accelerate the pace of radiomics research and pave the way toward successful clinical translation.

60 APPLIED LIFE SCIENCES↗

CoREC: Scalable and Resilient In-memory Data Staging for In-situ Workflows

The dramatic increase in the scale of current and planned high-end HPC systems is leading new challenges, such as the growing costs of data movement and IO, and the reduced mean time between failures (MTBF) of system components. In-situ workflows, i.e., executing the entire application workflows on the HPC system, have emerged as an attractive approach to address data-related challenges by moving computations closer to the data, and staging-based frameworks have been effectively used to support in-situ workflows at scale. However, the resilience of these staging-based solutions has not been addressed, and they remain susceptible to expensive data failures. Furthermore, naive use of data resilience techniques such as n-way replication and erasure codes can impact latency and/or result in significant storage overheads. In this article, we present CoREC, a scalable and resilient in-memory data staging runtime for large-scale in-situ workflows. CoREC uses a novel hybrid approach that combines dynamic replication with erasure coding based on data access patterns. It also leverages multiple levels of replications and erasure coding to support diverse data resiliency requirements. Furthermore, the article presents optimizations for load balancing and conflict-avoiding encoding, and a low overhead, lazy data recovery scheme. We have implemented the CoREC runtime and have deployed with the DataSpaces staging service on leadership class computing machines and present an experimental evaluation in the article. Here, the experiments demonstrate that CoREC can tolerate in-memory data failures while maintaining low latency and sustaining high overall storage efficiency at large scales.

97 MATHEMATICS AND COMPUTING↗

Hawthorne Nevada Deep Direct-Use Feasibility Study - Geology

The objective of this project is to use a multi-disciplinary, three-tiered approach to assess the geothermal resource and determine the feasibility of implementing a large-scale, direct-use facility for the Hawthorne Army Depot (HAD) and the various town and county facilities in Hawthorne, Nevada. This assessment directly targets a geothermal resource recently characterized by the Navy Geothermal Program Office (GPO) as part of a focused exploration and development campaign. This data includes: Zip file containing geologic map and related data of the Hawthorne area, Zip file containing the report and Maps produced by John Oldow, Zip file containing GIS mapping done by UNR in 2009, Low Sun Angle Photos Quaternary Fault Study report, Hawthorne well cuttings descriptions report.

15 GEOTHERMAL ENERGY↗

Organic Matter Composition in June 2023 and September 2023 Across the McKenzie Sub-Basin Impacted by the 2020 Holiday Farm Fire

This dataset represents results from a field study aiming to understand the variability in post-fire responses of dissolved organic matter and determine drivers of post-fire responses. Samples were collected at 58 sites within the McKenzie River Watershed (Oregon, USA) that were upstream, within, and downstream of the Holiday Farm Fire burn perimeter. The samples were collected in June 2023 and September 2023 during storm events, approximately 3 years post-fire. Samples were characterized for benezenepolycarboxylic acids (BPCA) and ultra-high resolution mass spectrometry. Dissolved organic carbon and optics (absorbance and fluorescence) data can be found in a separate data packages (https://ir.library.oregonstate.edu/concern/datasets/zc77sz60m, https://ir.library.oregonstate.edu/concern/datasets/mc87q034m). Related data from a subset of sites from 2020-2022 can be found at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1869708 and https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2478546. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. This dataset contains (1) file-level metadata; (2) data dictionary; (3) data package readme; (4) metadata; (5) methods information; (6) benzene polycarboxylic acid (BPCA) concentration data; (7) Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) methods; (8) folder of high resolution characterization of organic matter via 12 Tesla FTICR-MS data generated through the Environmental Molecular Sciences Laboratory (EMSL; https://www.pnnl.gov/environmental-molecular-sciences-laboratory). This package contains the following file types: csv, xml, pdf.

54 ENVIRONMENTAL SCIENCES↗

Commercial Building Partnerships Replication and Diffusion

This study presents findings from survey and interview data investigating replication efforts of Commercial Building Partnership (CBP) partners that worked directly with the Pacific Northwest National Laboratory (PNNL). PNNL partnered directly with 12 organizations on new and retrofit construction projects, which represented approximately 28 percent of the entire U.S. Department of Energy (DOE) CBP program. Through a feedback survey mechanism, along with personal interviews, PNNL gathered quantitative and qualitative data relating to replication efforts by each organization. These data were analyzed to provide insight into two primary research areas: 1) CBP partners’ replication efforts of technologies and approaches used in the CBP project to the rest of the organization’s building portfolio (including replication verification), and, 2) the market potential for technology diffusion into the total U.S. commercial building stock, as a direct result of the CBP program. The first area of this research focused specifically on replication efforts underway or planned by each CBP program participant. Factors that impact replication include motivation, organizational structure and objectives firms have for implementation of energy efficient technologies. Comparing these factors between different CBP partners revealed patterns in motivation for constructing energy efficient buildings, along with better insight into market trends for green building practices. The second area of this research develops a diffusion of innovations model to analyze potential broad market impacts of the CBP program on the commercial building industry in the United States.

Commercial Building Partnerships↗

Generation and reduction of the data for the Ulysses gravitational wave experiment

A procedure for the generation and reduction of the radiometric data known as REGRES is described. The software is implemented on a HP-1000F computer and was tested on REGRES data relative to the Voyager I spacecraft. The REGRES data are a current output of NASA's Orbit Determination Program. The software package was developed in view of the data analysis of the gravitational wave experiment planned for the European spacecraft Ulysses.

Agresti, R.↗