Performance Optimization of Legacy HDF5 Data for Web Object Stores
Explore the source record for details and available documents.
James Gallagher↗
SEARCH · Search NASA
Results for “data legacy”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
TransPlatformer
We propose TransPlatformer for translating toxicogenomics from one platform to another. Transcriptomic profiling has evolved through multiple generations of technology, from microarrays (e.g., Affymetrix, CodeLink) to more recent high-throughput sequencing and targeted panels such as S1500+. Microarrays, which dominated gene expression studies in the early 2000s, provided affordable and high-throughput transcript quantification but suffered from cross-hybridization issues and limited dynamic range . RNA-Seq, introduced in the late 2000s, revolutionized transcriptomics by enabling unbiased and comprehensive gene expression analysis, albeit at higher costs and computational demands . Despite advances, many studies rely on historical microarray data, necessitating the translation of legacy data into modern platforms to ensure continuity and comparability. This translation is complicated by factors such as platform-specific probe design, differences in transcript coverage, and batch effects . Existing methods for cross-platform mapping include statistical normalization, machine learning models, and biological anchoring approaches. The ability to translate transcriptomic data between platforms has broad implications, including enhanced meta-analyses, improved toxicological modeling, and better integration of historical datasets with contemporary research. TransPlatformer seeks to contribute to this effort by evaluating translation methodologies and proposing novel strategies to improve cross-platform gene expression harmonization. In this repository there are code examples for TransPlatformer implementation
Cong, Guojing↗
The NASA Tournament Laboratory (NTL): Improving Data Access at PDS while Spreading Joy and Engaging Students through 16 Micro-Contests
NASA PDS hosts terabytes of valuable data from hundreds of data sources and spans decades of research. Data is stored on flat-file systems regulated through careful meta dictionaries. PDS's data is available to the public through its website which supports data searches through drill-down navigation. While the system returns data quickly, result sets in response to identical input differ depending on the drill-down path a user follows. To correct this Issue, to allow custom searching, and to improve general accessibility, PDS sought to create a new data structure and API, and to use them to build applications that are a joy to use and showcase the value of the data to students, teachers and citizens. PDS engaged TopCoder and Harvard Business School through the NTL to pursue these objectives in a pilot effort. Scope was limited to Small Bodies Node data. NTL analyzed data, proposed a solution, and implemented it through a series of micro-contests. Contest focused on different segments of the problem; conceptualization, architectural design, implementation, testing, etc. To demonstrate the utility of the completed solution, NTL developed web-based and mobile applications that can compare targets, regardless of mission. To further explore the potential of the solution NTL hosted "Mash-up" challenges that integrated the API with other publically available assets, to produce consumer and teaching applications, including an Augmented Reality iPad tool. Two contests were also posted to middle and high school students via the NoNameSite.com platform, and as a result of these contests, PDS/SBN has initiated a Facebook program. These contests defined and implemented a data warehouse with the necessary migration tools to transform legacy data, produced a public web interface for the new search, developed a public API, and produced four mobile applications that we expect to appeal to users both within and, without the academic community.
LaMora, Andy↗
Ziggy, A Portable, Scalable Infrastructure for Science Data Processing Pipelines and Its Application to A Proxy, Legacy Global Hyperspectral Data Set for NASA's Earth System Observatory’s Upcoming Surface, Biology and Geology Mission
Explore the source record for details and available documents.
TESS↗
Finding, Organizing, and Preserving Legacy Nuclear Test Monitoring Data—Examples from the Livermore Nevada Network
A challenge for geophysical research is the relatively short time for which continuous digital data have been available. There are many events of research interest where much of the data were collected by analog or temporary digital means. These legacy data require special efforts to find, organize, and preserve for future research. Here, we focus on one type of legacy data, nuclear explosions, and associated events (e.g., collapses, aftershocks) of high interest for nuclear monitoring research and development. For nuclear tests conducted in Nevada, the Lawrence Livermore Nevada Network recorded valuable data on a variety of formats. In this article, we briefly review this network, and describe one set of data that previously was available via CD-ROM by request, and since 2018 has become available through Incorporated Research Institutions for Seismology as assembled dataset 18-001.
58 GEOSCIENCES↗
Modernization of B-2 Data, Video, and Control Systems Infrastructure
The National Aeronautics and Space Administration (NASA) Glenn Research Center (GRC) Plum Brook Station (PBS) Spacecraft Propulsion Research Facility, commonly referred to as B-2, is NASA s third largest thermal-vacuum facility with propellant systems capability. B-2 has completed a modernization effort of its facility legacy data, video and control systems infrastructure to accommodate modern integrated testing and Information Technology (IT) Security requirements. Integrated systems tests have been conducted to demonstrate the new data, video and control systems functionality and capability. Discrete analog signal conditioners have been replaced by new programmable, signal processing hardware that is integrated with the data system. This integration supports automated calibration and verification of the analog subsystem. Modern measurement systems analysis (MSA) tools are being developed to help verify system health and measurement integrity. Legacy hard wired digital data systems have been replaced by distributed Fibre Channel (FC) network connected digitizers where high speed sampling rates have increased to 256,000 samples per second. Several analog video cameras have been replaced by digital image and storage systems. Hard-wired analog control systems have been replaced by Programmable Logic Controllers (PLC), fiber optic networks (FON) infrastructure and human machine interface (HMI) operator screens. New modern IT Security procedures and schemes have been employed to control data access and process control flows. Due to the nature of testing possible at B-2, flexibility and configurability of systems has been central to the architecture during modernization.
Cmar, Mark D.↗
Modernization of B-2 Data, Video, and Control Systems Infrastructure
The National Aeronautics and Space Administration (NASA) Glenn Research Center (GRC) Plum Brook Station (PBS) Spacecraft Propulsion Research Facility, commonly referred to as B-2, is NASA's third largest thermal-vacuum facility with propellant systems capability. B-2 has completed a modernization effort of its facility legacy data, video and control systems infrastructure to accommodate modern integrated testing and Information Technology (IT) Security requirements. Integrated systems tests have been conducted to demonstrate the new data, video and control systems functionality and capability. Discrete analog signal conditioners have been replaced by new programmable, signal processing hardware that is integrated with the data system. This integration supports automated calibration and verification of the analog subsystem. Modern measurement systems analysis (MSA) tools are being developed to help verify system health and measurement integrity. Legacy hard wired digital data systems have been replaced by distributed Fibre Channel (FC) network connected digitizers where high speed sampling rates have increased to 256,000 samples per second. Several analog video cameras have been replaced by digital image and storage systems. Hard-wired analog control systems have been replaced by Programmable Logic Controllers (PLC), fiber optic networks (FON) infrastructure and human machine interface (HMI) operator screens. New modern IT Security procedures and schemes have been employed to control data access and process control flows. Due to the nature of testing possible at B-2, flexibility and configurability of systems has been central to the architecture during modernization.
Cmar, Mark D.↗
Open Science for Life in Space
Understanding how biology changes in response spaceflight and how these changes affect crew and craft is important to the design of safe, robust and effective space missions. Advances in analytical technologies allow large volumes of new data to be generated from space biological experiments, and a growing library of legacy data can be re-analyzed in the context of a greater understanding of biological systems. This enables powerful insights into how biology changes during spaceflight. However, for this to be fully realized additional tools, programs, and communities must be developed. Now a developing suite of interconnected open science resources (GeneLab, the Ames Life Sciences Data Archive, the NASA Biological Institutional Science Collection, the Biospecimen Sharing Program) can be leveraged by dedicated Analysis Working Groups to accelerate the pace of discovery in the space biological sciences.
Open Science↗
The SPASE Data Model: A Metadata Standard for Registering, Finding, Accessing, and Using Heliophysics Data Obtained from Observations and Modeling
The Space Physics Archive Search and Extract Consortium has developed and implemented the SPASE Data Model that provides a common language for registering a wide range of Heliophysics data and other products. The Data Model enables discovery and access tools such that any researcher can obtain data easily, thereby facilitating research, including on space weather. The Data Model includes descriptions of Simulation Models and Numerical Output, pioneered by the Integrated Medium for Planetary Exploration (IMPEx) group in Europe, and subsequently adopted by the Community Coordinated Modeling Center (CCMC). The SPASE group intends to register all relevant Heliophysics data resources, including space-, ground-, and model-based. Substantial progress has been made, especially for space-based observational data and associated observatories, instruments, and display data. Legacy product registrations and access go back more than 50 years. Real-time data will be included. The National Aeronautics and Space Administration (NASA) portion of the SPASE group has funding that assures continuity in the upkeep of the Data Model and aids with adding new products. Tools are being developed for making and editing data descriptions. Digital Object Identifiers (DOIs) for Data Products can now be included in the descriptions. The data access that SPASE facilitates is becoming more uniform, and work is progressing on Web Service access via a standard Application Programming Interface. The SPASE Data Model is stable; changes over the past 9 years were additions of terms and capabilities that are backward compatible. This paper provides a summary of the history, structure, use, and future of the SPASE Data Model.
Roberts, D. Aaron↗
Roughrider Carbon Storage Hub (Final Report)
The Roughrider Carbon Storage Hub was a 2-year project (October 2023 – September 2025) conducted by the Energy & Environmental Research Center (EERC) focused on advancing the feasibility of a commercial-scale carbon dioxide (CO 2 ) geologic storage hub in McKenzie County, North Dakota. The project’s objective was to investigate the potential that stacked storage complexes (multiple deep saline formations) can safely and economically store at least 50 million tonnes of CO 2 within 30 years. The captured CO 2 would be sourced from industrial emitters including project partner ONEOK, Inc.’s gas-processing plants and a planned gas-to-liquids facility. Drilling of the Roughrider 1 stratigraphic test well (14,979-ft total depth) was completed in November 2024. The wellbore intersected four candidate storage formations: Inyan Kara, Broom Creek, Mission Canyon, and Black Island–Deadwood. Operational challenges, including a stuck drill string, were resolved without long-term impact. A comprehensive logging and coring program was conducted, followed by successful well abandonment and site reclamation. Over 660 ft of 4-in. whole core was retrieved. Core plug samples were processed and analyzed for petrophysical and geochemical properties. Results confirmed promising porosity and permeability in the Inyan Kara and Broom Creek Formations and removal of the Mission Canyon and Black Island–Deadwood horizons from further investigation. Data derived from the logging and coring program were used to improve initial geologic models built from legacy data. CO 2 injection simulations showed that the Inyan Kara alone can feasibly store the target mass of CO 2 . Because of subtle differences in geologic structure and porosity trends between the formations, a stacked storage scenario using the Broom Creek and Inyan Kara Formations resulted in a larger overall plume area than using the Inyan Kara alone. Preliminary CO 2 pipeline routes from the industrial sources were mapped utilizing existing rights of way and evaluated for capacity and cost using U.S. Department of Energy Office of Fossil Energy and Carbon Management/National Energy Technology Laboratory models and U.S. Environmental Protection Agency emissions data. Integrating capture, transport, and storage cost estimates with policy incentives (e.g., 45Q credits) provided a total cost-per-ton analysis. Results indicate that the small scale of the volumes to be transported over the cumulative large distances does not support the project’s financial viability. However, the groundwork laid during this project from geological, regulatory, and social perspectives positions the Roughrider hub site as a promising candidate for commercial carbon storage in North Dakota, especially if the economy of scale is introduced for CO 2 transportation to the hub site.
01 COAL, LIGNITE, AND PEAT↗
SAGE III/ISS: Continuing the Legacy of SAGE Data Products
The Stratospheric Aerosol and Gas Experiment III (SAGE III) instrument installed on the International Space Station (ISS) is a solar and lunar occultation instrument that scans the light from the Sun and Moon through the limb of the Earth’s atmosphere to produce vertical profiles of aerosol, ozone, water vapor, and other trace gases. SAGE III/ISS has completed almost half of a decade of data collection and production of science data products. It continues the legacy of previous SAGE instruments dating back to the 1970s to provide data continuity of stratospheric constituents critical for assessing trends in the ozone layer. This presentation shows how SAGE III/ISS aerosol and gas vertical profiles continue to benefit a worldwide database of in situ and satellite data for climate observation.
stratosphere↗
Assessing the Impact of Molten Halide Salts on Creep of Structural Alloys at 650°-750°C
There is a critical lack of data on the mechanical behavior of candidate structural materials for advanced nuclear reactors under molten halide salt environments. Limited legacy data from the molten salt reactor experiment (MSRE) program showed a significant reduction in creep rupture strength of a Ni-base alloy in molten fluoride salt. With ongoing efforts to commercialize different molten salt reactor concepts, the industry can considerably benefit from quantitative information on the impact of molten halide salts on the engineering properties such as creep and fatigue strength of materials of interest. The present work aims to assess the role of molten salt corrosion on the creep behavior of three alloys 316H, 617 and 282 at 650-816 °C. Creep tests were conducted in fluoride (FLiNaK) and chloride (NaCl-MgCl2) salts. Initial results from the ongoing testing will be presented which suggest that the molten salt environment caused a 25-50% reduction in creep rupture lifetime compared to air exposures. Physics-based corrosion and creep models were employed to gain some insights into the potential degradation mechanisms.
Pillai, Rishi↗
High-Reliability Systems and the Control of National Security Data and Information
High-reliability systems are characterized by catastrophic implications in the event of failure. These implications can include substantive damage to the environment, social order, and loss of life. Examples of high-reliability systems include nuclear submarines, nuclear reactors, the electric grid, and nuclear weapons. Due to the catastrophic implications of failure, there are heightened awareness and control mechanisms surrounding related data and information. However, defining the difference between data and information is often ambiguous across scholarly disciplines and in United States policy and legislation. For high-reliability systems, the implications of ambiguity between data and information may affect the security of United States interests and even cost lives. For security, data are raw facts or figures without context, while information is the compilation or articulation of data that forms context. Security depends on clarity in the differences between data and information and how to control them. Control is necessary to ensure that data and information are not unintentionally released to foreign governments, the public, or those without need-to-know. A primary concern in the practice of security is the control of data to avoid the unintended conversion to information. Intra-institutionally, this control is highly complex given the amalgam of legacy data systems and the numerous and constantly evolving nature of modern data systems that were not necessarily designed to be integrated. The complexity of this concern is augmented when institutions are part of interinstitutional collaborations or networks of public-private partnerships that share data and information. Additionally, institutions that share data as a function of policy and legislative action— particularly formally integrated data and information system infrastructures—may be at higher security risk. This paper will present an intra-institutional paradigm that utilizes and integrates concepts from numerous disciplines to frame a critical and underspecified practical issue in security—controlling for the unintended conversion of data to information.
45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
High-Reliability Systems and the Control of National Security Data and Information
High-reliability systems are characterized by catastrophic implications in the event of failure. These implications can include substantive damage to the environment, social order, and loss of life. Examples of high-reliability systems include nuclear submarines, nuclear reactors, the electric grid, and nuclear weapons. Due to the catastrophic implications of failure, there are heightened awareness and control mechanisms surrounding related data and information. However, defining the difference between data and information is often ambiguous across scholarly disciplines and in United States policy and legislation. For high-reliability systems, the implications of ambiguity between data and information may affect the security of United States interests and even cost lives. For security, data are raw facts or figures without context, while information is the compilation or articulation of data that forms context. Security depends on clarity in the differences between data and information and how to control them. Control is necessary to ensure that data and information are not unintentionally released to foreign governments, the public, or those without need-to-know. A primary concern in the practice of security is the control of data to avoid the unintended conversion to information. Intra-institutionally, this control is highly complex given the amalgam of legacy data systems and the numerous and constantly evolving nature of modern data systems that were not necessarily designed to be integrated. The complexity of this concern is augmented when institutions are part of inter-institutional collaborations or networks of public-private partnerships that share data and information. Additionally, institutions that share data as a function of policy and legislative action—particularly formally integrated data and information system infrastructures—may be at higher security risk. This paper will present an intra-institutional paradigm that utilizes and integrates concepts from numerous disciplines to frame a critical and underspecified practical issue in security—controlling for the unintended conversion of data to information.
45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
Bioenergy Research Centers Data Sharing Portal
The bioenergy.org website is the end product of the Data Sharing Shared Research objective for the Bioenergy Centers. The objective is to Enhance BRC data legacy through the development and use of shared software tools to make previously published datasets more findable and accessible through the Inter-BRC Data Products Portal, and to explore the use of generative AI to assist in the exploration of published datasets. The software repository is released per the license information below.
Thrower, Nicholas↗
A Global End-Member Approach to Derive aCDOM(440) from Near-Surface Optical Measurements
This study establishes an optical inversion scheme for deriving the absorption coefficient of colored (or chromophoric, depending on the literature) dissolved organic material (CDOM) at the 440 nm wavelength, which can be applied to global water masses with near-equal efficacy. The approach uses a ratio of diffuse attenuation coefficient spectral end members, i.e., a short and long wavelength pair. The global perspective is established by sampling "extremely" clear water plus a generalized extent in turbidity and optical properties that each span three decades of dynamic range. A unique data set was collected in oceanic, coastal, and inland waters (as shallow as 0.6 m) from the North Pacific Ocean, the Arctic Ocean, Hawaii, Japan, Puerto Rico, and the east and west coasts of the United States. The data were partitioned using subjective categorizations to define a validation quality subset of conservative water masses, i.e., the inflow and outflow of properties constrain the range in the gradient of a constituent, plus 15 subcategories of water masses that were not evolving conservatively. The dependence on subcategories was confirmed with an objective methodology based on cluster analysis techniques. The latter defined five distinct classes with validation quality data present in all classes, but which also decreased in percent composition as a function of increasing class number and optical complexity. Four different algorithms based on different validation quality end members were validated with accuracies of 1.–6.2 %, wherein pairs with the largest spectral span were most accurate. Although algorithm accuracy decreased with the inclusion of more subcategories containing non-conservative water masses, changes to the algorithm fit were small when a preponderance of subcategories were included. The high accuracy for all end-member algorithms was the result of data acquisition and data processing improvements, e.g., increased vertical sampling resolution to less than 1mm and a boundary constraint to mitigate wave focusing effects, respectively. An independent evaluation with a historical database confirmed the consistency of the algorithmic approach and its application to quality assurance, e.g., to flag data outside expected ranges, identify suspect spectra, and objectively determine the in-water extrapolation interval by converging agreement for all applicable end-member algorithms. The legacy data exhibit degraded performance (as 44 % uncertainty) due to a lack of high-quality near-surface observations, especially for clear waters wherein wave-focusing effects are problematic. The novel optical approach allows the in situ estimation of an in-water constituent in keeping with the accuracy obtained in the laboratory.
Stanford B Hooker↗
Beyond magnons in Nd 2 ScNbO 7 : An Ising pyrochlore antiferromagnet with all-in–all-out order and random fields
We report the low-temperature magnetic properties of Nd 3+ pyrochlore Nd 2 ScNbO 7 . Susceptibility and magnetization show an easy-axis moment, and heat capacity reveals a phase transition to long-range order at T N =371(2) mK with a fully recovered ΔS=Rln(2), 53% of it recovered for T>T N . Elastic neutron scattering shows a long-range all-in all-out magnetic order with low-Q diffuse elastic scattering. Inelastic neutron scattering shows a low-energy flat band, indicating a magnetic Hamiltonian similar to Nd 2 Zr 2 O 7 . Nuclear hyperfine excitations measured by ultra-high-resolution neutron backscattering indicate a distribution of static electronic moments below T N , which may be due to B-site disorder influencing Nd crystal electric fields. Analysis of heat-capacity data shows an unexpected T-linear or T 3/2 term which is inconsistent with conventional magnon quasiparticles, but is consistent with fractionalized spinons or gapless local spin excitations. We use legacy data to show similar behavior in Nd 2 Zr 2 O 7 . Comparing local static moments also reveals a suppression of the nuclear Schottky anomaly in temperature, evidencing a fraction of Nd sites with nearly zero static moment, consistent with exchange-disorder-induced random singlet formation. Finally, taken together, these measurements suggest an unusual fluctuating magnetic ground state which mimics a spin liquid, but may not actually be one.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
Exploring Diverse Data Sets and Developing New Theories and Ideas With Project Integration Architecture
The development of new ideas is the essence of scientific research. This is frequently done by developing models of physical processes and comparing model predictions with results from experiments. With models becoming ever more complex and data acquisition systems becoming more powerful, the researcher is burdened with wading through data ranging in volume up to a level of many terabytes and beyond. These data often come from multiple, heterogeneous sources and usually the methods for searching through it are at or near the manual level. In addition, current documentation methods are generally limited to researchers pen-and-paper style notebooks. Researchers may want to form constraint-based queries on a body of existing knowledge that is, itself, distributed over many different machines and environments and from the results of such queries then spawn additional queries, simulations, and data analyses in order to discover new insights into the problem being investigated. Currently, researchers are restricted to working within the boundaries of tools that are inefficient at probing current and legacy data to extend the knowledge of the problem at hand and reveal innovative and efficient solutions. A framework called the Project Integration Architecture is discussed that can address these desired functionalities.
Benyo, Theresa L.↗