Search NASA⌕ Search

SEARCH · Search NASA

Results for “Scientific data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Quality Control of and Analysis Enabling Use of MARCUS and MICRE data for Scientific Applications

The primary objective of this project was to provide a preliminary investigation of data collected during the MARCUS/MICRE field experiments and to produce products and analysis for the scientific community that will enable future scientific investigations and hypothesis testing. Further, the goal was to assist those in the scientific community to understand the strengths and caveats of the MARCUS/MICRE data so that members of the scientific community could use the data in their publications.

54 ENVIRONMENTAL SCIENCES↗

Automated system for measurement, collection and processing of hydrometeorological data aboard scientific research vessels of the GUGMS (SIGMA-s)

A report is made on the automated system known as SIGMA-s for the measurement, collection, and processing of hydrometeorological data aboard scientific research vessels of the Hydrometeorological Service. The various components of the system and the interfacing between them are described, as well as the projects that the system is equipped to handle.

Borisenkov, Y. P.↗

Nationwide Buildings Energy Research enabled through an integrated Data Intensive Scientific Workflow and Advanced Analysis Environment

Modern workflow systems enable scientists to run ensemble simulations at unprecedented scales and levels of complexity, allowing them to study system sizes previously impossible to achieve, due to the inherent resource requirements needed for the modeling work. However as a result of these new capabilities the science teams suddenly also face unprecedented data volumes that they are unable to analyze with their existing tools and methodologies in a timely fashion. In this paper we will describe the ongoing development work to create an integrated data intensive scientific workflow and analysis environment that offers researchers the ability to easily create and execute complex simulation studies and provides them with different scalable methods to analyze the resulting data volumes. The integration of simulation and analysis environments is hereby not only a question of ease of use, but supports fundamental functions in the correlated analysis of simulation input, execution details and derived results for multi-variant, complex studies. To this end the team extended and integrated the existing capabilities of the Velo data management and analysis infrastructure, the MeDICi data intensive workflow system and RHIPE the R for Hadoop version of the well-known statistics package, as well as developing a new visual analytics interface for the result exploitation by multi-domain users. The capabilities of the new environment are demonstrated on a use case that focusses on the Pacific Northwest National Laboratory (PNNL) building energy team, showing how they were able to take their previously local scale simulations to a nationwide level by utilizing data intensive computing techniques not only for their modeling work, but also for the subsequent analysis of their modeling results. As part of the PNNL research initiative PRIMA (Platform for Regional Integrated Modeling and Analysis) the team performed an initial 3 year study of building energy demands for the US Eastern Interconnect domain, which they are now planning to extend to predict the demand for the complete century. The initial study raised their data demands from a few GBs to 400GB for the 3year study and expected tens of TBs for the full century.

99 GENERAL AND MISCELLANEOUS↗

Apollo scientific experiments data handbook

A brief description of each of the Apollo scientific experiments was described, together with its operational history, the data content and formats, and the availability of the data. The lunar surface experiments described are the passive seismic, active seismic, lunar surface magnetometer, solar wind spectrometer, suprathermal ion detector, heat flow, charged particle, cold cathode gage, lunar geology, laser ranging retroreflector, cosmic ray detector, lunar portable magnetometer, traverse gravimeter, soil mechanics, far UV camera (lunar surface), lunar ejecta and meteorites, surface electrical properties, lunar atmospheric composition, lunar surface gravimeter, lunar seismic profiling, neutron flux, and dust detector. The orbital experiments described are the gamma-ray spectrometer, X-ray fluorescence, alpha-particle spectrometer, S-band transponder, mass spectrometer, far UV spectrometer, bistatic radar, IR scanning radiometer, particle shadows, magnetometer, lunar sounder, and laser altimeter. A brief listing of the mapping products available and information on the sample program were also included.

Eichelman, W. F.↗

Time-Series Forecast Modeling on High-Bandwidth Network Measurements

With the increasing number of geographically distributed scientific collaborations and the growing sizes of scientific data, it has become challenging for users to achieve the best possible network performance on a shared network. In this paper, we have developed a model to forecast expected bandwidth utilization on high-bandwidth wide area networks. The forecast model can improve the efficiency of the resource utilization and scheduling of data movements on high-bandwidth networks to accommodate ever increasing data volume for large-scale scientific data applications. A univariate time-series forecast model is developed with the Seasonal decomposition of Time series by Loess (STL) and the AutoRegressive Integrated Moving Average (ARIMA) on Simple Network Management Protocol (SNMP) path utilization measurement data. Compared with the traditional approach such as Box-Jenkins methodology to train the ARIMA model, our forecast model reduces computation time up to 92.6 %. It also shows resilience against abrupt network usage changes. Finally, our forecast model conducts the large number of multi-step forecast, and the forecast errors are within the mean absolute deviation (MAD) of the monitored measurements.

97 MATHEMATICS AND COMPUTING↗

NASA IKONOS Radiometric Characterization

NASA acquired imagery from the IKONOS satellite as part of its Scientific Data Purchase (SDP) program, which purchases scientific data sets from commercial sources. This viewgraph presentation describes the IKONOS satellite and its sensors, and then gives an overview of characterization efforts undertaken by NASA in cooperation with other government agencies. The characterization included relative radiometric correction, absolute radiometric characterization of data from Lunar Lake Playa, Nevada, and calibration of data from Stennis Space Center, Mississippi.

Pagnutti, Mary↗

Analysis of CrIS ATMS and AIRS AMSU Data Using Scientifically Equivalent Retrieval Algorithms

Monthly mean August 2014 Version-6.28 AIRS and CrIS products agree well with OMPS and CERES, and reasonably well with each other. Version-6.28 CrIS total precipitable water is biased dry compared to AIRS. AIRS and CrIS Version-6.36 water vapor products are both improved compared to Version-6.28. Version-6.36 AIRS and CrIS total precipitable water also shows improved agreement with each other. AIRS Version-6.36 total ozone agrees even better with OMPS than does AIRS Version-6.28, and gives reasonable results during polar winter where OMPS does not generate products. CrIS and ATMS are high spectral resolution IR and Microwave atmospheric sounders currently flying on the SNPP satellite, and are also scheduled for flight on future NPOESS satellites. CrIS/ATMS have similar sounding capabilities to those of the AIRS/AMSU sounder suite flying on EOS Aqua. The objective of this research is to develop and implement scientifically equivalent AIRS/AMSU and CrIS/ATMS retrieval algorithms with the goal of generating a continuous data record of AIRS/AMSU and CrIS/ATMS level-3 data products with a seamless transition between them in time. To achieve this, monthly mean AIRS/AMSU and CrIS/ATMS retrieved products, and more importantly their interannual differences, should show excellent agreement with each other. The currently operational AIRS Science Team Version-6 retrieval algorithm has generated 14 years of level-3 data products. A scientifically improved AIRS Version-7 retrieval algorithm is expected to become operational in 2017. We see significant improvements in water vapor and ozone in Version-7 retrieval methodology compared to Version-6.We are working toward finalization and implementation of scientifically equivalent AIRS/AMSU and CrIS/ATMS Version-7 retrieval algorithms to be used for the eventual processing of all AIRS/AMSU and CrIS/ATMS data. The latest version of our retrieval algorithm is Verison-6.36, which includes almost all the improvements we want in Version-7. Version-6.28 has been used to process both AIRS and CrIS data for August 2014. This poster compares August 2014 monthly mean Version-6.28 AIRS/AMSU and CrIS/ATMS products with each other, and also with monthly mean products obtained using AIRS Version-6. AIRS and CrIS results using Version-6.36 are presented for April 15, 2016. These demonstrate further improvements since Version-6.28. The new results also show improved agreement of Version-6.36 AIRS and CrIS products with each other. Version-6.36 is not yet optimized for CrIS ozone products.

AIRS↗

Working with Workflows: Highlights from 5 years Building Scientific Workflows

In 2006, the SciDAC Scientific Data Management (SDM) Center proposed to continue its work deploying leading edge data management and analysis capabilities to scientific applications. One of three thrust areas within the proposed center was focused on Scientific Process Automation (SPA) using workflow technology. As a founding member of the Kepler consortium [LAB+09], the SDM Center team was well positioned to begin deploying workflows immediately. We were also keenly aware of some of the deficiencies in Kepler when applied to high performance computing workflows, which allowed us to focus our research and development efforts on critical new capabilities which were ultimately integrated into the Kepler open source distribution, benefiting the entire community. Significant work was required to ensure Kepler was capable of supporting large-scale production runs for SciDAC applications. Our work on generic actors and templates have improved the portability of workflows across machines and provided a higher level of abstraction for workflow developers. Fault tolerance and provenance tracking were obvious areas for improvement within Kepler given the longevity and complexity of our target workflows. To monitor workflow execution, we developed and deployed a web-based dashboard. We then generalized this interface and released it so it could be deployed at other locations. Outreach has always been a primary focus of our work and we had many successful deployments across a number of scientific domains while continually publishing and presenting our work. This short paper describes our most significant accomplishments over the past 5 years. Additional information about the SDM Center can be found in the companion paper: The Scientific Data Management Center: Available Technologies and Highlights.

99 GENERAL AND MISCELLANEOUS↗

Publication of science data on CD-ROM: A guide and example

CD-ROM (Compact Disk-Read Only Memory) is becoming the standard media not only in audio recording, but also in the publication of data and information accessible on many computer platforms. Little has been written about the complicated process involved in creating easy-to-use, high quality, and useful CD-ROM's containing scientific data. This document is a manual designed to aid those who are responsible for the publication of scientific data on CD-ROM. All aspects and steps of the procedure are covered, from feasibility assessment through disk design, data preparation, disc mastering, and CD-ROM distribution. General advice and actual examples are based on lessons learned from the publication of scientific data for an interdisciplinary field experiment. Appendices include actual files from a CD-ROM, a purchase request for CD-ROM mastering services, and the disk art for the first disk published for the project.

Angelici, Gary↗

DOE High Performance Computing Operational Review (HPCOR): Enabling Data-Driven Scientific Discovery at HPC Facilities

U.S. Department of Energy (DOE) High Performance Computing (HPC) facilities are on the verge of a paradigm shift in the way they deliver systems and services to science and engineering teams. Research projects are producing a wide variety of data at unprecedented scale and level of complexity, with community-specific services that are part of the data collection and analysis workflow. On June 18-19, 2014 representatives from six DOE HPC centers met in Oakland, CA at the DOE High Performance Operational Review (HPCOR) to discuss how they can best provide facilities and services to enable large-scale data-driven scientific discovery at the DOE national laboratories. The report contains findings from that review.

97 MATHEMATICS AND COMPUTING↗

Data Readiness for Scientific AI at Scale

This paper examines how Data Readiness for AI (DRAI) principles apply to leadership-scale scientific datasets used to train foundation models. We analyze archetypal workflows across four representative domains—climate, nuclear fusion, bio/health, and materials—to identify common preprocessing patterns and domain-specific constraints. We introduce a two-dimensional readiness framework that combines canonical preprocessing patterns with a five-level operational readiness scale, both tailored to high-performance computing (HPC) environments. This framework helps outline key challenges in transforming large-scale scientific data into formats suitable for scalable AI training. Together, these dimensions form a conceptual maturity matrix that characterizes scientific data readiness and guides infrastructure development toward standardized, cross-domain support for scalable and reproducible AI for science.

Brewer, Wes [ORNL] (ORCID:0000000236393956)↗

Aligning NASA Earth Science Data Stewardship with FAIR Principles: Outcomes, Recommendations, and Future Directions

The FAIR Principles—Findable, Accessible, Interoperable, and Reusable—offer a widely accepted framework for improving the sharing and reuse of digital scientific data by both human and machine users. Following these principles is critical for effective scientific data stewardship, broader scientific collaboration, and compliance with federal and agency data policies. This paper, based on the work of NASA’s Open, Free, and FAIR Working Group (O’FAIR WG) under the Earth Science Data Systems Program, presents an overview of how FAIR is being applied within NASA’s Earth science data landscape. It highlights ongoing progress and challenges, identifies FAIR-enabling resources, and offers recommendations and strategic actions to enhance the FAIRness of NASA-funded open and free Earth science data products. The FAIR-enabling resources identified underscore the vital role of NASA's existing enterprise processes, standards, tools, and infrastructures in supporting FAIR implementation. Our findings show strong performance in making NASA Earth science data more findable and accessible. However, further work is needed—especially in enhancing interoperability, so that different systems and tools can better understand and exchange data. This is especially important for enabling machine-driven discovery and analysis. We emphasize the importance of a balanced strategy that combines a centralized, top-down approach—focused on building enterprise-level capabilities and processes—with a decentralized, bottom-up approach driven by discipline-specific needs and community practices. We advocate for coordinated efforts to enhance (meta)data interoperability to facilitate seamless data and information sharing and exchange of Earth science data both within NASA and across other agencies managing Earth science data.

Data Product↗

Extracting Material Property Measurement Data from Scientific Articles

Machine learning-based prediction of material properties is often hampered by the lack of sufficiently large training datasets. The majority of such measurement data is embedded in scientific literature and the ability to automatically extract these data is essential to support the development of reliable property prediction methods. In this work, we describe a methodology for an automatic property extraction framework using material solubility as the target property. We create an annotated dataset containing tags for solubility-related entities using a combination of regular expressions and manual tagging. We then compare five entity recognition models leveraging both token-level and span-level architectures on the task of classifying solute names, solubility values, and solubility units. Additionally, we explore a novel pretraining approach that leverages automated chemical name and quantity extraction tools to generate large datasets that do not rely on intensive manual effort. Finally, we perform an analysis to identify the causes of classification errors.

Panapitiya, Gihan U.↗

Measuring the impact of burst buffers on data-intensive scientific workflows

Science applications frequently produce and consume large volumes of data, but delivering this data to and from compute resources can be concerning, as parallel file system performance is not keeping up with compute and memory performance. To alter this I/O bottleneck, some systems have deployed burst buffers, but their impact on performance for real-world scientific workflow applications is still not clear. In this paper, we examine the impact of burst buffers through the remote-shared, allocatable burst buffers on the Cori system at NERSC. By running two data-intensive workflows, a high-throughput genome analysis workflow, and a subset of the SCEC high-performance CyberShake workflow, a production seismic hazard analysis workflow, we find that using burst buffers offers read and write improvements of an order of magnitude, and these improvements lead to increased job performance, and thereby increased overall workflow performance, even for long-running CPU-bound jobs.

42 ENGINEERING↗

A History of NASA Remote Sensing Contributions to Archaeology

During its long history of developing and deploying remote sensing instruments, NASA has provided a scientific data that have benefitted a variety of scientific applications among them archaeology. Multispectral and hyperspectral instrument mounted on orbiting and suborbital platforms have provided new and important information for the discovery, delineation and analysis of archaeological sites worldwide. Since the early 1970s, several of the ten NASA centers have collaborated with archaeologists to refine and validate the use of active and passive remote sensing for archeological use. The Stennis Space Center (SSC), located in Mississippi USA has been the NASA leader in archeological research. Together with colleagues from Goddard Space Flight Center (GSFC), Marshall Space Flight Center (MSFC), and the Jet Propulsion Laboratory (JPL), SSC scientists have provided the archaeological community with useful images and sophisticated processing that have pushed the technological frontiers of archaeological research and applications. Successful projects include identifying prehistoric roads in Chaco canyon, identifying sites from the Lewis and Clark Corps of Discovery exploration and assessing prehistoric settlement patterns in southeast Louisiana. The Scientific Data Purchase (SDP) stimulated commercial companies to collect archaeological data. At present, NASA formally solicits "space archaeology" proposals through its Earth Science Directorate and continues to assist archaeologists and cultural resource managers in doing their work more efficiently and effectively. This paper focuses on passive remote sensing and does not consider the significant contributions made by NASA active sensors. Hyperspectral data offers new opportunities for future archeological discoveries.

Giardino, Marco J.↗

Visualization Quality Assessment

Understanding how inaccuracies in visualizations affect users’ perception and understanding of scientific data is hard. Inaccuracies in visualizations are quite common and could arise from a range of sources such as errors in the original dataset arising from compression artifacts, errors in the capturing device, noise during transmission of the data, effects due to the algorithm being used to convert data to visualization images, images generated from neural networks, and sources we have yet to discover. Many image quality assessment metrics have been developed to quantify image errors. However, these are usually focused on “natural images” rather than visualizations of scientific data. Common image quality assessment metrics (IQAs) include MSE, PSNR, perceptual metrics such SSIM, FSIM as well as perceptual metrics using deep learning approaches. However, a critical part of understanding how errors are perceived by humans, and subsequently developing more accurate quality assessment metrics, is through user evaluation studies. The goal of this software is to develop a visualization quality assessment (VQA) process that will enable the generation of VQAs that can be used to quantify errors in scientific data visualizations. The VQA development process will include software to support user evaluation experimental design, analysis of visualization differences against standard quality metrics, and the ability to develop additional VQA metrics specific to scientific visualization images.

Grosset, Andre↗

DataFed

There is a need to easily and uniformly capture, access, enrich, organize, search, and collaborate on working scientific data sets across geographically distributed experiment, computation, and data analytics facilities. DataFed provides a set of services and applications enabling simple and uniform cross-facility scientific data management with federated (distributed) data repositories. This solution greatly reduces effort required by scientist to organize and/or move data between facilities/institutes, Reduces likelihood of misidentification and subsequent misuse of data, and improves scientific reproducibility through deep, domain-specific context and provenance capture.

Stansberry, DaleV.↗