Search NASA⌕ Search

SEARCH · Search NASA

Results for “data provenance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Earth Science Informatics - Overview

Over the last 10-15 years, significant advances have been made in information management, there are an increasing number of individuals entering the field of information management as it applies to Geoscience and Remote Sensing data, and the field of informatics has come to its own. Informatics is the science and technology of applying computers and computational methods to the systematic analysis, management, interchange, and representation of science data, information, and knowledge. Informatics also includes the use of computers and computational methods to support decision making and applications. Earth Science Informatics (ESI, a.k.a. geoinformatics) is the application of informatics in the Earth science domain. ESI is a rapidly developing discipline integrating computer science, information science, and Earth science. Major national and international research and infrastructure projects in ESI have been carried out or are on-going. Notable among these are: the Global Earth Observation System of Systems (GEOSS), the European Commissions INSPIRE, the U.S. NSDI and Geospatial One-Stop, the NASA EOSDIS, and the NSF DataONE, EarthCube and Cyberinfrastructure for Geoinformatics. More than 18 departments and agencies in the U.S. federal government have been active in Earth science informatics. All major space agencies in the world, have been involved in ESI research and application activities. In the United States, the Federation of Earth Science Information Partners (ESIP), whose membership includes over 180 organizations (government, academic and commercial) dedicated to managing, delivering and applying Earth science data, has been working on many ESI topics since 1998. The Committee on Earth Observation Satellites (CEOS)s Working Group on Information Systems and Services (WGISS) has been actively coordinating the ESI activities among the space agencies.The talk will present an overview of current efforts in ESI, the role members of IEEE GRSS play, and discuss recent developments in data preservation and provenance.

Remote Sensing↗

Preservation of Provenance and Context to Ensure Future Understandability of Airborne Earth Observations and Derived Data Products

Open-source science goes beyond making data from scientific projects (e.g., on-orbit/satellite missions, airborne and field investigations, and other data producing activities) openly available after they are generated, but involves and open sharing of information throughout the project lifecycle. Preservation of the data and associated information required for understanding and reusing the data well after the scientific projects is a contributor to open-source science as well. Considering the high investment in the on-orbit/satellite missions, we had developed a document titled “NASA Earth Science Data Preservation Content Specification (PCS)” in 2011. This document has been used as a requirement for recent on-orbit/satellite missions by NASA. Recently it became clear that the specifications should be applied to other scientific projects as well. Therefore, the document was revised to cover other types of projects, and a Preservation Content Implementation Guidance (PCIG) document was also developed. The revised PCS, and the PCIG, were published in 2022. The purpose of this presentation is to highlight the contents of these documents as they apply to suborbital/airborne investigations. The PCS calls for content preservation in eight general categories - Measuring Instrument/Platform Description, Instrument and Science Data Products and Metadata, Science Raw Data, Product and Algorithm Documentation, Instrument Calibration, Science Algorithm Software, Science Data Product Algorithm Inputs, Science Data Product Validation, and Science Data Access and Analysis Tools. While all these categories apply to various types of projects, a few clarifying sentences have been added to the descriptions of contents in each of the categories to show which categories are especially important to airborne and field investigations and where some contents are not applicable (or difficult to obtain). The PCIG document provides some general guidance applicable to all types of projects and specific guidance in a separate section for airborne and field investigations. This section calls out typical artifacts produced during such investigations that can meet the spirit of the various PCS categories.

remote sensing↗

Data Quality Challenges for Analysis Ready Data (ARD)

Data quality plays a critical role in research and applications. The Earth Science Information Partners (ESIP) Information Quality Cluster (IQC) defines four aspects of information quality: Science, Product, Stewardship, and Services. The ESIP IQC has become internationally recognized as an authoritative and responsive resource of information and guidance to data producers and distributors on how to implement data quality standards and best practices for their science data systems, datasets, and data/metadata dissemination services. In recent years, cloud computing environments have provided scale-up capabilities such as data archives and services, enabling interdisciplinary science and applications. More value-added products are expected from data service providers, including Analysis Ready Data (ARD). ARD refers to data that has been preprocessed into a form that allows immediate analysis by the end user, processed to a minimum set of requirements and provides interoperability over time and across multiple datasets. Once a dataset has been developed from its original form to produce ARD, what quality characteristics should the derived dataset or ARD possess? Also, is it safe to assume that the quality of the ARD is consistent with the quality of the source data, or are there special attributes to an ARD that would warrant a secondary, independent quality assessment? What provenance (also called “data lineage”) information needs to be included in ARD? It is important to answer these questions, especially given the ease of use of ARD, and the consequent temptation by users to trust ARD without understanding the limitations or possible variations in quality compared to the source data. In this presentation, we will discuss data quality challenges for ARD products and services and introduce IQC for participation.

data quality↗

Lower bound on reliability for Weibull distribution when shape parameter is not estimated accurately

The mathematical relationships between the shape parameter Beta and estimates of reliability and a life limit lower bound for the two parameter Weibull distribution are investigated. It is shown that under rather general conditions, both the reliability lower bound and the allowable life limit lower bound (often called a tolerance limit) have unique global minimums over a range of Beta. Hence lower bound solutions can be obtained without assuming or estimating Beta. The existence and uniqueness of these lower bounds are proven. Some real data examples are given to show how these lower bounds can be easily established and to demonstrate their practicality. The method developed here has proven to be extremely useful when using the Weibull distribution in analysis of no-failure or few-failures data. The results are applicable not only in the aerospace industry but anywhere that system reliabilities are high.

Huang, Zhaofeng↗

Lower bound on reliability for Weibull distribution when shape parameter is not estimated accurately

The mathematical relationships between the shape parameter Beta and estimates of reliability and a life limit lower bound for the two parameter Weibull distribution are investigated. It is shown that under rather general conditions, both the reliability lower bound and the allowable life limit lower bound (often called a tolerance limit) have unique global minimums over a range of Beta. Hence lower bound solutions can be obtained without assuming or estimating Beta. The existence and uniqueness of these lower bounds are proven. Some real data examples are given to show how these lower bounds can be easily established and to demonstrate their practicality. The method developed here has proven to be extremely useful when using the Weibull distribution in analysis of no-failure or few-failures data. The results are applicable not only in the aerospace industry but anywhere that system reliabilities are high.

Huang, Zhaofeng↗

Providing Global Change Information for Decision-Making: Capturing and Presenting Provenance

Global change information demands access to data sources and well-documented provenance to provide evidence needed to build confidence in scientific conclusions and, in specific applications, to ensure the information's suitability for use in decision-making. A new generation of Web technology, the Semantic Web, provides tools for that purpose. The topic of global change covers changes in the global environment (including alterations in climate, land productivity, oceans or other water resources, atmospheric composition and or chemistry, and ecological systems) that may alter the capacity of the Earth to sustain life and support human systems. Data and findings associated with global change research are of great public, government, and academic concern and are used in policy and decision-making, which makes the provenance of global change information especially important. In addition, since different types of decisions benefit from different types of information, understanding how to capture and present the provenance of global change information is becoming more of an imperative in adaptive planning.

provenance tracking↗

The Open Data Repository's Data Publisher

We have quickly gathered a diverse set of databases that have significant activity. Researchers are using them on a daily basis from collection through all phases of research. Focus on: (1) Linked data and semantic web integration are fundamental to our long term plans. (2) Citation system is critical before our first full release. Snapshot-based citation generation for data sets or objects. As we expand our feature set, expect the system will: (1) Provide a very high level of provenance for any data housed in the software. (2) Make data management beneficial to the researcher throughout the research process. (3) Create living archives that allow citable snapshots of data and summaries of the changes since the snapshot was created.

Stone, N.↗

Computer-aided analysis of Skylab scanner data for land use mapping, forestry and water resource applications

Skylab data were obtained over a mountainous test site containing a complex association of cover types and rugged topography. The application of computer-aided analysis techniques to the multispectral scanner data produced a number of significant results. Techniques were developed to digitally overlay topographic data (elevation, slope, and aspect) onto the S-192 MSS data to provide a method for increasing the effectiveness and accuracy of computer-aided analysis techniques for cover type mapping. The S-192 MSS data were analyzed using computer techniques developed at Laboratory for Applications of Remote Sensing (LARS), Purdue University. Land use maps, forest cover type maps, snow cover maps, and area tabulations were obtained and evaluated. These results compared very well with information obtained by conventional techniques. Analysis of the spectral characteristics of Skylab data has conclusively proven the value of the middle infrared portion of the spectrum (about 1.3-3.0 micrometers), a wavelength region not previously available in multispectral satellite data.

Hoffer, R. M.↗

Sun Safe Mode Controller Design for LADEE

This paper presents the development of sun safe controllers which are designed to keep the spacecraft power positive and thermally balanced in the event an anomaly is detected. Employed by NASA's Lunar Atmosphere and Dust Environment Explorer (LADEE), the controllers utilize the measured sun vector and the spacecraft body rates for feedback control. To improve the accuracy of sun vector estimation, the least square minimization approach is applied to process the sensor data, which is proven to be effective and accurate. To validate the controllers, the LADEE spacecraft model engaging the sun safe mode was first simulated and then compared with the actual LADEE orbital fight data. The results demonstrated the applicability of the proposed sun safe controllers.

Sun Safe Control↗

Jet-Surface Interaction Noise from High-Aspect Ratio Nozzles: Test Summary

Noise and flow data have been acquired for a 16:1 aspect ratio rectangular nozzle exhausting near a simple surface at the NASA Glenn Research Center as part of an ongoing effort to understand, model, and predict the noise produced by current and future concept aircraft employing a tightly integrated engine airframe designs. The particular concept under consideration in this experiment is a blended-wing-body airframe powered by a series of electric fans exhausting through slot nozzle over an aft deck. The exhaust Mach number and surface length were parametrically varied during the test. Far-field noise data were acquired for all nozzle surface geometries and exhaust flow conditions. Phased-array noise source localization data and in-flow pressure data were also acquired for a subset of the isolated (no surface) and surface configurations; these measurements provide data that have proven useful for modeling the jet-surface interaction noise source and the surface effect on the jet-mixing noise in round jets. A summary of the nozzle surface geometry, flow conditions tested, and data collected are presented.

Propulsion Noise↗

ERTS-1 applications in hydrology and water resources

After having been in orbit for less than one year, the Earth Resources Technology Satellite (ERTS-1) has shown that it provides very applicable data for more effective monitoring and management of surface water features over the globe. Mapping flooded areas, snowcover, and wetlands and surveying the size, type, and response of glaciers to climate are among the specific areas where ERTS-1 data were applied. In addition the data collection system has proven to be a reliable tool for gathering hydrologic data from remote regions. Turbidity variations in lakes and rivers were also observed and related to shoreline erosion, industrial plant effluent, and overall water quality.

Salomonson, V. V.↗

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗

Testing the thermal Sunyaev-Zel’dovich power spectrum of a halo model using hydrodynamical simulations

Statistical properties of large-scale cosmological structures serve as powerful tools for constraining the cosmological properties of our Universe. Tracing the gas pressure, the thermal Sunyaev-Zel’dovich (tSZ) effect is a biased probe of mass distribution and, hence, can be used to test the physics of feedback or cosmological models. Therefore, it is crucial to develop robust modelling of hot gas pressure for applications to tSZ surveys. Since gas collapses into bound structures, it is expected that most of the tSZ signal is within halos produced by cosmic accretion shocks. Hence, simple empirical halo models can be used to predict the tSZ power spectra. In this study, we employed the HMx halo model to compare the tSZ power spectra with those of several hydrodynamical simulations: the Horizon suite and the Magneticum simulation. We examine various contributions to the tSZ power spectrum across different redshifts, including the one- and two-halo term decomposition, the amount of bound gas, the importance of different masses, and the electron pressure profiles. Our comparison of the tSZ power spectrum reveals discrepancies between the halo model and cosmological simulations that increase with redshift. We find a 20% to 50% difference between the measured and predicted tSZ angular power spectrum over the multipole range ℓ = 10 3 − 10 4 . Our analysis reveals that these differences are driven by the excess of power in the predicted two-halo term at low k and in the one-halo term at high k . At higher redshifts ( z ∼ 3), simulations indicate that more power comes from outside the virial radius than from inside, suggesting a limitation in the applicability of the halo model. We also observe differences in the pressure profiles, despite the fair level of agreement on the tSZ power spectrum at low redshift with the default calibration of the halo model. In conclusion, our study suggests that the properties of the halo model need to be carefully controlled against real or mock data to be proven useful for cosmological purposes.

Ayçoberry, Emma (ORCID:0000000292351195)↗

Space Shuttle stability and control flight test techniques

A unique approach for obtaining vehicle aerodynamic characteristics during entry has been developed for the Space Shuttle. This is due to the high cost of Shuttle testing, the need to open constraints for operational flights, and the fact that all flight regimes are flown starting with the first flight. Because of uncertainties associated with predicted aerodynamic coefficients, nine flight conditions have been identified at which control problems could occur. A detailed test plan has been developed for testing at these conditions and is presented. Due to limited testing, precise computer initiated maneuvers are implemented. These maneuvers are designed to optimize the vehicle motion for determining aerodynamic coefficients. Special sensors and atmospheric measurements are required to provide stability and control flight data during an entire entry. The techniques employed in data reduction are proven programs developed and used at NASA/DFRC.

Cooke, D. R.↗

Initial results from the Magellan stereo experiment

The second global radar image coverage of Venus by Magellan included a 1 day experiment to produce a set of eight images along orbits that combined with the original nominal imagery into stereo image pairs suited for visual stereo interpretation and mapping of topographic elevations. Initial analysis shows excellent stereo radar data with good vertical exaggeration of six and more, parallax accuracies of +/- 0.6 pixels or +/- 45 m and a surface definition with +/- 30 m. The topographic relief can be very accentuated, with local elevation differences of 2.5 km and terrain slopes often in excess of 25 deg. This data set has proven the usefulness of global stereo coverage and marks the beginning of significant planetary stereo radargrammetric developments. Extensive mapping with this same stereo geometry is being carried out in cycle 3, and preparations are underway to develop a detailed stereo radargrammetric topographic model of the planet.

Leberl, Franz W.↗

Guideline requirements for serviceable spacecraft grasping/berthing/docking interfaces based on simulations and flight experience

The described efforts support a NASA Space Assembly and Servicing Working Group activity to draft guideline interface standards. The general requirements are to provide a simple, reliable, and durable system. Interface requirements developed include lateral position offset, axial and lateral velocities, and angular misalignment. A survey of concepts and simulation studies of spacecraft docking, existing docking/end effector performance criteria, and space proven, qualified docking data was conducted and evaluated, in order to provide recommended mechanical interface guidelines and interface tolerances for manual and autonomous capture operations. The criterion for the selection of the guidelines was maximum capability to handle malfunctions. Originally the guidelines for a zero velocity docking were considered to be covered within the grasping/berthing definition. It is acknowledged that perhaps a separate category needs to be established for this operation. The draft standard was delivered to the AIAA for review, revision, and issuance as the first U.S. national standard guideline on interfaces. The intent is to develop the guidelines into an International Standards Organization standard.

Thompson, Allen B.↗

Ecology and life history of an amoebomastigote, Paratetramitus jugosus, from a microbial mat: new evidence for multiple fission

Five microbial habitats (gypsum crust, gypsum photosynthetic community, Microcoleus mat, Thiocapsa scum, and black mud) were sampled for the presence of the euryhaline, rapidly growing amoebomastigote, Paratetramitus jugosus. Field investigations of microbial mats from Baja California Norte, Mexico, and Salina Bido near Matanzas, Cuba, reveal that P. jugosus is most frequently found in the Thiocapsa layer of microbial mats. Various stages of the life history were studied using phase-contrast, differential-interference, and transmission electron microscopy. Mastigote stages were induced and studied by electron microscopy; mastigotes that actively feed on bacteria bear two or more undulipodia. A three-dimensional drawing of the kinetid ("basal apparatus") based on electron micrographs is presented. Although promitoses were occasionally observed, it is unlikely that they can account for the rapid growth of P. jugosus populations on culture media. Dense, refractile, spherical, and irregular-shaped bodies were seen at all times in all cultures along with small mononucleate (approximately 2-7 micrometers diameter) amoebae. Cytochemical studies employing two different fluorescent stains for DNA (DAPI, mithramycin) verified the presence of DNA in these small bodies. Chromatin-like material seen in electron micrographs within the cytoplasm and blebbing off nuclei were interpreted to the chromatin bodies. Our interpretation, consistent with the data but not proven, is that propagation by multiple fission of released chromatin bodies that become small amoebae may occur in Paratetramitus jugosus. These observations are consistent with descriptions of amoeba propagules in the early literature (Hogue, 1914).

Non-NASA Center↗