Search NASA⌕ Search

SEARCH · Search NASA

Results for “Metadata Normalization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

15 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

GeneLab Analysis Working Group Kick-Off Meeting

Goals to achieve for GeneLab AWG - GL vision - Review of GeneLab AWG charter Timeline and milestones for 2018 Logistics - Monthly Meeting - Workshop - Internship - ASGSR Introduction of team leads and goals of each group Introduction of all members Q/A Three-tier Client Strategy to Democratize Data Physiological changes, pathway enrichment, differential expression, normalization, processing metadata, reproducibility, Data federation/integration with heterogeneous bioinformatics external databases The GLDS currently serves over 100 omics investigations to the biomedical community via open access. In order to expand the scope of metadata record searches via the GLDS, we designed a metadata warehouse that collects and updates metadata records from external systems housing similar data. To demonstrate the capabilities of federated search and retrieval of these data, we imported metadata records from three open-access data systems into the GLDS metadata warehouse: NCBI's Gene Expression Omnibus (GEO), EBI's PRoteomics IDEntifications (PRIDE) repository, and the Metagenomics Analysis server (MG-RAST). Each of these systems defines metadata for omics data sets differently. One solution to bridge such differences is to employ a common object model (COM) to which each systems' representation of metadata can be mapped. Warehoused metadata records are then transformed at ETL to this single, common representation. Queries generated via the GLDS are then executed against the warehouse, and matching records are shown in the COM representation (Fig. 1). While this approach is relatively straightforward to implement, the volume of the data in the omics domain presents challenges in dealing with latency and currency of records. Furthermore, the lack of a coordinated has been federated data search for and retrieval of these kinds of data across other open-access systems, so that users are able to conduct biological meta-investigations using data from a variety of sources. Such meta-investigations are key to corroborating findings from many kinds of assays and translating them into systems biology knowledge and, eventually, therapeutics.

GeneLab↗
NASA NTRSDate not supplied

Automated Metadata Scoring Approaches for Earth Observation Data

The Common Metadata Repository (CMR) contains metadata records describing NASA’s Earth observation data products which are archived across 12 data centers also known as Distributed Active Archive Centers (DAACs). To ensure that NASA’s data is discoverable, accessible, and usable, the Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, assesses the quality of these metadata records. The ARC team currently uses a combination of automated and manual methods to check metadata records for quality dimensions such as completeness, correctness, and consistency. In addition to these quality assessments, the team is currently exploring various metadata scoring methods in order to provide normalized results across the twelve DAACs. This method is conducted by using automated methods to assess metadata fields and then provide a numeric score, or grade, based on the analysis. To implement this process, two different approaches have been theorized and are currently being explored by the ARC team. This presentation will describe ARC's two proposed methodologies in more detail, and the pros and cons to using these metadata scoring methods.

Jenny Wood↗
NASA NTRS2004

Texture-Based Correspondence Display

Texture-based correspondence display is a methodology to display corresponding data elements in visual representations of complex multidimensional, multivariate data. Texture is utilized as a persistent medium to contain a visual representation model and as a means to create multiple renditions of data where color is used to identify correspondence. Corresponding data elements are displayed over a variety of visual metaphors in a normal rendering process without adding extraneous linking metadata creation and maintenance. The effectiveness of visual representation for understanding data is extended to the expression of the visual representation model in texture.

Gerald-Yamasaki, Michael↗
NASA NTRS2006

Controlled Vocabularies Boost International Participation and Normalization of Searches

The Global Change Master Directory's (GCMD) science staff set out to document Earth science data and provide a mechanism for it's discovery in fulfillment of a commitment to NASA's Earth Science progam and to the Committee on Earth Observation Satellites' (CEOS) International Directory Network (IDN.) At the time, whether to offer a controlled vocabulary search or a free-text search was resolved with a decision to support both. The feedback from the user community indicated that being asked to independently determine the appropriate 'English" words through a free-text search would be very difficult. The preference was to be 'prompted' for relevant keywords through the use of a hierarchy of well-designed science keywords. The controlled keywords serve to 'normalize' the search through knowledgeable input by metadata providers. Earth science keyword taxonomies were developed, rules for additions, deletions, and modifications were created. Secondary sets of controlled vocabularies for related descriptors such as projects, data centers, instruments, platforms, related data set link types, and locations, along with free-text searches assist users in further refining their search results. Through this robust 'search and refine' capability in the GCMD users are directed to the data and services they seek. The next step in guiding users more directly to the resources they desire is to build a 'reasoning' capability for search through the use of ontologies. Incorporating twelve sets of Earth science keyword taxonomies has boosted the GCMD S ability to help users define and more directly retrieve data of choice.

Olsen, Lola M.↗
NASA NTRS2023

Greenland and Canadian Arctic Ice Temperature Profiles Database

Here, we present a compilation of 95 ice temperature profiles from 85 boreholes from the Greenland ice sheet and peripheral ice caps, as well as local ice caps in the Canadian Arctic. Profiles from only 31 boreholes (36 %) were previously available in open-access data repositories. The remaining 54 borehole profiles (64 %) are being made digitally available here for the first time. These newly available profiles, which are associated with pre-2010 boreholes, have been submitted by community members or digitized from published graphics and/or data tables. All 95 profiles are now made available in both absolute (meters) and normalized (0 to 1 ice thickness) depth scales and are accompanied by extensive metadata. These metadata include a transparent description of data provenance. The ice temperature profiles span 70 years, with the earliest profile being from 1950 at Camp VI, West Greenland. To highlight the value of this database in evaluating ice flow simulations, we compare the ice temperature profiles from the Greenland ice sheet with an ice flow simulation by the Parallel Ice Sheet Model (PISM). We find a cold bias in modeled near-surface ice temperatures within the ablation area, a warm bias in modeled basal ice temperatures at inland cold-bedded sites, and an apparent underestimation of deformational heating in high-strain settings. These biases provide process level insight on simulated ice temperatures.

Greenland↗
NASA NTRS2016

Multi-Sensor Cloud and Aerosol Retrieval Simulator and Remote Sensing from Model Parameters : Aerosols - Part 2

The Multi-sensor Cloud Retrieval Simulator (MCRS) produces a simulated radiance product from any high-resolution general circulation model with interactive aerosol as if a specific sensor such as the Moderate Resolution Imaging Spectroradiometer (MODIS) were viewing a combination of the atmospheric column and land ocean surface at a specific location. Previously the MCRS code only included contributions from atmosphere and clouds in its radiance calculations and did not incorporate properties of aerosols. In this paper we added a new aerosol properties module to the MCRS code that allows users to insert a mixture of up to 15 different aerosol species in any of 36 vertical layers. This new MCRS code is now known as MCARS (Multi-sensor Cloud and Aerosol Retrieval Simulator). Inclusion of an aerosol module into MCARS not only allows for extensive, tightly controlled testing of various aspects of satellite operational cloud and aerosol properties retrieval algorithms, but also provides a platform for comparing cloud and aerosol models against satellite measurements. This kind of two-way platform can improve the efficacy of model parameterizations of measured satellite radiances, allowing the assessment of model skill consistently with the retrieval algorithm. The MCARS code provides dynamic controls for appearance of cloud and aerosol layers. Thereby detailed quantitative studies of the impacts of various atmospheric components can be controlled. In this paper we illustrate the operation of MCARS by deriving simulated radiances from various data field output by the Goddard Earth Observing System version 5 (GEOS-5) model. The model aerosol fields are prepared for translation to simulated radiance using the same model sub grid variability parameterizations as are used for cloud and atmospheric properties profiles, namely the ICA technique. After MCARS computes modeled sensor radiances equivalent to their observed counterparts, these radiances are presented as input to operational remote-sensing algorithms. Specifically, the MCARS-computed radiances are input into the processing chain used to produce the MODIS Data Collection 6 aerosol product (MOYD04). TheMOYD04 product is of course normally produced from MOYD021KM MODIS Level-1B radiance product directly acquired by the MODIS instrument. MCARS matches the format and metadata of a MOYD021KM product. The resulting MCARS output can be directly provided to MODAPS (MODIS Adaptive Processing System) as input to various operational atmospheric retrieval algorithms. Thus the operational algorithms can be tested directly without needing to make any software changes to accommodate an alternative input source. We show direct application of this synthetic product in analysis of the performance of the MOD04 operational algorithm. We use biomass-burning case studies over Amazonia employed in a recent Working Group on Numerical Experimentation (WGNE)-sponsored study of aerosol impacts on numerical weather prediction (Freitas et al., 2015). We demonstrate that a known low bias in retrieved MODIS aerosol optical depth appears to be due to a disconnect between actual column relative humidity and the value assumed by the MODIS aerosol product.

aerosol retrieval↗
NASA NTRSDate not supplied

NASA GeneLab Multi-study Visualization Portal

NASA GeneLab has helped advance the field of Space Biology by providing a public repository where researchers can store, share, analyze and visualize the results of space flight related omics experiments. The GeneLab data visualization portal allows any user, regardless of bioinformatics knowledge or access to computational resources, to interact with the experimental data, draw their own conclusions, and gain insights about the effects of space on living systems. These tools help democratize scientific research and foster the NASA Open Science initiative. The new multi-study feature of the GeneLab visualization platform allows users to mine study metadata from RNA sequencing (RNA-seq) experiments to identify samples of interest by filtering datasets based on organism, tissue, assay technology type, and/or factor. Once samples are selected from multiple datasets, users can combine and normalize the sample data, then utilize the visualization displays, including Principal Component Analysis (PCA) plots, to assess sample distributions. Finally, users can perform differential gene expression analysis on the combined data and visualize the results through PCA plots, Volcano plots, Pair plots, Heatmap, Ideogram and Gene Set Enrichment Analysis. All user-generated results and visualizations will be available for download. Here, we present a biological study using samples from multiple GeneLab RNA-seq datasets and analyzed using the multi-study visualization platform to demonstrate inter- and intra-study variability, as well as commonly differentially expressed genes between spaceflight and ground control conditions across datasets. This new feature opens a wide range of possibilities and opportunities for further development including combining other assay technology types and integration with batch effect correction techniques and machine learning applications. Overall, this tool allows users to increase the statistical power of individual experiments, validate hypothesis, identify patterns, and opens the door to new and exciting research.

space biology↗
NASA NTRS2017

Advancing Translational Space Research Through Biospecimen Sharing: Amplifying the Impact of Ground-Based Studies

Biospecimen Sharing Programs (BSPs) have been organized by NASA Ames Research Center since the 1960s with the goal of maximizing utilization and scientific return from rare, complex and costly spaceflight experiments. BSPs involve acquiring otherwise unused biological specimens from primary space research experiments for distribution to secondary experiments. Here we describe a collaboration leveraging Ames expertise in biospecimen sharing to magnify the scientific impact of research informing astronaut health funded by the NASA Human Research Program (HRP) Human Health Countermeasures (HHC) Element. The concept expands biospecimen sharing to one-off ground-based studies utilizing analogue space platforms (e.g., Hind limb Unloading (HLU), Artificial Gravity) for rodent experiments, thereby significantly broadening the range of research opportunities with translational relevance for protecting human health in space and on Earth. In this presentation, we will report on biospecimens currently being acquired from HHC Award Head-Down Tilt as a Model for Intracranial and Intraocular Pressures, and Retinal Changes during Spaceflight, and their availability. The BSP add-on to the project described herein has already yielded for HHC-funded investigators more than 4,700 additional tissues that would otherwise have been discarded as waste, with additional tissues available for analysis. Young (3-mo old) male and female rats and Older (9-mo old) male rats are being exposed to HLU for either 7, 14, 28, or 90 days. Additional groups are exposed to 90 days of unloading followed by either 7, 14, 28 days or 90 days of recovery (normal loading). Comparisons are made with non-suspended controls. Unused tissues are: Skin, Lungs, Thymus, Adrenals, Kidneys, Spleen, Hindlimb Muscles (Soleus, Extensor Digitorum Longus, Tibialis Anterior, Plantaris Gastrocnemius), Fat Pads, Reproductive Organs, and Intestines. Tissues are harvested, weighed, preserved then archived (with metadata) using a sample tracking system (CryoTrack). Preservation techniques include snap-freezing and RNALatersnap-freezing. Specimens were weighed at the time of dissection, and organ mass: body mass ratios analyzed to determine unloading effects across conditions and durations. The results corroborate previously reported effects of short-term exposure to microgravity or unloading exposure on various organs, and provide new insights into adaptation to long-duration unloading relevant to sustained spaceflight exposures on ISS. Supported by the Human Research Program (HRP) Human Health Countermeasures (HHC) Element and NASA Grant NNX13AD94G (CAF).

rodent↗
NASA NTRS2017

Advancing Translational Space Research Through Biospecimen Sharing: Amplified Impact of Studies Utilizing Analogue Space Platforms

Biospecimen Sharing Programs (BSPs) have been organized by NASA Ames Research Center since the 1960s with the goal of maximizing utilization and scientific return from rare, complex and costly spaceflight experiments. BSPs involve acquiring otherwise unused biological specimens from primary space research experiments for distribution to secondary experiments. Here we describe a collaboration leveraging Ames expertise in biospecimen sharing to magnify the scientific impact of research informing astronaut health funded by the NASA Human Research Program (HRP) Human Health Countermeasures (HHC) Element. The concept expands biospecimen sharing to one-off ground-based studies utilizing analogue space platforms (e.g., Hindlimb Unloading (HLU), Artificial Gravity) for rodent experiments, thereby significantly broadening the range of research opportunities with translational relevance for protecting human health in space and on Earth. In this presentation, we will report on biospecimens currently being acquired from HHC Award Head-Down Tilt as a Model for Intracranial and Intraocular Pressures, and Retinal Changes during Spaceflight, and their availability. The BSP add-on to the project described herein has already yielded for HHC-funded investigators more than 4,700 additional tissues that would otherwise have been discarded as waste, with additional tissues available for analysis. Young (3-mo old) male and female rats and Older (9-mo old) male rats are being exposed to HLU for either 7, 14, 28, or 90 days. Additional groups are exposed to 90 days of unloading followed by either 7, 14, 28 days or 90 days of recovery (normal loading). Comparisons are made with non-suspended controls. Unused tissues are: Skin, Lungs, Thymus, Adrenals, Kidneys, Spleen, Hindlimb Muscles (Soleus, Extensor Digitorum Longus, Tibialis Anterior, Plantaris Gastrocnemius), Fat Pads, Reproductive Organs, and Intestines. Tissues are harvested, weighed, preserved then archived (with metadata) using a sample tracking system (CryoTrack). Preservation techniques include snap-freezing and RNALatersnap-freezing. Specimens were weighed at the time of dissection, and organ mass:body mass ratios analyzed to determine unloading effects across conditions and durations. The results corroborate previously reported effects of short-term exposure to microgravity or unloading exposure on various organs, and provide new insights into adaptation to long-duration unloading relevant to sustained spaceflight exposures on ISS.

biospecimen sharing↗
NASA NTRS2011

In Situ Surface Characterization

Operation of in situ space assets, such as rovers and landers, requires operators to acquire a thorough understanding of the environment surrounding the spacecraft. The following programs help with that understanding by providing higher-level information characterizing the surface, which is not immediately obvious by just looking at the XYZ terrain data. This software suite covers three primary programs: marsuvw, marsrough, and marsslope, and two secondary programs, which together use XYZ data derived from in situ stereo imagery to characterize the surface by determining surface normal, surface roughness, and various aspects of local slope, respectively. These programs all use the Planetary Image Geometry (PIG) library to read mission-specific data files. The programs themselves are completely multimission; all mission dependencies are handled by PIG. The input data consists of images containing XYZ locations as derived by, e.g., marsxyz. The marsuvw program determines surface normals from XYZ data by gathering XYZ points from an area around each pixel and fitting a plane to those points. Outliers are rejected, and various consistency checks are applied. The result shows the orientation of the local surface at each point as a unit vector. The program can be run in two modes: standard, which is typically used for in situ arm work, and slope, which is typically used for rover mobility. The difference is primarily due to optimizations necessary for the larger patch sizes in the slope case. The marsrough program determines surface roughness in a small area around each pixel, which is defined as the maximum peak-to-peak deviation from the plane perpendicular to the surface normal at that pixel. The marsslope program takes a surface normal file as input and derives one of several slope-like outputs from it. The outputs include slope, slope rover direction (a measure of slope radially away from the rover), slope heading, slope magnitude, northerly tilt, and solar energy (compares the slope with the Sun s location at local noon). The marsuvwproj program projects a surface normal onto an arbitrary plane in space, resulting in a normalized 3D vector, which is constrained to lie in the plane. The marsuvwrot program rotates the vectors in a surface normal file, generating a new surface normal file. It also can change coordinate systems for an existing surface normal file. While the algorithms behind this suite are not particularly unique, what makes the programs useful is their integration into the larger in situ image processing system via the PIG library. They work directly with space in situ data, understanding the appropriate image metadata fields and updating them properly. The secondary programs (marsuvwproj, marsuvwrot) were originally developed to deal with anomalous situations on Opportunity and Spirit, respectively, but may have more general applicability.

Deen, Robert G.↗
NASA NTRS2011

NASA's Global Change Master Directory: Discover and Access Earth Science Data Sets, Related Data Services, and Climate Diagnostics

NASA's Global Change Master Directory provides the scientific community with the ability to discover, access, and use Earth science data, data-related services, and climate diagnostics worldwide. The GCMD offers descriptions of Earth science data sets using the Directory Interchange Format (DIF) metadata standard; Earth science related data services are described using the Service Entry Resource Format (SERF); and climate visualizations are described using the Climate Diagnostic (CD) standard. The DIF, SERF and CD standards each capture data attributes used to determine whether a data set, service, or climate visualization is relevant to a user's needs. Metadata fields include: title, summary, science keywords, service keywords, data center, data set citation, personnel, instrument, platform, quality, related URL, temporal and spatial coverage, data resolution and distribution information. In addition, nine valuable sets of controlled vocabularies have been developed to assist users in normalizing the search for data descriptions. An update to the GCMD's search functionality is planned to further capitalize on the controlled vocabularies during database queries. By implementing a dynamic keyword "tree", users will have the ability to search for data sets by combining keywords in new ways. This will allow users to conduct more relevant and efficient database searches to support the free exchange and re-use of Earth science data. http://gcmd.nasa.gov/

Aleman, Alicia↗
NASA NTRSDate not supplied

Open Science for Plants in Space: Improvements in NASA's Open Science Data Repository

Upcoming deep space missions will rely on plants for crew and ecosystem health. Open access space biology data enables scientists to examine the biological responses of plants to ionizing radiation, altered gravity, elevated CO2, and many other abiotic stressors. NASA has declared 2023 as the ‘Year of Open Science’ and created a 5-year Transform to Open Science (TOPS) initiative designed to rapidly transform the agency toward an inclusive culture of open science. NASA’s Open Science Data Repository (OSDR) combines two databases, GeneLab and Ames Life Sciences Data Archive (ALSDA) to maximize access to standardized ‘omics (e.g., transcriptomics, proteomics) and phenotypic data (e.g., microscopy, biomass), respectively. Current OSDR standards include the ISA (Investigation-Study-Assay) experiment model, assay metadata configurations, and standardized terminology and ontologies. In 2024 OSDR will include a new suite of features for improved FAIR compliance including downloadable plant metadata templates, data submission tools and overall improved AI-readiness of plant datasets. AI/ML methods can be helpful tools to overcome the inherent challenges of space biology research (small sample size, sparse and heterogeneous data etc.). However these methods are built on an assumption of normalized and well-curated data. OSDR’s new curation tools will improve users ability to leverage ML and AI methods to model space biology data and better understand the complex effects of spaceflight on living systems across hierarchical biological levels. We look forward to sharing our advances with the spaceflight community.

FAIR↗
NASA NTRS2016

Community Involvement in Enhancing the Global Change Master Directory (GCMD) Controlled Vocabularies (Keywords)

NASA's Global Change Master Directory (GCMD) develops and expands a hierarchical set of controlled vocabularies (keywords) covering the Earth sciences and associated information (data centers, projects, platforms, instruments, etc.). The purpose of the keywords is to describe Earth science data and services in a consistent and comprehensive manner, allowing for the precise searching of metadata and subsequent retrieval of data and services. The keywords are accessible in a standardized SKOSRDFOWL representation and are used as an authoritative taxonomy, as a source for developing ontologies, and to search and access Earth Science data within online metadata catalogues. The keyword development approach involves: (1) receiving community suggestions, (2) triaging community suggestions, (3) evaluating the keywords against a set of criteria coordinated by the NASA ESDIS Standards Office, and (4) publication/notification of the keyword changes. This approach emphasizes community input, which helps ensure a high quality, normalized, and relevant keyword structure that will evolve with users changing needs. The Keyword Community Forum, which promotes a responsive, open, and transparent processes, is an area where users can discuss keyword topics and make suggestions for new keywords. The formalized approach could potentially be used as a model for keyword development.

governance↗
NASA NTRS2015

Normalizing Resource Identifiers using Lexicons in the Global Change Information System: Linking Earth Science Identifiers, Concepts, and Communities

Earth Science informatics involves collaboration between multiple groups of people with diverse specializations and goals,often using variations in terminology to refer to common resources. The uniformity of the resource identifiers often does not cross organizational boundaries. Because of this, permanent, widely used, unambiguous identifiers for resources are elusive. We examine real world cases of changing and inconsistent identifiers which inherently work against persistence and uniformity. We also present a solution which mediates factors in these situations; namely the creation of lexicons:mappings of sets of terms to URIs which are curated within the Global Change Information System (GCIS). We discuss aspects of the GCIS which facilitate the use of lexicons: an information model which disambiguates resources, a RESTful API which provides metadata through content-negotiation, and a strategy for long term curation of URIs, including mechanisms for handling changes to URIs and variations in terms used by different communities while providing persistent URIs and preserving relationships between resources We provide working definitions of terms,contexts, and lexicons, and relate them to the practical challenges of disambiguation and curation. We also discuss the mechanisms employed and architecture of the GCIS, and how these choices facilitate representation of persistent identifiers and mappings of them to identifiers used colloquially within various earth science communities of practice.

Linkded Data↗
NASA NTRS2006

Remote Sensing Time Series Product Tool

The TSPT (Time Series Product Tool) software was custom-designed for NASA to rapidly create and display single-band and band-combination time series, such as NDVI (Normalized Difference Vegetation Index) images, for wide-area crop surveillance and for other time-critical applications. The TSPT, developed in MATLAB, allows users to create and display various MODIS (Moderate Resolution Imaging Spectroradiometer) or simulated VIIRS (Visible/Infrared Imager Radiometer Suite) products as single images, as time series plots at a selected location, or as temporally processed image videos. Manually creating these types of products is extremely labor intensive; however, the TSPT development tool makes the process simplified and efficient. MODIS is ideal for monitoring large crop areas because of its wide swath (2330 km), its relatively small ground sample distance (250 m), and its high temporal revisit time (twice daily). Furthermore, because MODIS imagery is acquired daily, rapid changes in vegetative health can potentially be detected. The new TSPT technology provides users with the ability to temporally process high-revisit-rate satellite imagery, such as that acquired from MODIS and from its successor, the VIIRS. The TSPT features the important capability of fusing data from both MODIS instruments onboard the Terra and Aqua satellites, which drastically improves cloud statistics. With the TSPT, MODIS metadata is used to find and optionally remove bad and suspect data. Noise removal and temporal processing techniques allow users to create low-noise time series plots and image videos and to select settings and thresholds that tailor particular output products. The TSPT GUI (graphical user interface) provides an interactive environment for crafting what-if scenarios by enabling a user to repeat product generation using different settings and thresholds. The TSPT Application Programming Interface provides more fine-tuned control of product generation, allowing experienced programmers to bypass the GUI and to create more user-specific output products, such as comparison time plots or images. This type of time series analysis tool for remotely sensed imagery could be the basis of a large-area vegetation surveillance system. The TSPT has been used to generate NDVI time series over growing seasons in California and Argentina and for hurricane events, such as Hurricane Katrina.

Predos, Don↗