Search NASA⌕ Search

SEARCH · Search NASA

Results for “Science Pipeline”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Detecting Methane From Leaking Pipelines and as Greenhouse Gas in the Atmosphere

Laser remote sensing measurements of trace gases from orbit can provide unprecedented information about important planetary science and answer critical questions about planetary atmospheres. Methane (CH4) is the second most important anthropogenically produced greenhouse gas. Though its atmospheric abundance is much less than that of CO2 (1.78 ppm vs. 380 ppm), it has much larger greenhouse heating potential. CH4 also contributes to pollution in the lower atmosphere through chemical reactions, leading to ozone production. Atmospheric CH4 concentrations have been increasing as a result of increased fossil fuel production, rice farming, livestock, and landfills. Natural sources of CH4 include wetlands, wild fires, and termites, and perhaps other unknown sources. Important sinks for CH4 include non-saturated soils and oxidation by hydroxyl radicals in the atmosphere. Remotely measuring CH4 and other biogenic molecules (such as ethane and formaldehyde) on Mars also has important implications on the existence of life on Mars. Measuring CH4 at very low (ppb) concentrations from orbit will dramatically improve the sensitivity and spatial resolution in the search for CH4 vents and sub-surface life on other planets. A capability has been developed using lasers and spectroscopic detection techniques for the remote measurements of trace gases in open paths. Detection of CH4, CO2, H2O, and CO in absorption cells and in open paths, both in the mid- IR and near-IR region, has been demonstrated using an Optical Parametric Amplifier laser transmitter developed at GSFC. With this transmitter, it would be possible to develop a remote sensing methane instrument. CH4 detection also has very important commercial applications. Pipeline leak detection from an aircraft or a helicopter can significantly reduce cost, response time, and pinpoint the location. The main advantage is the ability to rapidly detect CH4 leaks remotely. This is extremely important for the petrochemical industry. This capability can be used in manned or unmanned airborne platforms for the detection of leaks in pipelines and other areas of interest where a CH4 leak is suspected.

Riris, Haris↗
NASA NTRS2012

Using Quality Attributes to Bridge Systems Engineering Gaps : A Juno Ground Data Systems Case Study

The Juno Mission to Jupiter is the second mission selected by the NASA New Frontiers Program. Juno launched August 2011 and will reach Jupiter July 2016. Juno's payload system is composed of nine instruments plus a gravity science experiment. One of the primary functions of the Juno Ground Data System (GDS) is the assembly and distribution of the CFDP (CCSDS File Delivery Protocol) product telemetry, also referred to as raw science data, for eight out of the nine instruments. The GDS accomplishes this with the Instrument Data Pipeline (IDP). During payload integration, the first attempt to exercise the IDP in a flight like manner revealed that although the functional requirements were well understood, the system was unable to meet latency requirements with the as-is heritage design. A systems engineering gap emerged between Juno instrument data delivery requirements and the assumptions behind the heritage flight-ground interactions. This paper describes the use of quality attributes to measure and overcome this gap by introducing a new systems engineering activity, and a new monitoring service architecture that successfully delivered the performance metrics needed to validate Juno IDP.

Ground Data Systems (GDS)↗
NASA NTRS2012

MER Telemetry Processor

MERTELEMPROC processes telemetered data in data product format and generates Experiment Data Records (EDRs) for many instruments (HAZCAM, NAVCAM, PANCAM, microscopic imager, Moessbauer spectrometer, APXS, RAT, and EDLCAM) on the Mars Exploration Rover (MER). If the data is compressed, then MERTELEMPROC decompresses the data with an appropriate decompression algorithm. There are two compression algorithms (ICER and LOCO) used in MER. This program fulfills a MER specific need to generate Level 1 products within a 60-second time requirement. EDRs generated by this program are used by merinverter, marscahv, marsrad, and marsjplstereo to generate higher-level products for the mission operations. MERTELEPROC was the first GDS program to process the data product. Metadata of the data product is in XML format. The software allows user-configurable input parameters, per-product processing (not streambased processing), and fail-over is allowed if the leading image header is corrupted. It is used within the MER automated pipeline. MERTELEMPROC is part of the OPGS (Operational Product Generation Subsystem) automated pipeline, which analyzes images returned by in situ spacecraft and creates level 1 products to assist in operations, science, and outreach.

Lee, Hyun H.↗
NASA NTRS1997

Adventures in Technology = Options in Math and Science

All five school systems on the Virginia Peninsula participate with a total of 21 middle schools in the ATOMS program. More than 20,000 students have participated in the pipeline programs since 1989. The focus has been on creating a diverse pool of academically-prepared students. The number of minority students participating has steadily increased, reaching 49.1 % in 1997. Female participation has remained steady at 55.4%. Female and minority participation will continue to receive high priority. The programs were evaluated by means of student, teacher, and counselor surveys. Questionnaires are distributed immediately after each intervention. The respondents are asked questions concerning the appropriateness of the activity, their interest level and change in opinion after the intervention. More than 90% of all students rate each activity as "Interesting" to "Very Interesting." Almost 70 % of students indicate they intend to take additional higher level mathematics courses in high school after participating in the Site and Campus Visits. Between 70 and 80 % (79.3 % after the Career Awareness Activity, 72.0 % after the Industry Site Visit) of students indicated they have a better understanding of why math and science are important school subjects after participation in each ATOMS activity. Comparisons in scores from the Iowa Test of Basic Skills have been made between the ATOMS students and the remainder of the seventh and eighth grade populations. ATOMS students' math and science achievement scores from the fifth grade were near the district average. After participating in ATOMS, students scored significantly higher than their peers. ATOMS students enrolled at TNCC have been identified and are being tracked further for achievement.

Quanty, Michael↗
NASA NTRS2015

The CHARIS IFS for high contrast imaging at Subaru

The Coronagraphic High Angular Resolution Imaging Spectrograph (CHARIS) is an integral field spectrograph (IFS) being built for the Subaru telescope. CHARIS will take spectra of brown dwarfs and hot Jovian planets in the coronagraphic image provided by the Subaru Coronagraphic Extreme Adaptive Optics (SCExAO) and AO188 adaptive optics systems. The system is designed to detect objects five orders of magnitude dimmer than their parent star down to an 80 milliarcsecond inner working angle. For characterization, CHARIS has a high-resolution prism providing an average spectral resolution of R82, R69, and R82 in J, H, and K bands respectively. The so-called discovery mode uses a second low-resolution prism with an average spectral resolution of R19 spanning 1.15-2.37 microns (J+H+K bands). This is unique compared to other high contrast IFS designs. It augments low inner working angle performance by reducing the separation at which we can rely on spectral differential imaging. The principal challenge for a high-contrast IFS is quasi-static speckles, which cause undue levels of spectral crosstalk. CHARIS has addressed this through several key design aspects that should constrain crosstalk between adjacent spectral features to be below 1%. Sitting on the Nasmyth platform, the alignment between the lenslet array, prism, and detector will be highly stable, key for the performance of the data pipeline. Nearly every component has arrived and the project is entering its final build phase. Here we review the science case, the resulting design, status of final construction, and lessons learned that are directly applicable to future exoplanet instruments.

Subaru Coronagraphic Extreme Adaptive Optics (SCEx↗
NASA NTRSDate not supplied

Open Science for Life in Space: Data Sharing and Tools for Knowledge Discovery

The fast-growing array of space biological data, which in the past was simply archived after minimal analysis, holds great potential if it can be reorganized and formatted for Open Science. Organizing the data for such analysis is a challenge because of its diverse nature (molecular, cellular, tissue, whole organism, behavior; tabular, imagery). Open Science is the concept that the more people have access to scientifically curated data, the more knowledge will be gained. This led NASA to start the development of GeneLab in 2015. GeneLab houses spaceflight and space-analog multi-omics datasets from plant, rodent, small animal, and microbial experiments. The success and knowledge gained from GeneLab led to a new alliance of NASA “Open Science Data Repositories” (OSDR), which include the Ames Life Sciences Data Archive (ALSDA) and the NASA Biological Institutional Scientific Collection (NBISC). Both are adopting the GeneLab data system, so data are more findable, accessible, interoperable, and reusable (FAIR). OSDR systems provide users the ability to upload, download, search, share, analyze, and visualize. Open Science also needs strong confidence in the data, which is gained through building science communities. With ~400 current members, GeneLab and ALSDA formed Analysis Working Groups (AWGs) to provide feedback on processing pipelines, metadata curation standards (for ‘omics and phenotypic-physiological-behavioral assays), and to collaborate in effectively reusing data. The AWG also led to the development of the Radiation Biology Ontology (RBO), ensuring radiation metadata are efficiently captured, connected, and interoperable. Feedback from the AWG provided design input toward the new single point-of-entry data submission portal for all investigators to submit, curate, and share their research data. Space biological data is now maximally open access, collected-curated with rich metadata, and formatted for interoperability to enable systems biology, meta-analysis, knowledge graphs, machine learning, modeling, and other reuse approaches. With potential for further federation of OSDR for data mining with traditional biological and medical databases (NIH, NCI, EBI, etc.), a new era for space biology has begun to support the knowledge discovery necessary for Lunar and Martian missions.

Ryan T Scott↗
NASA NTRSDate not supplied

Science Target Prioritization Framework for Remote Sensing

Behind the scenes of a remote sensing mission there are complex decision making and planning operations. Streamlining these operations, with a quantitative scientific value framework, aids efficient and optimized science data collection.While there have been previous efforts to quantify the science value for specific science scenarios, our work aims to develop a general framework which can be applied across different scenarios. We describe a pipeline of processes which combines model forecast and observation data, in computational forms, as dictated by the mission objectives set forth by subject matter experts. The framework is described with use cases involving the monitoring of nitrogen dioxide (NO2) concentrations over the Gulf of Mexico and methane concentrations over interior Alaska.

Remote Sensing↗
NASA NTRSDate not supplied

Open Science for Life in Space: Data Sharing and Tools for Knowledge Discovery

Molecular-omics, physiological-phenotypic-behavioral, and environmental-radiation telemetry data from spaceflight biological and health studies are increasingly being made findable, accessible, interoperable, and reusable for the scientific public. These data, as well as space science-relevant biospecimens, are available through NASA’s Open Science Data Repository (OSDR), which is the new umbrella grouping of NASA GeneLab, the Ames Life Sciences Data Archive (ALSDA), and the NASA Biological Institutional Scientific Collection (NBISC). The quality of data is underpinned by datasets having rich metadata (determined through Analysis Working Group members), processing pipelines to enable data reuse standards, and ontologies specifying terminology semantics (e.g., the Radiation Biology Ontology).

space biology↗
NASA NTRSDate not supplied

Primary Mission Threshold Crossing Events in the TESS SPOC Transit Search

We present an overview of the single- and multiple-sector results of the Science Processing Operations Center (SPOC) transit search in the primary Transiting Exoplanet Survey Satellite (TESS) mission. TESS was designed to survey bright stars in the greater Solar neighborhood in search of transiting exoplanets. Data were acquired at a 2-minute cadence for 16,000-20,000 pre-selected target stars in each 28-day observation sector and processed in the SPOC pipeline at NASA Ames Research Center. The photometry pipeline produced a systematic error corrected light curve for each target star. Light curves were searched for transiting planet signatures by sector for all target stars, and separately for target stars observed in multiple sectors. Potential transit signals for which the transiting planet detection threshold was exceeded and a series of transit consistency tests were passed are referred to as Threshold Crossing Events (TCEs). We highlight the full TCE population and the population of SPOC TCEs that were later identified as TESS Objects of Interest (TOIs). Characteristics of the TCE populations implied by limb-darkened transiting planet model fits are also presented. SPOC pipeline data products are delivered to the Mikulski Archive for Space Telescopes (MAST)(http://archive.stsci.edu/missions-and-data/tess) for access by the community. Funding for the TESS Mission has been provided by the NASA Science Mission Directorate.

TESS↗
NASA NTRS2013

Dynamic Black-Level Correction and Artifact Flagging in the Kepler Data Pipeline

Instrument-induced artifacts in the raw Kepler pixel data include time-varying crosstalk from the fine guidance sensor (FGS) clock signals, manifestations of drifting moiré pattern as locally correlated nonstationary noise and rolling bands in the images which find their way into the calibrated pixel time series and ultimately into the calibrated target flux time series. Using a combination of raw science pixel data, full frame images, reverse-clocked pixel data and ancillary temperature data the Keplerpipeline models and removes the FGS crosstalk artifacts by dynamically adjusting the black level correction. By examining the residuals to the model fits, the pipeline detects and flags spatial regions and time intervals of strong time-varying blacklevel (rolling bands ) on a per row per cadence basis. These flags are made available to downstream users of the data since the uncorrected rolling band artifacts could complicate processing or lead to misinterpretation of instrument behavior as stellar. This model fitting and artifact flagging is performed within the new stand-alone pipeline model called Dynablack. We discuss the implementation of Dynablack in the Kepler data pipeline and present results regarding the improvement in calibrated pixels and the expected improvement in cotrending performances as a result of including FGS corrections in the calibration. We also discuss the effectiveness of the rolling band flagging for downstream users and illustrate with some affected light curves.

Clarke, B. D.↗
NASA NTRSDate not supplied

GL4U: Using Space Biology Omics Data to Provide Bioinformatics Training for Students and Educators

NASA’s GeneLab project provides researchers open access to space-relevant multi-omics data via the Open Science Data Repository (OSDR) that can be mined to understand the effects of spaceflight on biological systems. To maximize the number of scientists who understand and utilize GeneLab data and data processing pipelines, GeneLab created GeneLab for Colleges and Universities (GL4U). GL4U provides space biology-relevant training in bioinformatics to the next generation of scientists through direct (training students) and indirect (training educators) approaches. The GL4U pilot programs were conducted in June 2021 (direct training) and 2022 (indirect training). During the pilots, students and educators at Historically Black Colleges and Universities (HBCUs) and Minority Serving Institutions (MSIs) participated in a week-long (direct training) or two-week-long (indirect training) bootcamp consisting of space biology-specific lectures and hands-on instruction using Jupyter Notebooks to analyze space biology RNA sequencing data from OSDR. During the educator pilot, participants received materials, training, and the necessary compute resources to enable them to run the bootcamp at their home institutions, thereby extending the reach of this initiative. In July 2023, GeneLab is partnering with JPL to expand GL4U to include amplicon sequencing (Amp-Seq) analysis training. During the GL4U Amp-Seq bootcamp, student and educator participants will receive training on how to analyze and interpret Amp-Seq data using the NASA GeneLab data processing pipeline. All bootcamp material, including instructions for requesting compute resources, will be made publicly available on GitHub for educators to teach the GL4U content in subsequent semesters. GL4U provides undergraduate students from underrepresented groups the opportunity to learn about NASA and Space Biology, and to enhance their career prospects by gaining hands-on experience analyzing omics data, a skillset that is highly applicable and marketable in the life sciences. We present results from pre- and post-training surveys completed by all participants of the Amp-Seq bootcamp.

Amanda M Saravia-Butler↗
NASA NTRS1985

Subsurface Mapping

Target areas for sinking base holes, underground pipelines, etc., can be identified with the assistance of NASA Ames developed technology, by Airborne Pipeline Services, Inc. Subsurface features are computer processed; the system can cover 250 miles a day and was first developed by Applied Science, Inc.

Source record↗
NASA NTRSDate not supplied

The Nasa SRA Process as It Relates to Open-Source Workflows Developed for GeneLab Data Processing

To release open, standards-compliant processed data sets in the Open Science Data Repository (OSDR), the GeneLab Data Processing team works with the scientific community through the OSDR Analysis Working Groups to design and build open-source data processing pipelines. Once baselined internally, these pipelines are wrapped into workflows and published on the NASA GeneLab Data Processing public GitHub repository along with detailed instructions for installation and use. Each workflow must be approved through NASA's Software Release Authorization (SRA) process prior to publishing. However, the SRA process lacks sufficient documentation and clarity regarding which forms are applicable for new open-source software that utilizes publicly available 3rd party tools, and the SRA process can take several months to complete, making sharing software outside of NASA cumbersome and in contradiction with the concept of Open Science. Furthermore, the SRA process was designed as a one-size fits all approach and thus many of the questions asked are not applicable to our open-source workflows. Here we describe the software provided on the NASA GeneLab Data Processing GitHub repository, summarize our experiences with the SRA process to release these software, and propose a more stream-lined approach for review of open-source projects.

Software Release Authorization↗
NASA NTRSDate not supplied

The NASA SRA Process as it Relates to Open-Source Workflows Developed for GeneLab Data Processing

To release open, standards-compliant processed data sets in the Open Science Data Repository (OSDR), the GeneLab Data Processing team works with the scientific community through the OSDR Analysis Working Groups to design and build open-source data processing pipelines. Once baselined internally, these pipelines are wrapped into workflows and published on the NASA GeneLab Data Processing public GitHub repository along with detailed instructions for installation and use. Each workflow must be approved through NASA's Software Release Authorization (SRA) process prior to publishing. However, the SRA process lacks sufficient documentation and clarity regarding which forms are applicable for new open-source software that utilizes publicly available 3rd party tools, and the SRA process can take several months to complete, making sharing software outside of NASA cumbersome and in contradiction with the concept of Open Science. Furthermore, the SRA process was designed as a one-size fits all approach and thus many of the questions asked are not applicable to our open-source workflows. Here we describe the software provided on the NASA GeneLab Data Processing GitHub repository, summarize our experiences with the SRA process to release these software, and propose a more stream-lined approach for review of open-source projects.

Software Release Authorization↗
NASA NTRS2011

Framework for Integrating Science Data Processing Algorithms Into Process Control Systems

A software framework called PCS Task Wrapper is responsible for standardizing the setup, process initiation, execution, and file management tasks surrounding the execution of science data algorithms, which are referred to by NASA as Product Generation Executives (PGEs). PGEs codify a scientific algorithm, some step in the overall scientific process involved in a mission science workflow. The PCS Task Wrapper provides a stable operating environment to the underlying PGE during its execution lifecycle. If the PGE requires a file, or metadata regarding the file, the PCS Task Wrapper is responsible for delivering that information to the PGE in a manner that meets its requirements. If the PGE requires knowledge of upstream or downstream PGEs in a sequence of executions, that information is also made available. Finally, if information regarding disk space, or node information such as CPU availability, etc., is required, the PCS Task Wrapper provides this information to the underlying PGE. After this information is collected, the PGE is executed, and its output Product file and Metadata generation is managed via the PCS Task Wrapper framework. The innovation is responsible for marshalling output Products and Metadata back to a PCS File Management component for use in downstream data processing and pedigree. In support of this, the PCS Task Wrapper leverages the PCS Crawler Framework to ingest (during pipeline processing) the output Product files and Metadata produced by the PGE. The architectural components of the PCS Task Wrapper framework include PGE Task Instance, PGE Config File Builder, Config File Property Adder, Science PGE Config File Writer, and PCS Met file Writer. This innovative framework is really the unifying bridge between the execution of a step in the overall processing pipeline, and the available PCS component services as well as the information that they collectively manage.

Mattmann, Chris A.↗
NASA NTRSDate not supplied

RadLab and the Environmental Data Application Dashboard: Graphical and Programming Interfaces for Interrogation of Space Telemetry Data

Sensors on the International Space Station (ISS) and multiple spacecraft elsewhere in Earth orbit and in deep space continuously monitor and collect environmental data, transmitting this information back to Earth. These data include ionizing radiation and, on the ISS, CO2, relative humidity levels, and temperature, and are of great importance to space biology research. Ionizing radiation in particular has been established in ground-based experiments as being correlated with increased risk of carcinogenesis and cardiovascular and neurological effects. Looking ahead to future long duration crewed missions beyond low Earth orbit, the ability to study how factors including CO2 levels, light cycle, temperature modulate the response to ionizing radiation and microgravity is essential. To date, access to these data has been fragmented across space agencies, spacecraft, and databases. To address this issue, NASA’s Open Science Data Repository (osdr.nasa.gov) has developed two Web applications: the Environmental Data Application (EDA) and a radiation-specific RadLab. Each consists of an API (application programming interface) and an associated GUI (graphical user interface) that provide single points of access to the data. To date, OSDR has focused on the sensors from payloads and radiation detectors located on the ISS. The Web applications process telemetry information and associated data, such as spacecraft location and orientation, from multiple international databases. The applications’ request syntax enables users to interrogate these data by craft, sensor type, time range, radiation type (galactic cosmic rays, solar particle events, the contribution of the South Atlantic Anomaly), facilitating arbitrary comparisons of original source data at varying time resolutions. The applications provide programmatic access for use in computational pipelines and GUIs for data visualization and exploration, making these data FAIR (Findable, Accessible, Interoperable, and Reusable), complementing the biological data contained in OSDR, and providing the space science community with a valuable resource for scientific analyses.

radiation↗
NASA NTRS2018

An Overview of Science Challenges Pertaining to our Understanding of Extreme Geomagnetically Induced Currents

Vulnerability of man-made infrastructure to Earth-directed space weather events is a serious concern for today's technology-dependent society. Space weather-driven geomagnetically induced currents (GICs) can disrupt operation of extended electrically conducting technological systems. The threat of adverse impacts on critical technological infrastructure, like power grids, oil and gas pipelines, and communication networks, has sparked renewed interest in extreme space weather. Because extreme space weather events have low occurrence rate but potentially high impact, this presents a major challenge for our understanding of extreme GIC activity. In this chapter, we discuss some of the key science challenges pertaining to our understanding of extreme events. In addition, we present an overview of GICs including highlights of severe impacts over the last 80 years and recent U.S. Federal actions relevant to this community.

Ngwira, Chigomezyo M.↗