Search NASA⌕ Search

SEARCH · Search NASA

Results for “pipeline data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

315 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

HydroSAR: A Cloud-based SAR Data Analysis Service to Monitor Hydrological Disasters and their Impact on Population and Agriculture

Weather-related hazards are ubiquitous around the world including: 1) hurricane storm surges, 2) rapid snowmelt and heavy rainfall, 3) severe weather leading to flash floods, and 4) seasonal freeze and thaw of rivers that may lead to ice jams. Each of these hazards affects human settlements and has the potential to impact agricultural productivity. In each setting, end-users in disaster management need access to data processing tools helpful in mapping past and current disasters. Analysis of past events supports risk mitigation by understanding what has already occurred and how to alleviate those impacts in the future. Having capabilities to generate the same products in a response setting means that lessons learned from risk analysis will carry forward to event response. Synthetic aperture radar (SAR) data are particularly useful for these activities due to their all-weather 24/7 monitoring capabilities. In this effort we present HydroSAR, a cloud-based SAR data analysis service for the mapping of meteorological and hydrological disasters as well as their impact on population and agriculture. As part of this project we have developed a series of SAR-based value added products for the monitoring of surface hydrology (image time series, change detection, flood extent, flood depth) and the assessment of impacts on population (flood depth) and agriculture (active agriculture, inundated agriculture, flood duration). We also developed a cloud-based platform for generating these products over affected areas and are working with end-users to integrate derived product into decision-making workflows The paper will briefly introduce the SAR-based products that were developed for this effort. We describe the cloud-based production pipeline that was built to automatically generate these products in near-real time over extended regions. The integration of SAR-based information into hazard preparation and response activities is described for a number of recent disasters including the 2019 forest fires in Alaska, 2019 flooding in the U.S. Midwest, the 2020 U.S. severe weather easter outbreak, 2020 tropical storm Christobal, 2020 cyclone Amphan, 2020, Alaska Spring breakup flooding, and the 2020 flood season in Eastern India, Bangladesh, and Nepal.

Franz Josef Meyer↗
NASA NTRSDate not supplied

Culture-Independent Fungal Profiling for the International Space Station using Nanopore Sequencing: Method Development

Microbial monitoring of the International Space Station (ISS) environment is a crew health requirement that encompasses both bacterial and fungal identification. To achieve this currently, culture-based methods are used for sample collection, and these samples must be returned to the laboratory for analysis. The use of culture and the need for sample return to Earth results in a bias toward culturable organisms and causes a significant delay between sample collection and delivery of final data (weeks to months), respectively. Recently, advancements in molecular technology have aided a broad range of applications, including medical, industrial, and basic sciences. Additionally, increases in portability and ease-of-use of molecular platforms have provided point-of-use capabilities demonstrated by the miniPCR thermal cycler (miniPCR bio) and the MinION sequencer (Oxford Nanopore Technologies). Together, these devices have been applied to, and validated for, the identification of bacteria onboard the ISS. Building on this work, we have developed a spaceflight-compatible fungal workflow. Molecular-based fungal analysis is complicated by low biomass, difficult-to-lyse spores, debate regarding the region for taxonomic assignment, and the lack of bioinformatic pipelines and reference databases. To overcome these difficulties, primers yielding an ~ 2 Kb amplicon were validated against a wide range of ISS fungal isolates. The current spaceflight library preparation was substantially optimized, a bioinformatic pipeline was created, and refinements to the UNITE database were implemented. To compare this optimized method to the current culture-based standard, 30 sample sets (60 total swabs, two swabs held in tandem) were evaluated. Parallel fungal profiles were obtained between the two methods, with the culture-independent method revealing increased diversity. The addition of this method to the already established bacterial process fulfills the crew health identification requirement. Moreover, the implementation of this method onboard ISS will enhance our understanding of its unique fungal microbiome.

Hang N. Nguyen↗
NASA NTRS2020

Back to the Future: Surveying the Northern Hemisphere and Reprocessing the Southern TESS Data Set

TESS launched 18 April 2018 to conduct a two-year, near all-sky survey for at least 50 small, nearby exoplanets for which masses can be ascertained and whose atmospheres can be characterized by ground- and space-based follow-on observations. TESS has completed its survey of the southern hemisphere and begun its survey of the northern hemisphere, identifying >1000 candidate exoplanets and unveiling a plethora of exciting non-exoplanet astrophysics results, such as asteroseismology, asteroids, and supernova. The TESS Science Processing Operations Center (SPOC) processes the data downlinked every two weeks to generate a range of data products hosted at the Mikulski Archive for Space Telescopes (MAST). For each sector (~1 month) of observations, the SPOC calibrates the image data for both 30-min Full Frame Images (FFIs) and up to 20,000 pre-selected 2-min target star postage stamps. Data products for the 2-min targets include simple aperture photometry and systematic error-corrected flux time series. The SPOC also conducts searches for transiting exoplanets in the 2-min data for each sector and generates Data Validation time series and associated reports for each transit-like feature identified in the search. Multi-sector searches for exoplanets are conducted periodically to discover longer period planets, including those in the James Webb Continuous Viewing Zone (CVZ), which are observed for up to one year. Starting with Sector 8, scattered light from the Earth and Moon contaminated significant portions of the data in each orbit. We have developed algorithms for automated identification of the scattered light features at the individual target level. Previously, data for all stars on a CCD affected by scattered light were manually excluded. The automated flagging will allow us to retain significantly more data for stars that are not affected by the scattered light even though it is occurring elsewhere on the CCD. We also discuss enhancements to the SPOC pipeline and the newly available FFI light curves. The TESS Mission is funded by NASA's Science Mission Directorate as an Astrophysics Explorer Mission.

Jenkins, Jon M.↗
NASA NTRSDate not supplied

GeoAI advances in specific landform mapping

Landform mapping (also referred to as geomorphology or geomorphometry) can be divided into two domains: general and specific (Evans 2012). Whereas general landform mapping categorizes all elements of the study area into landform classes, such as ridges, valleys, peaks, and depressions, the mapping of specific landforms requires the delineation (even if fuzzy) of individual landforms. The former is mainly driven by physical properties such as elevation, slope, and curvature. The latter, however, must consider the cognitive (human) reasoning that discriminates individual landforms in addition to these physical properties (Arundel and Sinha 2018). Both mapping forms are important. General geomorphometry is needed to understand geological and ecological processes and as boundary layer input to climate and environmental models. Specific geomorphometry supports such activities as disaster management and recovery, emergency response, transportation, and navigation. In the United States, individual landforms of interest are named in the U.S. Geological Survey (USGS) Geographic Names Information System, a point dataset captured specifically to digitize geographic names from the USGS Historical Topographic Map Collection (HTMC). Named landform extent is represented only by the name placement in the HTMC. Recent work has investigated CNN-based deep learning methods to capture these extents in machine-readable form. These studies first relied on physical properties (Arundel et al. 2020) and then included the HTMC as a band in RGB images in limited testing (Arundel et al. 2023). Results from the HTMC dataset surpassed those using just physical properties and using the HTMC alone performed best due to the hillshading and elevation (contour) data incorporated into the topographic maps. However, results fell short of an operational capacity to map all named landforms in the United States. Thus, our current work expands upon past research by focusing on the HTMC and physical information as inputs and the named landform label extents. Specifically, we propose to leverage pre-trained foundation models for segmentation and optical character recognition (OCR) models to jointly map landforms in the United States. Our approach aims to bridge the disparities among the independent information sources to facilitate informed decision-making. The modeling pipeline performs (1) segmentation using the physical information and (2) information extraction using OCR, in parallel. Then a computer vision approach merges the two branches into a labeled segmentation. References: Arundel, Samantha T., Wenwen Li, and Sizhe Wang. 2020. “GeoNat v1.0: A Dataset for Natural Feature Mapping with Artificial Intelligence and Supervised Learning.” Transactions in GIS 24 (3): 556–72. https://doi.org/10.1111/tgis.12633. Arundel, Samantha T, and Gaurav Sinha. 2018. “Validating GEOBIA Based Terrain Segmentation and Classification for Automated Delineation of Cognitively Salient Landforms BT - Proceedings of Workshops and Posters at the 13th International Conference on Spatial Information Theory (COSIT 2017).” In Proceedings of Workshops and Posters at the 13th International Conference on Spatial Information Theory (COSIT 2017), Lecture Notes in Geoinformation and Cartography, edited by Paolo Fogliaroni, Andrea Ballatore, and Eliseo Clementini, 9–14. Cham: Springer International Publishing. Arundel, Samantha T., Gaurav Sinha, Wenwen Li, David P. Martin, Kevin G. McKeehan, and Philip T. Thiem. 2023. “Historical Maps Inform Landform Cognition in Machine Learning.” Abstracts of the ICA 6 (August): 1–2. https://doi.org/10.5194/ica-abs-6-10-2023. Evans, Ian S. 2012. “Geomorphometry and Landform Mapping: What Is a Landform?” Geomorphology 137 (1): 94–106. https://doi.org/10.1016/j.geomorph.2010.09.029.

machine learning↗
NASA NTRSDate not supplied

GeoAI Advances in Specific Landform Mapping

Landform mapping (also referred to as geomorphology or geomorphometry) can be divided into two domains: general and specific (Evans 2012). Whereas general landform mapping categorizes all elements of the study area into landform classes, such as ridges, valleys, peaks, and depressions, the mapping of specific landforms requires the delineation (even if fuzzy) of individual landforms. The former is mainly driven by physical properties such as elevation, slope, and curvature. The latter, however, must consider the cognitive (human) reasoning that discriminates individual landforms in addition to these physical properties (Arundel and Sinha 2018). Both mapping forms are important. General geomorphometry is needed to understand geological and ecological processes and as boundary layer input to climate and environmental models. Specific geomorphometry supports such activities as disaster management and recovery, emergency response, transportation, and navigation. In the United States, individual landforms of interest are named in the U.S. Geological Survey (USGS) Geographic Names Information System, a point dataset captured specifically to digitize geographic names from the USGS Historical Topographic Map Collection (HTMC). Named landform extent is represented only by the name placement in the HTMC. Recent work has investigated CNN-based deep learning methods to capture these extents in machine-readable form. These studies first relied on physical properties (Arundel et al. 2020) and then included the HTMC as a band in RGB images in limited testing (Arundel et al. 2023). Results from the HTMC dataset surpassed those using just physical properties and using the HTMC alone performed best due to the hillshading and elevation (contour) data incorporated into the topographic maps. However, results fell short of an operational capacity to map all named landforms in the United States. Thus, our current work expands upon past research by focusing on the HTMC and physical information as inputs and the named landform label extents. Specifically, we propose to leverage pre-trained foundation models for segmentation and optical character recognition (OCR) models to jointly map landforms in the United States. Our approach aims to bridge the disparities among the independent information sources to facilitate informed decision-making. The modeling pipeline performs (1) segmentation using the physical information and (2) information extraction using OCR, in parallel. Then a computer vision approach merges the two branches into a labeled segmentation.

machine learning↗
NASA NTRS2022

Space Communications Responsive to Events Across Missions (SCREAM): An Investigation of Network Solutions for Transient Science Space Systems

Space Communications Responsive to Events Across Missions (SCREAM): An Investigation of Network Solutions for Transient Science Space Systems The National Academies have prioritized the pursuit of new scientific discoveries using diverse and temporally coordinated measurements from multiple ground and space-based observatories. Networked communications can enable such measurements by connecting individual observatories and allowing them to operate as a cohesive and purposefully designed system. Timely data flows across terrestrial and space communications networks are required to observe transient scientific events and processes. Currently, communications to space-based observatories experience large latencies due to manual service reservation and scheduling procedures, intermittent signal coverage, and network capacity constraints. If space communications network latencies could be reduced, new discoveries about dynamic scientific processes could be realized. However, science mission and network planners lack a systematic framework for defining, quantifying and evaluating timely space data flow implementation options for transient scientific observation scenarios involving multiple ground and space-based observatories. This dissertation presents a model-based systems engineering approach to investigate and develop network solutions to meet the needs of transient science space systems. First, a systematic investigation of the current transient science operations of the National Aeronautics and Space Administration’s (NASA) Tracking and Data Relay Satellite (TDRS) space data network and the Neil Gehrels Swift Observatory resulted in a formal architectural model for transient science space systems. Two methods individual missions may use to achieve timely network services were defined, quantitatively modeled, and experimentally compared. Next, the architectural model was extended to describe two alternative ways to achieve timely and autonomous space data flows to multiple space-based observatories within the context of a purposefully designed transient science observation scenario. A quantitative multipoint space data flow modeling method based in queueing theory was defined. General system suitability metrics for timeliness, throughput, and capacity were specified to support the evaluation of alternative network data flow implementations. A hypothetical design study was performed to demonstrate the multipoint data flow modeling method and to evaluate alternative data flow implementations using TDRS. The merits of a proposed future TDRS broadcast service to implement multipoint data flows were quantified and compared to expected outcomes using the as-built TDRS network. Then, the architectural model was extended to incorporate commercial network service providers. Quantitative models for Globalstar and Iridium short messaging data services were developed based on publicly available sources. Financial cost was added to the set of system suitability metrics. The hypothetical design study was extended to compare the relative suitability of the as-built TDRS network with the commercial Globalstar and Iridium networks. Finally, results from this research are being applied by NASA missions and network planners. In 2020, Swift implemented the first automated command pipeline, increasing its expected gravitational wave follow-up detection rate by greater than 400%. Current NASA technology initiatives informed by this research will enable future space-based observatories to become interoperable sensing devices connected by a diverse ecosystem of network service providers.

Christopher J. Roberts↗
NASA NTRS2004

The Star Formation History of Orion and its Environs

During this period of performance, we have obtained the following observations and carried out the analysis of the Orion associations itemized below. 1. Quest Optical Photometry: The photometric survey carries out with the Quest camera is finished. The strips at declinations +1 degree and -1 degree have already been processed. Photometry for a total of around 400,000 stars was obtained in these two strips with the Quest camera pipeline. Around 24,000 variables were picked out of this total by our variability software. Of these, around 2,500 stars fall above the main sequence and so were picked as candidates for spectroscopic follow-up. 2. Slit spectroscopy of bright candidates: Spectra for some 800 candidate PMS stars were obtained with the FAST spectrograph at the SAO 1.5m telescope in Mt. Hopkins. The spectra are being analyzed; 300 stars have been confirmed as young. 3. Multifiber spectroscopy: The first test of the multifiber spectrograph Hectoechelle were carried out in December 2003. One field of the Orion Nebula Cluster was observed with Hectochelle at three wavelength settings. A total of 157 spectra were obtained. Of these, 63 stars have been confirmed as Classical T Tauri stars, and 36 additional stars need further follow up. A paper is in preparation. 4. UBVRI photometry: We were granted time with the 4-shooter CCD Mosaic Camera at the SAO 1.2m telescope, to obtain UBVRI photometry of a subset of 53 newly identified T Tauri stars in the strips centered at DEC=-1 and +l. This sample is composed of strong Halpha emitting PMS stars (Classical T Tauri stars) located mostly in the Orion OB l b association, around the Orion Belt area. We have estimated mass accretion rates for 22 for these stars using the U photometry and the calibration of Gullbring et al. (1998), and found it to be similar to that of young stars in associations of similar age. 5. Near and mid-IR photometry: During the winter of 2003, we used the IR Camera on the SAO 1.2m telescope, to obtain L- band photometry of a set of the newly identified Orion OB l a and l b stars, in order to look for IR excess emission coming from the hotter inner parts of circumstellar disks. These data is being combined with the GEMINI/OSCIR 10 micron photometry obtained during 2002 and the mass accretion rates to determine the properties of disks in Ori lb. A paper is presently on preparation.

Calvet, Nuria↗
NASA NTRSDate not supplied

The Completion of a Geosynchronous Earth Orbit Survey with the Eugene Stansbery-Meter Class Autonomous Telescope

The Eugene Stansbery-Meter Class Autonomous Telescope (ES-MCAT) is the primary optical sensor used by the NASA Orbital Debris Program Office (ODPO) to statistically characterize the geosynchronous Earth orbit (GEO) debris environment and support future Orbital Debris Engineering Model (ORDEM) releases. The ES-MCAT completed its first optical survey of the GEO region from 2020 to 2022. The primary goal of this survey was to autonomously collect and process GEO data with calculated photometric and astrometric uncertainties. A pointing plan was developed to provide uniform sampling within the region of interest (ROI) while accounting for predicted downtime due to insufficient observing conditions. Detections are autonomously correlated to the Space Surveillance Network (SSN) catalog to determine if objects are correlated targets (CTs) or uncorrelated targets (UCTs), the latter of which are of interest for modeling the GEO orbital debris environment. To assess the size detection sensitivity over time and monitor the general performance of the telescope’s optics and software, the optical throughput of the system and limiting magnitudes are evaluated on a routine basis. While the telescope’s ability to operate autonomously and remotely allowed for the GEO survey to continue throughout the COVID-19 pandemic, travel restrictions hampered routine cleaning of the optics during this time, and the primary mirror degraded enough to require recoating. The mirror was removed in 2022, concluding the first GEO survey. The primary mirror received a new coating designed to be more robust against the harsh environment surrounding the ES-MCAT’s location on Ascension Island, accounting for experience gained during operations over the first GEO survey. In early 2023, the recoated primary mirror was reinstalled, and the second GEO survey was initiated. The primary goal of the second GEO survey is to characterize the evolving GEO debris environment with updated optics, software, and pointing strategies while allowing for the inclusion of non-GEO regimes or those that are outside of the ROI. While the pointing method implemented in the first survey allowed for adequate coverage of the ROI over two years, it has been improved to include pointings that avoid the Moon’s position and the galactic plane to reduce software processing time and maximize the detection capabilities of fainter objects. This method also accounts for the changing weather patterns throughout the year and reduces coverage gaps in the ROI. Provided the success of the first two-year GEO survey using autonomous operations, the ODPO is actively collaborating with the United States Space Force (USSF) to make the ES-MCAT a contributing sensor to the SSN. This paper presents results from the first GEO survey including magnitude distributions and orbital parameters for CTs and UCTs. Details are provided for the automated processing pipeline and the optical system throughput for the previous and current primary mirror coatings. In addition, an updated strategy for the second GEO survey to optimize coverage over the ROI is discussed, as are preliminary results from the ongoing second survey.

Corbin Cruz↗
NASA NTRSDate not supplied

The Completion of a Geosynchronous Earth Orbit Survey with the Eugene Stansbery-Meter Class Autonomous Telescope

The Eugene Stansbery-Meter Class Autonomous Telescope (ES-MCAT) is the primary optical sensor used by the NASA Orbital Debris Program Office (ODPO) to statistically characterize the geosynchronous Earth orbit (GEO) debris environment and support future Orbital Debris Engineering Model (ORDEM) releases. The ES-MCAT completed its first optical survey of the GEO region from 2020 to 2022. The primary goal of this survey was to autonomously collect and process GEO data with calculated photometric and astrometric uncertainties. A pointing plan was developed to provide uniform sampling within the region of interest (ROI) while accounting for predicted downtime due to insufficient observing conditions. Detections are autonomously correlated to the Space Surveillance Network (SSN) catalog to determine if objects are correlated targets (CTs) or uncorrelated targets (UCTs), the latter of which are of interest for modeling the GEO orbital debris environment. To assess the size detection sensitivity over time and monitor the general performance of the telescope’s optics and software, the optical throughput of the system and limiting magnitudes are evaluated on a routine basis. While the telescope’s ability to operate autonomously and remotely allowed for the GEO survey to continue throughout the COVID-19 pandemic, travel restrictions hampered routine cleaning of the optics during this time, and the primary mirror degraded enough to require recoating. The mirror was removed in 2022, concluding the first GEO survey. The primary mirror received a new coating designed to be more robust against the harsh environment surrounding the ES-MCAT’s location on Ascension Island, accounting for experience gained during operations over the first GEO survey. In early 2023, the recoated primary mirror was reinstalled, and the second GEO survey was initiated. The primary goal of the second GEO survey is to characterize the evolving GEO debris environment with updated optics, software, and pointing strategies while allowing for the inclusion of non-GEO regimes or those that are outside of the ROI. While the pointing method implemented in the first survey allowed for adequate coverage of the ROI over two years, it has been improved to include pointings that avoid the Moon’s position and the galactic plane to reduce software processing time and maximize the detection capabilities of fainter objects. This method also accounts for the changing weather patterns throughout the year and reduces coverage gaps in the ROI. Provided the success of the first two-year GEO survey using autonomous operations, the ODPO is actively collaborating with the United States Space Force (USSF) to make the ES-MCAT a contributing sensor to the SSN. This paper presents results from the first GEO survey including magnitude distributions and orbital parameters for CTs and UCTs. Details are provided for the automated processing pipeline and the optical system throughput for the previous and current primary mirror coatings. In addition, an updated strategy for the second GEO survey to optimize coverage over the ROI is discussed, as are preliminary results from the ongoing second survey.

Corbin Cruz↗