Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Intensive Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS1989

Parallel asynchronous systems and image processing algorithms

A new hardware approach to implementation of image processing algorithms is described. The approach is based on silicon devices which would permit an independent analog processing channel to be dedicated to evey pixel. A laminar architecture consisting of a stack of planar arrays of the device would form a two-dimensional array processor with a 2-D array of inputs located directly behind a focal plane detector array. A 2-D image data stream would propagate in neuronlike asynchronous pulse coded form through the laminar processor. Such systems would integrate image acquisition and image processing. Acquisition and processing would be performed concurrently as in natural vision systems. The research is aimed at implementation of algorithms, such as the intensity dependent summation algorithm and pyramid processing structures, which are motivated by the operation of natural vision systems. Implementation of natural vision algorithms would benefit from the use of neuronlike information coding and the laminar, 2-D parallel, vision system type architecture. Besides providing a neural network framework for implementation of natural vision algorithms, a 2-D parallel approach could eliminate the serial bottleneck of conventional processing systems. Conversion to serial format would occur only after raw intensity data has been substantially processed. An interesting challenge arises from the fact that the mathematical formulation of natural vision algorithms does not specify the means of implementation, so that hardware implementation poses intriguing questions involving vision science.

Coon, D. D.↗
NASA NTRS1992

Functional requirements document for the Earth Observing System Data and Information System (EOSDIS) Scientific Computing Facilities (SCF) of the NASA/MSFC Earth Science and Applications Division, 1992

Five scientists at MSFC/ESAD have EOS SCF investigator status. Each SCF has unique tasks which require the establishment of a computing facility dedicated to accomplishing those tasks. A SCF Working Group was established at ESAD with the charter of defining the computing requirements of the individual SCFs and recommending options for meeting these requirements. The primary goal of the working group was to determine which computing needs can be satisfied using either shared resources or separate but compatible resources, and which needs require unique individual resources. The requirements investigated included CPU-intensive vector and scalar processing, visualization, data storage, connectivity, and I/O peripherals. A review of computer industry directions and a market survey of computing hardware provided information regarding important industry standards and candidate computing platforms. It was determined that the total SCF computing requirements might be most effectively met using a hierarchy consisting of shared and individual resources. This hierarchy is composed of five major system types: (1) a supercomputer class vector processor; (2) a high-end scalar multiprocessor workstation; (3) a file server; (4) a few medium- to high-end visualization workstations; and (5) several low- to medium-range personal graphics workstations. Specific recommendations for meeting the needs of each of these types are presented.

Botts, Michael E.↗
NASA NTRS2016

Using Citizen Science Reports to Define the Equatorial Extent of Auroral Visibility

An aurora may often be viewed hundreds of kilometers equatorward of the auroral oval owing to its altitude. As such, the NOAA Space Weather Prediction Center (SWPC) Aurora Forecast product provides a "view line" to demonstrate the equatorial extent of auroral visibility, assuming that it is sufficiently bright and high in altitude. The view line in the SWPC product is based upon the latitude of the brightest aurora, for each hemisphere, as specified by the real-time oval variation, assessment, tracking, intensity, and online nowcasting (OVATION) Prime (2010) aurora precipitation model. In this study, we utilize nearly 500 citizen science auroral reports to compare with the view line provided by an updated SWPC aurora forecast product using auroral precipitation data from OVATION Prime (2013). The citizen science observations were recorded during March and April 2015 using the Aurorasaurus platform and cover one large geomagnetic storm and several smaller events. We find that this updated SWPC view line is conservative in its estimate and that the aurora is often viewable further equatorward than Is indicated by the forecast. By using the citizen reports to modify the scaling parameters used to link the OVATION Prime (2013) model to the view line, we produce a new view line estimate that more accurately represents the equatorial extent of visible aurora. An OVATION Prime (2013) energy flux-based equatorial boundary view line is also developed and is found to provide the best overall agreement with the citizen science reports, with an accuracy of 91 percent.

Case, N. A.↗
DOE OSTI2025

PSTN-056: Survey Cadence Optimization Committee's Phase 3 Recommendations

We present the final planned comprehensive recommendation for Rubin Observatory the Legacy Survey of Space and Time (LSST) survey strategy ahead of the start of LSST. This recommendation is the product of a many-years-long iterative process where community recommendations to maximize the scientific impact of LSST across domains of astrophysics were reviewed, synthesized, aggregated, and merged to define the overall plan for 10 years of LSST observations. The current recommendation builds on Phase 1 (PSTN-053) and Phase 2 recommendations (PSTN-055) and, together, they define a 10-year plan for observing. Here we answer questions left open in PSTN-055, refine additional survey details, and describe the scope of future activities of the SCOC.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Generic and ML Workloads in an HPC Datacenter: Node Energy, Job Failures, and Node-Job Analysis

HPC datacenters offer a backbone to the modern digital society. Increasingly, they run Machine Learning (ML) jobs next to generic, compute-intensive workloads, supporting science, business, and other decision-making processes. However, understanding how ML jobs impact the operation of HPC datacenters, relative to generic jobs, remains desirable but understudied. In this work, we leverage long-term operational data, collected from a national-scale production HPC datacenter, and statistically compare how ML and generic jobs can impact the performance, failures, resource utilization, and energy consumption of HPC datacenters. Our study provides key insights, e.g., ML-related power usage causes GPU nodes to run into temperature limitations, median/mean runtime and failure rates are higher for ML jobs than for generic jobs, both ML and generic jobs exhibit highly variable arrival processes and resource demands, significant amounts of energy are spent on unsuccessfully terminating jobs, and concurrent jobs tend to terminate in the same state. We open-source our cleaned-up data traces on Zenodo (https://doi. org/10.5281/zenodo.13685426), and provide our analysis toolkit as software hosted on GitHub (https://github.com/atlarge-research/2024-icpads-hpc-workload-characterization). This study offers multiple benefits for data center administrators, who can improve operational efficiency, and for researchers, who can further improve system designs, scheduling techniques, etc.

crossanalysis↗
NASA NTRS2010

Automation of Cassini Support Imaging Uplink Command Development

"Support imaging" is imagery requested by other Cassini science teams to aid in the interpretation of their data. The generation of the spacecraft command sequences for these images is performed by the Cassini Instrument Operations Team. The process initially established for doing this was very labor-intensive, tedious and prone to human error. Team management recognized this process as one that could easily benefit from automation. Team members were tasked to document the existing manual process, develop a plan and strategy to automate the process, implement the plan and strategy, test and validate the new automated process, and deliver the new software tools and documentation to Flight Operations for use during the Cassini extended mission. In addition to the goals of higher efficiency and lower risk in the processing of support imaging requests, an effort was made to maximize adaptability of the process to accommodate uplink procedure changes and the potential addition of new capabilities outside the scope of the initial effort.

Ly-Hollins, Lisa↗
NASA NTRS2019

Machine Learning-Based Atmospheric Phenomena Detection Platform

As the number of Earth pointing satellites has increased over the last several decades, the data volume retrieved from instruments onboard these satellites has also increased. It is expected that this trend will continue as more data intensive missions and small satellite constellations are launched. Currently, feature detection - namely atmospheric phenomena - in these datasets is performed manually and is thus not scalable with the growing data archives. Recent advancements in computational efficiency allow for the Earth science community to leverage machine learning to identify interesting atmospheric phenomena. Given the wide range of distinctive features in various atmospheric phenomena, a specialized machine learning model is required for accurate detection of these phenomena independently. The Phenomena Portal, developed at NASA IMPACT, is designed to provide visualization for the output from these machine learning models. In addition, detected events for each atmospheric phenomena are stored in a database that can be used to more easily use/subset larger spatiotemporal datasets. The user interface also incorporates additional features to enhance the user experience including spatiotemporal analysis, multiple base layer images, and a slider to filter events with lower probabilities of positive detection. Each detection supports user feedback on whether the detection is true or false that can then be stored and used to improve the machine learning model performance.

Gurung, Iksha↗
NASA NTRS1988

A solar-wind 'trigger' for the outer heliosphere radio emissions and the distance to the terminal shock

The solar wind data from the plasma science experiment on the Voyager spacecraft are examined to search for the source of the 2 to 3 kHz radio noise detected in the outer heliosphere. It is found that two anomalous high speed streams passed Voyager 2 before the noise was initially observed. It is suggested that the interaction of these streams with the terminal shock is responsible for the more intense emission. Using a time-of-flight argument, the distance to the shock is estimated at about 70 AU-140 AU. The larger value is consistent with an estimate using Voyager data and a standard pressure-balance argument.

Mcnutt, Ralph L., Jr.↗
DOE OSTI2025

RTN-095: The Vera C. Rubin Observatory Data Preview 1

We present Rubin Data Preview 1 (DP1), the first release of data from the NSF-DOE Vera C. Rubin Observatory, consisting of raw and calibrated single-epoch images, coadds, difference images, detection catalogs, and other derived data products. DP1 is based on 1792 science-grade optical/near-infrared exposures acquired over 48 distinct nights by the Rubin Commissioning Camera, LSSTComCam, on the Simonyi Survey Telescope at the Summit Facility on Cerro Pachón, Chile during the first on-sky commissioning campaign in late 2024. DP1 covers a total of ~15 sq. deg. over seven roughly equally-sized non-contiguous fields, each independently observed in six broad photometric bands, ugrizy, spanning a range of stellar densities and latitudes and overlapping with external reference datasets. The median image quality across all bands, measured by the FWHM of the point-spread function, is approximately 1.13 arcseconds, with the sharpest images reaching about 0.65 arcseconds. DP1 contains approximately 2.3 million distinct astrophysical objects, of which 1.6 million are extended in at least one band, and 431 solar system objects, of which 93 are new discoveries. DP1 is approximately 3.5 TB in size and available to Rubin data rights holders via the Rubin Science Platform, a cloud-based environment for the analysis of petascale astronomical data. While small compared to future LSST releases, its high quality and diversity of data support a broad range of early science investigations across all four LSST themes, providing a valuable opportunity to engage with Rubin data ahead of the start of full operations in late 2025.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

CROCUS Urban Canyons - Space Science and Engineering Center (SPARC) Doppler lidar data

This is the netCDF format output from the Halo Photonics Streamline XR Doppler lidar that was deployed next to the Space Science and Engineering Center (SPARC) trailer at the University of Illnois-Chicago greenhouse parking lot during CROCUS Urban Canyons. The purpose of collecting this dataset is to provide vertical and horizontal wind profiles for studying the characteristics of turbulence over the urban canyon of Chicago. This data contains the radial velocity, intensity, and backscatter from the vertical profile, range height indicator, and sector scans that were performed over both Intensive Operating Period 1 and 2 of CROCUS Urban Canyons. There are four different types of files: * The Range Height Indicator (RHI) files contain scans that are along a constant azimuth, spanning the entire hemisphere of elevation values above the surface. * The Velocity Azimuth Display (VAD) files contain the raw radial velocity data from the 6-beam, 60 degree scans. * The User1 files contain stacked Plan Position Indicator scans over a 45 degree quadrant over downtown Chicago. * The Stare files contain vertically pointing scans. These are standard netCDF files that can be opened using xarray. The VAD scans can be processed from their raw radial velocities to horizontal wind speeds with the Atmospheric data Community Toolkit (https://arm-doe.github.io/ACT/).

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC WINDS↗
NASA NTRS1974

The application of natural science data to land management decision-making

A natural environmental analysis process which allows the decision maker to know the probable consequences of a decision prior to the act is developed. Emphasis is placed on the fit between the natural environment and the social, economic, and functional attributes of man's communities and the transition from nature in its present state to various forms and intensities of development. Applications of the analysis are examined. It is concluded that the analysis is a workable system for land use management.

Williams, D. L.↗
NASA NTRS1991

A search for periodicity in the x ray spectrum of black hole candidate A0620-00

The archived data from the SAS-3 observations of the X-ray nova A0620-00, the best of the stellar blackhole candidates, were exhaustively examined for evidence of variable phenomena correlated with the orbital motion of the binary system of which it is a member. The original analysis of these data was completed before discovery of the binary companion and determination of the orbital period of the system. New interest was drawn to the task of a reexamination of the archive data by the recent discovery of the massive nature of the X-ray source through analysis of the Doppler variations and ellipsoidal light variations of the faint K-star companion by McClintock and Remillard. The archive research, carried out under the supervision of the principal investigator, was the topic of the thesis submitted to the MIT Department of Physics by Kenneth Plaks in partial fulfillment of the requirements for the degree of Master of Science. Plaks' effort was focused on the elimination of fluctuations in the data due to errors in attitude solutions and other extraneous causes. The first products of his work were long-term light curves of the X-ray intensities in the various energy channels as functions of time during the time from outbursts in August 1975 to quiescence approximately 6 months later. These curves, are refined versions of the preliminary results published in 1976 (Matilsky et al. 1976). Smooth exponentials were fitted to these long term light curves to provide the basis for detrending the data, thereby permitting a calculation of residuals derived by subtracting the fitted curve from the data. The residuals were then analyzed by Fourier analysis to search for variations with the period of the binary orbit, namely 7.75 hours. No evidence of an orbital periodicity was found. However, the refined light curve provides a much clearer picture of the outburst and subsequent decay of the X-ray luminosity. In fact, there were two outbursts, each followed by an exponential decay with similar time constants of about 25 days. Previous evidence of a three-oscillation variation with a 7.8 day period were confirmed. Substantial theoretical effort has been devoted to attempts to account for the decay characteristics as the result of the gradual eating up of an accretion disk by a stellar-mass blackhole (e.g., Huang and Wheeler 1989). The improved decay curves will provide significant new constraints on the theoretical analyses.

Clark, George W.↗
NASA NTRS2020

Clouds Around the World: How a Simple Citizen Science Data Challenge Became a Worldwide Success

Citizen science is often recognized for its potential to directly engage the public in science, and is uniquely positioned to support and extend participants’ learning in science. In March 2018, the Global Learning and Observations to Benefit the Environment (GLOBE) Program, NASA’s largest and longest-lasting citizen science program about Earth, organized a month-long event that asked people around the world to contribute daily cloud observations and photographs of the sky (15 March–15 April 2018). What was considered a simple engagement activity turned into an unprecedented worldwide event that garnered major public interest and media recognition, collecting over 55,000 observations from 99 different countries, in more than 15,000 locations, on every continent including Antarctica. The event was called the “Spring Cloud Challenge” and was created to 1) engage the general public in the scientific process and promote the use of the GLOBE Observer app, 2) collect ground-based visual observations of varying cloud types during boreal spring, and 3) increase the number and locations of ground-based visual cloud observations collocated with cloud-observing satellites. The event resulted in roughly 3 times more observations than during the historic and highly publicized 2017 North American total solar eclipse. The dataset also includes observations over the Drake Passage in Antarctica and reports from intense Saharan dust events. This article describes how the challenge was crafted, outreach to volunteer scientists around the world, details of the data collected, and impact of the data.

GLOBE↗
DOE OSTI2024

Atmospheric Ion Composition, SGP, April-May 2023

These files contain select ion count rates measured by an atmospheric pressure interface time-of-flight mass spectrometer (APi-ToF) at the Atmospheric Radiation Measurement Southern Great Plains site from April 28, 2023 to May 31, 2023. Files are in ICARTT format. The APi-ToF measures the chemical composition of naturally charged ions using mass spectrometry. Due to the nature of the measurements, time-series data are non-quantitative. This dataset contains time-series information for the ions that are typically the most intense ions observed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

COURAGE S7 TBS AIRBORNE SONIC WIND AND TURBULENCE DATA

These data were collected with airborne wind instrumentation booms onboard the TBS at CoURAGE S7 during February 2025. The data include 60 Hz wind speed, component wind speed, wind direction, TKE, TI, and altitude measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

BNF M1 TBS AIRBORNE SONIC WIND AND TURBULENCE DATA

These data were collected with airborne wind instrumentation booms onboard the TBS at BNF M1. The data include 60 Hz wind speed, component wind speed, wind direction, TKE, TI, and altitude measurements.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2006

Cassini Camera Contamination Anomaly: Experiences and Lessons Learned

We discuss the contamination 'Haze' anomaly for the Cassini Narrow Angle Camera (NAC), one of two optical telescopes that comprise the Imaging Science Subsystem (ISS). Cassini is a Saturn Orbiter with a 4-year nominal mission. The incident occurred in 2001, five months after Jupiter encounter during the Cruise phase and ironically at the resumption of planned maintenance decontamination cycles. The degraded optical performance was first identified by the Instrument Operations Team with the first ISS Saturn imaging six weeks later. A distinct haze of varying size from image to image marred the images of Saturn. A photometric star calibration of the Pleiades, 4 days after the incident, showed stars with halos. Analysis showed that while the halo's intensity was only 1 - 2% of the intensity of the central peak of a star, the halo contained 30 - 70% of its integrated flux. This condition would impact science return. In a review of our experiences, we examine the contamination control plan, discuss the analysis of the limited data available and describe the one-year campaign to remove the haze from the camera. After several long conservative heating activities and interim analysis of their results, the contamination problem as measured by the camera's point spread function was essentially back to preanomaly size and at a point where there would be more risk to continue. We stress the importance of the flexibility of operations and instrument design, the need to do early infight instrument calibration and continual monitoring of instrument performance.

Cassini↗
NASA NTRSDate not supplied

Impact of Canadian Wildfires on Mid Atlantic’s Region Air Quality: An Analysis Using ASDC Data

Wildfires pose a growing concern in North America due to their harmful impacts on air quality and public health, with increased wildfire activity in recent years leading to widespread smoke plumes that can transcend borders. The exposure of New York City (NYC), the most populous city in North America, to Canadian wildfire smoke highlights the substantial implications for public health and urban environments. To better understand the impact of Canadian wildfires on air quality in NYC, satellite data from the NASA Atmospheric Science Data Center (ASDC) at Langley Research Center, along with ground-based measurements and atmospheric modeling results, are analyzed. We examine concentrations of atmospheric aerosols—particularly PM2.5 particulate matter originating from Canadian wildfires—their dispersion patterns, and the duration and intensity of smoke events impacting NYC. Data from multiple satellites, such as those from the Earth Polychromatic Imaging Camera (EPIC), are synergistically used to identify regions affected by wildfires and estimate aerosol loading. Ground-based measurements, including data from air quality monitoring stations, provide localized information for validation and calibration purposes. The findings of this study contribute to our understanding of the impact of Canadian wildfires on NYC's air quality and emphasize the importance of monitoring and prediction of transboundary smoke events using data synthesized from multiple sources, such as those provided by the ASDC. This information is crucial for policymakers, public health officials, and residents in affected areas to develop effective strategies for mitigating the health risks associated with wildfire smoke and improving air quality during wildfire seasons. The utilization of ASDC data in this research highlights the critical role of atmospheric remote sensing in addressing the challenges posed by wildfires and their consequences on regional scales.

Ingrid Garcia-Solera↗