Search NASA⌕ Search

SEARCH · Search NASA

Results for “large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Automated Discovery of Flight Track Anomalies

As new technologies are developed to handle the complexities of the Next Generation Air Transportation System (NextGen), it is increasingly important to address both current and future safety concerns along with the operational, environmental, and efficiency issues within the National Airspace System (NAS). In recent years, the Federal Aviation Administration’s (FAA) safety offices have been researching ways to utilize the many safety databases maintained by the FAA, such as those involving flight recorders, radar tracks, weather, and many other high- volume sensors, in order to monitor this unique and complex system. Although a number of current technologies do monitor the frequency of known safety risks in the NAS, very few methods currently exist that are capable of analyzing large data repositories with the purpose of discovering new and previously unmonitored safety risks. While monitoring the frequency of known events in the NAS enables mitigation of already identified problems, a more proactive approach of finding unidentified issues still needs to be addressed. This is especially important in the proactive identification of new, emergent safety issues that may result from the planned introduction of advanced NextGen air traffic management technologies and procedures. Development of an automated tool that continuously evaluates the NAS to discover both events exhibiting flight characteristics indicative of safety-related concerns as well as operational anomalies will heighten the awareness of such situations in the aviation community and serve to increase the overall safety of the NAS. This paper discusses the extension of previous anomaly detection work to identify operationally significant flights within the highly complex airspace encompassing the New York area of operations, focusing on the major airports of Newark International (EWR), LaGuardia International (LGA), and John F. Kennedy International (JFK). In addition, flight traffic in the vicinity of Denver International (DEN) airport/airspace is also investigated to evaluate the impact on operations due to variances in seasonal weather and airport elevation. From our previous research, subject matter experts determined that some of the identified anomalies were significant, but could not reach conclusive findings without additional supportive data. To advance this research further, causal examination using domain experts is continued along with the integration of air traffic control (ATC) voice data to shed much needed insight into resolving which flight characteristic(s) may be impacting an aircraft's unusual profile. Once a flight characteristic is identified, it could be included in a list of potential safety precursors. This paper also describes a process that has been developed and implemented to automatically identify and produce daily reports on flights of interest from the previous day.

Matthews, Bryan↗

HelioSwarm: Swarm Mission Design in High Altitude Orbit for Heliophysics

Resolving the complex three-dimensional turbulent structures that characterize the solar wind requires contemporaneous spatially and temporally distributed measurements. HelioSwarm is a mission concept that will deploy multiple, co-orbiting satellites to use the solar wind as a natural laboratory for understanding the fundamental, universal process of plasma turbulence. The HelioSwarm transfer trajectory and science orbit use a lunar gravity assist to deliver the ESPA-class nodes attached to a large data transfer hub to a P/2 lunar resonant orbit. Once deployed in the science orbit, the free-flying, propulsive nodes use simple Cartesian relative motion patterns to establish baseline separations both along and across the solar wind flow direction.

lunar resonant orbit↗

HelioSwarm: Swarm Mission Design in High Altitude Orbit for Heliophysics

Resolving the complex three-dimensional turbulent structures that characterize the solar wind requires contemporaneous spatially and temporally distributed measurements. HelioSwarm is a mission concept that will deploy multiple, co-orbiting satellites to use the solar wind as a natural laboratory for understanding the fundamental, universal process of plasma turbulence. The HelioSwarm transfer trajectory and science orbit use a lunar gravity assist to deliver the ESPA-class nodes attached to a large data transfer hub to a P/2 lunar resonant orbit. Once deployed in the science orbit, the free-flying, propulsive nodes use simple Cartesian relative motion patterns to establish baseline separations both along and across the solar wind flow direction.

lunar resonant orbit↗

Evaluation of a Commercial Surface Vorticity Flow Solver for the Modeling of Propeller-Wing Interaction

A commercially available surface vorticity flow solver’s ability to model propeller-wing interaction effects was evaluated. First, a study was conducted to determine solution sensitivity to simulation parameters. Then, a deflected slipstream experiment was replicated with an actuator disk and wing model. Comparison with experimental data showed that predictions of lift and longitudinal force coefficients matched well at low flap deflections, but experienced offsets in magnitude with increasing flap deflection. Predictions of pitching moment differed significantly from experimental data largely due to the simple actuator disk model being insufficient for capturing the effects of non-zero flow incidence and non-uniform inflow.

Fei, Xiaofan↗

Machine Learning for the Zwicky Transient Facility

The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective.

Ashish Mahabal↗

Nancy Grace Roman Space Telescope Observatory Implementation and Challenges

NASA’s Nancy Grace Roman Space Telescope (Roman) is a deep space infrared observatory with a Hubble-sized telescope and wide field of regard with a boresight view greater than 200 times that of the Hubble Wide Field Camera 3infrared field of view, that will conduct a suite of science surveys to characterize dark energy and expand the census of exoplanets in our galaxy. Roman will also demonstrate exoplanet coronagraphy with active wavefront control technology and provide general investigator opportunities for the science community. Roman is finishing the critical design phase and is planning for launch in 2026. It will operate at the second Sun-Earth-Moon Lagrange for a five-year primary mission life. The Observatory features a telescope with an existing, repurposed 2.4m primary mirror, a Wide Field Instrument with a near-infrared detector focal plane array and optical elements for imaging and spectroscopy, as well as a Coronagraph instrument technology demonstration for direct imaging and spectroscopy of exoplanets. The telescope and instruments are mounted to an Instrument Carrier for optical metering and isolation from Spacecraft-induced disturbances. The Spacecraft includes a Bus, Solar Array Sunshield, Deployable Aperture Cover, Outer Barrel Assembly, and Star Tracker/Inertial Reference Unit Bench. When fully integrated, Roman will be the largest Observatory assembled and tested at NASA’s Goddard Space Flight Center. The development of scientific satellites is challenging and pushes engineering boundaries to broaden scientific knowledge. The Roman mission implementation is a prime example and expected challenges have been amplified by the foundational decision to use existing, repurposed telescope components. Other unique aspects of the Roman mission, including its survey nature, large data volume, and Observatory packaging, create constrained design spaces that drive competing requirements across Observatory subsystems. Given these challenges, systems engineering has been a critical discipline in balancing implementation decisions and will continue to play a key role in the development of the Roman mission. This paper will discuss details of the Roman Observatory configuration, systems engineering challenges and the decision-making process used to mature the Roman Space Telescope from preliminary design to implementation.

Lisa M L Bartusek↗

Automatic variable selection in ecological niche modeling: A case study using Cassin’s Sparrow (Peucaea cassinii)

MERRA/Max provides a feature selection approach to dimensionality reduction that enables direct use of global climate model outputs in ecological niche modeling. The system accomplishes this reduction through a Monte Carlo optimization in which many independent MaxEnt runs, operating on a species occurrence file and a small set of randomly selected variables in a large collection of variables, converge on an estimate of the top contributing predictors in the larger collection. These top predictors can be viewed as potential candidates in the variable selection step of the ecological niche modeling process. MERRA/Max’s Monte Carlo algorithm operates on files stored in the underlying filesystem, making it scalable to large data sets. Its software components can run as parallel processes in a high-performance cloud computing environment to yield near real-time performance. In tests using Cassin’s Sparrow (Peucaea cassinii) as the target species, MERRA/Max selected a set of predictors from Worldclim’s Bioclim collection of 19 environmental variables that have been shown to be important determinants of the species’ bioclimatic niche. It also selected biologically and ecologically plausible predictors from a more diverse set of 86 environmental variables derived from NASA’s Modern-Era Retrospective Analysis for Research and Applications Version 2 (MERRA-2) reanalysis, an output product of the Goddard Earth Observing System Version 5 (GEOS-5) modeling system. We believe these results point to a technological approach that could expand the use global climate model outputs in ecological niche modeling, foster exploratory experimentation with otherwise difficult-to-use climate data sets, streamline the modeling process, and, eventually, enable automated bioclimatic modeling as a practical, readily accessible, low-cost, commercial cloud service.

John L. Schnase↗

Ocean and Earth System Modelling

Petascale supercomputing infrastructure + modelling and analysis capabilities + interdisciplinary upper-ocean expertise Multiscale ocean turbulence simulation Physical-biogeochemical interactions Analysis of large data sets from remote sensing and Earth system model ensembles

Ocean↗

Developing Fast and Accurate Radiative Transfer Models to Meet the Needs of Modern Satellite Remote Sensing Applications

Modern hyperspectral satellite remote sensors provide highly accurate measurements the Earth’s Top-of-Atmosphere (TOA) radiance, reflectance, or polarized spectra with hundreds to thousands of spectral channels and with millions of observations per day. The large data volume and high spectral dimensionality of the data pose challenges for retrieval algorithms. To process the satellite Level-1 data (e.g. calibrated TOA spectra) into Level-2 products (e.g. atmospheric and surface properties) using physical-based retrieval algorithms, accurate and fast Radiative Transfer Models (RTMs) are needed. RTMs are usually the limiting factor in determining the speed of a level-2 algorithm. For example, more than one million Line-by-Line (LBL) radiative transfer (RT) calculations are needed in order to properly capture the spectral contributions of important atmospheric molecules for an IR hyperspectral sensor with a spectral coverage from 3.5 m to 15 m or a solar hyperspectral sensor with spectral coverage from 0.25 m to 2.5 m. In this presentation, we will discuss advantages and disadvantages of different ways (e.g. correlated k and effective transmittance) to accelerate the speed of a fast RTM. We finally describe a Principal Component-based Radiative Transfer Model (PCRTM), which can calculate TOA radiance or reflectance spectra from 50 cm-1 to 40,000 cm-1 (200 m to 0.25 m). It has demonstrated very good accuracy relative to reference LBL RTMs and saves orders of magnitude in computational time. The PCRTM has been used in many satellite remote sensing applications. Examples include forward modeling in Level-2 and Level-3 retrieval algorithms, high fidelity satellite instrument simulators and instrument performance trade studies, spectral and radiometric accuracy characterizations of satellite Level-1 data, tools for inter-satellite calibrations, tools for satellite RTM lookup table generations, and tools for generating physically based training datasets for Artificial Intelligence (AI) algorithms.

climate data record↗

High performance semantic factoring of giga-scale semantic graph databases.

As semantic graph database technology grows to address components ranging from extant large triple stores to SPARQL endpoints over SQL-structured relational databases, it will become increasingly important to be able to bring high performance computational resources to bear on their analysis, interpretation, and visualization, especially with respect to their innate semantic structure. Our research group built a novel high performance hybrid system comprising computational capability for semantic graph database processing utilizing the large multithreaded architecture of the Cray XMT platform, conventional clusters, and large data stores. In this paper we describe that architecture, and present the results of our deploying that for the analysis of the Billion Triple dataset with respect to its semantic factors, including basic properties, connected components, namespace interaction, and typed paths.

99 GENERAL AND MISCELLANEOUS↗

B Mixing in the Standard Model and Beyond: Lattice QCD

We give a brief overview and progress report on our lattice QCD calculation of neutral B mixing hadronic matrix elements needed for Standard Model and Beyond the Standard Model physics. Reference [1] contains more details and results. We have a good start on a large-data-set lattice QCD calculation of the matrix elements that describe neutral-B mixing. Our calculation will cover the operators needed for both Standard Model and Beyond the Standard Model physics. For the Standard Model matrix elements, we expect to halve the error on current, published calculations. In the Beyond the Standard Model case, this will be the first full-QCD (unquenched) calculation and the first update in ten years.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Enhancing I/O Throughput via Efficient Routing and Placement for Large-scale Parallel File Systems

As storage systems get larger to meet the demands of petascale systems, careful planning must be applied to avoid congestion points and extract the maximum performance. In addition, the large data sets generated by such systems makes it desirable for all compute resources to have common access to this data without needing to copy it to each machine. This paper describes a method of placing I/O close to the storage nodes to minimize contention on Cray s SeaStar2+ network, and extends it to a routed Lustre configuration to gain the same benefits when running against a center-wide file system. Our experiments using half of the resources of Spider the center-wide file system at the Oak Ridge Leadership Computing Facility show that I/O write bandwidth can be improved by up to 45% (from 71.9 to 104 GB/s) for a direct-attached configuration and by 137% (47.6 GB/s to 115 GB/s) for a routed configuration. We demonstrated up to 20.7% reduction in run-time for production scientific applications. With the full Spider system, we demonstrated over 240 GB/s of aggregate bandwidth using our techniques.

99 GENERAL AND MISCELLANEOUS↗

Final Technical Report: DOE-Biological Ocean Margins Program. Microbial Ecology of Denitrifying Bacteria in the Coastal Ocean.

The focus of our research was to provide a comprehensive study of the bacterioplankton populations off the coast of New Jersey near the Rutgers University marine field station using terminal restriction fragment polymorphism analysis (TRFLP) coupled to 16S rRNA genes for large data set studies. Our three revised objectives to this study became: (1) to describe bacterioplankton population dynamics in the Mid Atlantic Bight using TRFLP analysis of 16S rRNA genes. (2) to determine whether spatial and temporal factors are driving bacterioplankton community dynamics in the MAB using monthly samping along our transect line over a 2-year period. (3) to identify dominant members of a coastal bacterioplankton population by clonal library analysis of 16S rDNA genes and sequencing of PCR product corresponding to specific TRFLP peaks in the data set. Although open ocean time-series sites have been areas of microbial research for years, relatively little was known about the population dynamics of bacterioplankton communities in the coastal ocean on kilometer spatial and seasonal temporal scales. To gain a better understanding of microbial community variability, monthly samples of bacterial biomass were collected in 1995-1996 along a 34-km transect near the Long-Term Ecosystem Observatory (LEO-15) off the New Jersey coast. Surface and bottom sampling was performed at seven stations along a transect line with depths ranging from 1 to 35m (n=178). The data revealed distinct temporal patterns among the bacterioplankton communities in the Mid-Atlantic Bight rather than grouping by sample location or depth (figure 2-next page). Principal components analysis models supported the temporal patterns. In addition, partial least squares regression modeling could not discern a significant correlation from traditional oceanographic physical and phytoplankton nutrient parameters on overall bacterial community variability patterns at LEO-15. These results suggest factors not traditionally measured during oceanographic studies are structuring coastal microbial communities.

09 BIOMASS FUELS↗

Design and Implementation of Broadcast Algorithms for Extreme-Scale Systems

The scalability and performance of collective communication operations limit the scalability and performance of many scientific applications. This paper presents two new blocking and nonblocking Broadcast algorithms for communicators with arbitrary communication topology, and studies their performance. These algorithms benefit from increased concurrency and a reduced memory footprint, making them suitable for use on large-scale systems. Measuring small, medium, and large data Broadcasts on a Cray-XT5, using 24,576 MPI processes, the Cheetah algorithms outperform the native MPI on that system by 51%, 69%, and 9%, respectively, at the same process count. These results demonstrate an algorithmic approach to the implementation of the important class of collective communications, which is high performing, scalable, and also uses resources in a scalable manner.

99 GENERAL AND MISCELLANEOUS↗

Distributed Parallel Particle Advection using Work Requesting

Particle advection is an important vector field visualization technique that is difficult to apply to very large data sets in a distributed setting due to scalability limitations in existing algorithms. In this paper, we report on several experiments using work requesting dynamic scheduling which achieves balanced work distribution on arbitrary problems with minimal communication overhead. We present a corresponding prototype implementation, provide and analyze benchmark results, and compare our results to an existing algorithm.

97 MATHEMATICS AND COMPUTING↗

High Performance Semantic Factoring of Giga-Scale Semantic Graph Databases

As semantic graph database technology grows to address components ranging from extant large triple stores to SPARQL endpoints over SQL-structured relational databases, it will become increasingly important to be able to bring high performance computational resources to bear on their analysis, interpretation, and visualization, especially with respect to their innate semantic structure. Our research group built a novel high performance hybrid system comprising computational capability for semantic graph database processing utilizing the large multithreaded architecture of the Cray XMT platform, conventional clusters, and large data stores. In this paper we describe that architecture, and present the results of our deploying that for the analysis of the Billion Triple dataset with respect to its semantic factors.

Semantic graph databases, high performance computi↗

Properties of Alloy 617 for Heat Exchanger Design

Abstract – Alloy 617 is among the primary candidates for very high temperature reactor heat exchangers anticipated for use up to 950ºC. Elevated temperature properties of this alloy and the mechanisms responsible for the observed tensile, creep and creep-fatigue behavior have been characterized over a wide range of test temperatures up to 1000ºC. Properties from the current experimental program have been combined with archival information from previous VHTR research to provide large data sets for many heats of material, product forms, and weldments. The combined data have been analyzed to determine conservative values of yield and tensile strength, strain rate sensitivity, creep-rupture behavior, fatigue and creep- fatigue properties that can be used for engineering design of reactor components. Phenomenological models have been developed to bound the regions over which the engineering properties are well known or can be confidently extrapolated for use in design.

Alloy 617↗