SEARCH · Search NASA

Results for “Big data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

NASA NTRS2009

On Organization of Information: Approach and Early Work

In this report we describe an approach for organizing information for presentation and display. "e approach stems from the observation that there is a stepwise progression in the way signals (from the environment and the system under consideration) are extracted and transformed into data, and then analyzed and abstracted to form representations (e.g., indications and icons) on the user interface. In physical environments such as aerospace and process control, many system components and their corresponding data and information are interrelated (e.g., an increase in a chamber s temperature results in an increase in its pressure). "ese interrelationships, when presented clearly, allow users to understand linkages among system components and how they may affect one another. Organization of these interrelationships by means of an orderly structure provides for the so-called "big picture" that pilots, astronauts, and operators strive for.

Degani, Asaf↗

NASA NTRS2018

Introduction to Big Earth Data Applications

Climate and weather modeling generate enormous volumes that make iterative analysis challenging, spurring the development of new ways to work with the data. A theme going across applications is the need to identify and highlight "interesting" data for the scientist to focus on. Operational applications often scale up from small, local studies to larger spatial scales with more analysis targets.

parallel processing (computers)↗

NASA NTRS1994

Interpretation of the COBE FIRAS CMBR spectrum

The cosmic microwave background radiation (CMBR) spectrum measured by the Far-Infrared Absolute Spectrophotometer (FIRAS) instrument on NASA's Cosmic Background Explorer (COBE) is indistinguishable from a blackbody, implying stringent limits on energy release in the early universe later than the time t = 1 yr after the big bang. We compare the FIRAS data to previous precise measurements of the cosmic microwave background spectrum and find a reasonable agreement. We discuss the implications of the absolute value of y is less than 2.5 x 10(exp -5) and the absolute value of mu is less than 3.3 x 10(exp -4) 95% confidence limits found by Mather et al. (1994) on many processes occurring after t = 1 yr, such as explosive structure formation, reionization, and dissipation of small-scale density perturbations. We place limits on models with dust plus Population III stars, or evolving populations of IR galaxies, by directly comparing the Mather et al. spectrum to the model predictions.

Wright, E. L.↗

NASA NTRS1983

Geologic exploration: The contribution of LANDSAT-4 thematic mapper data

The major advantages of the TM data over that of MSS systems are increased spatial resolution and a greater number of narrow, strategically placed spectral bands. The 30 meter pixel size permits finer definition of ground features and improves reliability of the photointerpretation of geologic structure. The value of the spatial data increases relative to the value of the spectral data as soil and vegetation cover increase. In arid areas with good exposure, it is possible with careful digital processing and some inventive color compositing to produce enough spectral differentiation of rock types and thereby produce facsimiles of standard geologic maps with a minimum of field work or reference to existing maps. Hue-saturation value images are compared with geological maps of Death Valley, California, the Big Horn/Wind River Basin of Wyoming, the area around Cement, Oklahoma, and Detroit. False color composites of the Ontario region are also examined.

Everett, J. R.↗

NASA NTRS2003

Combining Multiple Gyroscope Outputs for Increased Accuracy

A proposed method of processing the outputs of multiple gyroscopes to increase the accuracy of rate (that is, angular-velocity) readings has been developed theoretically and demonstrated by computer simulation. Although the method is applicable, in principle, to any gyroscopes, it is intended especially for application to gyroscopes that are parts of microelectromechanical systems (MEMS). The method is based on the concept that the collective performance of multiple, relatively inexpensive, nominally identical devices can be better than that of one of the devices considered by itself. The method would make it possible to synthesize the readings of a single, more accurate gyroscope (a virtual gyroscope) from the outputs of a large number of microscopic gyroscopes fabricated together on a single MEMS chip. The big advantage would be that the combination of the MEMS gyroscope array and the processing circuitry needed to implement the method would be smaller, lighter in weight, and less power-hungry, relative to a conventional gyroscope of equal accuracy. The method (see figure) is one of combining and filtering the digitized outputs of multiple gyroscopes to obtain minimum-variance estimates of rate. In the combining-and-filtering operations, measurement data from the gyroscopes would be weighted and smoothed with respect to each other according to the gain matrix of a minimum- variance filter. According to Kalman-filter theory, the gain matrix of the minimum-variance filter is uniquely specified by the filter covariance, which propagates according to a matrix Riccati equation. The present method incorporates an exact analytical solution of this equation.

Bayard, David S.↗

NASA NTRS2017

Planetesimals Born Big by Clustering Instability?

Roughly 100km diameter primitive bodies (today's asteroids and TNOs; [1]) are thought to be the end product of so-called "primary accretion". They dominated the initial mass function of planetesimals, and precipitated the onset of a subsequent stage, characterized by runaway gravitational effects, which proceeded onwards to planetary mass objects, some of which accreted massive gas envelopes. Asteroids are the parents of primitive meteorites; meteorite data suggest that asteroids initially formed directly from freelyfloating nebula particles in the mm-size range. Unfortunately, the process by which these primary 100km diameter planetesimals formed remains problematic. We review the most diagnostic primitive parent body observations, highlight critical aspects of the nebula context, and describe the issues facing various primary accretion models. We suggest a path forward that combines current scenarios of "turbulent concentration" (TC) and "streaming instabilities" (SI) into a triggered formation process we call clustering instability (CI). Under expected conditions of nebula turbulence, the success of these processes at forming terrestrial region (mostly silicate) planetesimals requires growth by sticking into aggregates in the several cm size range, at least, which is orders of magnitude more massive than allowed by current growth-by-sticking models using current experimental sticking parameters [2-4]. The situation is not as dire in the ice-rich outer solar system; however, growth outside of the snowline has important effects on growth inside of it [4] and at least one aspect of outer solar system planetesimals (high binary fraction) supports some kind of clustering instability.

Cuzzi, Jeffrey N.↗

NASA NTRS2017

Planetesimals Born Big by Clustering Instability?

Asteroids↗

NASA NTRS1991

COBE ground segment attitude determination

The Cosmic Background Explorer (COBE) spacecraft was launched in November 1989 by NASA to survey the sky for primordial radiation left from the Big Bang explosion. The success of the mission requires an accurate determination of the spacecraft attitude. While the accuracy of the attitude obtained from the attitude sensors is adequate for two of the experiments, the higher accuracy required by the Diffuse Infrared Background Experiment (DIRBE) is obtained by using the DIRBE instrument as a special type of star sensor. Presented here is an overview of the attitude processing algorithms used at the Cosmology Data Analysis Center (CDAC) and the results obtained from the flight data.

Kumar, V. K.↗

NASA NTRS1999

Origin of Gamma-Ray Emissions from the MeV Blazars

More than sixty gamma-ray emitting blazars have been detected by the Compton Gamma Ray Observatory (CGRO). A sub-class of these blazars is known as MeV blazars that are most luminous at the MeV energies. Spectra of these sources show a break somewhere between 1 MeV and 30 MeV with break amplitude as large as DELTA-GAMMA = 1.5. Different models like Compton cooling jet models, synchrotron self-Compton models, etc., have been suggested to explain the observed properties of the MeV luminous blazars. However these models are unable to account for spectral break amplitudes in excess of 0.5. Here we suggest an inverse-Compton model based on recent published experimental data where MeV gamma rays were produced via Compton backscattering of UV photons with 500 MeV electrons. We show that the high energy electrons of the relativistic jet can collide with the copious ultraviolet photons of the big blue bump of the blazar, and produce photons peaked in the MeV region. Also we show that the X rays and the soft gamma rays in these sources are produced through the synchrotron self-Compton process. Flux computed from our model have been used to compare with the observed X-ray/gamma-ray spectra of the MeV luminous blazars. Details of the model are discussed in the present paper.

Ghosh, K. K.↗

NASA NTRS1998

Origin of Gamma-Ray Emissions from the MeV Blazars

More than sixty gamma-ray emitting blazars have been detected by the Compton Gamma Ray Observatory (CGRO). A sub-class of these blazars is known as MeV blazars that are most luminous at the MeV energies. Spectra of these sources show a break somewhere between 1 MeV and 30 MeV with break amplitude as large as Delta(Gamma) = 1.5. Different models like Compton cooling jet models, synchrotron self-Compton models, etc., have been suggested to explain the observed properties of the MeV luminous blazars. However these models are unable to account for spectral break amplitudes in excess of 0.5. Here we suggest an inverse-Compton model based on recent published experimental data where MeV gamma rays were produced via Compton backscattering of UV photons with 500 MeV electrons. We show that the high energy electrons of the relativistic jet can collide with the copious ultraviolet photons of the big blue bump of the blazar, and produce photons peaked in the MeV region. Also we show that the X rays and the soft gamma rays in these sources are produced through the synchrotron self-Compton process. Flux computed from our model have been used to compare with the observed X-ray/ gamma-ray spectra of the MeV luminous blazars. Details of the model are discussed in the present paper.

Ghosh, K. K.↗

NASA NTRS1981

Applications of digital image analysis capability in Idaho

The use of digital image analysis of LANDSAT imagery in water resource assessment is discussed. The data processing systems employed are described. The determination of urban land use conversion of agricultural land in two southwestern Idaho counties involving estimation and mapping of crop types and of irrigated land is described. The system was also applied to an inventory of irrigated cropland in the Snake River basin and establishment of a digital irrigation water source/service area data base for the basin. Application of the system to a determination of irrigation development in the Big Lost River basin as part of a hydrologic survey of the basin is also described.

Johnson, K. A.↗

NASA NTRS2015

A Heuristic Approach to Correlating ERAM Flight Data from Twenty Centers

Among its many other functions, the Federal Aviation Administration’s En Route Automation Modernization (ERAM) provides external systems with real-time air traffic data for flights in enroute airspace in the National Airspace System. It replaced the En Route Host computer and backup system used at 20 FAA Air Route Traffic Control Centers (Centers) nationwide. Among the new features of ERAM, its output data stream of flight plan and track data includes a unique identifier for a flight originating in any one of the 20 ERAM Centers. The unique identifier, called the Global Unique Flight Identifier (GUFI), is persistent across all the Centers that track the flight. However, certain factors make it difficult to correlate data using the GUFI. First, the value of the GUFI is only unique within a time window of seven days. Second, the GUFI is attached only to flight-plan related data messages. Finally, track positions reported by ERAM do not reference the GUFI. In order to correlate historical as well as real time flight-plan and position related ERAM data, an efficient, heuristic approach was developed, and a prototype was developed. The approach showed that the processing speed, through parallel processing, is sufficient to correlate ERAM data in real-time. As described in this paper, when there are multiple track positions reported from multiple Centers within a few seconds, each position is assigned with a weighted score to indicate the quality of the position relative to its last know position. The weighted score can be used to eliminate potentially duplicate track positions. The approach is database-agnostic, and can be implemented in a Big Data system such as an Apache Hadoop system, as well as in traditional database systems.

Correlating ERAM Flight Data↗

NASA NTRS2002

Seeing Red and Shooting Blanks: A Study of Red Quasars and Blank Field X-Ray Sources

We have identified a population of 'blank field sources' (or 'blanks') among the ROSAT (Roentgen Satellite) bright unidentified X-ray sources with faint optical counterparts. The extreme X-ray over optical flux ratio of blank field sources is not compatible with the main classes of X-ray emitters except for extreme BL Lacertae objects at fx/fv is equal to or less than 35. From the analysis of ROSAT archival data we found evidence for only three sources, out of 16, needing absorption in excess of the Galactic value and no indication of variability. We also found evidence for an extended nature for only one of the five blanks with a serendipitous HRI (High Resolution Imager) detection; this source (1WGA J1226.9+3332) was confirmed as a z=0.89 cluster of galaxies. Palomar images reveal the presence of a red (O - E is equal to or greater than 2) counterpart in the X-ray error circle for six blanks. The identification process brought to the discovery of another high z cluster of galaxies, one (possibly extreme) BL Lac and two apparently normal type 1 AGNs (Active Galactic Nuclei). These AGNs, together with four more AGN-like objects seem to form a well defined group: they present type 1 X-ray spectra but red Palomar counterparts. We discuss the possible explanations for the discrepancy between the X-ray and optical data, among which: a suppressed big blue bump emission, an extreme dust to gas (approximately 40 - 60 the Galactic ratio) ratio value and a high redshift (z is greater than or equal to 3.5) QSO (Quasi-Stellar Object) nature. These AGN-like blanks seem to be the bright (and easier to study) analogs of the sources which are being found in deep Chandra observations. Five more blanks have a still an unknown nature.

Elvis, Martin↗

NASA NTRS2019

SERVIR: Leveraging the Expertise of a Space Agency and a Development Agency to Increase Impact of Earth Observation in the Developing World

SERVIR is a joint initiative of the National Aeronautics and Space Administration (NASA) and the U.S. Agency for International Development (USAID), in collaboration with leading technical organizations around the world-- called SERVIR hubs--that serve and empower developing countries to use satellite data addressing critical challenges in food security and agriculture; water and water-related disasters; land cover, land use and ecosystems; and weather and climate. Over the past fourteen years, the program has worked with stakeholders in 50 countries across the world, partnered with 390 institutions, and generated and shared over 70 products from 27 satellites and sensors. In that process, around 7,400 specialists have been trained in the application of Earth observation data and technology. In its lifetime, SERVIR has been agile and innovative in shifting from what was essentially an incubator for testing and deploying Earth observation science and technology to making co-development the hallmark of its work, exemplified by both South-South and North-South scientific collaborations. SERVIR’s approach has embodied the concept that to solve really big problems, big, creative solutions are needed. SERVIR represents the world working together to address environmental challenges using spaced-based and geospatial technologies. Aligning with the very meaning of SERVIR, i.e. “to serve,” the program continues to be demand-driven in developing and deploying services (versus one-off products) which address development challenges using geospatial tools and Earth observation science. In 2016, as part of SERVIR’s evolution, USAID and NASA released the ‘SERVIR Service Planning Toolkit,’ a guidance document which provides a framework for how geospatial services can be used to tackle development challenges in a sustained manner. Since then, the Service Planning Toolkit’s systematic approach has begun to catch on in other Earth observation efforts. To improve access and use, SERVIR launched a Service Catalogue in February 2019, a searchable collection of demand-driven geospatial services that use Earth observations to support decision making. SERVIR implementing hub partners –include SERVIR-West Africa at the Agrometeorology, Hydrology and Meteorology (AGRHYMET) Regional Center, in Niamey, Niger; SERVIR-Eastern & Southern Africa at the Regional Centre for Mapping of Resources for Development in Nairobi, Kenya; SERVIR-Hindu Kush Himalaya at the International Centre for Integrated Mountain Development in Kathmandu, Nepal; SERVIR-Mekong at the Asian Disaster Preparedness Center in Bangkok, Thailand; and SERVIR’ -Amazonia, at the International Center for Tropical Agriculture (CIAT) in Cali, Colombia.

Searby, Nancy D.↗

NASA NTRS1993

RAID 7 disk array

Each RAID level reflects a different design architecture. Associated with each is a backdrop of imposed limitations, as well as possibilities which may be exploited within the architectural constraints of that level. There are three unique features that differentiate RAID 7 from all other levels. RAID 7 is asynchronous with respect to usage of I/O data paths. Each I/O drive (includes all data and one parity drives) as well as each host interface (there may be multiple host interfaces) has independent control and data paths. This means that each can be accessed completely, independently, of the other. This is facilitated by a separate device cache for each device/interface as well. RAID 7 is asynchronous with respect to device hierarchy and data bus utilization. Each drive and each interface is connected to a high speed data bus controlled by the embedded operating system to make independent transfers to and from central cache. RAID 7 is asynchronous with respect to the operation of an embedded real time process oriented operating system. This means that exclusive and independent of the host, or multiple host paths, the embedded OS manages all I/O transfers asynchronously across the data and parity drives. A key factor to consider is that of the RAID 7's ability to anticipate and match host I/O usage patterns. This yields the following benefits over RAID's built around micro-code based architectures. RAID 7 appears to the host as a normally connected Big Fast Disk (BFD). RAID 7 appears, from the perspective of the individual disk devices, to minimize the total number of accesses and optimize read/write transfer requests. RAID 7 smoothly integrates the random demands of independent users with the principles of spatial and temporal locality. This optimizes small, large, and time sequenced I/O requests which results in users having an I/O performance which approaches performance to that of main memory.

Stout, Lloyd↗

NASA NTRSDate not supplied

NASA’s Prototype Spectral Water Inversion Processor and Emulator (SWIPE): Towards Global Coastal and Inland Water Quality and Algal Biodiversity Monitoring

Degradation of Earth’s inland water resources due to anthropogenic perturbations and climate anomalies at both local and global scales continues to place human health at substantial risk. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will provide updates on NASA’s prototype open-source aquatic modeling platform, Spectral Water Inversion Processor and Emulator (SWIPE), which is a comprehensive, multi-faceted modeling platform for both forward and inverse modeling of diverse aquatic ecosystems from the benthos to top-of-atmosphere (TOA). SWIPE provides a cohesive application which leverages recent advancements in particle modeling, Big Data analytics, and machine learning to develop a high-fidelity synthetic training ground for sensitivity studies and algorithm development for multispectral or upcoming hyperspectral missions. Some of the prominent features of SWIPE to be discussed include: 1. Advanced hyperspectral modeling of globally diverse algal and non-algal particles using a novel two-layer coated sphere scattering model and radiative transfer modeling, 2. Massive, highly detailed synthetic spectral libraries of Analysis-Ready-Data (ARD) which include spectral libraries of particle microphysics, water biogeophysical and optical properties, as well as surface and TOA reflectances at 1 nm resolution, 3. An ensemble of pre-built analytic, machine learning, and deep learning inversion algorithms for various water quality and biodiversity related retrieval parameters and uncertainty quantification, 4. Sensor-agnostic water quality inversion at wide ranging spatial and spectral resolutions including a codebase for seamless application in the Google Earth Engine and NASA Earth Exchange (NEX) for planetary scale analysis. SWIPE will be a fully open-source platform based in python with comprehensive documentation, tutorials, and options for distributed computing on high performance computing clusters or on single, local machines. Further, we will discuss how we envision SWIPE contributing towards a global analysis of coastal and inland water quality dynamics.

top-of-atmosphere (TOA)↗

NASA NTRSDate not supplied

Tracking Critical Thermal Metrics throughout the Life Cycle of a Large Observatory Thermal Model

Observatory thermal models for large, complex missions, such as the Wide Field InfraRed Survey Telescope (WFIRST) mission, produce an immense amount of data to be processed. Configuration management of the model throughout the project life cycle has mainly focused on which versions of the subsystem models form the current observatory level configuration. However, the results produced by the model are not nearly as well tracked and traceable. Given the various states of design maturity for each of the components in the WFIRST design, an updated component model is nearly ready to be integrated at the next higher level of assembly about every month or two. With each subsystem model delivery, the observatory model needs to remove the old component, integrate the new one, execute the model, and inspect the results. Usually, this inspection focuses primarily on the newly integrated component. Recently, a Metric Tracking Spreadsheet was developed to help provide a “big picture” view of the entire observatory highlighting key parameters critical to mission performance. This spreadsheet helps track impacts on subsystems by updates of other subsystems that were not intuitively obvious. Metrics tracked include: absorbed environmental loading (to determine effectiveness of sunshield), temperatures of critical avionics, electrical dissipations, heater power predictions, stability of critical optics, parasitic heat leaks in cryogenic region, high level heat flows between elements, and model run time. Producing this data for the same operational configuration with each model update has helped produce a trail of data to evaluate the impact of model updates. While the metrics selected are specific for WFIRST, other large, complex observatories could be well served to establish their own metrics early in the project life cycle to track to quickly assess the impact of any subsystem on other subsystems or the overall system itself.

Thermal Desktop↗

NASA NTRS2013

Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Final Maps and Results

We present the final nine-year maps and basic results from the Wilkinson Microwave Anisotropy Probe (WMAP) mission. The full nine-year analysis of the time-ordered data provides updated characterizations and calibrations of the experiment. We also provide new nine-year full sky temperature maps that were processed to reduce the asymmetry of the effective beams. Temperature and polarization sky maps are examined to separate cosmic microwave background (CMB) anisotropy from foreground emission, and both types of signals are analyzed in detail.We provide new point source catalogs as well as new diffuse and point source foreground masks. An updated template-removal process is used for cosmological analysis; new foreground fits are performed, and new foreground reduced are presented.We nowimplement an optimal C(exp -1)1 weighting to compute the temperature angular power spectrum. The WMAP mission has resulted in a highly constrained Lambda-CDM cosmological model with precise and accurate parameters in agreement with a host of other cosmological measurements. When WMAP data are combined with finer scale CMB, baryon acoustic oscillation, and Hubble constant measurements, we find that big bang nucleosynthesis is well supported and there is no compelling evidence for a non-standard number of neutrino species (N(sub eff) = 3.84 +/- 0.40). The model fit also implies that the age of the universe is (sub 0) = 13.772 +/- 0.059 Gyr, and the fit Hubble constant is H(sub 0) = 69.32 +/- 0.80 km/s/ Mpc. Inflation is also supported: the fluctuations are adiabatic, with Gaussian random phases; the detection of a deviation of the scalar spectral index from unity, reported earlier by the WMAP team, now has high statistical significance (n(sub s) = 0.9608+/-0.0080); and the universe is close to flat/Euclidean (Omega = −0.0027+0.0039/−0.0038). Overall, the WMAP mission has resulted in a reduction of the cosmological parameter volume by a factor of 68,000 for the standard six-parameter Lambda-CDM model, based on CMB data alone. For a model including tensors, the allowed seven-parameter volume has been reduced by a factor 117,000. Other cosmological observations are in accord with the CMB predictions, and the combined data reduces the cosmological parameter volume even further.With no significant anomalies and an adequate goodness of fit, the inflationary flat Lambda-CDM model and its precise and accurate parameters rooted in WMAP data stands as the standard model of cosmology.

dark matter↗