Search NASA⌕ Search

SEARCH · Search NASA

Results for “big data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Introduction to NASA Goddard Workshop on Artificial Intelligence

Artificial Intelligence (AI) is a collection of advanced technologies that allows machines to think and act, both humanly and rationally, through sensing, comprehending, acting and learning. AI's foundations lie at the intersection of several traditional fields Philosophy, Mathematics, Economics, Neuroscience, Psychology and Computer Science. Although the inception of AI started in the 1950's, it has recently made a strong comeback in all aspects of society and all over the world; this is mainly due to the timely combination of increased data volumes, advanced and mature algorithms, and improvements in computing power and storage. Current AI applications include big data analytics, robotics, intelligent sensing, assisted decision making, and speech recognition just to name a few.This workshop will be investigating how AI technologies can be adapted or developed to address the following challenges: Discover events of interest and correlations in large amounts of science data; improve the outcomes of science modeling and data assimilation using improved data processing, integration, and analysis. Design advisors for mission planning and operations, including anomaly detection and spacecraft health monitoring. Develop tools for engineering support, including advanced manufacturing, orbit determination, new component design and system engineering. Customize intelligent user interfaces, including visual analytics and natural language processing.

Le Moigne, Jacqueline↗

Marshall Space Flight Center Propulsion Systems Department (PSD) KM Initiative

NASA Marshall Space Flight Center s Propulsion Systems Department (PSD) is four months into a fifteen month Knowledge Management (KM) initiative to support enhanced engineering decision making and analyses, faster resolution of anomalies (near-term) and effective, efficient knowledge infused engineering processes, reduced knowledge attrition, and reduced anomaly occurrences (long-term). The near-term objective of this initiative is developing a KM Pilot project, within the context of a 3-5 year KM strategy, to introduce and evaluate the use of KM within PSD. An internal NASA/MSFC PSD KM team was established early in project formulation to maintain a practitioner, user-centric focus throughout the conceptual development, planning and deployment of KM technologies and capabilities with in the PSD. The PSD internal team is supported by the University of Alabama's Aging Infrastructure Systems Center Of Excellence (AISCE), Intergraph Corporation, and The Knowledge Institute. The principle product of the initial four month effort has been strategic planning of PSD KM implementation by first determining the "as is" state of KM capabilities and developing, planning and documenting the roadmap to achieve the desired "to be" state. Activities undertaken to support the planning phase have included data gathering; cultural surveys, group work-sessions, interviews, documentation review, and independent research. Assessments and analyses have been performed including industry benchmarking, related local and Agency initiatives, specific tools and techniques used and strategies for leveraging existing resources, people and technology to achieve common KM goals. Key findings captured in the PSD KM Strategic Plan include the system vision, purpose, stakeholders, prioritized strategic objectives mapped to the top ten practitioner needs and analysis of current resource usage. Opportunities identified from research, analyses, cultural/KM surveys and practitioner interviews include: executive and senior management sponsorship, KM awareness, promotion and training, cultural change management, process improvement, leveraging existing resources and new innovative technologies to align with other NASA KM initiatives (convergence: the big picture). To enable results based incremental implementation and future growth of the KM initiative, key performance measures have been identified including stakeholder value, system utility, learning and growth (knowledge capture, sharing, reduced anomaly recurrence), cultural change, process improvement and return-on-investment. The next steps for the initial implementation spiral (focused on SSME Turbomachinery) have been identified, largely based on the organization and compilation of summary level engineering process models, data capture matrices, functional models and conceptual-level systems architecture. Key elements include detailed KM requirements definition, KM technology architecture assessment, evaluation and selection, deployable KM Pilot design, development, implementation and evaluation, and justifying full implementation (estimated Return-on-Investment). Features identified for the notional system architecture include the knowledge presentation layer (and its components), knowledge network layer (and its components), knowledge storage layer (and its components), User Interface and capabilities. This paper provides a snapshot of the progress to date, the near term planning for deploying the KM pilot project and a forward look at results based growth of KM capabilities with-in the MSFC PSD.

Caraccioli, Paul↗

Marshall Space Flight Center Propulsion Systems Department (PSD) Knowledge Management (KM) Initiative

NASA Marshall Space Flight Center's Propulsion Systems Department (PSD) is four months into a fifteen month Knowledge Management (KM) initiative to support enhanced engineering decision making and analyses, faster resolution of anomalies (near-term) and effective, efficient knowledge infused engineering processes, reduced knowledge attrition, and reduced anomaly occurrences (long-term). The near-term objective of this initiative is developing a KM Pilot project, within the context of a 3-5 year KM strategy, to introduce and evaluate the use of KM within PSD. An internal NASA/MSFC PSD KM team was established early in project formulation to maintain a practitioner, user-centric focus throughout the conceptual development, planning and deployment of KM technologies and capabilities within the PSD. The PSD internal team is supported by the University of Alabama's Aging Infrastructure Systems Center of Excellence (AISCE), lntergraph Corporation, and The Knowledge Institute. The principle product of the initial four month effort has been strategic planning of PSD KNI implementation by first determining the "as is" state of KM capabilities and developing, planning and documenting the roadmap to achieve the desired "to be" state. Activities undertaken to suppo~th e planning phase have included data gathering; cultural surveys, group work-sessions, interviews, documentation review, and independent research. Assessments and analyses have beon pedormed including industry benchmarking, related local and Agency initiatives, specific tools and techniques used and strategies for leveraging existing resources, people and technology to achieve common KM goals. Key findings captured in the PSD KM Strategic Plan include the system vision, purpose, stakeholders, prioritized strategic objectives mapped to the top ten practitioner needs and analysis of current resource usage. Opportunities identified from research, analyses, cultural1KM surveys and practitioner interviews include: executive and senior management sponsorship, KM awareness, promotion and training, cultural change management, process improvement, leveraging existing resources and new innovative technologies to align with other NASA KM initiatives (convergence: the big picture). To enable results based incremental implementation and future growth of the KM initiative, key performance measures have been identified including stakeholder value, system utility, learning and growth (knowledge capture, sharing, reduced anomaly recurrence), cultural change, process improvement and return-on-investment. The next steps for the initial implementation spiral (focused on SSME Turbomachinery) have been identified, largely based on the organization and compilation of summary level engineering process models, data capture matrices, functional models and conceptual-level svstems architecture. Key elements include detailed KM requirements definition, KM technology architecture assessment, - evaluation and selection, deployable KM Pilot design, development, implementation and evaluation, and justifying full implementation (estimated Return-on-Investment). Features identified for the notional system architecture include the knowledge presentation layer (and its components), knowledge network layer (and its components), knowledge storage layer (and its components), User Interface and capabilities. This paper provides a snapshot of the progress to date, the near term planning for deploying the KM pilot project and a forward look at results based growth of KM capabilities with-in the MSFC PSD.

Caraccioli, Paul↗

Multispectral remote sensing as stratigraphic and structural tool, Wind River Basin and Big Horn Basin areas, Wyoming

The use of Landsat TM, Airborne Imaging Spectrometer, and airborne Thermal IR Multispectral Scanner data in the geological evaluation of two sites in central Wyoming is described and illustrated with diagrams, maps, photographs, sample images, and tables of numerical data. The value of the remotely sensed information on the areal variation of attitude, sequence, thickness, and lithology of exposed strata is demonstrated; details of the data analysis are given; and the specialized software packages employed are briefly characterized.

Lang, Harold R.↗

Satellite cloud climatology of summertime cumulus research areas

Defense Meteorological Satellite Program data available for the summer of 1974 was used to construct a cloud climatology of areas where weather modification experiments are currently being conducted or planned; the three High Plains Experiment sites at Colby, Kansas, Big Springs, Texas, and Miles City, Montana; South Park, Colorado, where the South Park Area Cumulus Experiment is being conducted; and the National Hail Research Experiment area in northeastern Colorado. Digital data tapes were produced from the transparencies, obtained from the sun-synchronous polar-orbiting satellite passing over the study areas at about 1200 local time, and a computer analysis was carried out, producing areas and numbers of clouds for each area and day as well as providing data for cumulative averages over selected time periods for each study area.

Stodt, R. W.↗

MSL SAM-Like Evolved Gas Analyses of Si-rich Amorphous Materials

Chemical and mineralogical analyses of several samples from Murray Formation mudstones and Stimson Formation sandstones by the Mars Science Laboratory (MSL) revealed the presence of Si-rich amorphous or poorly ordered materials. It is possible to identify the presence of high-SiO2 vs. lower SiO2 amorphous materials (e.g., basaltic glasses), based on the position of the resulting wide diffraction features in XRD patterns from the Chemistry and Mineralogy (CheMin) instrument, but it is not possible to distinguish between several candidate high-SiO2 amorphous materials such as opal-A or rhyolitic glass. In the Buckskin (BS) sample from the upper Murray Formation, and the Big Sky (BY) and Greenhorn (GH) samples from the Stimson Formation, analyses by the Sample Analysis at Mars (SAM) instrument showed very broad H2O evolutions during sample heating at temperatures >450-500degC which had not been observed from previous samples. BS also had a significant broad evolution <450-500degC. We have undertaken a laboratory study targeted at understanding if the data from SAM can be used to place constraints on the nature of the amorphous phases. SAM-like evolved gas analyses have been performed on several opal and rhyolitic glass samples. Opal-A samples exhibited wide <500degC H2O evolutions, with lesser H2O evolved above ~500degC. H2O evolution traces from rhyolitic glasses varied, having either two broad H2O peaks, <300degC and >500degC, or a broad peak centered around 400degC. For samples that produced two evolutions, the lower temperature peak is more intense than the higher temperature peak, a trend also exhibited by opal-A. This trend is consistent with data from BS, but does not seem consistent with data from BY and GH which evolved most of their H2O >500degC. It may be that dehydration of opal-A and/or rhyolitic glass can result in some preferential loss of lower temperature H2O, to produce traces that more closely resemble BY and GH. This is currently under investigation and results will be reported.

McAdam, Amy↗

Cloud Optimized Data Formats

Cloud computing offers the promise of being able to analyze Big Data earth Observations at scale, by allowing scientists to deploy many nodes at once to analyze the data. However, in order to take full advantage of cloud scalability, it is often necessary to reorganize and reformat the data to enable fine-grained, parallel access to the data in Web Object Storage. NASA recently conducted a study of several formats that are optimized for analysis in the cloud: Parquet, zarr, HDF (Hierarchical Data Format) in the Cloud, and Cloud-Optimized GeoTIFF (Tagged Image File Format). They were compared against non-cloud-optimized formats, netCDF (network Common Data Form) and GeoTIFF, with criteria based both on stewardship and analysis performance.

Christopher Lynnes↗

MIL-HDBK-338: Environmental Conversion Table Correction

In reliability analysis, especially for launch vehicles, limited data is frequently a problem. Component data from other environments must be used. MIL-HBK-338 has a matrix showing the conversation between environments. Due to round off the conversions are not commutative, converting from A to B will not equal converting from B to A. Agenda: Introduction to environment conversions; Original table; Original table with edits; How big is the problem?; First attempt at correction; Proposed solution.

Hark, Frank↗

Measurements of striae in CR+ doped YAG laser crystals

Striations in Czochralski (CZ) grown crystals have been observed in materials such as GaAs, silicon, photorefractive crystals used for data storage, potassium titanyl phosphate crystals and LiNbO3. Several techniques have been used for investigating these defects including electron microscopy, laser scanning tomography, selective photoetching, X-ray diffuse scattering, interference orthoscopy, laser interferometry and micro-Fourier transform infrared spectroscopy mapping. A 2mm thick sample of the material to be investigated is illuminated with light that is absorbed and non-absorbed by the ion concentration to be observed. The back surface of the sample is focused onto a solid-state image detector and images of the input beam and absorbed (and diffracted) beams are captured at two wavelengths. The variation of the coefficient of absorption asa function of distance on the sample can be derived from these measurements. A Big Sky Software Beamcode system is used to capture and display images. Software has been written to convert the Beamcode data files to a format that can be imported into a spreadsheet program such as Quatro Pro. The spreadsheet is then used to manipulate and display data. A model of the intensity map of the striae collected by the imaging system has been proposed and a data analysis procedure derived. From this, the variability of the attenuation coefficient alpha can be generated. Preliminary results show that alpha may vary by a factor of four or five over distances of 100 mu m. Potential errors and problems have been discovered and additional experiments and improvements to the experimental setup are in progress and we must now show that the measurement techniques and data analysis procedures provide 'real' information. Striae are clearly visible at all wavelengths including white light. Their basic spatial frequency does not change radically, at least when changing from blue to green to white light. Further experimental and theoretical work can be done to improve the data collection techniques and to verify the data analysis procedures.

Cady, Fredrick M.↗

Experiment to evaluate feasibility of utilizing Skylab-EREP remote sensing data for tectonic analysis of the Bighorn Mountains region, Wyoming-Montana

The author has identified the following significant results. Analysis of SL-3, S-190A, and S-190B color frames indicates two sets of linears obliquely cutting across the east-west trending Owl Creek-Bridger uplifts. A northwest set of faults and folds has been mapped previously but the imagery indicates some changes and addition of detail can be made. A less pronounced east-northeast set of linear alignments (drainage segments, lithologic contacts, possible faults) extends into the southeast part of the Big Horn Basin.

Hoppin, R. A.↗

COBE ground segment attitude determination

The Cosmic Background Explorer (COBE) spacecraft was launched in November 1989 by NASA to survey the sky for primordial radiation left from the Big Bang explosion. The success of the mission requires an accurate determination of the spacecraft attitude. While the accuracy of the attitude obtained from the attitude sensors is adequate for two of the experiments, the higher accuracy required by the Diffuse Infrared Background Experiment (DIRBE) is obtained by using the DIRBE instrument as a special type of star sensor. Presented here is an overview of the attitude processing algorithms used at the Cosmology Data Analysis Center (CDAC) and the results obtained from the flight data.

Kumar, V. K.↗

Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Final Maps and Results

We present the final nine-year maps and basic results from the Wilkinson Microwave Anisotropy Probe (WMAP) mission. The full nine-year analysis of the time-ordered data provides updated characterizations and calibrations of the experiment. We also provide new nine-year full sky temperature maps that were processed to reduce the asymmetry of the effective beams. Temperature and polarization sky maps are examined to separate cosmic microwave background (CMB) anisotropy from foreground emission, and both types of signals are analyzed in detail.We provide new point source catalogs as well as new diffuse and point source foreground masks. An updated template-removal process is used for cosmological analysis; new foreground fits are performed, and new foreground reduced are presented.We nowimplement an optimal C(exp -1)1 weighting to compute the temperature angular power spectrum. The WMAP mission has resulted in a highly constrained Lambda-CDM cosmological model with precise and accurate parameters in agreement with a host of other cosmological measurements. When WMAP data are combined with finer scale CMB, baryon acoustic oscillation, and Hubble constant measurements, we find that big bang nucleosynthesis is well supported and there is no compelling evidence for a non-standard number of neutrino species (N(sub eff) = 3.84 +/- 0.40). The model fit also implies that the age of the universe is (sub 0) = 13.772 +/- 0.059 Gyr, and the fit Hubble constant is H(sub 0) = 69.32 +/- 0.80 km/s/ Mpc. Inflation is also supported: the fluctuations are adiabatic, with Gaussian random phases; the detection of a deviation of the scalar spectral index from unity, reported earlier by the WMAP team, now has high statistical significance (n(sub s) = 0.9608+/-0.0080); and the universe is close to flat/Euclidean (Omega = −0.0027+0.0039/−0.0038). Overall, the WMAP mission has resulted in a reduction of the cosmological parameter volume by a factor of 68,000 for the standard six-parameter Lambda-CDM model, based on CMB data alone. For a model including tensors, the allowed seven-parameter volume has been reduced by a factor 117,000. Other cosmological observations are in accord with the CMB predictions, and the combined data reduces the cosmological parameter volume even further.With no significant anomalies and an adequate goodness of fit, the inflationary flat Lambda-CDM model and its precise and accurate parameters rooted in WMAP data stands as the standard model of cosmology.

dark matter↗

Ocean Wave Studies with Applications to Ocean Modeling and Improvement of Satellite Altimeter Measurements

Combining analysis of satellite data (altimeter, scatterometer, high-resolution visible and infrared images, etc.) with mathematical modeling of non-linear wave processes, we investigate various ocean wave fields (on scales from capillary to planetary), their role in ocean dynamics and turbulent transport (of heat and biogeochemical quantities), and their effects on satellite altimeter measuring accuracy. In 1998 my attention was focused on long internal gravity waves (10 to 1000 km), known also as baroclinic inertia-gravity (BIG) waves. We found these waves to be a major factor of altimeter measurements "noise," resulting in a greater uncertainty [up to 10 cm in terms of sea surface height (SSH) amplitude] in the measured SSH signal than that caused by the sea state bias variations (up to 5 cm or so). This effect still remains largely overlooked by the satellite altimeter community. Our studies of BIG waves address not only their influence on altimeter measurements but also their role in global ocean dynamics and in transport and turbulent diffusion of biogeochemical quantities. In particular, in collaboration with Prof Peter Weichman, Caltech, we developed a theory of turbulent diffusion caused by wave motions of most general nature. Applied to the problem of horizontal turbulent diffusion in the ocean, the theory yielded the effective diffusion coefficient as a function of BIG wave parameters obtainable from satellite altimeter data. This effort, begun in 1997, has been successfully completed in 1998. We also developed a theory that relates spatial fluctuations of scalar fields (such as sea surface temperature, chlorophyll concentration, drifting ice concentration, etc.) to statistical characteristics of BIG waves obtainable from altimeter measurements. A manuscript is in the final stages of preparation. In order to verify the theoretical predictions and apply them to observations, we are now analyzing Sea-viewing Wide Field of view Sensor (SeaWiFS) and Field of view Sensor (SeaWiFS) and Advanced Very High-Resolution Radiometer (AVHRR) data on sea surface temperature (SST) and chlorophyll concentration jointly with TOPEX/POSEIDON data on SSH variations.

Glazman, Roman E.↗

Semantic Representation and Scale-Up of Integrated Air Traffic Management Data

Each day, the global air transportation industry generates a vast amount of heterogeneous data from air carriers, air traffic control providers, and secondary aviation entities handling baggage, ticketing, catering, fuel delivery, and other services. Generally, these data are stored in isolated data systems, separated from each other by significant political, regulatory, economic, and technological divides. These realities aside, integrating aviation data into a single, queryable, big data store could enable insights leading to major efficiency, safety, and cost advantages. In this paper, we describe an implemented system for combining heterogeneous air traffic management data using semantic integration techniques. The system transforms data from its original disparate source formats into a unified semantic representation within an ontology-based triple store. Our initial prototype stores only a small sliver of air traffic data covering one day of operations at a major airport. The paper also describes our analysis of difficulties ahead as we prepare to scale up data storage to accommodate successively larger quantities of data -- eventually covering all US commercial domestic flights over an extended multi-year timeframe. We review several approaches to mitigating scale-up related query performance concerns.

data management↗

Semantic Representation and Scale-Up of Integrated Air Traffic Management Data

Each day, the global air transportation industry generates a vast amount of heterogeneous data from air carriers, air traffic control providers, and secondary aviation entities handling baggage, ticketing, catering, fuel delivery, and other services. Generally, these data are stored in isolated data systems, separated from each other by significant political, regulatory, economic, and technological divides. These realities aside, integrating aviation data into a single, queryable, big data store could enable insights leading to major efficiency, safety, and cost advantages. In this paper, we describe an implemented system for combining heterogeneous air traffic management data using semantic integration techniques. The system transforms data from its original disparate source formats into a unified semantic representation within an ontology-based triple store. Our initial prototype stores only a small sliver of air traffic data covering one day of operations at a major airport. The paper also describes our analysis of difficulties ahead as we prepare to scale up data storage to accommodate successively larger quantities of data -- eventually covering all US commercial domestic flights over an extended multi-year timeframe. We review several approaches to mitigating scale-up related query performance concerns.

air traffic management↗

Evaluating the Impact of Data Placement to Spark and SciDB with an Earth Science Use Case

We investigate the impact of data placement for two Big Data technologies, Spark and SciDB, with a use case from Earth Science where data arrays are multidimensional. Simultaneously, this investigation provides an opportunity to evaluate the performance of the technologies involved. Two datastores, HDFS and Cassandra, are used with Spark for our comparison. It is found that Spark with Cassandra performs better than with HDFS, but SciDB performs better yet than Spark with either datastore. The investigation also underscores the value of having data aligned for the most common analysis scenarios in advance on a shared nothing architecture. Otherwise, repartitioning needs to be carried out on the fly, degrading overall performance.

Spark↗

ROSAT-IUE All Sky Survey (RIASS): First results on active galaxies

To optimize the activity of the RIASS collaboration was established between IUE and Rosat projects. Some of the results obtained are given and the importance of such coordinated observations for the Spectral Energy Distribution (SED) definition of Active Galactic Nuclei is illustrated. All the participants in the AGN part of the RIASS program are listed. The RIASS observations allow for a comprehensive study of the overall spectral energy distribution of AGN's. For the first time, data from different instruments can be used to determine the SED, since the observations were simultaneous. A preliminary analysis shows that the energies radiated in the UV and the soft X-rays domains are closely related. The spectra of individual objects as well as the correlation found between the intensity of CIV lambda 1550 emission line and the soft X-rays luminosity, suggest that the excess detected in this band is the high energy tail of the big UV bump.

Wamsteker, W.↗

Big-data Efficient and Automated Science Transfer (BEAST): An Open-Source Software Architecture for Arc Jet Data Management, Modeling, and Automation

Big-data Efficient and Automated Science Transfer (BEAST) was conceived to address the existing ground testing data management of the NASA Ames arc jet facilities (e.g., manually entered Excel files and USB drive data transfers). These data management practices were seen as a choke point for future thermal protection system (TPS) development as they limit statistical tracking, resolution of diagnostics, coordination between video/time series, data throughput, and data processing speed/efficiency. Consequently, BEAST was developed to provide a new data infrastructure with streamlined data collection, processing, transfer, and analysis. This new framework also seeks to implement the FAIR principles of data stewardship: Findable, Accessible, Interoperable, and Reusable. The BEAST framework is based on a combination of the Python Django web framework and the Python data stack to provide a monolithic, open-source platform for data management, automation, and machine learning. This architecture was chosen for maintainability and scalability for a small, in-house development team. This paper will describe the application framework, deployment, and discuss the benefits and future plans for the system.

Data management↗