SEARCH · Search NASA

Results for “Big data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Facilitating better and faster simulations of aerosol-cloud interactions in Earth system models

Focal Area(s): 1. Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising a hierarchy of models. 2. Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI. Science Challenge: One major challenge that Earth system models (ESMs) face in providing credible prediction of the Earth system and its water cycle characteristics (e.g., mean state, variability, and extreme events) is to accurately simulate aerosol-cloud interactions (ACI). The physical, chemical, and dynamical processes affecting ACI are extremely complex and they range from nanoscale to planetary scale. In each model development cycle, scientists spend significant efforts investigating model deficiencies and uncertainties associated with aerosols (e.g., emissions, chemical processes, aerosol microphysics, and transport) and clouds (e.g., macrophysics, microphysics, turbulence, and large-scale circulation) in order to develop improved treatments. However, despite decades of active research, ACI is still a major source of uncertainty in climate projections, even though great progress has been made. Specific scientific challenges include: (i) Parameterizations are developed based on limited data; (ii) The complexity of a parameterization required for accurate predictions is not understood; (iii) Incomplete and unknown physics leads to errors in the fully coupled Earth system; and (iv) Complex physics is computationally too expensive to employ in ESMs.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2008

Proceedings of the 39th Lunar and Planetary Science Conference

Sessions with oral presentations include: A SPECIAL SESSION: MESSENGER at Mercury, Mars: Pingos, Polygons, and Other Puzzles, Solar Wind and Genesis: Measurements and Interpretation, Asteroids, Comets, and Small Bodies, Mars: Ice On the Ground and In the Ground, SPECIAL SESSION: Results from Kaguya (SELENE) Mission to the Moon, Outer Planet Satellites: Not Titan, Not Enceladus, SPECIAL SESSION: Lunar Science: Past, Present, and Future, Mars: North Pole, South Pole - Structure and Evolution, Refractory Inclusions, Impact Events: Modeling, Experiments, and Observations, Mars Sedimentary Processes from Victoria Crater to the Columbia Hills, Formation and Alteration of Carbonaceous Chondrites, New Achondrite GRA 06128/GRA 06129 - Origins Unknown, The Science Behind Lunar Missions, Mars Volcanics and Tectonics, From Dust to Planets (Planetary Formation and Planetesimals):When, Where, and Kaboom! Astrobiology: Biosignatures, Impacts, Habitability, Excavating a Comet, Mars Interior Dynamics to Exterior Impacts, Achondrites, Lunar Remote Sensing, Mars Aeolian Processes and Gully Formation Mechanisms, Solar Nebula Shake and Bake: Mixing and Isotopes, Lunar Geophysics, Meteorites from Mars: Shergottite and Nakhlite Invasion, Mars Fluvial Geomorphology, Chondrules and Chondrule Formation, Lunar Samples: Chronology, Geochemistry, and Petrology, Enceladus, Venus: Resurfacing and Topography (with Pancakes!), Overview of the Lunar Reconnaissance Orbiter Mission, Mars Sulfates, Phyllosilicates, and Their Aqueous Sources, Ordinary and Enstatite Chondrites, Impact Calibration and Effects, Comparative Planetology, Analogs: Environments and Materials, Mars: The Orbital View of Sediments and Aqueous Mineralogy, Planetary Differentiation, Titan, Presolar Grains: Still More Isotopes Out of This World, Poster sessions include: Education and Public Outreach Programs, Early Solar System and Planet Formation, Solar Wind and Genesis, Asteroids, Comets, and Small Bodies, Carbonaceous Chondrites, Chondrules and Chondrule Formation, Chondrites, Refractory Inclusions, Organics in Chondrites, Meteorites: Techniques, Experiments, and Physical Properties, MESSENGER and Mercury, Lunar Science Present: Kaguya (SELENE) Results, Lunar Remote Sensing: Basins and Mapping of Geology and Geochemistry, Lunar Science: Dust and Ice, Lunar Science: Missions and Planning, Mars: Layered, Icy, and Polygonal, Mars Stratigraphy and Sedimentology, Mars (Peri)Glacial, Mars Polar (and Vast), Mars, You are Here: Landing Sites and Imagery, Mars Volcanics and Magmas, Mars Atmosphere, Impact Events: Modeling, Experiments, and Observation, Ice is Nice: Mostly Outer Planet Satellites, Galilean Satellites, The Big Giant Planets, Astrobiology, In Situ Instrumentation, Rocket Scientist's Toolbox: Mission Science and Operations, Spacecraft Missions, Presolar Grains, Micrometeorites, Condensation-Evaporation: Stardust Ties, Comet Dust, Comparative Planetology, Planetary Differentiation, Lunar Meteorites, Nonchondritic Meteorites, Martian Meteorites, Apollo Samples and Lunar Interior, Lunar Geophysics, Lunar Science: Geophysics, Surface Science, and Extralunar Components, Mars, Remotely, Mars Orbital Data - Methods and Interpretation, Mars Tectonics and Dynamics, Mars Craters: Tiny to Humongous, Mars Sedimentary Mineralogy, Martian Gullies and Slope Streaks, Mars Fluvial Geomorphology, Mars Aeolian Processes, Mars Data and Mission,s Venus Mapping, Modeling, and Data Analysis, Titan, Icy Dwarf Satellites, Rocket Scientist's Toolbox: In Situ Analysis, Remote Sensing Approaches, Advances, and Applications, Analogs: Sulfates - Earth and Lab to Mars, Analogs: Remote Sensing and Spectroscopy, Analogs: Methods and Instruments, Analogs: Weird Places!. Print Only Early Solar System, Solar Wind, IDPs, Presolar/Solar Grains, Stardust, Comets, Asteroids, and Phobos, Venus, Mercury, Moon, Meteorites, Mars, Astrobiology, Impacts, Outer Planets, Satellites, and Rings, Support for Mission Operations, Analog Education and Public Outreach.

Source record↗

DOE OSTI2019

Condition Monitoring of Wind Turbine Planetary Gearboxes Under Different Operating Conditions

Digitally enhanced services for wind power could reduce Operations and Maintenance (O&M) costs as well as the Levelised Cost Of Energy (LCOE). Therefore, there is a continuous need for advanced monitoring techniques which can exploit the opportunities of Internet of Things (IoT) and Big Data Analytics, revolutionizing the future of the energy sector. The heart of wind turbines is a rather complex epicyclic gearbox. Among others, extremely critical gearbox components which are often responsible for machinery stops are the rolling element bearings. The vibration signatures of bearings are rather weak compared to other components, such as gears, and as a result an extended number of signal processing techniques and tools have been proposed during the last decades, focusing towards accurate, early, and on time bearing fault detection with limited false alarms and missed detections. Envelope Analysis is one of the most important methodologies, where an envelope of the vibration signal is estimated usually after filtering around a frequency band excited by impacts due to the bearing faults. Different tools, such as Kurtogram, have been proposed in order to accurately select the optimum filter parameters (center frequency and bandwidth). Cyclic Spectral Correlation and Cyclic Spectral Coherence, based on Cyclostationary Analysis, have been proved as very powerful tools for condition monitoring. The monitoring techniques seem to have reached a mature level in case a machinery operates under steady speed and load. On the other hand, in case the operating conditions change, it is still unclear whether the change of the monitoring indicators is due to the change of the health of the machinery or due to the change of the operating parameters. Recently, the authors have proposed a new tool called IESFOgram, which is based on Cyclic Spectral Coherence and can automatically select the filtering band. Furthermore, the Cyclic Spectral Coherence is integrated along the selected frequency band leading to an Improved Envelope Spectrum. In this paper, the performance of the tool is evaluated and further extended on cases operating under different speeds and different loads. The effectiveness of the methodology is tested and validated on the National Renewable Energy Laboratory (NREL) wind turbine gearbox vibration condition monitoring benchmarking data set which includes various faults with different levels of diagnostic complexity as well as various speed and load operating conditions.

17 WIND ENERGY↗

DOE OSTI2025

Release of ENDF81SaB: ENDF/B-VIII.1-Based ACE Data Files for Thermal Scattering

On August 30, 2024, the National Nuclear Data Center (NNDC) released the ENDF/B-VIII.1 nuclear data library. The library was released in the standard Evaluated Nuclear Data File (ENDF) format. These files can be accessed on the NNDC's website (www.nndc.bnl.gov). The files provided in the thermal neutron scattering sublibrary were processed into A Compact ENDF (ACE)-formatted files, verified, and validated by the XCP-5 Nuclear Data Team, resulting in the ENDF81SaB application library. This report details the processing of these files and the quality assurance approach taken. This is not intended to be a full validation effort; rather, this library is intended to simply reproduce the released files for further validation testing by the community. The validation basis and details of the evaluations are documented in the forthcoming ``Big Paper''.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRSDate not supplied

Big-data Efficient and Automated Science Transfer (BEAST): An Open-Source Software Architecture for Arc Jet Data Management, Modeling, and Automation

Big-data Efficient and Automated Science Transfer (BEAST) was conceived to address the existing ground testing data management of the NASA Ames arc jet facilities (e.g., manually entered Excel files and USB drive data transfers). These data management practices were seen as a choke point for future thermal protection system (TPS) development as they limit statistical tracking, resolution of diagnostics, coordination between video/time series, data throughput, and data processing speed/efficiency. Consequently, BEAST was developed to provide a new data infrastructure with streamlined data collection, processing, transfer, and analysis. This new framework also seeks to implement the FAIR principles of data stewardship: Findable, Accessible, Interoperable, and Reusable. The BEAST framework is based on a combination of the Python Django web framework and the Python data stack to provide a monolithic, open-source platform for data management, automation, and machine learning. This architecture was chosen for maintainability and scalability for a small, in-house development team. This paper will describe the application framework, deployment, and discuss the benefits and future plans for the system.

Data management↗

NASA NTRSDate not supplied

Big-data Efficient Automated Science Transfer (BEAST): an open-source software architecture for arc jet data management, modeling, and automation

Data management↗

DOE OSTI2020

Experimentally Constrained (\(n,\gamma \)) Reaction Rates Relevant to r- and i-Process Nucleosynthesis

The element distribution that we observe in the Universe today, tells a fascinating story of nucleosynthesis events that have taken place throughout the 13.7-billion-years-long history starting with the Big Bang. It is known for a long time that radiative neutron-capture reactions play a major role in synthesizing elements heavier than iron. However, many questions remain when it comes to our understanding of neutron-capture processes in extreme stellar environments. In particular, the intermediate and rapid neutron-capture processes are very challenging to describe, as there exist little or no data on the much-needed neutron-capture rates. In this work we discuss possibilities to obtain indirect, experimental constrains on these rates by means of the Oslo and the β-Oslo methods.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS2009

On Organization of Information: Approach and Early Work

In this report we describe an approach for organizing information for presentation and display. "e approach stems from the observation that there is a stepwise progression in the way signals (from the environment and the system under consideration) are extracted and transformed into data, and then analyzed and abstracted to form representations (e.g., indications and icons) on the user interface. In physical environments such as aerospace and process control, many system components and their corresponding data and information are interrelated (e.g., an increase in a chamber s temperature results in an increase in its pressure). "ese interrelationships, when presented clearly, allow users to understand linkages among system components and how they may affect one another. Organization of these interrelationships by means of an orderly structure provides for the so-called "big picture" that pilots, astronauts, and operators strive for.

Degani, Asaf↗

NASA NTRS2018

Introduction to Big Earth Data Applications

Climate and weather modeling generate enormous volumes that make iterative analysis challenging, spurring the development of new ways to work with the data. A theme going across applications is the need to identify and highlight "interesting" data for the scientist to focus on. Operational applications often scale up from small, local studies to larger spatial scales with more analysis targets.

parallel processing (computers)↗

NASA NTRS1994

Interpretation of the COBE FIRAS CMBR spectrum

The cosmic microwave background radiation (CMBR) spectrum measured by the Far-Infrared Absolute Spectrophotometer (FIRAS) instrument on NASA's Cosmic Background Explorer (COBE) is indistinguishable from a blackbody, implying stringent limits on energy release in the early universe later than the time t = 1 yr after the big bang. We compare the FIRAS data to previous precise measurements of the cosmic microwave background spectrum and find a reasonable agreement. We discuss the implications of the absolute value of y is less than 2.5 x 10(exp -5) and the absolute value of mu is less than 3.3 x 10(exp -4) 95% confidence limits found by Mather et al. (1994) on many processes occurring after t = 1 yr, such as explosive structure formation, reionization, and dissipation of small-scale density perturbations. We place limits on models with dust plus Population III stars, or evolving populations of IR galaxies, by directly comparing the Mather et al. spectrum to the model predictions.

Wright, E. L.↗

DOE OSTI2022

Automated System-wide Event Detection and Classification Using Machine Learning on Synchrophasor Data

As the number of phasor measurement units (PMUs) deployed in a power system increases, and their data volume streamed to the control canter intensifies, operators are facing challenges related to the analysis of such data, which need to be observed and responded to as the measurements are displayed in the Control Room. Humans are generally unable to process such large amount of data efficiently and rapidly. There is an apparent need for automated ways to analyze the data, extract actionable information about occurrence of specific events, and characterize the events quickly and cost effectively. This paper discusses the use of machine learning (ML) to facilitate such tasks by providing automated, highly computationally efficient, and cost-effective ways of extracting actionable information from synchrophasor big data in real-time. We developed Big Data Smart (BDSmart) ML-based prototype tool for the Control Room use that automatically analyses data properties from synchrophasor system measurements taken across the three grid Interconnections in the USA (Western, Eastern and ERCOT). The data collected from several hundreds of PMUs located across the Interconnections over a period of two years have been made available for our extensive study. As a result, we were able to identify a number of big data properties that influence how ML methodology is applied to select, develop, train and test the data models that can eventually be used for the tool implementation. The resulting set of candidate algorithms spans unsupervised, supervised, semi-supervised and transfer-learning approaches. Many ML techniques, such as decision trees, multinomial logistic regression, feed-forward neural networks, K-nearest neighbor, multiclass support vector machine, and single and multi-channel convolutional neural networks, are implemented, and their performance is examined. We offer the results from testing the data models. The novelty of our study is in the approaches for bad data detection and mitigation, selection of a simplified feature for event detection, and data label improvements. As a result, we came up with a list of recommendations for the utilities on how to improve the PMU recording practices to cater to the future ML applications aimed at automating the analysis of synchrophasor data.

Synchrophasors, Machine Learning, System-wide Even↗

DOE OSTI2026

Vanderbilt CMS Heavy-Ion Tier-2 Facility (Final Report)

The CMS experiment at the LHC at CERN in Geneva, Switzerland spends a portion of its running time colliding heavy ions. These heavy ion collisions are a key probe of a state of matter known as a Quark Gluon Plasma, which is a state of matter found in the very early universe 10s of microseconds after the big bang. These collision data are recorded by the CMS experiment and then undergo several stages of refinement to extract physics properties of the collisions from the raw data recorded by the various detector subsystems in CMS. In addition, copies of these datasets are stored on tape archival storage for data preservation. This award funds the deployment, maintenance, and operation of a computing facility at Vanderbilt University which processes, stores, and analyzes these collision data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Introduction to the special issue on smart transportation

Transportation is getting smarter and smarter, with the prominence of connected automated vehicle technologies in the global auto industry’s near-term growth strategies, of big data analytics and unprecedented access to sensing data of mobility, and of integration of this analytics into the optimization of mobility and transport. Further, these developments are setting off a wave of smart transportation innovations, which are featured by new methods and applications driven by various forms of sensor data such as GPS, CAN bus, LIDA, images, etc. At the same time, complexities surrounding the use, conflation, and processing of disparate data in near real-time is of essence for the design and development of futuristic smart transportation.

33 ADVANCED PROPULSION SYSTEMS↗

NASA NTRS1983

Geologic exploration: The contribution of LANDSAT-4 thematic mapper data

The major advantages of the TM data over that of MSS systems are increased spatial resolution and a greater number of narrow, strategically placed spectral bands. The 30 meter pixel size permits finer definition of ground features and improves reliability of the photointerpretation of geologic structure. The value of the spatial data increases relative to the value of the spectral data as soil and vegetation cover increase. In arid areas with good exposure, it is possible with careful digital processing and some inventive color compositing to produce enough spectral differentiation of rock types and thereby produce facsimiles of standard geologic maps with a minimum of field work or reference to existing maps. Hue-saturation value images are compared with geological maps of Death Valley, California, the Big Horn/Wind River Basin of Wyoming, the area around Cement, Oklahoma, and Detroit. False color composites of the Ontario region are also examined.

Everett, J. R.↗

DOE OSTI2019

Materials informatics: From the atomic-level to the continuum

We report that in recent years materials informatics, which is the application of data science to problems in materials science and engineering, has emerged as a powerful tool for materials discovery and design. This relatively new field is already having a significant impact on the interpretation of data for a variety of materials systems, including those used in thermoelectrics, ferroelectrics, battery anodes and cathodes, hydrogen storage materials, polymer dielectrics, etc. Its practitioners employ the methods of multivariate statistics and machine learning in conjunction with standard computational tools (e.g., density-functional theory) to, for example, visualize and dimensionally reduce large data sets, identify patterns in hyperspectral data, parse microstructural images of polycrystals, characterize vortex structures in ferroelectrics, design batteries and, in general, establish correlations to extract important physics and infer structure-property-processing relationships. In this Overview, we critically examine the role of informatics in several important materials subfields, highlighting significant contributions to date and identifying known shortcomings. We specifically focus attention on the difference between the correlative approach of classical data science and the causative approach of physical sciences. From this perspective, we also outline some potential opportunities and challenges for informatics in the materials realm in this era of big data.

36 MATERIALS SCIENCE↗

NASA NTRS2003

Combining Multiple Gyroscope Outputs for Increased Accuracy

A proposed method of processing the outputs of multiple gyroscopes to increase the accuracy of rate (that is, angular-velocity) readings has been developed theoretically and demonstrated by computer simulation. Although the method is applicable, in principle, to any gyroscopes, it is intended especially for application to gyroscopes that are parts of microelectromechanical systems (MEMS). The method is based on the concept that the collective performance of multiple, relatively inexpensive, nominally identical devices can be better than that of one of the devices considered by itself. The method would make it possible to synthesize the readings of a single, more accurate gyroscope (a virtual gyroscope) from the outputs of a large number of microscopic gyroscopes fabricated together on a single MEMS chip. The big advantage would be that the combination of the MEMS gyroscope array and the processing circuitry needed to implement the method would be smaller, lighter in weight, and less power-hungry, relative to a conventional gyroscope of equal accuracy. The method (see figure) is one of combining and filtering the digitized outputs of multiple gyroscopes to obtain minimum-variance estimates of rate. In the combining-and-filtering operations, measurement data from the gyroscopes would be weighted and smoothed with respect to each other according to the gain matrix of a minimum- variance filter. According to Kalman-filter theory, the gain matrix of the minimum-variance filter is uniquely specified by the filter covariance, which propagates according to a matrix Riccati equation. The present method incorporates an exact analytical solution of this equation.

Bayard, David S.↗

NASA NTRS2017

Planetesimals Born Big by Clustering Instability?

Roughly 100km diameter primitive bodies (today's asteroids and TNOs; [1]) are thought to be the end product of so-called "primary accretion". They dominated the initial mass function of planetesimals, and precipitated the onset of a subsequent stage, characterized by runaway gravitational effects, which proceeded onwards to planetary mass objects, some of which accreted massive gas envelopes. Asteroids are the parents of primitive meteorites; meteorite data suggest that asteroids initially formed directly from freelyfloating nebula particles in the mm-size range. Unfortunately, the process by which these primary 100km diameter planetesimals formed remains problematic. We review the most diagnostic primitive parent body observations, highlight critical aspects of the nebula context, and describe the issues facing various primary accretion models. We suggest a path forward that combines current scenarios of "turbulent concentration" (TC) and "streaming instabilities" (SI) into a triggered formation process we call clustering instability (CI). Under expected conditions of nebula turbulence, the success of these processes at forming terrestrial region (mostly silicate) planetesimals requires growth by sticking into aggregates in the several cm size range, at least, which is orders of magnitude more massive than allowed by current growth-by-sticking models using current experimental sticking parameters [2-4]. The situation is not as dire in the ice-rich outer solar system; however, growth outside of the snowline has important effects on growth inside of it [4] and at least one aspect of outer solar system planetesimals (high binary fraction) supports some kind of clustering instability.

Cuzzi, Jeffrey N.↗

NASA NTRS2017

Planetesimals Born Big by Clustering Instability?

Asteroids↗