Search NASA⌕ Search

SEARCH · Search NASA

Results for “Technology data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Large-scale seismic waveform quality metric calculation using Hadoop

Here in this work we investigated the suitability of Hadoop MapReduce and Apache Spark for large-scale computation of seismic waveform quality metrics by comparing their performance with that of a traditional distributed implementation. The Incorporated Research Institutions for Seismology (IRIS) Data Management Center (DMC) provided 43 terabytes of broadband waveform data of which 5.1 TB of data were processed with the traditional architecture, and the full 43 TB were processed using MapReduce and Spark. Maximum performance of ~0.56 terabytes per hour was achieved using all 5 nodes of the traditional implementation. We noted that I/O dominated processing, and that I/O performance was deteriorating with the addition of the 5th node. Data collected from this experiment provided the baseline against which the Hadoop results were compared. Next, we processed the full 43 TB dataset using both MapReduce and Apache Spark on our 18-node Hadoop cluster. We conducted these experiments multiple times with various subsets of the data so that we could build models to predict performance as a function of dataset size. We found that both MapReduce and Spark significantly outperformed the traditional reference implementation. At a dataset size of 5.1 terabytes, both Spark and MapReduce were about 15 times faster than the reference implementation. Furthermore, our performance models predict that for a dataset of 350 terabytes, Spark running on a 100-node cluster would be about 265 times faster than the reference implementation. We do not expect that the reference implementation deployed on a 100-node cluster would perform significantly better than on the 5-node cluster because the I/O performance cannot be made to scale. Finally, we note that although Big Data technologies clearly provide a way to process seismic waveform datasets in a high-performance and scalable manner, the technology is still rapidly changing, requires a high degree of investment in personnel, and will likely require significant changes in other parts of our infrastructure. Nevertheless, we anticipate that as the technology matures and third-party tool vendors make it easier to manage and operate clusters, Hadoop (or a successor) will play a large role in our seismic data processing.

58 GEOSCIENCES↗

COFFEA - Columnar Object Framework For Effective Analysis [Slides]

The COFFEA Framework provides a new approach to HEP analysis, via columnar operations, that improves time-to-insight, scalability, portability, and reproducibility of analysis. It is implemented with the Python programming language and commodity big data technologies such as Apache Spark and NoSQL databases. To achieve this suite of improvements across many use cases, COFFEA takes a factorized approach, separating the analysis implementation and data delivery scheme. All analysis operations are implemented using the NumPy or awkward-array packages which are wrapped to yield user code whose purpose is quickly intuited. Various data delivery schemes are wrapped into a common front-end which accepts user inputs and code, and returns user defined outputs. We will present published results from analysis of CMS data using the COFFEA framework along with a discussion of metrics and the user experience of arriving at those results with columnar analysis.

97 MATHEMATICS AND COMPUTING↗

Air Pollutant Emissions Projections for the Cement and Steel Industry in China and the Impact of Emissions Control Technologies

China’s cement and steel industry accounts for approximately half of the world’s total cement and steel production. These two industries are two of the most energy-intensive and highest carbon dioxide (CO 2 )-emitting industries and two of the key industrial contributors to air pollution in China. For example, the cement industry is the largest source of particulate matter (PM) emissions in China, accounting for 40 percent of its industrial PM emissions and 27 percent of its total national PM emissions. The Chinese steel industry contributed to approximately 20 percent of sulfur dioxide (SO 2) emissions and 27 percent of PM emissions for all key manufacturing industries in China in 2013. In this study, we analyzed and projected the total PM and SO 2 emissions from the Chinese cement and steel industry from 2010–2050 under three different scenarios: a Base Case scenario, an Advanced scenario, and an Advanced EOP (end-of-pipe) scenario. We used bottom-up emissions control technologies data and assumptions to project the emissions. In addition, we conducted an economic analysis to estimate the cost for PM emissions reductions in the Chinese cement industry using EOP control technologies, energy efficiency measures, and product change measures. The results of the emissions projection showed that there is not a substantial difference in PM emissions between the Base Case and Advanced scenarios, for both the cement and steel industries. This is mainly because PM emissions in the cement industry caused mainly by production process and not the fuel use. Since our forecast for the cement production in the Base Case and Advanced scenarios are not too different from each other, this results in only a slight difference in PM emissions forecast for these two scenarios. Also, we assumed a similar share and penetration rate of control technologies from 2010 up to 2050 for these two scenarios for the cement and steel industry. However, the Advanced EOP scenario showed significantly lower PM emissions for the cement industry, reaching to 1.7 million tons of PM in 2050, which is less than half of that in the other two scenarios. The Advanced EOP scenario also has the lowest SO 2 emissions for the cement industry in China, reaching to 212,000 tons of SO 2 in 2050, which is equal to 40 percent of the SO 2 emissions in the Advanced scenario and 30 percent of the emissions in the Base Case scenario. The SO 2 emission is mainly caused by fuel (coal) burning in cement kiln or steel processes. For the steel industry, the SO 2 emissions of the Advanced EOP scenario are significantly lower than the other scenarios, with emissions declining to 323,000 tons in 2050, which is equal to 21 percent and 17 percent of the emissions of Advanced and Base Case scenarios in 2050, respectively. Results of the economic analysis show that for the Chinese cement industry, end-of-pipe PM control technologies have the lowest abatement cost per ton of PM reduced, followed by product change measures and energy efficiency measures, respectively. In summary, in order to meet Chinese national and regional air quality standards, best practice end-of-pipe emissions control technologies must be installed in both cement and steel industry and it must be supplemented by implementation of energy efficiency technologies and reduction of cement and steel production through structural change in industry.

54 ENVIRONMENTAL SCIENCES↗

A Greenhouse-Gas Information System: Monitoring and Validating Emissions Reporting and Mitigation

Current GHG-mitigating regimes, whether internationally agreed or self-imposed, rely on the aggregation of self-reported data, with limited checks for consistency and accuracy, for monitoring. As nations commit to more stringent GHG emissions-mitigation actions and as economic rewards or penalties are attached to emission levels, self-reported data will require independent confirmation that they are accurate and reliable, if they are to provide the basis for critical choices and actions that may be required. Supporting emissions-mitigation efforts and agreements, as well as monitoring energy- and fossil-fuel intensive national and global activities would be best achieved by a process of: (1) monitoring of emissions and emission-mitigation actions, based, in part, on, (2) (self-) reporting of pertinent bottom-up inventory data, (3) verification that reported data derive from and are consistent with agreed-upon processes and procedures, and (4) validation that reported emissions and emissions-mitigation action data are correct, based on independent measurements (top-down) derived from a suite of sensors in space, air, land, and, possibly, sea, used to deduce and attribute anthropogenic emissions. These data would be assessed and used to deduce and attribute measured GHG concentrations to anthropogenic emissions, attributed geographically and, to the extent possible, by economic sector. The validation element is needed to provide independent assurance that emissions are in accord with reported values, and should be considered as an important addition to the accepted MRV process, leading to a MRV&V process. This study and report focus on attributes of a greenhouse-gas information system (GHGIS) needed to support MRV&V needs. These needs set the function of such a system apart from scientific/research monitoring of GHGs and carbon-cycle systems, and include (not exclusively): the need for a GHGIS that is operational, as required for decision-support; the need for a system that meets specifications derived from imposed requirements; the need for rigorous calibration, verification, and validation (CV&V) standards, processes, and records for all measurement and modeling/data-inversion data; the need to develop and adopt an uncertainty-quantification (UQ) regimen for all measurement and modeling data; and the requirement that GHGIS products can be subjected to third-party questioning and scientific scrutiny. This report examines and assesses presently available capabilities that could contribute to a future GHGIS. These capabilities include sensors and measurement technologies; data analysis and data uncertainty quantification (UQ) practices and methods; and model-based data-inversion practices, methods, and their associated UQ. The report further examines the need for traceable calibration, verification, and validation processes and attached metadata; differences between present science-/research-oriented needs and those that would be required for an operational GHGIS; the development, operation, and maintenance of a GHGIS missions-operations center (GMOC); and the complex systems engineering and integration that would be required to develop, operate, and evolve a future GHGIS. Present monitoring systems would be heavily relied on in any GHGIS implementation at the outset and would likely continue to provide valuable future contributions to GHGIS. However, present monitoring systems were developed to serve science/research purposes. This study concludes that no component or capability presently available is at the level of technological maturity and readiness required for implementation in an operational GHGIS today. However, purpose-designed and -built components could be developed and implemented in support of a future GHGIS. The study concludes that it is possible to develop and provide a capability-driven prototype GHGIS, as part of a Phase-1 effort, within three years from project-funding start, that would make use of and integrate existing sensing and system capabilities. As part of a Phase-2 effort, a requirements-driven, operational GHGIS could be developed, within ten years from project funding start. That schedule is driven by the development and long lead-times for some system components. The two efforts would be focused on different deliverables but could commence concurrently, to save time, if that was deemed desirable. We note that, developing and supporting an operational GHGIS will require a new approach and management, sustained funding and other support, as well as technical advances and development of purpose-built components that meet the requisite specifications. A functioning GHGIS will provide the basis for reasoned choices on how best to respond to rising GHG levels, especially when proposed U.S. actions are compared with or conditioned on the actions of other nations.

54 ENVIRONMENTAL SCIENCES↗

Data Diodes in Support of Trustworthy Cyber Infrastructure

Interconnections between process control networks and en- terprise networks has resulted in the proliferation of stan- dard communication protocols in industrial control systems which exposes instrumentation, control systems, and the critical infrastructure components they operate to a variety of cyber attacks. Various standards and technologies have been proposed to protect industrial control systems against cyber attacks and to provide them with confidentiality, in- tegrity, and availability. Among these technologies, data diodes provide protection of critical systems by the means of physically enforcing traffic direction on the network. In order to deploy data diodes effectively, it is imperative to un- derstand the protection they provide, the protection they do not provide, their limitations, and their place in the larger security infrastructure. In this work, we briefly review the security challenges in an industrial control system, study data diodes, their functionalities and limitations, and pro- pose a scheme for their effective deployment in trusted pro- cess control networks (TPCNs.)

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

A Greenhouse-Gas Information System: Monitoring and Validating Emissions Reporting and Mitigation

This study and report focus on attributes of a greenhouse-gas information system (GHGIS) needed to support MRV&V needs. These needs set the function of such a system apart from scientific/research monitoring of GHGs and carbon-cycle systems, and include (not exclusively): the need for a GHGIS that is operational, as required for decision-support; the need for a system that meets specifications derived from imposed requirements; the need for rigorous calibration, verification, and validation (CV&V) standards, processes, and records for all measurement and modeling/data-inversion data; the need to develop and adopt an uncertainty-quantification (UQ) regimen for all measurement and modeling data; and the requirement that GHGIS products can be subjected to third-party questioning and scientific scrutiny. This report examines and assesses presently available capabilities that could contribute to a future GHGIS. These capabilities include sensors and measurement technologies; data analysis and data uncertainty quantification (UQ) practices and methods; and model-based data-inversion practices, methods, and their associated UQ. The report further examines the need for traceable calibration, verification, and validation processes and attached metadata; differences between present science-/research-oriented needs and those that would be required for an operational GHGIS; the development, operation, and maintenance of a GHGIS missions-operations center (GMOC); and the complex systems engineering and integration that would be required to develop, operate, and evolve a future GHGIS.

54 ENVIRONMENTAL SCIENCES↗

Autonomous Correction of Sensor Data Applied to Building Technologies Using Filtering Methods

Sensor data validity is extremely important in a number of applications, particularly building technologies where collected data are used to determine performance. An example of this is Oak Ridge National Laboratory s ZEBRAlliance research project, which consists of four single-family homes located in Oak Ridge, TN. The homes are outfitted with a total of 1,218 sensors to determine the performance of a variety of different technologies integrated within each home. Issues arise with such a large amount of sensors, such as missing or corrupt data. This paper aims to eliminate these problems using: (1) Kalman filtering and (2) linear prediction filtering techniques. Five types of data are the focus of this paper: (1) temperature; (2) humidity; (3) energy consumption; (4) pressure; and (5) airflow. Simulations show the Kalman filtering method performed best in predicting temperature, humidity, pressure, and airflow data, while the linear prediction filtering method performed best with energy consumption data.

Castello, Charles C↗

Solar Technology Test, Evaluation, and Data Collection: Cooperative Research and Development Final Report, CRADA Number CRD-08-279

Under this Agreement, NREL will work with Abengoa Solar Inc. on the testing, evaluation, and collection of data related to Abengoa Solar Inc. solar technologies and systems. This work includes, but is not limited to, testing and evaluation of solar component and system technologies, data collection and monitoring, performance evaluation, reliability testing, thermal energy storage integration, solar resource measurement and forecasting, grid impact testing, and analysis. This work will be conducted at NREL, SolarTAC (Aurora), and other field test locations.

14 SOLAR ENERGY↗

ETDEWEB versus the World-Wide-Web: a specific database/web comparison

A study was performed comparing user search results from the specialized scientific database on energy-related information, ETDEWEB, with search results from the internet search engines Google and Google Scholar. The primary objective of the study was to determine if ETDEWEB (the Energy Technology Data Exchange – World Energy Base) continues to bring the user search results that are not being found by Google and Google Scholar. As a multilateral information exchange initiative, ETDE’s member countries and partners contribute cost- and task-sharing resources to build the largest database of energy-related information in the world. As of early 2010, the ETDEWEB database has 4.3 million citations to world-wide energy literature. One of ETDEWEB’s strengths is its focused scientific content and direct access to full text for its grey literature (over 300,000 documents in PDF available for viewing from the ETDE site and over a million additional links to where the documents can be found at research organizations and major publishers globally). Google and Google Scholar are well-known for the wide breadth of the information they search, with Google bringing in news, factual and opinion-related information, and Google Scholar also emphasizing scientific content across many disciplines. The analysis compared the results of 15 energy-related queries performed on all three systems using identical words/phrases. A variety of subjects was chosen, although the topics were mostly in renewable energy areas due to broad international interest. Over 40,000 search result records from the three sources were evaluated. The study concluded that ETDEWEB is a significant resource to energy experts for discovering relevant energy information. For the 15 topics in this study, ETDEWEB was shown to bring the user unique results not shown by Google or Google Scholar 86.7% of the time. Much was learned from the study beyond just metric comparisons. Observations about the strengths of each system and factors impacting the search results are also shared along with background information and summary tables of the results. If a user knows a very specific title of a document, all three systems are helpful in finding the user a source for the document. But if the user is looking to discover relevant documents on a specific topic, each of the three systems will bring back a considerable volume of data, but quite different in focus. Google is certainly a highly-used and valuable tool to find significant ‘non-specialist’ information, and Google Scholar does help the user focus on scientific disciplines. But if a user’s interest is scientific and energy-specific, ETDEWEB continues to hold a strong position in the energy research, technology and development (RTD) information field and adds considerable value in knowledge discovery. (auth)

99 GENERAL AND MISCELLANEOUS↗

Statistical Inference for Big Data Problems in Molecular Biophysics

We highlight the role of statistical inference techniques in providing biological insights from analyzing long time-scale molecular simulation data. Technologi- cal and algorithmic improvements in computation have brought molecular simu- lations to the forefront of techniques applied to investigating the basis of living systems. While these longer simulations, increasingly complex reaching petabyte scales presently, promise a detailed view into microscopic behavior, teasing out the important information has now become a true challenge on its own. Mining this data for important patterns is critical to automating therapeutic intervention discovery, improving protein design, and fundamentally understanding the mech- anistic basis of cellular homeostasis.

Ramanathan, Arvind↗

Latest Results from DIII-D and Their Implications for Future Devices

The DIII-D Tokamak has become one of the major sources of physics and technology data for the design of future large machines such as ITER and CIT. In large part this is because of its extremely flexible design and the ability to run tests or add new diagnostic devices with a minimum of down-time and expense. Fundamental plasma physics studies are still the major focus of our experimental program, but increasingly, we are looking at new ways to answer the complex fusion technology questions emerging from the design studies for the next-generation devices. Recent results have demonstrated world record beta plasmas, long quiescent H-mode operation, partial noninductive current drive using both neutral beam and rf power injection, single- and double-null divertor operation, and divertor particle- and heat-load management. The recently installed Advanced Divertor hardware will allow critical transport experiments to be run with independent control of the density. It will also permit the concept of dc helicity injection current drive to be tested. This paper summarizes our most important recent findings and also outlines a few of the many interesting problems that are now under study to address fusion technology questions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Unlocking the Tight Oil Reservoirs of the Powder River Basin, Wyoming

The project focused on detailed geologic characterization, geomechanical studies, well completion optimization, stimulation monitoring, and field development strategies. A key aspect involved partnerships with industry and academic collaborators such as Occidental Petroleum, Southern Illinois University, Britt Rock Mechanics and Piri Technologies. Data acquisition included drilling, logging, coring, deployment of fiber optics, and microseismic monitoring. The project emphasized feedback loops for continuous model updating and integration of economic evaluations to guide development strategies.

02 PETROLEUM↗

Snowmass Topical Group Summary Report: IF04 -- Trigger and Data Acquisition Systems

A trend for future high energy physics experiments is an increase in the data bandwidth produced from the detectors. Datasets of the Petabyte scale have already become the norm, and the requirements of future experiments -- greater in size, exposure, and complexity -- will further push the limits of data acquisition technologies to data rates of exabytes per seconds. The challenge for these future data-intensive physics facilities lies in the reduction of the flow of data through a combination of sophisticated event selection in the form of high-performance triggers and improved data representation through compression and calculation of high-level quantities. These tasks must be performed with low-latency (i.e. in real-time) and often in extreme environments including high radiation, high magnetic fields, and cryogenic temperatures.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Snowmass Topical Group Summary Report: IF04 -- Trigger and Data Acquisition Systems

A trend for future high energy physics experiments is an increase in the data bandwidth produced from the detectors. Datasets of the Petabyte scale have already become the norm, and the requirements of future experiments -- greater in size, exposure, and complexity -- will further push the limits of data acquisition technologies to data rates of exabytes per seconds. The challenge for these future data-intensive physics facilities lies in the reduction of the flow of data through a combination of sophisticated event selection in the form of high-performance triggers and improved data representation through compression and calculation of high-level quantities. These tasks must be performed with low-latency (i.e. in real-time) and often in extreme environments including high radiation, high magnetic fields, and cryogenic temperatures.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Big Data Analysis of Massive PMU Datasets: A Data Platform Perspective

The discovery of `event signatures' and useful insights from very large historical Phasor Measurement Unit (PMU) datasets is predicated on offline Big Data analysis approaches that rely on the generation of predictive features on a massive scale. This paper presents lessons learned from a data platform perspective towards reducing barriers to adoption of Big Data analytics against a real dataset of almost half a trillion data points drawn from over 400 PMUs distributed across the North American power grid. We demonstrate software abstractions and targeted performance optimizations that can lead to significant productivity gains for power systems researchers seeking to perform offline exploratory temporal analysis and modeling tasks, with a focus on feature generation. We describe how our optimized approach goes beyond a naive application of mainstream Big Data technologies, enabling feature generation tasks, that previously took days or even weeks, to now be completed in just a few hours.

Kumar, Vijay S.↗

A review of battery life-cycle analysis : state of knowledge and critical needs.

A literature review and evaluation has been conducted on cradle-to-gate life-cycle inventory studies of lead-acid, nickel-cadmium, nickel-metal hydride, sodium-sulfur, and lithium-ion battery technologies. Data were sought that represent the production of battery constituent materials and battery manufacture and assembly. Life-cycle production data for many battery materials are available and usable, though some need updating. For the remaining battery materials, lifecycle data either are nonexistent or, in some cases, in need of updating. Although battery manufacturing processes have occasionally been well described, detailed quantitative information on energy and material flows is missing. For all but the lithium-ion batteries, enough constituent material production energy data are available to approximate material production energies for the batteries, though improved input data for some materials are needed. Due to the potential benefit of battery recycling and a scarcity of associated data, there is a critical need for life-cycle data on battery material recycling. Either on a per kilogram or per watt-hour capacity basis, lead-acid batteries have the lowest production energy, carbon dioxide emissions, and criteria pollutant emissions. Some process-related emissions are also reviewed in this report.

25 ENERGY STORAGE↗

Data And Informatics Working Group On Virtual Data Integration Workshop Report

This report is the outcome of a workshop that was commissioned by the Department of Energy’s Climate and Environmental Sciences Division (CESD) to examine current and future data infrastructure requirements that would be foundational to achieving CESD’s scientific mission goals. Over the past several years, data volumes in CESD disciplines have risen sharply to unprecedented levels (tens of petabytes). So too has the complexity and diversity of the research data (simulation, observation, and reanalysis) needing to be captured, stored, verified, analyzed, and integrated. With the trends of increased data volume (in the hundreds of petabytes), more complex analysis processes, and growing crossdisciplinary collaborations, it is timely to investigate whether the CESD community has the right computational and data support to realize the full scientific potential from its data collections. In recognition of the challenges, a partnership is forming across CESD and with national and international agencies to investigate the viability of creating an integrated, collaborative data infrastructure: a virtual laboratory. The overarching goal of this report is to identify the community’s key data technology requirements and high-priority development needs for sustaining and growing their scientific discovery potential. The report also aims to map these requirements to existing solutions and to identify gaps in current services, tools, and infrastructure that will need to be addressed in the short, medium, and long term so as not to impede scientific progress

54 ENVIRONMENTAL SCIENCES↗