Search NASA⌕ Search

SEARCH · Search NASA

Results for “process data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Improving Performance of M-to-N Processing and Data Redistribution in In Transit Analysis and Visualization

In an in transit setting, a parallel data producer, such as a numerical simulation, runs on one set of ranks M, while a data consumer, such as a parallel visualization application, runs on a different set of ranks N: One of the central challenges in this in transit setting is to determine the mapping of data from the set of M producer ranks to the set of N consumer ranks. This is a challenging problem for several reasons, such as the producer and consumer codes potentially having different scaling characteristics and different data models. The resulting mapping from M to N ranks can have a significant impact on aggregate application performance. In this work, we present an approach for performing this M-to-N mapping in a way that has broad applicability across a diversity of data producer and consumer applications. We evaluate its design and performance with a study that runs at high concurrency on a modern HPC platform. By leveraging design characteristics, which facilitate an ''intelligent'' mapping from M-to-N, we observe significant performance gains are possible in terms of several different metrics, including time-to-solution and amount of data moved.

Loring, Burlen↗

Enabling Recycling of Composites: Understanding the Impacts of Multiple Thermal Processing Cycles

When considering the utilization of recycled short carbon fiber feedstock materials for advanced manufacturing, understanding the material degradation behavior is essential in determining how many times a composite material can be effectively reprocessed and remanufactured. This study characterizes the degradation behavior of short carbon fiber acrylonitrile butadiene (CF-ABS) that has been reprocessed five times with twin screw extrusion. Parallel plate rheology was completed to observe the degradation in complex viscosity of the recycled feedstock materials. Gel permeation chromatography (GPC) was utilized to characterize the changes in molecular weight distribution of the recycled materials as a result of thermal and mechanical degradation during the re-processing steps. Rheological characterization, GPC, and twin-screw processing data help inform the process optimizations required to process the recycled feedstock material. Successful characterization of the degradation behavior of short fiber composite feedstock materials aids in increased understanding of the lifespan of high value carbon fiber composite materials and aids in process optimization of recycled composite materials.

Walker, Roo↗

Testing of ENDF/B-VIII.0 in the GNDS format with LLNL transport codes - 25606

ENDF/B-VIII.0 was released in the Evaluated Nuclear Data Format and the Generalized Nuclear Data Structure format (GNDS), a new international standard for storing nuclear data developed under the auspices of the Nuclear Energy Agency Working Party on Evaluation Cooperation Subgroup 38. GNDS relies on modern coding practices, and offers a structured, flexible and physics-based standard for storing and exchanging nuclear data to address limitations in legacy nuclear data formats such as ENDF-6. GNDS supports the storage of evaluated nuclear data as well as processed data suitable for both deterministic (i.e., multi-group) and Monte Carlo transport codes. Lawrence Livermore National Laboratory has implemented a complete suite of codes to test GNDS data. Simulations for the ENDF/B-VIII.0 cross-section library in GNDS format are presented. Deterministic and Monte Carlo radiation transport simulations with the Ardra and Mercury codes respectively, are validated against reactivities in fast criticality safety benchmark assemblies. Finally, Mercury simulations of {sup 238}U(n,f), {sup 237}Np(n,f) and {sup 239}Pu(n,f) reaction rates in Godiva, Jezebel and Flattop are compared to MCNP results and measured data. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

TRACC: An open source software for processing sap flux data from thermal dissipation probes

Here, thermal dissipation probes (TDPs) have become a widely used method of monitoring plant water use in recent years. The use of TDPs requires calibration to a theoretical zero-flow value (ΔT0); usually based upon the assumption that at least some nighttime measurements represent zero-flow conditions. Fully automating the processing of data from TDPs is made exceedingly difficult due to errors arising from many sources. However, it is desirable to minimize variation arising from different researchers’ processing data, and thus, a common platform for processing data, including editing raw data and determination of ΔT0, is useful and increases the transparency and replicability of TDP-based research. Here, we present the TDP data processing software TRACC (Thermal dissipation Review Assessment Cleaning and Conversion) to serve this purpose. TRACC is an open-source software written in the language R, using graphical presentation of data and on screen prompts with yes/no or simple numerical responses. It allows the user to select several important options, such as calibration coefficients and the exclusion of nights when vapor pressure deficit does not approach zero. Although it is designed for users with no coding experience, the outputs of TRACC could be easily incorporated into more complex models or software.

60 APPLIED LIFE SCIENCES↗

Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources

Apache Calcite is a foundational software framework that provides query processing, optimization, and query language support to many popular open-source data processing systems such as Apache Hive, Apache Storm, Apache Flink, Druid, and MapD. The goal of this paper is to formally introduce Calcite to the broader research community, brie y present its history, and describe its architecture, features, functionality, and patterns for adoption. Calcite's architecture consists of a modular and extensible query optimizer with hundreds of built-in optimization rules, a query processor capable of processing a variety of query languages, an adapter architecture designed for extensibility, and support for heterogeneous data models and stores (relational, semi-structured, streaming, and geospatial). This exible, embeddable, and extensible architecture is what makes Calcite an attractive choice for adoption in big-data frameworks. It is an active project that continues to introduce support for the new types of data sources, query languages, and approaches to query processing and optimization.

Begoli, Edmon↗

Open Source Visualization and Analysis Platform for 3D Reconstructions of Materials by Transmission Electron Microscopy

Three-dimensional characterization of materials at the nano- and meso-scale has become possible with transmission and scanning transmission electron microscopes (S/TEM). Its importance has extended to a wide class of nanomaterials such as hydrogen fuel cells, solar cells, industrial catalysts, new battery materials and semiconductor devices, as well as spanning high-tech industry, universities, and national labs. While capable instrumentation is abundant, this rapidly expanding demand for high-resolution tomography is bottlenecked by software that is instead tailored for lower-dose, biological applications and not optimized for higher-resolution materials applications. Existing tomography fails to utilize the chemical information provided by S/TEM spectrometers. To address this problem, this project delivered a scalable, fully functional, freely-distributable, open Source materials tomography package with a modern user interface that enables automated acquisition, alignment, and real-time reconstruction of raw tomography data, and provides advanced segmentation, three-dimensional chemical visualization and analysis optimized for materials applications. It has established an extendable framework capable of automation for high-throughput for the tomography of materials from data acquisition to visualization. Phase I and II delivered a full-featured, cross-platform, clean and integrated application for S/TEM materials tomography. It can read projection data from the microscope, with graphical tools for alignment of data, tomographic reconstruction, segmentation, and visualization of the reconstructed 3D volume. The entire pipeline can be saved to an XML state file, enabling fully reproducible data processing and analysis with a full Python environment for the development of custom algorithms, processing, and analysis requirements. Phase IIB extended the application to provide real-time tomographic reconstruction, "live updates" as data is processed, analysis of big data, and multi-channel tomography. Here, quantitative assessment of nanomaterials can occur as data is being recorded on a 3D visualization platform that accommodates additional information from multiple channels. We provide unmatched high-throughput tomography, where the complete tomographic pipeline from measurement to 3D visualization can occur rapidly. The project was extended to offer capabilities for micro-CT, X-ray, neutron, focused ion beam, atomic electron tomography and atom probe tomography. With over 600 transmission electron microscopes worldwide and approximately 50 coming online each year, the demand and impact of an open-source tomography tool is large. Significant opportunities exist in high-tech industry, universities, and national labs to enable or enhance three-dimensional imaging at the nanoscale and bring automated high-throughput approaches that will accelerate progress in materials characterization and metrology. The project supports a service based business model by enabling lab-specific acquisition and processing customization and integration-support and development that will be provided into Phase III and beyond.

36 MATERIALS SCIENCE↗

Development of Real-Time High-Density Pulsar Data Transmission and Processing for Grid Synchronization

Taking advantage of the extreme stability of the pulsar period, it can serve as the timing source for grid synchronization to compensate for the timing drift instigated by the loss of GPS signal. Nevertheless, the real-time transmission and processing of the pulsar data suffer from its high-frequency data rate, varying from megahertz to gigahertz, resulting in reduced computing speed and increased time delay. To mitigate this issue, the hardware and software frameworks are implemented for the high-density pulsar data transmission and processing for grid synchronization in this research. Initially, the high-density pulsar data is transferred using open-source software. The complementary duty cycle timing module is designed to coordinate the operation of the dual-channel high-speed interface and software. Subsequently, the multiple-threading is applied to the receiving, parsing, and splicing pulsar data. Next, the pulsar signal extraction method is implemented based on the polyphase filterbank and time of arrival estimation. Ultimately, real-time performance verification experiments are carried out for different components under two hardware platforms. Finally, the results demonstrate that only 0.482 s is required for processing 4 Gigabyte data through multiple-threading, which is 3.8 times faster than the single thread. The pulsar signal extraction can also be executed within 707 ms for 4.8 seconds of data, thereby indicating that real-time requirements can be met.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Iterative Processing Framework: A New Paradigm for Automatic Event Building

Abstract In a traditional data-processing pipeline, waveforms are acquired, a detector makes the signal detections (i.e., arrival times, slownesses, and azimuths) and passes them to an associator. The associator then links the detections to the fitting-event hypotheses to generate an event bulletin. Most of the time, this traditional pipeline requires substantial human-analyst involvement to improve the quality of the resulting event bulletin. For the year 2017, for instance, International Data Center (IDC) analysts rejected about 40% of the events in the automatic bulletin and manually built 30% of the legitimate events. Here, we introduce an iterative processing framework (IPF) that includes a new data-processing module that incorporates automatic analyst behaviors (auto analyst [AA]) into the event-building pipeline. In the proposed framework, through an iterative process, the AA takes over many of the tasks traditionally performed by human analysts. These tasks can be grouped into two major processes: (1) evaluating small events with a low number of location-defining arrival phases to improve their formation; and (2) scanning for and exploiting unassociated arrivals to form potential events missed by previous association runs. To test the proposed framework, we processed a two-week period (15–28 May 2010) of the signal-detections dataset from the IDC. Comparison with an expert analyst-reviewed bulletin for the same time period suggests that IPF performs better than the traditional pipelines (IDC and baseline pipelines). The majority of the additional events built by the AA are low-magnitude events that were missed by these traditional pipelines. The AA also adds additional signal detections to existing events, which saves analyst time, even if the event locations are not significantly affected.

58 GEOSCIENCES↗

Adapt: A Weather Radar Data Analysis and Nowcasting Platform for Informed Adaptive Scanning

SF-26-021 Adapt is a data processing platform for real-time data analysis, short term prediction of targets convective cells and tracking for archived data. It provides tools for downloading, processing, segmenting, projecting, analyzing, and visualizing storm cell data from weather radar. The pipeline includes cell detection, motion estimation using optical flow, cell property extraction, and persistence to NetCDF and SQLite/Parquet for guiding adaptive scanning.

Raut, Bhupendra Ashokrao [Argonne National Laborat↗

Extreme-Scale Distribution-Based Data Analysis

Scientists overview and identify regions of interest by transforming data into compact information descriptors that characterize simulation results and allow detailed analysis on demand. Among many existing feature descriptors, statistical information derived from data samples is a promising approach to taming the big data avalanche because data distributionscomputed from a population can compactly describe the presence and characteristics of salient data features with minimal data movement. The ability to computationally summarize and process data using distributions also provides an efficient and representative capture of information that can adjust to size and resource constraints, with the added benefit that uncertainty associated with results can be quantified and communicated. In this project, we have developed a distribution-based data analysis and visualization framework for optimizing in situ processing and analysis of extreme-scale scientific data.

97 MATHEMATICS AND COMPUTING↗

Toward CO 2 Multimeasurement Geophysical Monitoring in the North Dakota CarbonSAFE Project

Paper presented at 16th International Conference on Greenhouse Gas Control Technologies (GHGT-16), October 23–27, 2022, Lyon, France. Overcoming data acquisition challenges associated with a lake in the study area, electrical infrastructure around the plant, noise from mine activities, complex near-surface conditions associated with reclaimed mine land, high wind speed, and extremely cold temperatures, data processing, modeling, and inversion of the baseline geophysical data demonstrated the importance of high-quality data for a CO 2 geophysical monitoring program. Implementing more advanced data acquisition and processing techniques in future monitoring surveys can further improve confidence in interpretations of geophysical survey data.

20 FOSSIL-FUELED POWER PLANTS↗

Field evaluation of remote wind sensing technologies: Shore-based and buoy mounted LIDAR systems

In developing a national energy strategy, the United States has a number of objectives, including increasing economic growth, improving environmental quality, and enhancing national energy security. Wind power contributes to these objectives through the deployment of clean, affordable and reliable domestic energy. To achieve U.S. wind generation objectives, the Wind and Water Power Program within the Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE) instituted the U.S. Offshore Wind: Removing Market Barriers Program in FY 2011. Accurate and comprehensive information on offshore wind resource characteristics across a range of spatial and temporal scales is one market barrier that needs to be addressed through advanced research in remote sensing technologies. There is a pressing need for reliable offshore wind-speed measurements to assess the availability of the potential wind energy resource in terms of power production and to identify any frequently occurring spatial variability in the offshore wind resource that may impact the operational reliability and lifetime of wind turbines and their components and to provide a verification program to validate the “bankability” of the output of these alternative technologies for use by finance institutions for the financing of offshore wind farm construction. The application of emerging remote sensing technologies is viewed as a means to cost-effectively meet the data needs of the offshore wind industry. In particular, scanning and buoy mounted LIDAR have been proposed as a means to obtain accurate offshore wind data at multiple locations without the high cost and regulatory hurdles associated with the construction of offshore meteorological towers. However; before these remote sensing technologies can be accepted the validity of the measured data must be evaluated to ensure their accuracy. The proposed research will establish a unique coastal ocean test-bed in the Mid-Atlantic for the evaluation of LIDAR-based wind measurement systems to validate the accuracy of remotely measured wind data in marine applications. Specifically, the test-bed will be utilized to systematically evaluate the capability of emerging scanning LIDAR and buoy mounted vertically profiling LIDAR by: (1) Evaluating a fixed scanning LIDAR against land-based 50 and 60 meter high meteorological masts fitted with research quality cup-vane and/or sonic anemometers; (2) Evaluating a buoy mounted vertically profiling LIDAR fixed on land and floating in a sheltered bay against a co-located 60 meter high meteorological mast fitted with a research quality cup-vane and/or sonic anemometers and the fixed scanning LIDAR; and (3) Offshore field evaluation of both LIDAR platforms through a comparison of the fixed scanning LIDAR data and data obtained by the buoy mounted LIDAR located 10 miles offshore. The proposed research will systematically validate Light Detection and Ranging (LIDAR) based wind measurement systems and assess the temporal and spatial variability of the offshore wind resource in the Mid-Atlantic east of New Jersey. The goal of the proposed project is to address the technical and commercial challenges of the offshore wind energy industry by validating and assessing cost-effective, over ocean wind resource characterization technologies. The objective is to systematically evaluate the capability of both scanning and vertically profiling LIDARs to accurately measure 3D wind fields through comparison with fixed met masts and intercomparison among LIDAR platforms. Once validated, data collected by both buoy mounted vertically profiling LIDARs and shore-based, pulsed horizontally scanning LIDARs can be used to accurately assess offshore wind resources and to quantify the spatial and temporal variability in the offshore wind fields. One of the fundamental research questions to be addressed in phase 1 is the assessment of various measurement and data processing schemes to retrieve accurate wind vectors in the marine environment over large sampling ranges (10 to 12 km) and varying atmospheric aerosol levels. Atmospheric conditions and aerosol content within the coastal ocean region of the Mid-Atlantic seaboard of the US can vary significantly over short time periods in response to frontal passages and extratropical and tropical low pressure system passage offshore of the coast. Since aerosols provide the scattering medium for the determination of LIDAR Doppler shifts in the atmosphere the accuracy and range of LIDAR derived velocity measurements as a function of variation in aerosol content in the marine environment is a key research question to be addressed. In phase 1, it is desired to capture as much variation in atmospheric conditions and aerosol content as possible. To this end, collocated measurements of LIDAR and standard anemometer wind fields will be captured by the project PIs over all four seasons and during specific events (e.g., coastal low pressure system passage) in year 1. Additionally, since the meteorological masts are permanent structures, additional events can be captured over the three year duration of the field research project. All research instruments are owned by Fishermen’s Energy and made available to the PIs though a lease agreement as part of the DOE grant. Energy Fishermen’s Energy will be responsible for the operation and maintenance of the scanning LIDAR and met mast anemometers. On a daily basis, environmental data and systems performance indicators will be transmitted from each measurement station to the Fishermen’s project team consisting of both in-house personnel and equipment manufacturer engineers. Data sets include compiled LIDAR files as well as data sets from ancillary sensors. Diagnostic parameters to be monitored include standard deviations of measured values, battery levels and charging systems output, and the operational status. Once data have been confirmed as complete and reliable, files will be transferred to the Garrad Hassan (a subcontractor to Fishermen’s Energy) for incorporation in to the validation database, which is accessible to other scientific team members. Data collection times and durations will be determined by the PI and Co-PIs in consultation with instrument engineers to ensure the capture of data representative of the expected range of mid-Atlantic atmospheric conditions (e.g., temperature, moisture, coastal low pressure systems, tropical systems, rain, snow, fog). The collection and processing of the data is a function of site specific measurement requirements (Kelley et.al. 2007; Hannon et.al. 2008). To determine the optimal profiles of wind speed and direction from the LIDAR radial velocities as a function of azimuth angle, rigorous estimates of the bias and random error of each radial velocity estimate are required. Lockheed Martin Coherent Technologies, Inc., under contract with Fishermen’s Energy, will provide analyses of raw and processed data using various scan patterns to determine optimal performance settings for the pulsed scanning LIDAR. Once optimized, appropriate processing and analyses techniques will be evaluated by Garrad Hassan for use in validating the accuracy of the LIDAR wind field measurements against the standard anemometer measurements from the meteorological masts. The most attractive capability of the scanning LIDAR is the ability to provide high spatial resolution observations in a three-dimensional volume which provides superior statistical accuracy due to the large number of samples obtained. Each radial scan provides measurements in 100 range gates over a distance of 10 to 12 km at an update rate of 5 to 10 Hz and rotation of 2.5° per second. Each rotation at a fixed azimuth requires 2.4 minutes. Depending on the number of azimuths desired a complete scan can take up to 10 minutes or longer to complete. Once collected the radial velocities are processed to produce vector wind velocity estimates based on a set of data distributed in angle and range around points of interest, typically a standard grid within the radial wind map. To calculate wind vectors over a limited spatial area of interest for the comparison of data with other measurement platforms a localized least-squares approach has been applied by Hannon et.al. (2008) and a Variation Assimilation (VAR) processing technique has been applied by Chan and al Assimilation (VAR) processing technique has been applied by Chan and Shao (2006). Additionally, Kelley et.al. (2007) applied a “stare” technique that fixed a scanning LIDAR in both azimuth and elevation angles to measure over collocated sampling volumes of the LIDAR and a 3D sonic anemometer mounted to a fixed mast. Although the stare technique is limited to wind directions aligned with the sampling radial of the LIDAR, it does provide a direct comparison of sampling volumes. Each of the processing techniques described above (and possibly others) will be evaluated to determine the validity of the LIDAR derived wind fields in the marine environment. Numerical methods such as linear regression and comparison of probability density functions of wind fields measured by each instrument platform will be used to assess the processing techniques. Linear regression has the advantage of directly evaluating corresponding pairs of wind data measured by each instrument and can lend insight into deviations and bias between instruments as a function of wind speed. Assessment of the coherency between the probability density function of the wind measured by each instrument provides insight into processes that may not be accurately resolved by each instrument at specific frequencies. Once processed and assessed the most appropriate technique will be utilized to provide valid wind measurements from the pulsed scanning LIDAR. A detailed analysis of the measurement data from the LIDAR and the three meteorological towers and comparison of the coastal wind characteristics from the different systems will be performed by the CO_PI at NREL. This analysis will evaluate how the WT LIDAR performance and measurement of the wind characteristics vary with distance from the LIDAR and by atmospheric conditions; using the tower measurements at different distances (4.8, 9.6, and 19 km) from the LIDAR as a reference. The comparative analysis will include, to the extent possible, evaluation of parameters such as wind speed and direction distributions, wind shear, turbulence intensity and their variations by atmospheric conditions, month or season, and time of day.

17 WIND ENERGY↗

Utah FORGE Well 78B-32 Daily Drilling Reports and Logs

This data set includes the daily drilling reports and Pason data for well 78B-32 and Schlumberger logs acquired after drilling completion. This well was drilled between June 27th and July 31st of 2021. Also included is raw and processed data for a variety of well data metrics including temperature, porosity, density, and sonic data. This data was taken at the Utah FORGE site as part of the Utah FORGE project.

15 GEOTHERMAL ENERGY↗

Methods and algorithms for computer synthesis of holographic elements to obtain a complex impulse response of optical information processing systems based on modern spatial light modulators

The possibilities of designing optical devices for data processing and imaging based on the manipulation of coherent light beams by means of spatial light modulators (SLMs) are investigated. A review of commercially available SLMs is presented and the limitations of their complex modulation characteristics are analysed. The main problem of using present-day SLMs is the lack of the ability to modulate directly all states within a unit circle in the complex plane. In this regard, the characteristics of current methods for the synthesis of holographic elements are described that implement a given complex impulse response of the optical system and are optimal for using SLMs with purely amplitude, purely phase, and hybrid amplitude – phase modulation. (paper)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗