Search NASA⌕ Search

SEARCH · Search NASA

Results for “large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Estimation of Uncertainties of Wall Temperature Accomplished by Model Calibration Technique Using Small to Large Scale Reflooding Test Data

The fidelity of the prediction can be evaluated by performing validation and uncertainty quantification with suitable test data. Nuclear power plant design and operation must accommodate the uncertainties in predicting system performance, where those uncertainties originating due to initial and boundary conditions, numerics, and modeling uncertainties. To improve the prediction of the reactor system performance, these various sources of uncertainties can be refined through model calibration technique. The objective of this work is to refine the model parameters and to estimate the uncertainties on parameters/responses during reflood phase. To accomplish this experiments should be performed, data collected, and the data utilized to complete model calibration for the thermal-hydraulic input parameters. Simulations were performed using Safety and Performance Analysis Code (SPACE) developed by multiple research institutes in South Korea to predict the thermal hydraulic system behaviors of nuclear power plants. Since existing experimental data were obtained from several tests performed at the small scale, scaling considerations must be addressed during the uncertainty quantification process. (authors)

42 ENGINEERING↗

Improving the Inventory of Large Lunar Basins: Using LOLA Data to Test Previous Candidates and Search for New Ones

Topography and crustal thickness data from LOLA altimetry were used to test the validity of 98 candidate large lunar basins derived from photogeologic and earlier topographic and crustal thickness data, and to search for possible new candidates. We eliminate 23 previous candidates but find good evidence for 20 new candidates. The number of basins greater than 300 km diameter on the Moon is almost certainly a factor 2 (maybe 3?) larger than the number of named features having basin-like topography. Unified Lunar Control Net 2005 data [1] and model crustal thickness data [2] were previously used to search for possible previously unrecognized large lunar impact basins [3,4]. An inventory of 98 candidate topographic basins greater than 300 km in diameter was found [5]. This includes 33 named features (only those having basin-like topography) out of the 45 listed by Wilhelms [6], 38 additional Quasi-Circular Depressions (QCDs) found in the ULCN2005 topography, and 27 Circular Thin Areas (CTAs) found in model crustal thickness data [2]. Most named features and additional QCDs have strong CTA signatures, but there may be a class of CTAs that are not easily recognized in the old and low resolution ULCN2005 topography. Lunar Orbiter Laser Altimeter (LOLA) data have recently become publically available. We used these data to (a) refine the center and ring diameters of known basins, (b) test the viability of the candidate basins previously found (as described above), and (c) search for additional candidate basins not revealed by the earlier lower resolution data. We used the LOLA topography directly but also a recent new model crustal thickness data that includes Kaguya gravity data [7]. We repeated a Topographic Expression (TE) and a Crustal Thickness Expression (CTE) scoring exercise originally done with the basins found in ULCN and earlier model crustal thickness data [5]. Each candidate was scored on a scale from 0 (no topographic basin or circular thin area signature) to 5 (strong circular low or strong circular thin area signature). These were combined into a total score used to rank the probability for each candidate basin. We used the same GRIDVIEW software to stretch, contour and profile the LOLA and new crustal thickness data as was done with the ULCN2005 and older model crustal thickness data.

Frey, H. V.↗

Using ADOPT Algorithm and Operational Data to Discover Precursors to Aviation Adverse Events

The US National Airspace System (NAS) is making its transition to the NextGen system and assuring safety is one of the top priorities in NextGen. At present, safety is managed reactively (correct after occurrence of an unsafe event). While this strategy works for current operations, it may soon become ineffective for future airspace designs and high density operations. There is a need for proactive management of safety risks by identifying hidden and "unknown" risks and evaluating the impacts on future operations. To this end, NASA Ames has developed data mining algorithms that finds anomalies and precursors (high-risk states) to safety issues in the NAS. In this paper, we describe a recently developed algorithm called ADOPT that analyzes large volumes of data and automatically identifies precursors from real world data. Precursors help in detecting safety risks early so that the operator can mitigate the risk in time. In addition, precursors also help identify causal factors and help predict the safety incident. The ADOPT algorithm scales well to large data sets and to multidimensional time series, reduce analyst time significantly, quantify multiple safety risks giving a holistic view of safety among other benefits. This paper details the algorithm and includes several case studies to demonstrate its application to discover the "known" and "unknown" safety precursors in aviation operation.

aviation safet↗

Space-vehicle correlation of ground and flight experiments

A 2-percent-scale model was designed for testing in the NTF. This model has remotely controlled elevons, body flap, and rudder to minimize tunnel entries associated with configuration changes in the NTF. The Shuttle Orbiter has a very large aerodynamic data base obtained in ground facilities. Since the vehicle flight-test program has already begun, a large amount of flight data can be analyzed and correlated with the NTF results.

Scallion, W. I.↗

Proton Radiography: Cross Section Measurements and Detector Development

Proton radiography has become an important tool for predicting the performance of stockpiled nuclear weapons. Current proton radiography experiments at LANSCE are confined to relatively small targets on the order of centimeters in size because of the low beam energy. LANL scientists have made radiographs with 12 and 24 GeV protons produced by the accelerator at Brookhaven National Laboratory. These energies are in the range required for hydrotest radiography. The design of a facility for hydrotest radiography requires knowledge of the cross sections for producing high-energy particles in the forward direction, which are incorporated into the Monte Carlo simulation used in designing the beam and detectors. There are few existing measurements of neutron production cross sections for proton-nuclei interactions in the 50 GeV range, and almost no data exist for forward neutron production, especially for heavy target nuclei. Thus the data from the MIPP EMCAL and HCAL, for which our group was responsible, are critical to proton radiography. Since neutrons and photons cannot be focused by magnets, they cause a background “fog” on the images. This problem can be minimized by careful design of the focusing system and detectors. The purpose of our research was to measure forward production of neutrons produced by high-energy proton beams striking a variety of targets. The forward-going particles carry most of the energy from a high-energy proton interaction, so these are the most important to proton radiography. This work was carried out in conjunction with the Fermilab E-907 (MIPP) collaboration. Our group was responsible for designing and building the E907 forward neutron and photon calorimeters. With the support of our Stewardship Science Academic Alliances grants, we were able to design, build, and commission the calorimeters on budget and ahead of schedule. The MIPP experiment accumulated a large amount of data in the first run that ended in early 2006. Our group has almost completed the analysis the forward neutron production data. Large dis-crepancies between our neutron production data and Monte Carlo expectations have been found.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Test data acquisition system for the ESTEC large solar simulator at ESA/ESTEC

A prototype data acquisition system is described. The device characteristics, its performance and the system aspects connected to the integration of the data acquisition system into the space simulator instrumentation and environment are discussed. The data acquisition system has a modular architecture and manifold configuration capability. The input characteristics feature high resolution and accuracy/stability for the measurement of low level (thermocouple originated) analog signals, even in the presence of high common mode and S/N figures. The output is serial digital, compatible with ESA data handling standards. The device is designed to be installed in particularly hostile environments, such as that of a solar simulator.

Buroni, G.↗

Leveraging large language models to address data scarcity in machine learning for graphene synthesis

Machine learning in experimental materials science faces significant challenges due to the scarcity of data, which are costly and time-consuming to generate, particularly when relying on in-house experiments. Literature data mining offers a potential solution but introduces issues like mixed data quality, inconsistent formats, and non-uniform reporting of synthesis parameters, resulting in partially missing and heterogeneous features across the dataset. Here, we propose data imputation and feature engineering methods that employ pre-trained large language models (LLMs) to enhance machine learning performance on scarce, heterogeneous datasets, demonstrated on graphene CVD synthesis data and the ML-HydPARK hydrogen storage dataset. GPT models perform data imputation via tailored prompting and semantic normalization of inconsistently reported features through embeddings, for example, to harmonize the complex nomenclature of CVD substrates. Beyond yielding more diverse and richer feature representations than traditional methods such as K-nearest neighbors (KNN) and Multivariate Imputation by Chained Equations (MICE), LLM-based data imputation is evaluated against dataset characteristics and prompting strategies. We vary the level of autonomy granted to the LLM, from generic prompting that leverages pre-trained knowledge for autonomous data generation to data-informed prompting that constrains outputs using target-specific information, and demonstrate which level of autonomy yields superior imputation performance across datasets and feature types. The proposed data engineering methods markedly improve downstream performance; for example, in graphene layer number classification using a support vector machine (SVM), binary accuracy increases from 39% to 65% and ternary accuracy from 52% to 72%. Fine-tuning experiments on both datasets show that combining our proposed LLM-based data imputation and feature encoding methods with numerical machine learning predictors outperforms standalone fine-tuned LLM predictors in data-scarce settings. The proposed strategies emphasize data enhancement techniques rather than refining learning architectures or regularizing loss functions, offering a broadly applicable framework for improving machine learning performance on scarce, inhomogeneous datasets.

Chemical vapor deposition↗

Seismology in the Cloud: A New Streaming Workflow

Data-intensive research in seismology is experiencing a recent boom, driven in part by large volumes of available data and advances in the growing field of data science. However, there are significant barriers to processing large data volumes, such as long retrieval times from data repositories, complex data management, and limited computational resources. New tools and platforms have reduced the barriers to entry for scientific cluster computing, including the maturation of the commercial cloud as an accessible instrument for research. Here, we build a customized research cluster in the cloud to test a new workflow for large-scale seismic analysis, in which data are processed as a stream (retrieved on-the-fly and acted upon without storing), with data from the Incorporated Research Institutions for Seismology Data Management Center. We use this workflow to deploy a spectral peak detection algorithm over 5.6 TB of compressed continuous seismic data from 2074 stations of the USArray Transportable Array EarthScope network. Using a 50-node cluster in the cloud, we completed the noise survey in 80 hr, with an average data throughput of 1.7 GB per minute. By varying cluster sizes, we find the scaling of our analysis to be sublinear, due to a combination of algorithmic limitations and data center response times. The cloud-based streaming workflow represents an order-of-magnitude increase in acquisition and processing speed compared to a traditional download-store-process workflow, and offers the additional benefits of employing a flexible, accessible, and widely used computing architecture. It is limited, however, due to its reliance on Internet transfer speeds and data center service capacity, and may not work well for repeated analyses or those for which even higher data throughputs are needed. These research applications will require a new class of cloud-native approaches in which both data and analysis are in the cloud.

58 GEOSCIENCES↗

Disentangling Sources of Gene Tree Discordance in Phylogenomic Data Sets: Testing Ancient Hybridizations in Amaranthaceae s.l

Gene tree discordance in large genomic data sets can be caused by evolutionary processes such as incomplete lineage sorting and hybridization, as well as model violation, and errors in data processing, orthology inference, and gene tree estimation. Species tree methods that identify and accommodate all sources of conflict are not available, but a combination of multiple approaches can help tease apart alternative sources of conflict. Here, using a phylotranscriptomic analysis in combination with reference genomes, we test a hypothesis of ancient hybridization events within the plant family Amaranthaceae s.l. that was previously supported by morphological, ecological, and Sanger-based molecular data. The data set included seven genomes and 88 transcriptomes, 17 generated for this study. We examined gene-tree discordance using coalescent-based species trees and network inference, gene tree discordance analyses, site pattern tests of introgression, topology tests, synteny analyses, and simulations. We found that a combination of processes might have generated the high levels of gene tree discordance in the backbone of Amaranthaceae s.l. Furthermore, we found evidence that three consecutive short internal branches produce anomalous trees contributing to the discordance. Overall, our results suggest that Amaranthaceae s.l. might be a product of an ancient and rapid lineage diversification, and remains, and probably will remain, unresolved. This work highlights the potential problems of identifiability associated with the sources of gene tree discordance including, in particular, phylogenetic network methods. Our results also demonstrate the importance of thoroughly testing for multiple sources of conflict in phylogenomic analyses, especially in the context of ancient, rapid radiations. We provide several recommendations for exploring conflicting signals in such situations.

59 BASIC BIOLOGICAL SCIENCES↗

ISOBAR Preconditioner for Effective and High-throughput Lossless Data Compression

Efficient handling of large volumes of data is a necessity for exascale scientific applications and database systems. To address the growing imbalance between the amount of available storage and the amount of data being produced by high speed (FLOPS) processors on the system, data must be compressed to reduce the total amount of data placed on the file systems. General-purpose loss less compression frameworks, such as zlib and bzlib2, are commonly used on datasets requiring loss less compression. Quite often, however, many scientific data sets compress poorly, referred to as hard-to-compress datasets, due to the negative impact of highly entropic content represented within the data. An important problem in better loss less data compression is to identify the hard-to-compress information and subsequently optimize the compression techniques at the byte-level. To address this challenge, we introduce the In-Situ Orthogonal Byte Aggregate Reduction Compression (ISOBAR-compress) methodology as a preconditioner of loss less compression to identify and optimize the compression efficiency and throughput of hard-to-compress datasets.

Computer Science↗

WiP Abstract: Edge-Based Privacy of Naturalistic Driving Data Collection

Collecting large driving datasets is important for data-driven transportation research and studied in naturalistic driving [3]. Due to the standard implementation of a Controller Area Network (CAN) bus for a vehicle’s inter-module communication, many off-the-shelf devices can easily transform a vehicle into a rich data collection utility [2]. Vehicles with Adaptive Cruise Control (ACC) are an example of a feature resulting in emergent traffic behavior when scaled [4]. While these utilities were designed with particular data use cases, data may be publicly shared to benefit other researchers through online tools like CyVerse [1]. However, such data should only be shared when any private information is removed. This private information may exist as a set of GPS coordinates, since the start and end points of a trip may designate a driver’s place of residence or work. When considering larger continuously-collected data sets with a focus on naturalistic driving, many drivers are needed to make data collection feasible. Removal of private information becomes much more of a challenge since every driver may uniquely define their geographic privacy. This project aims to build upon the foundation of libpanda [2] by adding features of edge-based data privacy enforcement. In it’s current form, libpanda uses a GPS in conjunction with a CAN interface to record data. Libpanda feature s a set of startup and shutdown scripts to perform automatic data collection and upload. With additional support hardware on a Raspberry Pi, the Pi can maintain power on vehicle shutdown to automatically upload data before shutdown.

Bunting, Matt↗

DOE/NASA wind turbine data acquisition. Part 1: Equipment

Large quantities of data were collected, stored, and analyzed in connection with research and development programs on wind turbines. The hardware configuration of the wind energy remote data acquisition system is described along with its use on the NASA/DOE Wind Energy Program.

Strock, O. J.↗

Height and altitude distribution of large volcanoes on Venus

Magellan data reveal 156 large volcanoes on Venus (greater than 100 km in diameter) which range in height from 300 m to 5.55 km, with an average height of 1.42 km. On the basis of theory it has been predicted that the development of neutral buoyancy zones (NBZ) on Venus and thus the resulting volcanic deposits are strongly influenced by the altitude-controlled variations in surface pressure. The distribution and height of these large volcanoes as a function of altitude was examined to begin to test these predications. Although large volcanoes are relatively uniformly distributed in altitude, there may be a slight paucity of volcanoes at the lowest elevations and a slight surplus at mid-altitudes. In addition, it is observed that the volcanoes at the highest altitudes tend to be the tallest. The observed distributions at low-mid altitudes is consistent with the prediction of NBZ theory. The high altitude distribution and heights, however, emphasize the necessity of considering other factors, such as tectonic setting, edifice age, magma supply, and thermal gradient, in describing the location and development of large volcanoes on Venus.

Keddie, S. T.↗

SDS: A Framework for Scientific Data Services

Large-scale scientific applications typically write their data to parallel file systems with organizations designed to achieve fast write speeds. Analysis tasks frequently read the data in a pattern that is different from the write pattern, and therefore experience poor I/O performance. In this paper, we introduce a prototype framework for bridging the performance gap between write and read stages of data access from parallel file systems. We call this framework Scientific Data Services, or SDS for short. This initial implementation of SDS focuses on reorganizing previously written files into data layouts that benefit read patterns, and transparently directs read calls to the reorganized data. SDS follows a client-server architecture. The SDS Server manages partial or full replicas of reorganized datasets and serves SDS Clients' requests for data. The current version of the SDS client library supports HDF5 programming interface for reading data. The client library intercepts HDF5 calls and transparently redirects them to the reorganized data. The SDS client library also provides a querying interface for reading part of the data based on user-specified selective criteria. We describe the design and implementation of the SDS client-server architecture, and evaluate the response time of the SDS Server and the performance benefits of SDS.

59 BASIC BIOLOGICAL SCIENCES↗

DeepZipper: A Novel Deep-learning Architecture for Lensed Supernovae Identification

Large-scale astronomical surveys have the potential to capture data on large numbers of strongly gravitationally lensed supernovae (LSNe). To facilitate timely analysis and spectroscopic follow-up before the supernova fades, an LSN needs to be identified soon after it begins. To quickly identify LSNe in optical survey data sets, we designed ZipperNet, a multibranch deep neural network that combines convolutional layers (traditionally used for images) with long short-term memory layers (traditionally used for time series). We tested ZipperNet on the task of classifying objects from four categories—no lens, galaxy-galaxy lens, lensed Type-Ia supernova, lensed core-collapse supernova—within high-fidelity simulations of three cosmic survey data sets: the Dark Energy Survey, Rubin Observatory’s Legacy Survey of Space and Time (LSST), and a Dark Energy Spectroscopic Instrument (DESI) imaging survey. Among our results, we find that for the LSST-like data set, ZipperNet classifies LSNe with a receiver operating characteristic area under the curve of 0.97, predicts the spectroscopic type of the lensed supernovae with 79% accuracy, and demonstrates similarly high performance for LSNe 1–2 epochs after first detection. We anticipate that a model like ZipperNet, which simultaneously incorporates spatial and temporal information, can play a significant role in the rapid identification of lensed transient systems in cosmic survey experiments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Parallel visualization and analysis with paraview on a Cray XT4

Scientific data sets produced by modern supercomputers like ORNL's Cray XT 4, Jaguar, can be extremely large, making visualization and analysis more difficult as moving large resultant data to dedicated analysis systems can be prohibitively expensive. We share our continuing work of integrating a parallel visualization system, ParaView, on ORNL's Jaguar system and our efforts to enable extreme scale interactive data visualization and analysis. We will discuss porting challenges and present performance numbers. Jaguar is a Cray XT4 with 7,832 compute nodes each with 4 cores and 8GB of memory, located in Oak Ridge, Tennessee. Jaguar is currently ranked No.8 in the Top 500. Jaguar, and other machines like it, enable increasingly larger data sets. Whether scientists are producing extremely massive data or small data they still have a requirement for analysis. Analysis is often difficult for larger data and it is further complicated when the user is distant to the data. Data sets that are too large to ship and/or analyze on a single desktop require a parallel analysis tool and a high performance computer to run on. Running ParaView interactively on Jaguar is a positive improvement for both local and remote users. We have shown that it is feasible for our user at LANL to visualize his simulation data created on jaguar. Local users may face fewer obstacles and get improved performance, due to their higher bandwidth to Jaguar. For future work, we would like to see higher priority queues that enable interactive visualization. A more interactive user-friendly qsub that estimates time to allocation would be very useful. Hopefully, our work will lead to more users attempting interactive visualization on Jaguar, resulting in quicker turnaround times for visualization and analysis. As users migrate to using supercomputing platforms for visualization, we expect future research possibilities in this area.

00↗

Transferring a Molecular Foundation Model for Polymer Property Predictions

Transformer-based large language models have remarkable potential to accelerate design optimization for applications such as drug development and material discovery. Self-supervised pretraining of transformer models requires large-scale data sets, which are often sparsely populated in topical areas such as polymer science. Further, state-of-the-art approaches for polymers conduct data augmentation to generate additional samples but unavoidably incur extra computational costs. In contrast, large-scale open-source data sets are available for small molecules and provide a potential solution to data scarcity through transfer learning. In this work, we show that using transformers pretrained on small molecules and fine-tuned on polymer properties achieves comparable accuracy to those trained on augmented polymer data sets for a series of benchmark prediction tasks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Large Terrain Modeling and Visualization for Planets

Physics-based simulations are actively used in the design, testing, and operations phases of surface and near-surface planetary space missions. One of the challenges in realtime simulations is the ability to handle large multi-resolution terrain data sets within models as well as for visualization. In this paper, we describe special techniques that we have developed for visualization, paging, and data storage for dealing with these large data sets. The visualization technique uses a real-time GPU-based continuous level-of-detail technique that delivers multiple frames a second performance even for planetary scale terrain model sizes.

digital elevation map↗