Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Intensive Computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2011

Towards Composing Data Aware Systems Biology Workflows on Cloud Platforms: A MeDICi-based Approach

Cloud computing is being increasingly adopted for deploying systems biology scientific workflows. Scientists developing these workflows use a wide variety of fragmented and competing data sets and computational tools of all scales to support their research. To this end, the synergy of client side workflow tools with cloud platforms is a promising approach to share and reuse data and workflows. In such systems, the location of data and computation is essential consideration in terms of quality of service for composing a scientific workflow across remote cloud platforms. In this paper, we describe a cloud-based workflow for genome annotation processing that is underpinned by MeDICi - a middleware designed for data intensive scientific applications. The workflow implementation incorporates an execution layer for exploiting data locality that routes the workflow requests to the processing steps that are colocated with the data. We demonstrate our approach by composing two workflowswith the MeDICi pipelines.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Advancing specialized biofoundries via automated adaptive laboratory evolution

Adaptive laboratory evolution (ALE) is a powerful strategy for improving microbial phenotypes by harnessing natural selection under defined environmental conditions. Through applying selection regimes, beneficial mutations accumulate, enabling the generation of strains with enhanced properties. However, conventional ALE is labor-intensive and difficult to scale, limiting reproducibility and broader discovery of evolutionary principles. Recent advances in robotics, automation, and computational infrastructure are transforming ALE into a scalable, data-rich experimental paradigm. Automated platforms enable standardized and complex protocols, real-time monitoring, and highly parallel evolution campaigns, improving consistency while generating longitudinal datasets that reveal convergent adaptive mechanisms. Here, we discuss the role of specialized biofoundries in advancing automated ALE and enabling large-scale evolutionary engineering. We review major automated ALE formats and outline key design principles for effective ALE biofoundries, highlighting how automated ALE can support autonomous experimentation and AI-guided strain engineering.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Conditional diffusion machine-learning framework for mapping valence electron distribution from convergent beam electron diffraction

Quantitative convergent beam electron diffraction (CBED) enables determination of aspherical valence electron distributions through refinement of low-order structure factors, which are highly sensitive to chemical bonding and charge density variations. However, conventional quantitative CBED (QCBED) requires solving a highly nonlinear inverse problem with many coupled parameters, and computationally intensive dynamical diffraction calculations, making it time-consuming and difficult to apply to complex systems. More broadly, reconstructing charge density and orbital electron distribution from diffraction data has long been a central challenge in both x-ray and electron crystallography. Here, in this study, we introduce an artificial-intelligence (AI)-based framework that replaces traditional refinement with a data-driven inverse solver. Using a large synthetic CBED dataset generated by Bloch-wave simulations, we train a conditional diffusion model to directly infer crystal structural parameters and multipole density formalism parameters, and hence valence electron distributions, from CBED patterns alone. By learning from forward simulations across realistic parameter space, the model effectively solves the inverse problem. Compared with direct regression approaches, the diffusion-based framework provides posterior parameter distributions for rigorous uncertainty quantification while preserving quantitative fidelity and reducing analysis time by orders of magnitude. By eliminating the need for external single-crystal x-ray diffraction data and complex nonlinear refinement, this approach enables practical, high-throughput, and in situ quantitative CBED, enabling real-time mapping of valence electron distributions and their correlation with functional responses in quantum and energy materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2013

An Efficient Deterministic Parallel Algorithm for Adaptive Multidimensional Numerical Integration on GPUs

Recent development in Graphics Processing Units (GPUs) has enabled a new possibility for highly efficient parallel computing in science and engineering. Their massively parallel architecture makes GPUs very effective for algorithms where processing of large blocks of data can be executed in parallel. Multidimensional integration has important applications in areas like computational physics, plasma physics, computational fluid dynamics, quantum chemistry, molecular dynamics and signal processing. The computationally intensive nature of multidimensional integration requires a high-performance implementation. In this study, we present an efficient deterministic parallel algorithm for adaptive multidimensional numerical integration on GPUs. Various optimization techniques are applied to maximize the utilization of the GPU. GPU-based implementation outperforms the best known sequential methods and achieves a speed-up of up to 100. It also shows good scalability with the increase in dimensionality.

Arumugam, Kamesh↗
NASA NTRS1975

Interstellar reddening and gamma-ray emission as tracers of interstellar matter

It is shown that the gas to dust ratio in our galaxy is almost constant, even in regions of very different densities. The detailed comparison of the latitude distribution of the gamma-ray intensity with reddening data shows that in the solar vicinity the latter gives the best estimate of the total amount of interstellar gas. This conclusion is used to compute the nearby contributions to the gamma-rays longitude distribution observed by SAS II. Some implications for the large scale structure of the galaxy are examined.

Puget, J. L.↗
NASA NTRS1995

Scramjet Performance Assessment Using Water Absorption Diagnostics (U)

Simultaneous multiple path measurements of temperature and H2O concentration will be presented for the AIMHYE test entries in the NASA Ames 16-Inch Shock Tunnel. Monitoring the progress of high temperature chemical reactions that define scramjet combustor efficiencies is a task uniquely suited to nonintrusive optical diagnostics. One application strategy to overcome the many challenges and limitations of nonintrusive measurements is to use laser absorption spectroscopy coupled with optical fibers. Absorption spectroscopic techniques with rapidly tunable lasers are capable of making simultaneous measurements of mole fraction, temperature, pressure, and velocity. The scramjet water absorption diagnostic was used to measure combustor efficiency and was compared to thrust measurements using a nozzle force balance and integrated nozzle pressures to develop a direct technique for evaluating integrated scramjet performance. Tests were initially performed with a diode laser tuning over a water absorption feature at 1391.7 nm. A second diode laser later became available at a wavelength near 1343.3 nm covering an additional water absorption feature and was incorporated in the system for a two-wavelength technique. Both temperature and mole fraction can be inferred from the lineshape analysis using this approach. Additional high temperature spectroscopy research was conducted to reduce uncertainties in the scramjet application. The lasers are optical fiber coupled to ports at the combustor exit and in the nozzle region. The output from the two diode lasers were combined in a single fiber, and the resultant two-wavelength beam was subsequently split into four legs. Each leg was directed through 60 meters of optical fiber to four combustor exit locations for measurement of beam intensity after absorption by the water within the flow. Absorption results will be compared to 1D combustor analysis using RJPA and nozzle CFD computations as well as to data from a nozzle metric balance measuring thrust and integrated pressure measurements along the length of the nozzle. Assessment of its value as a combustor performance evaluation tool will be conducted.

Cavolowsky, John A.↗
DOE OSTI2018

CAT: computer aided triage improving upon the Bayes risk through ε-refusal triage rules

Manual extraction of information from electronic pathology (epath) reports to populate the Surveillance, Epidemiology, and End Result (SEER) database is labor intensive. Systematizing the data extraction automatically using machine-learning (ML) and natural language processing (NLP) is desirable to reduce the human labor required to populate the SEER database and to improve the timeliness of the data. This enables scaling up registry efficiency and collection of new data elements. To ensure the integrity, quality, and continuity of the SEER data, the misclassification error of ML and NPL algorithms needs to be negligible. Current algorithms fail to achieve the precision of human experts who can bring additional information in their assessments. Differences in registry format and the desire to develop a common information extraction platform further complicate the ML/NLP tasks. The purpose of our study is to develop triage rules to partially automate registry workflow to improve the precision of the auto-extracted information. This paper presents a mathematical framework to improve the precision of a classifier beyond that of the Bayes classifier by selectively classifying item that are most likely to be correct. This results in a triage rule that only classifies a subset of the item. We characterize the optimal triage rule and demonstrate its usefulness in the problem of classifying cancer site from electronic pathology reports to achieve a desired precision. From the mathematical formalism, we propose a heuristic estimate for triage rule based on post-processing the soft-max output from standard machine learning algorithms. We show, in test cases, that the triage rule significantly improve the classification accuracy.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2012

Interfractional Dose Variations in Intensity-Modulated Radiotherapy With Breath-Hold for Pancreatic Cancer

Purpose: To investigate the interfractional dose variations for intensity-modulated radiotherapy (RT) combined with breath-hold (BH) at end-exhalation (EE) for pancreatic cancer. Methods and Materials: A total of 10 consecutive patients with pancreatic cancer were enrolled. Each patient was fixed in the supine position on an individualized vacuum pillow with both arms raised. Computed tomography (CT) scans were performed before RT, and three additional scans were performed during the course of chemoradiotherapy using a conventional RT technique. The CT data were acquired under EE-BH conditions (BH-CT) using a visual feedback technique. The intensity-modulated RT plan, which used five 15-MV coplanar ports, was designed on the initial BH-CT set with a prescription dose of 39 Gy at 2.6 Gy/fraction. After rigid image registration between the initial and subsequent BH-CT scans, the dose distributions were recalculated on the subsequent BH-CT images under the same conditions as in planning. Changes in the dose-volume metrics of the gross tumor volume (GTV), clinical target volume (CTV = GTV + 5 mm), stomach, and duodenum were evaluated. Results: For the GTV and clinical target volume (CTV), the 95th percentile of the interfractional variations in the maximal dose, mean dose, dose covering 95% volume of the region of structure, and percentage of the volume covered by the 90% isodose line were within {+-}3%. Although the volume covered by the 39 Gy isodose line for the stomach and duodenum did not exceed 0.1 mL at planning, the volume covered by the 39 Gy isodose line for these structures was up to 11.4 cm{sup 3} and 1.8 cm{sup 3}, respectively. Conclusions: Despite variations in the gastrointestinal state and abdominal wall position at EE, the GTV and CTV were mostly ensured at the planned dose, with the exception of 1 patient. Compared with the duodenum, large variations in the stomach volume receiving high-dose radiation were observed, which might be beyond the negligible range in achieving dose escalation with intensity-modulated RT combined with BH at EE.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
NASA NTRS1994

Dynamic file-access characteristics of a production parallel scientific workload

Multiprocessors have permitted astounding increases in computational performance, but many cannot meet the intense I/O requirements of some scientific applications. An important component of any solution to this I/O bottleneck is a parallel file system that can provide high-bandwidth access to tremendous amounts of data in parallel to hundreds or thousands of processors. Most successful systems are based on a solid understanding of the expected workload, but thus far there have been no comprehensive workload characterizations of multiprocessor file systems. This paper presents the results of a three week tracing study in which all file-related activity on a massively parallel computer was recorded. Our instrumentation differs from previous efforts in that it collects information about every I/O request and about the mix of jobs running in a production environment. We also present the results of a trace-driven caching simulation and recommendations for designers of multiprocessor file systems.

Kotz, David↗
DOE OSTI2014

Petascale Application of a Coupled CPU-GPU Algorithm for Simulation and Analysis of Multiphase Flow Solutions in Porous Medium Systems, In: 2014 IEEE 28th International Parallel and Distributed Processing Symposium

Large-scale simulation can provide a wide range of information needed to develop and validate theoretical models for multiphase flow in porous medium systems. In this paper, we consider a coupled solution in which a multiphase flow simulator is coupled to an analysis approach used to extract the interfacial geometries as the flow evolves. This has been implemented using MPI to target heterogeneous nodes equipped with GPUs. The GPUs evolve the multiphase flow solution using the lattice Boltzmann method while the CPUs compute up scaled measures of the morphology and topology of the phase distributions and their rate of evolution. Our approach is demonstrated to scale to 4,096 GPUs and 65,536 CPU cores to achieve a maximum performance of 244,754 million-lattice-node updates per second (MLUPS) in double precision execution on Titan. In turn, this approach increases the size of systems that can be considered by an order of magnitude compared with previous work and enables detailed in situ tracking of averaged flow quantities at temporal resolutions that were previously impossible. Furthermore, it virtually eliminates the need for post-processing and intensive I/O and mitigates the potential loss of data associated with node failures.

Computer Science↗
DOE OSTI2016

Technical Note: SCUDA: A software platform for cumulative dose assessment

Purpose: Accurate tracking of anatomical changes and computation of actually delivered dose to the patient are critical for successful adaptive radiation therapy (ART). Additionally, efficient data management and fast processing are practically important for the adoption in clinic as ART involves a large amount of image and treatment data. The purpose of this study was to develop an accurate and efficient Software platform for CUmulative Dose Assessment (SCUDA) that can be seamlessly integrated into the clinical workflow. Methods: SCUDA consists of deformable image registration (DIR), segmentation, dose computation modules, and a graphical user interface. It is connected to our image PACS and radiotherapy informatics databases from which it automatically queries/retrieves patient images, radiotherapy plan, beam data, and daily treatment information, thus providing an efficient and unified workflow. For accurate registration of the planning CT and daily CBCTs, the authors iteratively correct CBCT intensities by matching local intensity histograms during the DIR process. Contours of the target tumor and critical structures are then propagated from the planning CT to daily CBCTs using the computed deformations. The actual delivered daily dose is computed using the registered CT and patient setup information by a superposition/convolution algorithm, and accumulated using the computed deformation fields. Both DIR and dose computation modules are accelerated by a graphics processing unit. Results: The cumulative dose computation process has been validated on 30 head and neck (HN) cancer cases, showing 3.5 ± 5.0 Gy (mean±STD) absolute mean dose differences between the planned and the actually delivered doses in the parotid glands. On average, DIR, dose computation, and segmentation take 20 s/fraction and 17 min for a 35-fraction treatment including additional computation for dose accumulation. Conclusions: The authors developed a unified software platform that provides accurate and efficient monitoring of anatomical changes and computation of actually delivered dose to the patient, thus realizing an efficient cumulative dose computation workflow. Evaluation on HN cases demonstrated the utility of our platform for monitoring the treatment quality and detecting significant dosimetric variations that are keys to successful ART.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2019

Optimizing wind farm siting to reduce power system impacts of wind variability

We introduce and solve two variants of a biobjective optimization model to reduce the negative impact of wind variability on the power system by strategically locating wind farms. The first model variant considers average changes in wind power over time; the second captures extreme fluctuations in wind power. A complementary set of wind sites is selected with the aim of minimizing both residual demand and the variability in residual demand. Because exact optimization is computationally intensive, we develop two heuristics—forward and backward greedy algorithms—to find approximate solutions. The results are compared with the exact optimization results for a well-selected subset of the data as well as to the results from selecting sites based on average wind alone. The two models are solved using demand data and potential wind sites for the Southwest Power Pool. Though both objectives can be improved by adding more sites, for a fixed number of sites, minimizing residual demand and variability in residual demand are competing objectives. Here, we find an approximate efficient frontier to compare trade-offs between the two objectives. We also vary the parameter in the heuristic that controls how the two objectives are prioritized. For the case study, the backward greedy algorithm is more effective at reducing the wind power variability than the forward greedy algorithm. Furthermore, using the backward algorithm for the full dataset is more effective than solving the exact optimization on a subset of the data when the results are evaluated using the full dataset.

17 WIND ENERGY↗
DOE OSTI2017

Automatic translation of MPI source into a latency-tolerant, data-driven form

Hiding communication behind useful computation is an important performance programming technique but remains an inscrutable programming exercise even for the expert. We present Bamboo, a code transformation framework that can realize communication overlap in applications written in MPI without the need to intrusively modify the source code. Bamboo reformulates MPI source into the form of a task dependency graph that expresses a partial ordering among tasks, enabling the program to execute in a data-driven fashion under the control of an external runtime system. Experimental results demonstrate that Bamboo significantly reduces communication delays while requiring only modest amounts of programmer annotation for a variety of applications and platforms, including those employing co-processors and accelerators. Moreover, Bamboo's performance meets or exceeds that of labor-intensive hand coding. The translator is more than a means of hiding communication costs automatically; it demonstrates the utility of semantic level optimization against a wellknown library.

Communication-computation↗
NASA NTRS1994

Fatigue crack growth in 2024-T3 aluminum under tensile and transverse shear stresses

The influence of transverse shear stresses on the fatigue crack growth rate in thin 2024-T3 aluminum alloy sheets is investigated experimentally. The tests are performed on double-edge cracked sheets in cyclic tensile and torsional loading. This loading generates crack tip stress intensity factors in the same ratio as the values computed for a crack lying along a lap joint in a pressurized aircraft fuselage. The relevant fracture mechanics of cracks in thin plates along with the details of the geometrically nonlinear finite element analyses used for the test specimen calibration are developed and discussed. Preliminary fatigue crack growth data correlated using the fully coupled stress intensity factor calibration are presented and compared with fatigue crack growth data from pure delta K(sub I)fatigue tests.

Viz, Mark J.↗
DOE OSTI2022

Experimental measurements of fluid flow in an 84-pin hexagonal rod bundle with spacer grid for a gas-cooled fast modular reactor

A 50 MW e helium-cooled fast modular reactor (FMR) is under development, and as part of the Department of Energy Integrated Research Project (IRP), Texas A&M University is conducting the thermal-hydraulic characterization of its baseline core configuration. Here, we experimentally investigated the axial and cross flow fields characteristics in the hexagonal fuel rod bundle composed of 84 rods, a central rod, and spacer grids at a Reynolds number of 12,000. A fully transparent experimental facility resembling of one unit of the fuel assembly was constructed. Time-resolved particle image velocimetry (TR-PIV) measurements were performed to characterize hydraulic behavior downstream the spacer grid. Velocity measurements were conducted in the axial and radial direction of the rod bundle. From the PIV velocity vector fields, the full-field flow statistics were computed for the mean velocity, vorticity, and Reynolds stresses. An analysis of the energy decay downstream of the spacer grid was conducted with calculations of secondary-flow intensities, turbulent kinetic energy, power spectrum, and spatial-temporal velocity cross correlations. The vorticity field was obtained and pairs of counter-rotating vortexes were identified using a 3D reconstruction of several measurement planes. The data from this experimental campaign will be used to validate numerical models based on Computational Fluid Dynamics and other codes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2011

CHALLENGES IN DATA INTENSIVE ANALYSIS AT SCIENTIFIC EXPERIMENTAL USER FACILITIES

This chapter will discuss the critical data intensive analysis and visualiza-tion challenges faced by the experimental science community at large scale and laboratory based facilities. The chapter will further highlight initial solutions under development through community efforts and lay out perspectives for the future, such as the potential of more closely linked experimental and computational science approaches, methods to achieve real time analysis capabilities and the challenges and opportunities of data integration across experimental scales, levels of theory and varying techniques.

Chemical Imaging↗
DOE OSTI2024

Efficient mapping between void shapes and stress fields using Deep Convolutional Neural Networks with sparse data

Establishing fast and accurate structure-to-property relationships is an important component in the design and discovery of advanced materials. Physics-based simulation models like the finite element method (FEM) are often used to predict deformation, stress, and strain fields as a function of material microstructure in material and structural systems. Such models may be computationally expensive and time intensive if the underlying physics of the system is complex. This limits their application to solve inverse design problems and identify structures that maximize performance. In such scenarios, surrogate models are employed to make the forward mapping computationally efficient to evaluate. However, the high dimensionality of the input microstructure and the output field of interest often renders such surrogate models inefficient, especially when dealing with sparse data. Deep convolutional neural network (CNN) based surrogate models have shown great promise in handling such high-dimensional problems. In this paper, a single ellipsoidal void structure under a uniaxial tensile load represented by a linear elastic, high-dimensional and expensive-to-query, FEM model. We consider two deep CNN architectures, a modified convolutional autoencoder framework with a fully connected bottleneck and a UNet CNN, and compare their accuracy in predicting the von Mises stress field for any given input void shape in the FEM model. Additionally, a sensitivity analysis study is performed using the two approaches, where the variation in the prediction accuracy on unseen test data is studied through numerical experiments by varying the number of training samples from 20 to 100.

surrogate modeling; convolutional neural networks;↗
DOE OSTI2021

A HPC Theory-Guided Machine Learning Cyberinfrastructure for Communicating Hydrometeorological Data Across Scales

High-resolution predictions of hydrometeorological variables are critical for supporting hydropower generation decisions and flood control at hydroelectric power plants. Traditional climate and hydrologic models rely on the numerical simulation of detailed physical processes. Therefore, running these simulations is time-, labor-, and computation-intensive. Improving the spatial and temporal resolution in these modeling outputs could lead to cubic increases in both the simulation time and computational demands, rendering high-resolution hydrometeorological predictions expensive and impractical. Many past studies apply the super resolution (SR) technique to downscale climate models using deep learners. However, deep learners are deemed “black-boxes,” as their derivation processes from low-resolution outputs to high-resolution outputs are often hidden. Their results are difficult for domain scientists to interpret and validate. Thus, there is a need for an exploratory machine learning approach that can partially integrate domain-specific theory and knowledge into the data-driven mapping process between simulation outputs of different spatial scales. The domain-specific theory and knowledge can be incorporated into the data model through an inductive approach in which process-related environmental variables are used and analyzed as key drivers (i.e., environmental surrogates) to reflect the complex physical processes. Many of these variables, such as land use land cover, soil types, topography, digital elevation, air temperature, and various watershed characteristics, can be directly measured through sensors or remote sensing techniques. Additionally, SR applications that can downscale hydrological and hydrodynamics models to efficiently produce high-resolution (1 m) flood depth grids are still rare. Since the flood depth grid can be used to support critical decisions for flood control operation at hydroelectric power plants, it is crucial to enable an SR-based capability for interpolating high-resolution flood inundation maps.

13 HYDRO ENERGY↗