Search NASA⌕ Search

SEARCH · Search NASA

Results for “data transfer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Quantitative Mapping of Nanoscale Chemical Dynamics in Sub-sampled Operando (S)TEM Images Using Spatio-Temporal Analytics

One of the main limitations in the use of operando scanning transmission electron microscopes to study dynamic chemical processes is the effect of the electron beam on the kinetics of the reaction being observed. Here we demonstrate that a flexible Gaussian mixture model can be used to extract quantitative information directly from sub-sampled images, i.e.~images where not all the pixels in the image are illuminated with the beam. The use of this method is demonstrated for the charge/discharge cycle of a Li-battery, where the deposition and dissolution of Li at the anode can be accurately quantified for sub-sampling levels down to 1%. Performing operando imaging using a small fraction of the pixels means that the observations can significantly reduce the effect of the beam, automatically increase the imaging speed and decrease the total data transfer rate required. Such new software capabilities offer the potential to significantly widen the application of operando hardware approaches to study nanoscale dynamics in materials.

Stanfill, Bryan A.↗

Analyzing Data Movements and Identifying Techniques for Next-generation High-bandwidth Networks

High-bandwidth networks are poised to provide new opportunities in tackling large data challenges in today's scientific applications. However, increasing the bandwidth is not sufficient by itself; we need careful evaluation of future high-bandwidth networks from the applications’ perspective. We have investigated data transfer requirements of climate applications as a typical scientific example and evaluated how the scientific community can benefit from next generation high-bandwidth networks. We have experimented with current state-of-the-art data movement tools, and realized that there is no single solution for presetting transfer parameters for optimal use of the available bandwidth. Thus, we developed an adaptive transfer methodology for tuning and optimization in wide-area data transfers. This worked well with large files. However, typical scientific datasets may include many small files. Current filecentric data transfer protocols do not perform well with managing the transfer of small files, even when using parallel streams or concurrent transfers over high bandwidth networks. In order to overcome this problem, we develop a new block-based data movement method (in contrast to the current file-based methods) to improve data movement performance and efficiency in moving large scientific datasets that contain many small files. We implemented the new block-based data movement tool, which takes the approach of aggregating files into blocks and providing dynamic data channel management. In our work, we also realized that one of the major obstacles in use of high-bandwidth networks is the limitation in host system resources. 100Gbps is beyond the capacity of today’s commodity machine, since we need substantial amount of processing power and involvement of multiple cores to fill a 40Gbps or 100Gbps network. As a result, host system performance plays an important role in the use of highbandwidth networks. We have conducted a large number of experiments with our new block-based method and with current available file-based data movement tools. In this white paper, we describe future research problems and challenges for efficient use of next-generation science networks, based on the lessons learnt and the experiences gained with 100Gbps network applications.

100Gbps network applications↗

Advance reservation access control using software-defined networking and tokens

Advance reservation systems allow users to reserve dedicated bandwidth connection resources from advanced high-speed networks. A common use case for such systems is data transfers in distributed science environments in which a user wants exclusive access to the reservation. However, current advance network reservation methods cannot ensure exclusive access of a network reservation to the specific flow for which the user made the reservation. We present here a novel network architecture that addresses this limitation and ensures that a reservation is used only by the intended flow. We achieve this by leveraging software-defined networking (SDN) and token-based authorization. We use SDN to orchestrate and automate the reservation of networking resources, end-to-end and across multiple administrative domains, and tokens to create a strong binding between the user or application that requested the reservation and the flows provisioned by SDN. We conducted experiments on the ESNet 100G SDN testbed, and demonstrated that our system effectively protects authorized flows from competing traffic in the network.

admission control↗

SU-G-TeP4-11: Implementation of a Non-Measurement-Based Patient-Specific IMRT QA Program

Purpose: To implement a comprehensive non-measurement-based verification program for patient-specific IMRT QA Methods: Based on published guidelines, a robust IMRT QA program should assess the following components: 1) accuracy of dose calculation, 2) accuracy of data transfer from the treatment planning system (TPS) to the record-and-verify (RV) system, 3) treatment plan deliverability, and 4) accuracy of plan delivery. Results: We have implemented an IMRT QA program that consist of four components: 1) an independent re-calculation of the dose distribution in the patient anatomy with a commercial secondary dose calculation program: Mobius3D (Mobius Medical Systems, Houston, TX), with dose accuracy evaluation using gamma analysis, PTV mean dose, PTV coverage to 95%, and organ-at-risk mean dose; 2) an automated in-house-developed plan comparison system that compares all relevant plan parameters such as MU, MLC position, beam iso-center position, collimator, gantry, couch, field size settings, and bolus placement, etc. between the plan and the RV system; 3) use of the RV system to check the plan deliverability and further confirm using “mode-up” function on treatment console for plans receiving warning; and 4) implementation of a comprehensive weekly MLC QA, in addition to routine accelerator monthly and daily QA. Among 1200 verifications, there were 9 cases of suspicious calculations, 5 cases of delivery failure, no data transfer errors, and no failure of weekly MLC QA. These 9 suspicious cases were due to the PTV extending to the skin or to heterogeneity correction effects, which would not have been caught using phantom measurement-based QA. The delivery failure was due to the rounding variation of MLC position between the planning system and RV system. Conclusion: A very efficient, yet comprehensive, non-measurement-based patient-specific QA program has been implemented and used clinically for about 18 months with excellent results.

60 APPLIED LIFE SCIENCES↗

Marangoni Effects on Near-Bubble Microscale Transport During Boiling of Binary Fluid Mixtures

In earlier investigations, Marangoni effects were observed to be the dominant mechanism of boiling transport in 2-propanol/water mixtures under reduced gravity conditions. In this investigation we have examined the mechanisms of binary mixture boiling by exploring the transport near a single bubble generated in a binary mixture between a heated surface and cold surface. The temperature field created in the liquid around the bubble produces vaporization over the portion of its interface near the heated surface and condensation over portions of its interface near the cold surface. Experiments were conducted using different mixtures of water and 2-propanol under 1g conditions and under reduced gravity conditions aboard the KC135 aircraft. Since 2-propanol is more volatile than water, there is a lower concentration of 2-propanol near the hot surface and a higher concentration of 2-propanol near the cold plate relative to the bulk quantity. This difference in interface concentration gives rise to strong Marangoni effects that move liquid toward the hot plate in the near bubble region for 2-propanol and water mixtures. In the experiments in this study, the pressure of the test system was maintained at about 5 kPa to achieve the full spectrum of boiling behavior (nucleate boiling, critical heat flux and film boiling) at low temperature and heat flux levels. Heat transfer data and visual documentation of the bubble shape were extracted from the experimental results. In the 1-g experiments at moderate to high heat flux levels, the bubble was observed to grow into a mushroom shape with a larger top portion near the cold plate due to the buoyancy effect. The shape of the bubble was somewhat affected by the cold plate subcooling and the superheat of the heated surface. At low superheat levels for the heated surface, several active nucleation sites were observed, and the vapor stems from them merged to form a larger bubble. The generation rate of vapor is moderate in this regime and the bubble shape is cylindrical in appearance. In some instances, the bubble interface appeared to oscillate. At higher applied heat flux levels, the top of the bubble became larger, apparently to provide more condensing interface area adjacent to the cold plate. Increasing the applied heat flux ultimately led to dry-out of the heated surface, with conditions just prior to dryout corresponding to the maximum heat flux (CHF). A more stable bubble was observed when the system attained the minimum heat flux (for film boiling). In this regime, most of the surface under the bottom of the bubble was dry with nucleate boiling sometimes occuring around the contact perimeter of the bubble at heated surface. Different variations (e.g. gap between two plates, molar concentration of the liquid mixture) of the experiments were examined to determine parametric effects on the boiling process and to determine the best conditions for the KC135 reduced gravity tests. Variation of the gap was found to have a minor impact on the CHF. However, reducing the gap between the hot and cold surface was observed to significantly reduce the minimum heat flux for fixed molar concentration of 2-propanol. In the reduced gravity experiments aboard the KC135 aircraft, the bubble formed in the 6.4 mm gap was generally cylindrical or barrel shaped and it increased its extent laterally as the surface superheat increased. In reduced gravity experiments, dryout of the heated surface under the bubble was observed to occur at a lower superheated temperature than for 1g conditions. Observed features of the boiling process and heat transfer data under reduced gravity will be discussed in detail. The results of the reduced gravity experiments will also be compared to those obtained in comparable 1g experiments. In tandem with the experiments we are also developing a computational model of the transport in the liquid surrounding the bubble during the boiling process. The computational model uses a level set method to model motion of the interface. It will incorporate a macroscale treatment of the transport in the liquid gap between the surfaces and a microscale treatment of transport in the regions between the bubble interface and the solid surfaces. The features of the model will be described in detail. Future research directions suggested by the results to date will also be discussed.

V. Carey↗

Measurement-based performance profiles and dynamics of UDT over dedicated connections

Wide-area data transfers in high-performance computing and big data scenarios are increasingly being carried over dedicated network connections that provide high capacities at low loss rates. UDP-based transport protocols are expected to be particularly well-suited for such transfers but their performance is relatively unexplored over a wide range of connection lengths, compared to TCP over shared connections. We present extensive throughput measurements of UDP-based Data Transfer (UDT) over a suite of physical and emulated 10 Gbps connections. In sharp contrast to current UDT analytical models, these measurements indicate much more complex throughput dynamics that are sensitive to the connection modality, protocol parameters, and round-trip times. Lyapunov exponents estimated from the Poincare maps of UDT traces clearly indicate regions of instability and complex dynamics. We propose a simple model based on the ramp-up and sustainment regimes of a generic transport protocol, which qualitatively illustrates the dominant monotonicity and concavity properties of throughput profiles and relates them to Lyapunov exponents. These measurements and analytical results together enable us to comprehensively evaluate UDT performance and select parameters to achieve high throughput, and they also provide guidelines for designing effective transport protocols for dedicated connections.

Foster, Ian↗

SU-E-J-199: A Software Tool for Quality Assurance of Online Replanning with MR-Linac

Purpose: To develop a quality assurance software tool, ArtQA, capable of automatically checking radiation treatment plan parameters, verifying plan data transfer from treatment planning system (TPS) to record and verify (R&V) system, performing a secondary MU calculation considering the effect of magnetic field from MR-Linac, and verifying the delivery and plan consistency, for online replanning. Methods: ArtQA was developed by creating interfaces to TPS (e.g., Monaco, Elekta), R&V system (Mosaiq, Elekta), and secondary MU calculation system. The tool obtains plan parameters from the TPS via direct file reading, and retrieves plan data both transferred from TPS and recorded during the actual delivery in the R&V system database via open database connectivity and structured query language. By comparing beam/plan datasets in different systems, ArtQA detects and outputs discrepancies between TPS, R&V system and secondary MU calculation system, and delivery. To consider the effect of 1.5T transverse magnetic field from MR-Linac in the secondary MU calculation, a method based on modified Clarkson integration algorithm was developed and tested for a series of clinical situations. Results: ArtQA is capable of automatically checking plan integrity and logic consistency, detecting plan data transfer errors, performing secondary MU calculations with or without a transverse magnetic field, and verifying treatment delivery. The tool is efficient and effective for pre- and post-treatment QA checks of all available treatment parameters that may be impractical with the commonly-used visual inspection. Conclusion: The software tool ArtQA can be used for quick and automatic pre- and post-treatment QA check, eliminating human error associated with visual inspection. While this tool is developed for online replanning to be used on MR-Linac, where the QA needs to be performed rapidly as the patient is lying on the table waiting for the treatment, ArtQA can be used as a general QA tool in radiation oncology practice. This work is partially supported by Elekta Inc.

60 APPLIED LIFE SCIENCES↗

Forecasting Responses of a Northern Peatland Carbon Cycle to Elevated CO 2 and a Gradient of Experimental Warming

The ability to forecast ecological carbon cycling is imperative to land management in a world where past carbon fluxes are no longer a clear guide in the Anthropocene. However, carbon–flux forecasting has not been practiced routinely like numerical weather prediction. This study explored (1) the relative contributions of model forcing data and parameters to uncertainty in forecasting flux– versus pool–based carbon cycle variables and (2) the time points when temperature and CO 2 treatments may cause statistically detectable differences in those variables. We developed an online forecasting workflow (Ecological Platform for Assimilation of Data (EcoPAD)), which facilitates iterative data–model integration. EcoPAD automates data transfer from sensor networks, data assimilation, and ecological forecasting. We used the Spruce and Peatland Responses Under Changing Experiments data collected from 2011 to 2014 to constrain the parameters in the Terrestrial Ecosystem Model, forecast carbon cycle responses to elevated CO 2 and a gradient of warming from 2015 to 2024, and specify uncertainties in the model output. Our results showed that data assimilation substantially reduces forecasting uncertainties. Interestingly, we found that the stochasticity of future external forcing contributed more to the uncertainty of forecasting future dynamics of C flux–related variables than model parameters. However, the parameter uncertainty primarily contributes to the uncertainty in forecasting C pool–related response variables. Given the uncertainties in forecasting carbon fluxes and pools, our analysis showed that statistically different responses of fast–turnover pools to various CO 2 and warming treatments were observed sooner than slow–turnover pools. In conclusion, our study has identified the sources of uncertainties in model prediction and thus leads to improve ecological carbon cycling forecasts in the future.

54 ENVIRONMENTAL SCIENCES↗

Enabling Low-Overhead HT-HPC Workflows at Extreme Scale using GNU Parallel

GNU Parallel is a versatile and powerful tool for process parallelization widely used in scientific computing. This paper demonstrates its effective application in high-performance computing (HPC) environments, particularly focusing on its scalability and efficiency in executing large-scale high-throughput high-performance computing (HT-HPC) workflows. Through real-world examples, we highlight GNU Parallel’s performance across various HPC workloads, including GPU computing, container-based workloads, and node-local NVMe storage. Our results on two leading supercomputers, OLCF’s Frontier and NERSC’s Perlmutter, showcase GNU Parallel’s rapid process dispatching ability and its capacity to maintain low overhead even at extreme scales. We explore GNU Parallel’s application in massive parallel file transfers using a scheduled Data Transfer Node (DTN) cluster, emphasizing its broad utility in diverse scientific workflows. Beyond its direct application as a viable workflow manager, GNU Parallel can be employed in conjunction with other workflow systems as a "last-mile" parallelizing driver and as a quick prototyping tool to design and extract parallel profiles from application executions. We then argue that the potential for GNU Parallel to transform workflow management at extreme scales is substantial, paving the way for more efficient and effective scientific discoveries.

Maheshwari, Ketan↗

Interactive data line study and experiment

The paper considers the utility of having remote terminals on a Landsat image processing system and the development of efficient data transfer strategies such as data compression. The approach is to link an image processing terminal (located in a mobile van) to a multiuser host computer via the Communications Technology Satellite and a leased phone line. The host computer will share time between the remote state users and local users. The terminal includes a minicomputer, a color video display, and a communications interface, and the user has access to all of the resources of the host facility via the data link. While at present the terminal acts in the display-only mode, the computing capability of the terminal can be varied from display-only up to a stand-alone image processing system. An analysis of trade-offs between data link and remote terminal capacities is described with attention to the evaluation of the system by state users and the selection of a system architecture suitable to unique needs.

Rasmussen, D. N.↗

Aerodynamic heating to representative SRB and ET protuberances

Heating data and data scaling methods which can be used on representative solid rocket booster and external tank (ET) protuberances are described. Topics covered include (1) ET geometry and heating points; (2) interference heating test data (51A); (3) heat transfer data from tests FH-15 and FH-16; (4) individual protuberance data; and (5) interference heating of paint data from test IH-42. A set of drawings of the ET moldline and protuberances is included.

Engel, C. D.↗

Turbulence modeling in shock wave/turbulent boundary layer interactions

The research performed was an experimental program to help develop turbulence models for shock wave boundary layer interactions. The measurements were taken in a Mach 3, 16 deg compression corner interaction, at a unit Reynolds number of 63 x 10(exp 6)/m. The data consisted of heat transfer data taken upstream and downstream of the interaction, hot wire measurements of the instantaneous temperature and velocity fluctuations to verify the Strong Reynolds Analogy, and single- and double-pulsed Rayleigh scattering images to study the development of the instantaneous shock/turbulence interaction.

Smits, A. J.↗

A Data Parallel Multizone Navier-Stokes Code

We have developed a data parallel multizone compressible Navier-Stokes code on the Connection Machine CM-5. The code is set up for implicit time-stepping on single or multiple structured grids. For multiple grids and geometrically complex problems, we follow the "chimera" approach, where flow data on one zone is interpolated onto another in the region of overlap. We will describe our design philosophy and give some timing results for the current code. The design choices can be summarized as: 1. finite differences on structured grids; 2. implicit time-stepping with either distributed solves or data motion and local solves; 3. sequential stepping through multiple zones with interzone data transfer via a distributed data structure. We have implemented these ideas on the CM-5 using CMF (Connection Machine Fortran), a data parallel language which combines elements of Fortran 90 and certain extensions, and which bears a strong similarity to High Performance Fortran (HPF). One interesting feature is the issue of turbulence modeling, where the architecture of a parallel machine makes the use of an algebraic turbulence model awkward, whereas models based on transport equations are more natural. We will present some performance figures for the code on the CM-5, and consider the issues involved in transitioning the code to HPF for portability to other parallel platforms.

Jespersen, Dennis C.↗

Scientist-Stakeholder Relationships Drive Carbon Data Product Transfer Effectiveness within NASA Program

Carbon cycle science is at the heart of research on global climate change and its long-term impacts, as it examines the exchange of carbon between the atmosphere, oceans, land, and the impact of fossil fuel emissions on this cycling. Given the urgency of the climate challenge, NASA’s Carbon Monitoring System (CMS) requires all funded investigators to identify and work with stakeholder organizations at project inception to accelerate the transfer of the products developed by funded research into decision making systems. In this study, we contribute to the literature through the implementation of a quantitative analysis of 908 unique survey responses from funded investigators to explore the maturity of the scientist-stakeholder engagement. The paper employs multiple correspondence analysis to provide evidence to support policy options to increase stakeholder integration into research programs. Despite limitations of the dataset used, we demonstrated that multiple funding rounds, long-standing relationships between the stakeholder and scientist, and the scientific productivity of the PI, including the ability to produce datasets and research papers on these datasets, all contribute to carbon products moving from research to operational use. The maturity of relationships between scientists and stakeholders was shown to result improved stakeholder engagement. The use of carbon products should be identified in every stage of the program, and that capacity building is needed to support both existing and newly identified stakeholders better understand and use CMS products. As Federal, State, and local policy on climate adaptation and mitigation matures, the need for information on carbon will expand. Building of stakeholder-scientist relationships in CMS results in an effective generation and use of datasets to support this need and prototype ways that improved information needed for decision making can be created.

Monitoring↗

Scientist-Stakeholder Relationships Drive Carbon Data Product Transfer Effectiveness within NASA Program

Carbon cycle science is at the heart of research on global climate change and its long-term impacts, as it examines the exchange of carbon between the atmosphere, oceans, land, and the impact of fossil fuel emissions on this cycling. Given the urgency of the climate challenge, NASA's Carbon Monitoring System (CMS) requires all funded investigators to identify and work with stakeholder organizations at project inception to accelerate the transfer of the products developed by funded research into decision making systems. In this study, we contribute to the literature through the implementation of a quantitative analysis of 908 unique survey responses from funded investigators to explore the maturity of the scientist-stakeholder engagement. The paper employs multiple correspondence analysis to provide evidence to support policy options to increase stakeholder integration into research programs. Despite limitations of the dataset used, we demonstrated that multiple funding rounds, long-standing relationships between the stakeholder and scientist, and the scientific productivity of the Principal Investigator, including the ability to produce datasets and research papers on these datasets, all contribute to carbon products moving from research to operational use. The maturity of relationships between scientists and stakeholders was shown to result improved stakeholder engagement. The use of carbon products should be identified in every stage of the program, and that capacity building is needed to support both existing and newly identified stakeholders better understand and use CMS products. As federal, state, and local policy on climate adaptation and mitigation matures, the need for information on carbon will expand. Building of stakeholder-scientist relationships in CMS results in an effective generation and use of datasets to support this need and prototype ways that improved information needed for decision making can be created.

Molly E Brown↗

An Overview of NASA’s Airborne and Field Data Resource Center

A key recommendation from NASA’s 2022 Airborne and Field Data Workshop called for the development of a virtual Resource Center for all stakeholders across the data lifecycle of airborne and field Earth observations. The agency’s Earth Science Data and Information System (ESDIS) Project and Airborne Data Management Group (ADMG) have worked in concert to establish the newly launched NASA Airborne and Field Data Resource Center (AFDRC) to provide a single entry point for a wide assortment of information on and the effective, responsible stewardship of non-satellite observational data. The AFDRC compiles access to many existing resources, but does so in a newly organized way that integrates availability to increase efficiency and holistic understanding while simplifying users’ experience. Initially launched in fall of 2023, the AFDRC is a NASA Earthdata domain website that clarifies several previously disparate resources and provides newly updated information, including: Learning Resources: Educational resources to broaden understanding of the role airborne and field observations play in advancing understanding of our planet and NASA’s role in collecting and archiving these data. Support for data users to Find and Access Data: Advanced contextual browse/search capabilities that efficiently link researchers to data products suitable for their science objectives - this includes linking to NASA’s Catalog of Archived Suborbital Earth Science Investigations (CASEI). Working with Data: Tools specific to individual types of suborbital Earth Science data and their (inter-)disciplinary communities to provide access as well as guidance for their application. Stewardship Responsibilities: Resources for data producers with to lessen requirement burdens at the time of data transfer, and information for data stewards with consistent, authoritative guidance on best practices and agency- and/or community- specific archival procedures. This presentation will give an overview of the motivation for NASA’s AFDRC, approach for the design and content, iterative community-driven improvements, promote the use of the AFDRC, and solicit additional feedback from airborne and field data user communities.

Sara Lubkin↗