Search NASA⌕ Search

SEARCH · Search NASA

Results for “complexity management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A Case Study of Multimodal, Multi-institutional Data Management for the Combinatorial Materials Science Community

Although the convergence of high-performance computing, automation, and machine learning has significantly altered the materials design timeline, transformative advances in functional materials and acceleration of their design will require addressing the deficiencies that currently exist in materials informatics, particularly a lack of standardized experimental data management. The challenges associated with experimental data management are especially true for combinatorial materials science, where advancements in automation of experimental workflows have produced datasets that are often too large and too complex for human reasoning. The data management challenge is further compounded by the multimodal and multi-institutional nature of these datasets, as they tend to be distributed across multiple institutions and can vary substantially in format, size, and content. Furthermore, modern materials engineering requires the tuning of not only composition but also of phase and microstructure to elucidate processing–structure–property–performance relationships. To adequately map a materials design space from such datasets, an ideal materials data infrastructure would contain data and metadata describing (i) synthesis and processing conditions, (ii) characterization results, and (iii) property and performance measurements. In this work, we present a case study for the low-barrier development of such a dashboard that enables standardized organization, analysis, and visualization of a large data lake consisting of combinatorial datasets of synthesis and processing conditions, X-ray diffraction patterns, and materials property measurements generated at several different institutions. While this dashboard was developed specifically for data-driven thermoelectric materials discovery, we envision the adaptation of this prototype to other materials applications, and, more ambitiously, future integration into an all-encompassing materials data management infrastructure.

36 MATERIALS SCIENCE↗
DOE OSTI2025

LANL Meteorology Program Self-Assessment 2025 Update

The LANL Meteorological (Met) Program has been subject to several external reviews over the past 19 years. The DOE Meteorological Coordinating Council (DMCC) conducted an initial Met Program Site Assist Visit (SAV) in August 2006 (DMCC 2006). A follow-up SAV in August 2015 assessed progress (DMCC 2015), and in June 2023, the DOE Meteorological Subcommittee (DMSC), successor to the DMCC, conducted a second follow-up SAV (DMSC 2023), in which the Met Program was evaluated relative to the following 8 high-level questions: • What is the state of the meteorological services provided to its customers? • What is the quality of meteorological data provided to its customers and is it adequate and available to meet all customer needs? • What is the quality of atmospheric transport and diffusion modeling provided to its customers and is it applicable to complex wind flow patterns at LANL? • Are the current and future meteorological service customers being serviced appropriately? • Are there adequate human resources to meet present and future program customer needs and are they being appropriately leveraged? • Are existing instrumentation, facilities, and systems adequate to meet present and future customer needs? • Are LANL meteorological services conducted in an efficient, cost-effective manner? • Is meteorological data used to ensure safety & health of LANL personnel? More specific evaluations were performed relative to 23 performance objectives extracted from the ANSI/ANS-3.11- 2024 national standard and 14 separate performance objectives associated with consequence assessment and atmospheric transport and diffusion modeling in the consequence assessment element of DOE G 151.1-1B. In 2023, the DMSC SAV Team also reviewed the status of each of the 18 remaining recommendations from its 2015 SAV. Based on this review, DMSC stated in its Exit Briefing that the LANL meteorological program has gotten much stronger and more robust since 2015 and now represents one of the better managed programs within the DOE complex.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2009

Using Coupled Models to Study the Effects of River Discharge on Biogeochemical Cycling and Hypoxia in the Northern Gulf of Mexico

We describe emerging capabilities to understand physical processes and biogeoehemical cycles in coastal waters through the use of satellites, numerical models, and ship observations. Emerging capabilities provide significantly improved ability to model ecological systems and the impact of environmental management actions on them. The complex interaction of physical and biogeoehemical processes responsible for hypoxic events requires an integrated approach to research, monitoring, and modeling in order to fully define the processes leading to hypoxia. Our efforts characterizes the carbon cycle associated with river plumes and the export of organic matter and nutrients form coastal Louisiana wetlands and embayments in a spatially and temporally intensive manner previously not possible. Riverine nutrients clearly affect ecosystems in the northern Gulf of Mexico as evidenced in the occurrence of regional hypoxia events. Less known and largely unqualified is the export of organic matter and nutrients from the large areas of disappearing coastal wetlands and large embayments adjacent to the Louisiana Continental Shelf. This project provides new methods to track the river plume along the shelf and to estimate the rate of export of suspended inorganic and organic paniculate matter and dissolved organic matter form coastal habitats of south Louisiana.

COUPLED MODEL↗
NASA NTRS2014

Evolution of Software-Only-Simulation at NASA IV and V

Software-Only-Simulations have been an emerging but quickly developing field of study throughout NASA. The NASA Independent Verification Validation (IVV) Independent Test Capability (ITC) team has been rapidly building a collection of simulators for a wide range of NASA missions. ITC specializes in full end-to-end simulations that enable developers, VV personnel, and operators to test-as-you-fly. In four years, the team has delivered a wide variety of spacecraft simulations that have ranged from low complexity science missions such as the Global Precipitation Management (GPM) satellite and the Deep Space Climate Observatory (DSCOVR), to the extremely complex missions such as the James Webb Space Telescope (JWST) and Space Launch System (SLS).This paper describes the evolution of ITCs technologies and processes that have been utilized to design, implement, and deploy end-to-end simulation environments for various NASA missions. A comparison of mission simulators are discussed with focus on technology and lessons learned in complexity, hardware modeling, and continuous integration. The paper also describes the methods for executing the missions unmodified flight software binaries (not cross-compiled) for verification and validation activities.

Embedded↗
NASA NTRS2015

Dynamic Emulation of NASA Missions for IVandV: A Case Study of JWST and SLS

Software-Only-Simulations are an emerging but quickly developing field of study throughout NASA. The NASA Independent Verification Validation (IVV) Independent Test Capability (ITC) team has been rapidly building a collection of simulators for a wide range of NASA missions. ITC specializes in full end-to-end simulations that enable developers, VV personnel, and operators to test-as-you-fly. In four years, the team has delivered a wide variety of spacecraft simulations ranging from low complexity science missions such as the Global Precipitation Management (GPM) satellite and the Deep Space Climate Observatory (DSCOVR), to the extremely complex missions such as the James Webb Space Telescope (JWST) and Space Launch System (SLS).

Emulation↗
NASA NTRSDate not supplied

Preliminary Evaluation of National Campaign Scenarios for Urban Air Mobility

Urban Air Mobility and Advanced Air Mobility concepts offer a novel method for transportation of passengers and cargo. Whereas the concept may reduce congestion of roads and highways, it also introduces new complexity to the National Airspace in terms of management of such operations. NASA, in partnership with FAA and industry, approaches these complexities with research and development activities such as flight tests and simulations, in order to better understand the impacts and necessary mechanisms by which these operations could be integrated. One example of such research and development activity that NASA is conducting is the Advanced Air Mobility National Campaign effort. Flight-test scenarios were proposed as part of the National Campaign and tested in simulation for evaluation with industry partners prior to the Flight test. This simulation, exercised as an engineering evaluation, provided a data collection opportunity to better understand what iterations and modifications would be needed to successfully demonstrate the flight-test scenarios in order to mature the concept of Urban Air Mobility and Advanced Air Mobility.

urban air mobility↗
NASA NTRSDate not supplied

Preliminary Evaluation of National Campaign Scenarios for Urban Air Mobility

Urban Air Mobility and Advanced Air Mobility concepts offer a novel method for transportation of passengers and cargo. Whereas the concept may reduce congestion of roads and highways, it also introduces new complexity to the National Airspace in terms of management of such operations. NASA, in partnership with FAA and industry, approaches these complexities with research and development activities such as flight tests and simulations, in order to better understand the impacts and necessary mechanisms by which these operations could be integrated. One example of such research and development activity that NASA is conducting is the Advanced Air Mobility National Campaign effort. Flight-test scenarios were proposed as part of the National Campaign and tested in simulation for evaluation with industry partners prior to the Flight test. This simulation, exercised as an engineering evaluation, provided a data collection opportunity to better understand what iterations and modifications would be needed to successfully demonstrate the flight-test scenarios in order to mature the concept of Urban Air Mobility and Advanced Air Mobility.

Urban Air Mobility↗
NASA NTRS1993

Planning: Management of predictability and uncertainty and keeping abreast of developments

The purpose of this study is to propose method to set up and control of a space mission plan such as that of the HERMES spaceplane. The interest of this subject, other than its complexity, is due to the need to manage imprecision and uncertainty during a mission, as well as changes in between missions. Under these conditions, the set up and control of a flight plan require certain special attention and this has led us to define a certain number of qualities: mastery of complexity in order to resolve conflicts between activities: configuration, resource and time management; consideration of various criteria such as risk minimization or the attainment of mission objectives; robustness and flexibility to allow for hazards and deviations from the norm during operation without having to draw up new plans; aptness for replanning by making changes to the plan without having to set up the whole plan again; and memorization and explanation facility in order to manage developments between missions.

Bastien-Thiry, Christophe↗
NASA NTRS2024

Launch Complex 39B, SWMU 009, 2023 Performance Monitoring and Air Sparge Expansion Construction Completion Report, Kennedy Space Center, Florida

The 2023 Performance Monitoring and Construction Completion Report (PM-CCR) presents the findings, observations, and results for Air Sparging (AS) operations and expansion activities, as well as sitewide groundwater monitoring for Launch Complex 39B (LC39B), Solid Waste Management Unit (SWMU) 009, at Kennedy Space Center (KSC), Florida. The reporting period for activities covered under this PM-CCR is from January 1, 2023, to December 31, 2023. At LC39B, AS operations began in 2017 in the area west of the launch pad, in the liquid oxygen (LOX) tank area located northwest of the launch pad, and in an area outside of the perimeter fence to protect nearby Outstanding Florida Waters (OFW). The LC39B AS system was installed with 279 AS wells to depths ranging from 23 to 60 feet below land surface (bls), including the sump, correlating to top of screen depths ranging from 20 to 57 feet bls. In December 2022, a total of 22 AS wells were abandoned to support launch pad crane operations, and in November 2023, the system was expanded with five additional AS wells installed to 13 or 17 feet bls near the LOX tank. The remedial objective of the LC39B AS Interim Measure (IM) is to actively decrease concentrations of contaminants of concern (COCs) in groundwater, specifically trichloroethene (TCE), cis-1,2-Dichloroethene (cDCE), and vinyl chloride (VC), to less than their respective Natural Attenuation Default Concentrations (NADCs), so LC39B can transition into a Long-Term Monitoring (LTM) program. This PM-CCR presents the following information for LC39B: • AS system operations and maintenance (O&M) (Year 7 of operation) from January 2023 to December 2023, to include AS trailer relocation in March 2023 and subsequent replacement and re-start in June 2023. • Construction completion details for AS system expansion, which included installation of five new AS wells and one new monitoring well in November 2023. As part of expansion activities, soil samples were also collected for petroleum analysis; no exceedances were identified, and no further investigation for petroleum is warranted. • Performance monitoring results for groundwater sampling events conducted in May/June 2023 (30 wells) and November 2023 (31 wells) in the AS IM area and in the Low Concentration Plume (LCP) areas located north and east of the launch pad for volatile organic compound (VOC) analysis. • Sampling results for one monitoring well, LOX-IW0012S, which is sampled for aluminum on an annual basis (May/June 2023). This well was resampled in November 2023 for both total and dissolved aluminum. Due to a communication error with the laboratory, the May/June 2023 sample was analyzed for total aluminum only. • Groundwater sampling results for per- and polyfluoroalkyl substances (PFAS) collected from seven monitoring wells during the May/June 2023 event to further investigate the Former Sewage Treatment Plant #6 and Percolation Pond area, west of the launch pad. O&M and performance monitoring results show that the AS system at LC39B is operating as designed and meeting performance criteria. Overall runtime was 45 percent (%) during the reporting period (January to December), but the operational runtime was 78% during the timeframe when the system could run (June to December). The most significant downtime contributor was post-launch crane operations following the Artemis launch on November 16, 2022, which lasted until June 2023. During that timeframe, the AS trailer at LC39B was relocated to another KSC remediation site (Wilson Corners) and was subsequently replaced with the AS trailer from the Paint & Oil Locker (POL) remediation site at KSC to resume AS system operations. Performance monitoring results in the AS IM and LCP areas continue to show reduction in COC concentrations over time when compared to baseline levels. In 2023, only one monitoring well (MW0048) detected a COC exceeding its NADC (VC at 740 micrograms per liter [µg/L]), which marks the baseline result for this new well installed during system expansion. Across the rest of the site, VC concentrations have declined or remained stable during the 2023 sampling events. Excluding MW0048, the highest VC result in 2023 was during the May/June sampling event with a concentration of 63 µg/L at MW0032, which is located near MW0048 and the AS expansion area by the LOX tank. TCE was detected in select monitoring wells in the IM area in 2023, but only two locations exceeded the State of Florida Groundwater Cleanup Target Level (GCTL): MW0032 (21 µg/L in May/June 2023 and 9.1 µg/L in November 2023) and MW0036 (5.0 µg/L in November 2023). MW0036 is also located near the LOX tank, on the north side, where the AS system is still operational (Zone Z4). cDCE and trans-1,2-dichloroethene concentrations were less than laboratory method detection limits or their respective GCTLs in all wells sampled in 2023. Near the OFW located northwest of the launch complex, all COC concentrations were less than laboratory method detection limits from monitoring wells (MW0039, MW0040, and LOXTA0002S) sampled in 2023. Aluminum results from LOX-IW0012S, which has been sampled routinely since 2006, detected a total aluminum concentration of 3,900 µg/L during the May/June 2023 sampling event. Results from the November 2023 event detected 5,700 µg/L for total aluminum and 5,500 µg/L for dissolved aluminum. These concentrations slightly decreased from the previous year but remain relatively consistent with historical detections. Aluminum will continue to be sampled on an annual basis at this well as results still exceed the GCTL of 200 µg/L and the Upper Limit of the KSC Background Concentration of 280 µg/L. PFAS results detected nine different PFAS compounds (out of 32 analyzed) from seven wells sampled. Two PFAS compounds, perfluorooctanesulfonic acid (PFOS) and perfluorooctanoic acid (PFOA), currently have FDEP Provisional GCTLs of 70 nanograms per liter (ng/L). All seven samples collected resulted in concentrations less than the FDEP Provisional GCTLs for both PFAS compounds; no exceedances were observed. PFOS and PFOA also have assigned United States Environmental Protection Agency (USEPA) Maximum Contaminant Levels (MCLs) of 4 nanograms per liter (ng/L). None of the PFOS results exceeded the USEPA MCLs. PFOA was detected in two samples above the USEPA MCL at concentrations of 5.8 ng/L (ECS-IW0009I) and 5.5 ng/L (ECS-IW0009S). Three other PFAS compounds, perfluorohexanesulfonic acid (PFHxS), perfluoro-n-nonanoic acid (PFNA), and hexafluoropropylene oxide dimer acid (GenX), currently have USEPA MCLs of 10 ng/L. PFHxS, PFNA, and GenX were not detected at concentrations greater than their respective USEPA MCLs in any of the seven wells. PFAS compounds without FDEP Provisional GCTLs or USEPA MCLs were screened against USEPA RSLs. No other detections exceeded their respective USEPA RSLs. Additional PFAS sampling will be conducted as part of a future PFAS Site Assessment. Based on O&M activities and performance monitoring, the following is recommended for LC39B: • Continue with Year 8 AS system operation within Zone Z4, which includes the AS expansion area. Zone Z3, which has been off since 2018, should remain off as no rebound has been observed. Zones Z1 and Z2, which were turned off at the end of 2022, will remain shut down as monitoring well results have consistently been below GCTLs or have low-level detections with stable or decreasing trends (Meeting Minute 2402-M10, Decision 2402-D30). • Continue with performance monitoring in 2024 with the same monitoring well network as 2023, except with the addition of MW0048 in both semi-annual events. Baseline concentrations for this well were collected during the November 2023 performance monitoring event. Semi-annual sampling should be planned for the May 2024 and November 2024 timeframes (Meeting Minute 2402-M10, Decision 2402-D31). • Continue sampling monitoring well, LOX-IW0012S, for aluminum (total and dissolved) on an annual basis in May 2024. It is also recommended to re-develop this well prior to the next sampling event (Meeting Minute 2402-M10, Decision 2402-D32). The above recommendations for LC39B were presented at the February 2024 KSCRT Meeting, with Team consensus reached on the path forward. The contents of this PM-CCR were also presented at this meeting.

Deborah M Wilson↗
DOE OSTI2020

Thermal characterization of the build chamber in electron beam melting

Electron beam powder bed fusion, commonly termed electron beam melting (EBM), offers great versatility in multiple-part processes and can produce high quality as-built components due to low residual stresses. The EBM process is complex and requires careful thermal management, including uniform and consistent preheating of the powder bed, in order to ensure quality and consistency of the product. However, most of the simulations in the literature focus on the selective melting stage of the process. As of today, optimal conditions for initial pre-heating temperatures are only available for specific materials. Thus, in order to extend the EBM technology to other desired build materials, a much better understanding of the pre-heating stages is required. In this work, numerical and experimental approaches are combined in order to investigate the effects and sensitivities of heat removal from the build plate during EBM pre-heating stages. For this purpose, a carefully reconstructed numerical model of the build chamber of an ARCAM Q20 + machine is developed. It includes all main parts of the chamber and all relevant heat transfer mechanisms, whereas special attention is paid to radiation heat exchange between various bodies. In order to validate the model, dedicated experiments are performed, in which a system of thermocouples is installed in the build chamber, allowing direct measurement of the local temperatures of the start-plate and heat shields. A good agreement between the simulation and experimental findings is achieved, leading to a better understanding of the thermal processes characteristic to the pre-heating stages. This basic analysis is followed by a representative pre-heating case, where a powder bed is also considered. The energy required to obtain the desired pre-heating temperatures is evaluated, and the role of the powder bed in heat transfer within the chamber is assessed. The pre-heating stage, simulated in the present work, is supposed to create proper conditions for sintering and consequent melting of the powder, which are highly dependent on the local temperatures and heat transfer features. Thus, the findings of the reported work present a step towards a better understanding of the thermal processes that characterize EBM. The reported model can be further used to provide realistic boundary condition inputs for other meso- or macro-scale models as a function of time and geometry. The model can serve also for verification of machine settings, i.e., jump-safe and melt-safe ones which actually provide desired preheat, and for development of settings for new powders.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Variational encoder geostatistical analysis (VEGAS) with an application to large scale riverine bathymetry

Estimation of riverbed profiles, also known as bathymetry, plays a vital role in many applications, such as safe and efficient inland navigation, prediction of bank erosion, land subsidence, and flood risk management. The high cost and complex logistics of direct bathymetry surveys, i.e, depth imaging, have encouraged the use of indirect measurements such as surface flow velocities. However, estimating high-resolution bathymetry from indirect measurements is an inverse problem that can be computationally challenging. Here, we propose a reduced-order model (ROM) based approach that utilizes a variational autoencoder (VAE), a type of deep neural network with a narrow layer in the middle, to compress bathymetry and flow velocity information and accelerate bathymetry inverse problems from flow velocity measurements. In our application, the shallow-water equations (SWE) with appropriate boundary conditions (BCs), e.g., the discharge and/or the free surface elevation, constitute the forward problem, to predict flow velocity. Then, ROMs of the SWEs are constructed on a nonlinear manifold of low dimensionality through a variational encoder and the bathymetry inversion problem is derived on the low-dimensional latent space in a Hierarchical Bayesian setting. Further, the reformulation allows variational inference with a small number (e.g., $\mathscr{O}$ (100) of ROM runs and efficient uncertainty quantification. We have tested our inversion approach on a one-mile reach of the Savannah River, GA, USA. Once the neural network is trained (offline stage), the proposed technique can perform the inversion operation orders of magnitude faster than traditional inversion methods that are commonly based on linear projections, such as principal component analysis (PCA), or the principal component geostatistical approach (PCGA). Furthermore, tests show that the algorithm can estimate the bathymetry with good accuracy even with sparse flow velocity measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2027

Conceptual design of highly-constrained splitters for the FFA@CEBAF energy upgrade study

The Continuous Electron Beam Accelerator Facility (CEBAF) at Jefferson Lab is investigating a significant energy upgrade utilizing Fixed-Field Alternating-gradient (FFA) recirculating arcs. This upgrade requires the design of complex horizontal beam splitters to manage up to six concurrent beam passes. This paper presents the conceptual design of these splitters, which are subject to severe physical constraints imposed by the existing accelerator tunnel and multifaceted beam dynamics requirements for matching into the permanent-magnet FFA arcs. The design methodology, centered on multi-pass simulations in the Bmad toolkit, is detailed from the initial geometric layout through the advanced optics matching. Key results include a robust geometric arrangement that fits within the spatial boundaries and the development of multiple, flexible optics matching solutions. Furthermore, the design integrates a viable scheme for extracting high-energy beams for the experimental halls, a critical operational requirement. This work establishes a comprehensive and viable conceptual design, forming a baseline for future engineering and performance optimization studies.

Bodenstein, R.M. [Thomas Jefferson National Accele↗
DOE OSTI2021

Influence of shrub willow buffers strategically integrated in an Illinois corn-soybean field on soil health and microbial community composition

We report soil serves many important ecological functions and is an integral part of our existence as a society. However, concerns for soil health are growing globally, in part due to the negative impacts of agricultural management on soil resources. The production of perennial bioenergy crops on marginal land in row-crop production systems is one solution that could improve land-use efficiency and address the sustainability of cropland management. Because the relationship between crop management and the environment is complex, more research is needed to evaluate the potential benefits perennial bioenergy crop production has on soil health, as well as other ecosystem services. In this study, shrub willow buffers were strategically integrated into a corn-soybean cropping system with the main objective of reducing nitrate-N leaching from grain crop production while producing biomass for bioenergy. Two buffer systems (defined by landscape positions) were included for comparison, one on marginal land with exposure to nitrate-N leaching from upslope grain (southern plots) and one on fertile soils with less nitrate-N leaching potential (northern plots). Evaluation of soil (chemistry, bulk density, microbial community) and shrub willow vegetation properties ( fine roots, leaf litter decomposition, and nutrient uptake dynamics), showed that landscape position plays an important role in (1) the dynamics of soil chemical properties, (2) shrub willow's influence and productivity, and (3) the provision of additional ecosystem services such as reductions in nitrous oxide emissions and nitrate-N leaching. In addition, the combination of crop type and landscape position (N-grain, N-willow, S-grain, and S-willow) influenced the species composition of the soil microbial community, resulting in unique and identifiable communities. These results highlight the potential application of shrub willow buffers for ecosystem service provision and support of ecosystem processes; however, understanding the relationship between the microbial community, crop type, and landscape is important for understanding the sustainability of the design.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Introduction of the Adding and Doubling Method for Solving Bateman Equations for Nuclear Fuel Depletion

This paper introduces and evaluates the Adding and Doubling Method (ADM) for solving the Bateman equations for depletion systems with varying numbers of nuclides and compares it to the Chebyshev Rational Approximation Method (CRAM), both implemented in the reactor physics analysis application Griffin. ADM, when applied to the Crank-Nicolson Finite Difference method, can produce results comparable in accuracy and precision to CRAM with comparable run times for systems with 35 or 297 nuclides. For systems with more than 300 nuclides, the matrix-matrix operations required by ADM are significantly more costly than the matrix-vector operations required by CRAM, making CRAM the more efficient method for systems with large numbers of nuclides. ADM is an accurate method that maintains other advantages over CRAM in that it does not depend on pre-generated coefficients or require complex number operations. ADM also manages to outperform CRAM by a factor of more than 250 in terms of run time for depletion systems that require multiple Bateman solves while the depletion matrix and time step size remain constant over all depletion intervals.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

pseudopod

Pseudopod is a software tool that makes it easier and safer to build and run Linux containers without needing additional system privileges. It is designed to work with the open-soruce Podman container runtime. Pseudopod also provides and implements small library named libpseudo that provides the core functionality for tracking and emulating identity related system calls with low performance overhead. This allows complex tools, such as package managers and build systems, to run in a familiar way within a container while preserving the security of the host system and networks.

Green, ElenaN [Lawrence Livermore National Laborat↗
DOE OSTI2021

Demystifying asynchronous I/O Interference in HPC applications

With increasing complexity of HPC workflows, data management services need to perform expensive I/O operations asynchronously in the background, aiming to overlap the I/O with the application runtime. However, this may cause interference due to competition for resources: CPU, memory/network bandwidth. The advent of multi-core architectures has exacerbated this problem, as many I/O operations are issued concurrently, thereby competing not only with the application but also among themselves. Furthermore, the interference patterns can dynamically change as a response to variations in application behavior and I/O subsystems (e.g. multiple users sharing a parallel file system). Without a thorough understanding, I/O operations may perform suboptimally, potentially even worse than in the blocking case. To fill this gap, here we investigate the causes and consequences of interference due to asynchronous I/O on HPC systems. Specifically, we focus on multi-core CPUs and memory bandwidth, isolating the interference due to each resource. Then, we perform an in-depth study to explain the interplay and contention in a variety of resource sharing scenarios such as varying priority and number of background I/O threads and different I/O strategies: sendfile, read/write, mmap/write underlining trade-offs. The insights from this study are important both to enable guided optimizations of existing background I/O, as well as to open new opportunities to design advanced asynchronous I/O strategies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

DPSIR-ESA Vulnerability Assessment (DEVA) Framework: Synthesis, Foundational Overview, and Expert Case Studies

Land resources are central to understanding the relationship between humans and their environment. We broadly define a land resource to include all the ecological resources of climate, water, soil, landforms, flora, and fauna, and all the socioeconomic systems that interact with agriculture, forestry, and other land uses within some system boundary. Understanding the vulnerability of land resources to changes in land management or climate forcing is critical to developing sustainable land management strategies. Vulnerability assessments are complex given the multiple uses of the assessments, the multi-disciplinary nature of the problem, limited understanding, the dynamic structure of vulnerability, scale issues, and problems with identifying effective vulnerability indicators. Here, we propose a novel conceptual framework for vulnerability assessments of land resources that combines the driver– pressure–state–impact–response (DPSIR) framework adopted by the European Environment Agency to describe interactions between society and the environment, and the exposure-sensitivity-adaptive capacity (ESA) framework used by the Intergovernmental Panel on Climate Change to assess impacts of climate change. The DPSIR-ESA Vulnerability Assessment (DEVA) framework operationalizes the process of assessing the vulnerability of a target system to external stressors. The DEVA framework includes the following elements: 1) Definition of the target system (Land resource), 2) Description of internal characteristics of the target system (State), 3) Description of target system vulnerability indicators (Adaptive capacity, Sensitivity), 4) Description of stressor characteristics (Drivers, Pressures), 5) Description of stressor vulnerability indicators (Exposure), 6) Description of target system response to stressors (Impacts), and 7) Description of modifications to target systems or stressors (Responses). In stating that they have “applied the DEVA framework”, analysts acknowledge that they have (a) considered the full breadth of each DEVA element, (b) have made conscious decisions to limit the scope and complexity of certain elements, and (c) can communicate both the rationale for these decisions and the impact of these decisions on the vulnerability assessment results and recommendations. The DEVA framework was refined during invited presentations and follow-up discussions from a series of Special Sessions with leading experts at two successive ASABE Annual International Meetings. Six case studies drawn from the sessions elaborate upon the DEVA framework and provide concrete examples of the key concepts. The DEVA approach gives engineers, planners, and analysts a new, flexible framework to apply a broad array of useful tools toward assessment of land resource system vulnerability.

Anandhi, Aauvadi↗