Search NASA⌕ Search

SEARCH · Search NASA

Results for “Computational Human Performance Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Advances in Design Capabilities for Planetary Missions from the NASA Entry Systems Modeling and Instrumentation Portfolio

The Entry Systems Modeling project (ESM) is supported by both the NASA Space Technology and the Science Mission Directorates and focuses on developing simulation tools and validated models for characterizing the performance of entry systems tailored to planetary destinations across the Solar System. ESM is organized into six technical capability areas that together address all relevant factors related to spacecraft entry, as well as some aspects of descent: Thermal Protection System (TPS) Materials; Aerothermodynamics; Entry & Descent Vehicle Dynamics; Guidance, Navigation, and Control; Vehicle Systems Analysis; and Advanced Tools and Numerical Methods. Development within the capability areas is undertaken explicitly with a focus on transition and infusion to science missions, human exploration missions, and commercial space activities. The present talk details developments that specifically impact science missions, including simulation tool capabilities that aid in mission design and model development to understand entry system performance at a given destination. Examples of the successful infusion and transition of such project outcomes to science missions also are provided. Several simulation tool development efforts within ESM have resulted in new design capabilities for missions. One such outcome is improved toolsets for mission trajectory and concept of operations design. Specifically, an initiative to couple a leading tool for entry, ascent/descent, and orbital trajectory optimization (Program to Optimize Simulated Trajectories II or POST2) to those used within the Agency for interplanetary trajectory optimization (Copernicus and Monte) has made substantial progress, with the outcomes to date promising to allow efficient trajectory optimization across mission phases. Additionally, toolchains for the evaluation of vehicle performance during entry and descent have been developed that allow assessment of multi-dimensional aeroheating on detailed vehicle geometries, characterization of deployment and inflation of parachutes, and assessment of vehicle dynamic stability during descent. These capabilities are achieved by coupling diverse sets of physics together – material response, computational fluid dynamics, radiation, and vehicle dynamics – to suitably describe complex entry and descent phenomena. Several model development and validation efforts for specific destinations and entry regimes also are underway within the ESM project. For instance, new experimental capabilities to validate radiation models at low densities/high altitudes recently have been established with project support, specifically the Low-Density Shock Tube (LDST) at the NASA Ames Research Center Electric Arc Shock Tube (EAST) facility. The LDST is being leveraged to develop improved models of shock layer kinetics and radiation in Titan atmospheres, while future studies will be conducted in the LDST and the existing high velocity shock tube to provide validation data for radiation models of Venus, Ice Giants, and Mars atmospheres. Models describing the aerothermal and thermo-structural performance of Thermal Protection System (TPS) materials has been another focus, with multiscale modeling activities on-going for the two leading TPS materials applicable to a range of entry conditions and science missions: the Phenolic-Impregnated Carbon Ablator (PICA) and woven materials like 3D Mid-Density Carbon Phenolic (3MDCP). A continual effort is made to infuse and transition outcomes from ESM simulation tool and model development activities into relevant science missions. Significant progress has been made on this front, with missions such as Dragonfly, DAVINCI, and Mars Missions benefitting from project outcomes. The groundwork also is being laid to provide insights into forward looking missions to Gas/Ice Giants as well as for potential sample returns.

Justin Haskins↗

Using computer graphics to enhance astronaut and systems safety

Computer graphics is being employed at the NASA Johnson Space Center as a tool to perform rapid, efficient and economical analyses for man-machine integration, flight operations development and systems engineering. The Operator Station Design System (OSDS), a computer-based facility featuring a highly flexible and versatile interactive software package, PLAID, is described. This unique evaluation tool, with its expanding data base of Space Shuttle elements, various payloads, experiments, crew equipment and man models, supports a multitude of technical evaluations, including spacecraft and workstation layout, definition of astronaut visual access, flight techniques development, cargo integration and crew training. As OSDS is being applied to the Space Shuttle, Orbiter payloads (including the European Space Agency's Spacelab) and future space vehicles and stations, astronaut and systems safety are being enhanced. Typical OSDS examples are presented. By performing physical and operational evaluations during early conceptual phases. supporting systems verification for flight readiness, and applying its capabilities to real-time mission support, the OSDS provides the wherewithal to satisfy a growing need of the current and future space programs for efficient, economical analyses.

Computer Simulation↗

Evaluation of Human and Anthropomorphic Test Device Finite Element Models under Spaceflight Loading Conditions

In an effort to develop occupant protection standards for future multipurpose crew vehicles, the National Aeronautics and Space Administration (NASA) has looked to evaluate the test device for human occupant restraint with the modification kit (THOR‐K) anthropomorphic test device (ATD) in relevant impact test scenarios. With the allowance and support of the National Highway Traffic Safety Administration, NASA has performed a series of sled impact tests on the latest developed THOR‐K ATD. These tests were performed to match test conditions from human volunteer data previously collected by the U.S. Air Force. The objective of this study was to evaluate the THOR‐K finite element (FE) model and the Total HUman Model for Safety (THUMS) FE model with respect to the tests performed. These models were evaluated in spinal and frontal impacts against kinematic and kinetic data recorded in ATD and human testing. Methods: The FE simulations were developed based on recorded pretest ATD/human position and sled acceleration pulses measured during testing. Predicted responses by both human and ATD models were compared to test data recorded under the same impact conditions. The kinematic responses of the models were quantitatively evaluated using the ISO‐metric curve rating system. In addition, ATD injury criteria and human stress/strain data were calculated to evaluate the risk of injury predicted by the ATD and human model, respectively. Results: Preliminary results show well‐correlated response between both FE models and their physical counterparts. In addition, predicted ATD injury criteria and human model stress/strain values are shown to positively relate. Kinematic comparison between human and ATD models indicates promising biofidelic response, although a slightly stiffer response is observed within the ATD. Conclusion: As a compliment to ATD testing, numerical simulation provides efficient means to assess vehicle safety throughout the design process and further improve the design of physical ATDs. The assessment of the THOR‐K and THUMS FE models in a spaceflight testing condition is an essential first step to implementing these models in the computational evaluation of spacecraft occupant safety. Promising results suggest future use of these models in the aerospace field.

Putnam, Jacob P.↗

Simulating Underexpanded Plumes in Martian and Lunar Environments

While the Loci/Chem Computational fluid dynamics (CFD) application has been validated and used extensively for simulating launch environments in atmospheric conditions, use of this tool for simulating supersonic plumes at much lower ambient pressure requires further validation. Simulations of underexpanded plumes have been performed using Loci/Chem at Martian pressure to predict several metrics for laminar, turbulent, and impinging plumes. The CFD results are compared with an experimental data set for low Reynolds number plumes at these conditions in order to evaluate the current capability of the Loci/Chem tool for these types of environments. The CFD validation results to date show reasonable agreement with the experimental data across all the metrics of interest for the configurations considered. The Loci/Chem-Boltzmann tool is a hybrid continuum/rarefied flow solver which extends modeling capabilities to very low-pressure environments such as those on the Moon. The Loci/Chem-Boltzmann solver uses a gradient-based continuum breakdown criterion to restrict solution of the computationally expensive Boltzmann equation to only a subset of the domain, while using the Navier-Stokes equations elsewhere. This CFD application is under active development, and current efforts toward establishing production ready capability for evaluating Lunar plume surface interactions are well under way. Initial simulations of an Apollo Lunar excursion module indicate that several regions of the flow require solving the Boltzmann equations due to extreme rarefaction. Early simulations are promising, indicating reasonable overall computational time for a full 3D human scale lander simulation.

Plume Surface Interaction↗

Utilizing the SACADA system to collect simulator training data to inform human reliability analyses - 169

Lack of appropriate human performance data for the development of human reliability analysis (HRA) methods has been identified as a key issue contributing to the method-to-method variability among the HRA methods. The United States Nuclear Regulatory Commission (NRC) worked with domain experts to develop the Scenario Authoring, Characterization, and Debriefing Application (SACADA) system to collect nuclear power plants' licensed operator simulator training and examination data to inform HRA. In the past two decades, significant improvements in understanding and modelling human performance in HRA have affected the perspectives of the types of data to be collected for HRA. A significant change is that human performance is strongly dependent on the context of the tasks to be performed. To incorporate this understanding, the SACADA data taxonomy collects the context and actual performance information of the training objective elements (TOEs) in nuclear plant operator simulator training. This provides a framework consistent with HRA to use context to estimate human error probabilities. It is recognized that measuring crew performance is equally important as improving operator training. SACADA is designed to support the nuclear trainers in capturing this important information that is used to identify training weaknesses and drive continuous improvement. This paper discusses the SACADA taxonomy, the SACADA system's functions, and the supporting software design to enable the SACADA system to be practically implemented in the nuclear power plants' operator simulator training program to collect data for tracking operator performance and HRA analysis. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A semi-automatic method for left ventricle volume estimate: an in vivo validation study

This study aims to the validation of the left ventricular (LV) volume estimates obtained by processing volumetric data utilizing a segmentation model based on level set technique. The validation has been performed by comparing real-time volumetric echo data (RT3DE) and magnetic resonance (MRI) data. A validation protocol has been defined. The validation protocol was applied to twenty-four estimates (range 61-467 ml) obtained from normal and pathologic subjects, which underwent both RT3DE and MRI. A statistical analysis was performed on each estimate and on clinical parameters as stroke volume (SV) and ejection fraction (EF). Assuming MRI estimates (x) as a reference, an excellent correlation was found with volume measured by utilizing the segmentation procedure (y) (y=0.89x + 13.78, r=0.98). The mean error on SV was 8 ml and the mean error on EF was 2%. This study demonstrated that the segmentation technique is reliably applicable on human hearts in clinical practice.

NASA Discipline Cardiopulmonary↗

Simulating Underexpanded Jets in Martian and Lunar Environments

As part of the Game Changing Development (GCD) Program, funded by NASA’s Space Technology Mission Directorate (STMD), the development of simulation capability for the prediction of extra-terrestrial Plume Surface Interaction (PSI) environments has been undertaken by the Fluid Dynamics Branch at NASA/MSFC. The GCD PSI Project, planned to be accomplished over a four year period, contains a Predictive Simulation Capability (PSC) Element focused on creating simulation capability for the reliable and accurate prediction of PSI in Martian (~650 Pa) and Lunar (vacuum) ambient environments. In addition to the PSC Element, the PSI Project also contains a companion Ground Testing Element for development of focused datasets for validation of predictive capability as well as a Flight-focused Instrumentation Element. This paper describes the activities and accomplishments in the past year for the Prediction of Plume Flow in low pressure environments component of the PSI Project. While the Loci/Chem Computational fluid dynamics (CFD) application has been validated and used extensively for simulating launch environments in atmospheric conditions, use of this tool for simulating supersonic plumes at Mars-like ambient pressure requires further validation. CFD simulations of underexpanded jets have been performed using Loci/Chem for Mars-like conditions to predict several metrics for steady laminar, turbulent, and impinging plumes. The CFD results are compared with an experimental data set for low Reynolds number plumes at these conditions in order to evaluate the current capability of the Loci/Chem tool for these types of environments. The CFD validation results to date show reasonable agreement with the experimental data across all of the metrics of interest for the configurations considered. The Loci/Chem-Boltzmann CFD application is a hybrid continuum/rarefied flow solver which extends modeling capabilities to very low pressure environments such as those on the Moon. The Loci/Chem-Boltzmann solver uses a gradient-based continuum breakdown criterion to restrict solution of the computationally expensive Boltzmann equation to only a subset of the domain, while using the Navier-Stokes equations elsewhere. This CFD application is under active development, and current efforts toward establishing production ready capability for evaluating Lunar plume surface interactions are well under way. Initial simulations of an Apollo LEM indicate that several regions of the flow require solving the Boltzmann equations due to extreme rarefaction. Early simulations are promising, indicating reasonable overall computational time for a full 3D human scale lander simulation.

Thomas Shurtz↗

Numerical Prediction of Heat Transfer Coefficients during Xenon Tank Fill in Microgravity

NASA’s Gateway will serve as an orbital outpost to enable sustained human lunar exploration and facilitate access to destinations beyond the Moon. To maintain sustainable deep space missions, on-orbit propellant transfer and refueling must be realized. One of Gateway’s critical components, the Power and Propulsion Element (PPE), will use solar electric propulsion to perform attitude control maneuvers and orbit transfers. Xenon will be used as the propellant for the PPE and stored in a composite overwrapped pressure vessel (COPV). During the propellant refueling process, xenon will compress causing the fluid and tank walls to warm. There is concern that the bond between the tank liner and composite may degrade at elevated temperatures, along with the possibility of the tank exceeding design pressure. While on-orbit testing is being proposed, numerical models are being used to predict the thermal response and reduce risk during a refueling operation in microgravity where natural convection is diminished. Accurate numerical models may be used to inform decisions for follow-on testing, or design and operation of refueling architectures. Challenges of modeling xenon tank fill in microgravity include non-ideal gas behavior, operating near the fluid’s critical point, and lack of experimental flight data. This study presents a computational fluid dynamics (CFD) model with conjugate heat transfer that is used to predict averaged heat transfer coefficients during tank filling. At the anticipated injection flow rates, the CFD results showed that forced convection dominates in microgravity. Initial results from a multi-node Thermal Desktop model that assumed a purely conducting fluid (Nu=1) over-predicted the CFD fluid temperature and pressure, while a similar model allowing for natural convection under-predicted. The heat transfer coefficients predicted by CFD were implemented into the multi-node model, and the COPV thermal response from the two computational approaches were compared with good agreement.

Heat Transfer↗

Volumetric Assessment of UPRITE Exercises From Marker-Based Motion Capture

BACKGROUND Lack of volumetric data on full-body movement of exercises presents a challenge to ensuring the fit of crew member’s full range of motion on the International Space Station (ISS). The Upright Proprioception Retention via In-flight Training and Evaluation (UPRITE) is a sensorimotor countermeasure device designed for maintaining crew members’ proprioception in a microgravity environment. A footplate—attached to a static base—rotates in two degrees of freedom (pitch and roll) up to a 20 deg angle. An initial volumetric assessment assuming an upright standing posture produced a cone-like shape with a narrow bottom and wide top. Such general volumetric assessments risk creating an overly conservative volume estimate, taking up more space than is necessary on the already limited interior space of the ISS, and neglecting necessary volume due to oversimplifying assumptions. Rather, higher-fidelity volumetric assessments offer more comprehensive insights in an environment where every area counts. The main objective of this work is to provide the spatial parameters of exercises on the UPRITE such that it is placed on the ISS according to its volumetric demands or that usage is adjusted to fit the available space. METHODS In 2023, a data collection was performed originally to inform loads and dynamics of system use and was recently leveraged for volumetric assessment. Three human subjects representing different body types (~63-76 inches in stature) performed a variety of board manipulations using UPRITE with body weight offload. The test collected the 3D positional data of a modified full-body Plug-in Gait marker set [1] via a 16-camera OptiTrack MoCap system. After processing – filling marker gaps and trimming data – in OptiTrack Motive, the recorded marker location data, which included device markers, was exported to a readable trajectory file. To accurately represent the full volume defining landmarks, additional markers were digitally added to an unscaled Modified Full Body Model [2]. The model was then scaled according to its subject parameters upon which an inverse kinematics analysis was performed. A custom plugin yielded model marker location data files. Volumetric analyses were performed on the recorded trajectory and model trajectory files using a custom Python-built tool that extracted the marker location data and plotted it in a 3D space. Concerned with only the maximum volume of the motion, a 3D convex hull analysis was applied to the plot, extracting the vertices or external points of the eventual 3D CAD output, dubbed aptly as a “volume shell”. This overall approach was based on guidance in a NASA-STD-3001 Technical Brief [3]. RESULTS AND DISCUSSION Batch volumetric assessment on the exercises for each subject was performed, producing high-fidelity volume shells in minimal time. Preliminary results highlighted the value in higher-fidelity volumes based on collected data when possible. For example, revolving a single posture in the cone assessment would not have sufficiently captured a single leg stance; rather, it would need to involve swinging the leg both forward and back. Additional observations and the maximal dimensions of the volumes, including those based on scaled data for ISS anthropometric requirements, will be presented at the Human Research Program Investigator’s Workshop. CONCLUSIONS While this work’s primary objective was for the UPRITE-to-ISS integration, the tool built to conduct this analysis has wide applications for future exercise systems as an informational tool for optimal device placement. The tool and its findings also have implications for exercise device design and spacecraft interior considerations on Gateway, the Lunar Pressurized Rover, and beyond. REFERENCES [1] Bell, C. A., et al. (2023) Recent Improvements and Verification of a Full Body Model in OpenSim. NASA Human Research Program Investigator’s Workshop. https://ntrs.nasa.gov/citations/20230001080 [2] Lostroscio, K., et al (2023) The Digital Astronaut Simulation. AHFE International Conference on Human Factors in Design, Engineering, and Computing for All. [3] Exercise Overview. (2023) NASA-STD-3001 Technical Brief. https://www.nasa.gov/wp-content/uploads/2023/12/ochmo-tb-031-exercise-overview.pdf?emrc=9d454c?emrc=9d454c

L D Quinto↗

Synchronized multiartifact reduction with tomographic reconstruction (SMART-RECON): A statistical model based iterative image reconstruction method to eliminate limited-view artifacts and to mitigate the temporal-average artifacts in time-resolved CT

Purpose: In x-ray computed tomography (CT), a violation of the Tuy data sufficiency condition leads to limited-view artifacts. In some applications, it is desirable to use data corresponding to a narrow temporal window to reconstruct images with reduced temporal-average artifacts. However, the need to reduce temporal-average artifacts in practice may result in a violation of the Tuy condition and thus undesirable limited-view artifacts. In this paper, the authors present a new iterative reconstruction method, synchronized multiartifact reduction with tomographic reconstruction (SMART-RECON), to eliminate limited-view artifacts using data acquired within an ultranarrow temporal window that severely violates the Tuy condition. Methods: In time-resolved contrast enhanced CT acquisitions, image contrast dynamically changes during data acquisition. Each image reconstructed from data acquired in a given temporal window represents one time frame and can be denoted as an image vector. Conventionally, each individual time frame is reconstructed independently. In this paper, all image frames are grouped into a spatial–temporal image matrix and are reconstructed together. Rather than the spatial and/or temporal smoothing regularizers commonly used in iterative image reconstruction, the nuclear norm of the spatial–temporal image matrix is used in SMART-RECON to regularize the reconstruction of all image time frames. This regularizer exploits the low-dimensional structure of the spatial–temporal image matrix to mitigate limited-view artifacts when an ultranarrow temporal window is desired in some applications to reduce temporal-average artifacts. Both numerical simulations in two dimensional image slices with known ground truth and in vivo human subject data acquired in a contrast enhanced cone beam CT exam have been used to validate the proposed SMART-RECON algorithm and to demonstrate the initial performance of the algorithm. Reconstruction errors and temporal fidelity of the reconstructed images were quantified using the relative root mean square error (rRMSE) and the universal quality index (UQI) in numerical simulations. The performance of the SMART-RECON algorithm was compared with that of the prior image constrained compressed sensing (PICCS) reconstruction quantitatively in simulations and qualitatively in human subject exam. Results: In numerical simulations, the 240{sup ∘} short scan angular span was divided into four consecutive 60{sup ∘} angular subsectors. SMART-RECON enables four high temporal fidelity images without limited-view artifacts. The average rRMSE is 16% and UQIs are 0.96 and 0.95 for the two local regions of interest, respectively. In contrast, the corresponding average rRMSE and UQIs are 25%, 0.78, and 0.81, respectively, for the PICCS reconstruction. Note that only one filtered backprojection image can be reconstructed from the same data set with an average rRMSE and UQIs are 45%, 0.71, and 0.79, respectively, to benchmark reconstruction accuracies. For in vivo contrast enhanced cone beam CT data acquired from a short scan angular span of 200{sup ∘}, three 66{sup ∘} angular subsectors were used in SMART-RECON. The results demonstrated clear contrast difference in three SMART-RECON reconstructed image volumes without limited-view artifacts. In contrast, for the same angular sectors, PICCS cannot reconstruct images without limited-view artifacts and with clear contrast difference in three reconstructed image volumes. Conclusions: In time-resolved CT, the proposed SMART-RECON method provides a new method to eliminate limited-view artifacts using data acquired in an ultranarrow temporal window, which corresponds to approximately 60{sup ∘} angular subsectors.

60 APPLIED LIFE SCIENCES↗

GIScience in the era of Artificial Intelligence: a research agenda towards Autonomous GIS

The advent of generative AI exemplified by large language models (LLMs) opens new ways to represent and compute geographic information and transcends the process of geographic knowledge production, driving geographic information systems (GIS) towards autonomous GIS. Leveraging LLMs as the decision core, autonomous GIS can independently generate and execute geoprocessing workflows to perform spatial analysis. In this vision paper, we further elaborate on the concept of autonomous GIS and present a conceptual framework that defines its five autonomous goals, five levels of autonomy, five core functions, and three operational scales. We demonstrate how autonomous GIS could perform geospatial data retrieval, spatial analysis, and map making with four proof-of-concept GIS agents. We conclude by identifying critical challenges and future research directions, including fine-tuning and self-growing decision-cores, autonomous modelling, and examining the societal and practical implications of autonomous GIS. By establishing the groundwork for a paradigm shift in GIScience, this paper envisions a future where GIS moves beyond traditional workflows to autonomously reason, derive, innovate, and advance geospatial solutions to pressing global challenges. Meanwhile, we emphasize that as we design and deploy increasingly intelligent geospatial systems, we carry a responsibility to ensure they are developed in socially responsible ways, serve the public good, and support the continued value of human geographic insight in an AI-augmented future.

Autonomous GI↗

Investigating Kinetic Mechanisms of Soot Formation in Plasma Pyrolysis of Methane via Active Learning (Final Technical Report)

Plasma pyrolysis of methane is an effective route for zero-carbon hydrogen production. Yet, soot generated from pyrolysis of hydrocarbons is detrimental to the climate and human health. There is ample experimental and theoretical evidence that suggests polycyclic aromatic hydrocarbons (PAHs) are the molecular precursors to soot particles. The reaction pathways of PAH formation are intricately dependent on a multitude of process parameters, whose kinetic mechanisms are not well-understood in plasma pyrolysis. This project aims to leverage advances in the kinetic modeling of soot formation in combustion, as well as in surrogate modeling and active learning, to systematically investigate the effects of process parameter on the kinetics of PAH formation in plasma pyrolysis of methane. To this end, we propose to use the PAH formation kinetics model developed by the PPPL/PU group based on the well-established ABF and HACA mechanisms, coupled with low-temperature plasma models. We will develop an active learning (AL) framework based on Bayesian optimization to systematically and data-efficiently explore the complex and multivariable parameter space of plasma pyrolysis in order to quantify the effects of plasma and feed parameters on the ABF and HACA kinetic pathways. AL is the branch of machine learning concerned with systematically querying samples from a system (experimental or computational) to train a data-driven model that maps design parameters to a performance criterion. We will use the data generated via AL to perform global sensitivity analysis, combined with uncertainty quantification, to elucidate the impact of different reaction pathways on minimizing formation of soot precursors. This study will result in an improved understanding of kinetics of PAH formation in plasma pyrolysis and can pave the way for more advanced mechanistic studies (e.g., soot nucleation mechanisms). Additionally, the findings will be useful for establishing practical strategies for increasing the pyrolysis efficiency and producing high-grade carbon for synthesis of nanomaterials.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Phase II Nevada Water Resources Data, Modeling, and Visualization (DMV) Center (Final Report)

Water is unquestionably a critical resource throughout the United States. In the semi-arid west -- an area stressed by increase in human population and sprawl of the built environment -- water is the most important limiting resource. Crucially, science must understand factors that affect availability and distribution of water. To sustain growing consumptive demand, science needs to translate understanding into reliable and robust predictions of availability under weather conditions that could be average but might be extreme. These predictions are needed to support current and long-term planning. Similar to the role of weather forecast and climate prediction, water prediction over short and long temporal scales can contribute to resource strategy, governmental policy and municipal infrastructure decisions, which are arguably tied to the natural variability and unnatural change to climate. Change in seasonal and annual temperature, precipitation, snowmelt, and runoff affect the distribution of water over large temporal and spatial scales, which impact the risk of flooding and the groundwater recharge. Anthropogenic influences and impacts increase the complexity and urgency of the challenge. The goal of this project has been to develop a decision support framework of data acquisition, digital modeling, and 3D visualization. This integrated framework consists of tools for compiling, discovering and projecting our understanding of processes that control the availability and distribution of water. The framework is intended to support the analysis of the complex interactions between processes that affect water supply, from controlled availability to either scarcity or deluge. The developed framework enables DRI to promote excellence in water resource management, particularly within the Lake Tahoe basin. In principle, this framework could be replicated for other watersheds throughout the United States. Phase II of this project builds upon the research conducted during Phase I, in which the hydrologic framework was investigated and the development initiated. Phase II concentrates on practical implementation of the earlier work but emphasizes applications to the hydrology of the Lake Tahoe basin. Phase 1 efforts have been refined and extended by creating a toolset for geographic information systems (GIS) that is usable for disparate types of geospatial and geo-referenced data. The toolset is intended to serve multiple users for a variety of applications. The web portal for internet access to hydrologic and remotely sensed product data, prototyped in Phase I, has been significantly enhanced. The portal provides high performance access to LANDSAT-derived data using techniques developed during the course of the project. The portal is interactive, and supports the geo-referenced display of hydrologic information derived from remotely sensed data, such as various vegetative indices used to calculate water consumption. The platform can serve both internal and external constituencies using inter-operating infrastructure that spans both sides of the DRI firewall. The platform is intended grow its supported data assets and to serve as a template for replication to other geographic areas. An unanticipated development during the project was the use of ArcGIS software on a new computer system, called the IBM PureSytems, and the parallel use of the systems for faster, more efficient image processing. Additional data, independent of the portal, was collected within the Sagehen basin and provides detailed information regarding the processes that control hydrologic responses within mountain watersheds. The newly collected data include elevation, evapotranspiration, energy balance and remotely sensed snow-pack data. A Lake Tahoe basin hydrologic model has been developed, in part to help predict the hydrologic impacts of climate change. The model couples both the surface and subsurface hydrology, with the two components having been independently calibrated. Results from the coupled simulations involving both surface water and groundwater processes show that it is possible to fairly accurately simulate lake effects and water budget variables over a wide range of dry and wet cycles in the historical record. The Lake Tahoe basin is representative of the hydrology, topography and climate throughout the Sierra Nevada Range, and the entire model development is prototypical of the efforts required to replicate the decision support framework to other locales. The Lake Tahoe model in particular, could allow water managers to evaluate more accurately components of the water budget (ET, runoff, groundwater, etc) and to answer important questions regarding water resources in northern Nevada. This report discusses the geographic scale and the hydrologic complexity of the calibrated model developed as part of this project, as well as simulation results for historical and future climate projects To enable human-driven data exploration and discovery, de novo software for a globalized rendering module that extends the capability of our evolving custom visualization engine from Phase I (called SMEngine) has been developed. The new rendering component, called Horizon, supports terrain rendering capable of displaying and interrogating both remotely sensed and modeled data. The development of Horizon necessitated adaptation of the visualization engine to allow extensible integration of components such as the global rendering module and support for associated features. The resulting software is general in its GIS capability, but a specific Lake Tahoe visualization application suitable for immersive decision support in the DRIVE6 virtual reality facility has been developed. During the development, various features to enhance the value of the visualization experience were explored, including the use of hyperspectral image overlays. An over-arching goal of the visualization aspect of the project has been to develop and demonstrate the CAVE (CAVE Automatic Virtual Environment) as a practical tool for hydrologic research.

54 ENVIRONMENTAL SCIENCES↗

Bayesian optimal experimental design for constitutive model calibration

Computational simulation is increasingly relied upon for high/consequence engineering decisions, which necessitates a high confidence in the calibration of and predictions from complex material models. However, the calibration and validation of material models is often a discrete, multi-stage process that is decoupled from material characterization activities, which means the data collected does not always align with the data that is needed. To address this issue, an integrated workflow for delivering an enhanced characterization and calibration procedure—Interlaced Characterization and Calibration (ICC)—is introduced and demonstrated. Further, this framework leverages Bayesian optimal experimental design (BOED), which creates a line of communication between model calibration needs and data collection capabilities in order to optimize the information content gathered from the experiments for model calibration. Eventually, the ICC framework will be used in quasi real-time to actively control experiments of complex specimens for the calibration of a high-fidelity material model. This work presents the critical first piece of algorithm development and a demonstration in determining the optimal load path of a cruciform specimen with simulated data. Calibration results, obtained via Bayesian inference, from the integrated ICC approach are compared to calibrations performed by choosing the load path a priori based on human intuition, as is traditionally done. The calibration results are communicated through parameter uncertainties which are propagated to the model output space (i.e. stress–strain). In these exemplar problems, data generated within the ICC framework resulted in calibrated model parameters with reduced measures of uncertainty compared to the traditional approaches.

42 ENGINEERING↗

Evaluating iterative reconstruction performance in computed tomography

Purpose: Iterative reconstruction (IR) offers notable advantages in computed tomography (CT). However, its performance characterization is complicated by its potentially nonlinear behavior, impacting performance in terms of specific tasks. This study aimed to evaluate the performance of IR with both task-specific and task-generic strategies. Methods: The performance of IR in CT was mathematically assessed with an observer model that predicted the detection accuracy in terms of the detectability index (d′). d′ was calculated based on the properties of the image noise and resolution, the observer, and the detection task. The characterizations of image noise and resolution were extended to accommodate the nonlinearity of IR. A library of tasks was mathematically modeled at a range of sizes (radius 1–4 mm), contrast levels (10–100 HU), and edge profiles (sharp and soft). Unique d′ values were calculated for each task with respect to five radiation exposure levels (volume CT dose index, CTDI{sub vol}: 3.4–64.8 mGy) and four reconstruction algorithms (filtered backprojection reconstruction, FBP; iterative reconstruction in imaging space, IRIS; and sinogram affirmed iterative reconstruction with strengths of 3 and 5, SAFIRE3 and SAFIRE5; all provided by Siemens Healthcare, Forchheim, Germany). The d′ values were translated into the areas under the receiver operating characteristic curve (AUC) to represent human observer performance. For each task and reconstruction algorithm, a threshold dose was derived as the minimum dose required to achieve a threshold AUC of 0.9. A task-specific dose reduction potential of IR was calculated as the difference between the threshold doses for IR and FBP. A task-generic comparison was further made between IR and FBP in terms of the percent of all tasks yielding an AUC higher than the threshold. Results: IR required less dose than FBP to achieve the threshold AUC. In general, SAFIRE5 showed the most significant dose reduction potentials (11–54 mGy, 77%–84%), followed by SAFIRE3 (7–36 mGy, 50%–61%) and IRIS (6–26 mGy, 37%–50%). The dose reduction potentials highly depended on task size and task contrast, with tasks of lower contrasts and smaller sizes, i.e., more challenging tasks, indicating higher dose reductions. Softer edge profile showed higher dose reduction potentials with SAFIRE3 and SAFIRE5, but not with IRIS. The task-generic comparison between IR and FBP demonstrated the overall superiority of IR performance, as IR allowed a larger percent of tasks to exceed the threshold AUC: IRIS, 8%–12%; SAFIRE3, 10%–16%; and SAFIRE5, 20%–33%. The improvement with IR was generally more pronounced at lower dose levels. Conclusions: Expanding beyond traditional contrast and noise based assessments of IR, we performed both task-specific and task-generic evaluations of IR performance. The task-specific evaluation demonstrated the dependency of IR’s dose reduction potential on task attributes, which can be employed to optimize IR for clinical indications with specific range of size and contrast. The task-generic evaluation demonstrated IR’s overall superiority over FBP in terms of the range of tasks exceeding a threshold performance level, which can be employed for general comparisons between algorithms.

60 APPLIED LIFE SCIENCES↗

Exploring Explicit Uncertainty for Binary Analysis (EUBA)

Reverse engineering (RE) analysts struggle to address critical questions about the safety of binary code accurately and promptly, and their supporting program analysis tools are simply wrong sometimes. The analysis tools have to approximate in order to provide any information at all, but this means that they introduce uncertainty into their results. And those uncertainties chain from analysis to analysis. We hypothesize that exposing sources, impacts, and control of uncertainty to human binary analysts will allow the analysts to approach their hardest problems with high-powered analytic techniques that they know when to trust. Combining expertise in binary analysis algorithms, human cognition, uncertainty quantification, verification and validation, and visualization, we pursue research that should benefit binary software analysis efforts across the board. We find a strong analogy between RE and exploratory data analysis (EDA); we begin to characterize sources and types of uncertainty found in practice in RE (both in the process and in supporting analyses); we explore a domain-specific focus on uncertainty in pointer analysis, showing that more precise models do help analysts answer small information flow questions faster and more accurately; and we test a general population with domain-general sudoku problems, showing that adding "knobs" to an analysis does not significantly slow down performance. This document describes our explorations in uncertainty in binary analysis.

97 MATHEMATICS AND COMPUTING↗

in silico Whole Genome Sequencer & Analyzer (iWGS): A Computational Pipeline to Guide the Design and Analysis of de novo Genome Sequencing Studies

The availability of genomes across the tree of life is highly biased toward vertebrates, pathogens, human disease models, and organisms with relatively small and simple genomes. Recent progress in genomics has enabled the de novo decoding of the genome of virtually any organism, greatly expanding its potential for understanding the biology and evolution of the full spectrum of biodiversity. The increasing diversity of sequencing technologies, assays, and de novo assembly algorithms have augmented the complexity of de novo genome sequencing projects in nonmodel organisms. To reduce the costs and challenges in de novo genome sequencing projects and streamline their experimental design and analysis, we developed iWGS (in silico Whole Genome Sequencer and Analyzer), an automated pipeline for guiding the choice of appropriate sequencing strategy and assembly protocols. iWGS seamlessly integrates the four key steps of a de novo genome sequencing project: data generation (through simulation), data quality control, de novo assembly, and assembly evaluation and validation. The last three steps can also be applied to the analysis of real data. iWGS is designed to enable the user to have great flexibility in testing the range of experimental designs available for genome sequencing projects, and supports all major sequencing technologies and popular assembly tools. Three case studies illustrate how iWGS can guide the design of de novo genome sequencing projects, and evaluate the performance of a wide variety of user-specified sequencing strategies and assembly protocols on genomes of differing architectures. iWGS, along with a detailed documentation, is freely available at https://github.com/zhouxiaofan1983/iWGS.

59 BASIC BIOLOGICAL SCIENCES↗

Advances in Machine and Deep Learning for Modeling and Real-time Detection of Multi-Messenger Sources

We live in momentous times. The science community is empowered with an arsenal of cosmic messengers to study the universe in unprecedented detail. Gravitational waves, electromagnetic waves, neutrinos, and cosmic rays cover a wide range of wavelengths and timescales. Combining and processing these datasets that vary in volume, speed, and dimensionality requires new modes of instrument coordination, funding, and international collaboration with a specialized human and technological infrastructure. In tandem with the advent of large-scale scientific facilities, the last decade has experienced an unprecedented transformation in computing and signal-processing algorithms. The combination of graphics processing units, deep learning, and the availability of open source, high-quality datasets has powered the rise of artificial intelligence. This digital revolution now powers a multibillion dollar industry, with far-reaching implications in technology and society. In this chapter, we describe pioneering efforts to adapt artificial intelligence algorithms to address computational grand challenges in multi-messenger astrophysics. We review the rapid evolution of these disruptive algorithms, from the first class of algorithms introduced in early 2017 to the sophisticated algorithms that now incorporate domain expertise in their architectural design and optimization schemes. We discuss the importance of scientific visualization and extreme-scale computing in reducing time-to-insight and obtaining new knowledge from the interplay between models and data.

Artificial Intelligence↗