Search NASA⌕ Search

SEARCH · Search NASA

Results for “Agent-based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Deep Reinforcement Learning and Simulation as a Path Toward Precision Medicine

In the past, precision medicine involves classifying patients to identify subpopulations that respond favorably to specific therapeutics. We discuss precision medicine as a dynamic feedback control problem, where treatment administered to a patient is guided by measurements taken during the course of treatment. We consider sepsis, a life-threatening condition in which dysregulation of the immune system causes tissue damage. We leverage an existing simulation of the innate immune response to infection and apply deep reinforcement learning (DRL) to discover an adaptive personalized treatment policy that specifies effective multicytokine therapy to simulated sepsis patients based on systemic measurements. The learned policy achieves a dramatic reduction in mortality rate over a set of 500 simulated patients relative to standalone antibiotic therapy. Advantages of our approach are threefold: (1) the use of simulation allows exploring therapeutic strategies beyond clinical practice and available data, (2) advances in DRL accommodate learning complex therapeutic strategies for complex biological systems, and (3) optimized treatments respond to a patient's individual disease progression over time, therefore, capturing both differences across patients and the inherent randomness of disease progression within a single patient. We believe that this work motivates both considering adaptive personalized multicytokine mediation therapy for sepsis and exploiting simulation with DRL for precision medicine more broadly.

59 BASIC BIOLOGICAL SCIENCES↗

Combining Agent Based Modeling and System Dynamics to Investigate the Circularity of Plastics

The United States currently produces about 1 million metric ton of ocean plastic pollution annually. One proposed solution to combat plastic waste is a circular economy (CE), which aims to transition from today's take-make-waste linear pattern of production and consumption to a system where the value of resources is maximized over time. Two key methods in industrial ecology are useful in assessing the viability of CE: (1) System Dynamics (SD) and (2) Agent Based Modeling (ABM). In prior work, the plastic life cycle was modeled with SD and ABM. The two models calculate recycling rates and costs in different ways, making it difficult to pinpoint necessary next steps. We integrate the ABM and SD models - linking the emergent patterns from micro-level human decisions to system level processes - which allows a more comprehensive understanding of feedbacks, costs, and environmental impacts. The integrated model is more accurate, and can be used to visualize recycling rates and human health and environmental impacts over time. The difference between the integrated and original SD model prompts a Sobol sensitivity analysis, which is used to understand which behavioral factors most affect plastic recycling patterns. We find that the habitual component is typically the most influential in promoting positive recycling behavior. Additionally, we utilize the combined model to understand and visualize how various behavioral intervention scenarios, like improved access to recycling programs and cart tagging, influence recycling patterns; these results can guide future policy-making.

agent-based modeling↗

Dynamic Ride-Matching for Large-Scale Transportation Systems

Efficient dynamic ride-matching (DRM) in large-scale transportation systems is a key driver in transport simulations to yield answers to challenging problems. Although the DRM problem is simple to solve, it quickly becomes a computationally challenging problem in large-scale transportation system simulations. Therefore, this study thoroughly examines the DRM problem dynamics and proposes an optimization-based solution framework to solve the problem efficiently. To benefit from parallel computing and reduce computational times, the problem’s network is divided into clusters utilizing a commonly used unsupervised machine learning algorithm along with a linear programming model. Then, these sub-problems are solved using another linear program to finalize the ride-matching. At the clustering level, the framework allows users adjusting cluster sizes to balance the trade-off between the computational time savings and the solution quality deviation. A case study in the Chicago Metropolitan Area, U.S., illustrates that the framework can reduce the average computational time by 58% at the cost of increasing the average pick up time by 26% compared with a system optimum, that is, non-clustered, approach. Another case study in a relatively small city, Bloomington, Illinois, U.S., shows that the framework provides quite similar results to the system-optimum approach in approximately 62% less computational time.

33 ADVANCED PROPULSION SYSTEMS↗

Microsimulation model calibration using incremental mixture approximate Bayesian computation

Microsimulation models (MSMs) are used to inform policy by predicting population-level outcomes under different scenarios. MSMs simulate individual-level event histories that mark the disease process (such as the development of cancer) and the effect of policy actions (such as screening) on these events. MSMs often have many unknown parameters; calibration is the process of searching the parameter space to select parameters that result in accurate MSM prediction of a wide range of targets. We develop Incremental Mixture Approximate Bayesian Computation (IMABC) for MSM calibration which results in a simulated sample from the posterior distribution of model parameters given calibration targets. IMABC begins with a rejection-based ABC step, drawing a sample of points from the prior distribution of model parameters and accepting points that result in simulated targets that are near observed targets. Next, the sample is iteratively updated by drawing additional points from a mixture of multivariate normal distributions and accepting points that result in accurate predictions. Posterior estimates are obtained by weighting the final set of accepted points to account for the adaptive sampling scheme. We demonstrate IMABC by calibrating CRC-SPIN 2.0, an updated version of a MSM for colorectal cancer (CRC) that has been used to inform national CRC screening guidelines.

97 MATHEMATICS AND COMPUTING↗

Use of a controlled experiment and computational models to measure the impact of sequential peer exposures on decision making

It is widely believed that one’s peers influence product adoption behaviors. This relationship has been linked to the number of signals a decision-maker receives in a social network. But it is unclear if these same principles hold when the “pattern” by which it receives these signals vary and when peer influence is directed towards choices which are not optimal. To investigate that, we manipulate social signal exposure in an online controlled experiment using a game with human participants. Each participant in the game decides among choices with differing utilities. We observe the following: (1) even in the presence of monetary risks and previously acquired knowledge of the choices, decision-makers tend to deviate from the obvious optimal decision when their peers make a similar decision which we call the influence decision, (2) when the quantity of social signals vary over time, the forwarding probability of the influence decision and therefore being responsive to social influence does not necessarily correlate proportionally to the absolute quantity of signals. To better understand how these rules of peer influence could be used in modeling applications of real world diffusion and in networked environments, we use our behavioral findings to simulate spreading dynamics in real world case studies. We specifically try to see how cumulative influence plays out in the presence of user uncertainty and measure its outcome on rumor diffusion, which we model as an example of sub-optimal choice diffusion. Together, our simulation results indicate that sequential peer effects from the influence decision overcomes individual uncertainty to guide faster rumor diffusion over time. However, when the rate of diffusion is slow in the beginning, user uncertainty can have a substantial role compared to peer influence in deciding the adoption trajectory of a piece of questionable information.

97 MATHEMATICS AND COMPUTING↗

Data analysis and modeling pipelines for controlled networked social science experiments

There is large interest in networked social science experiments for understanding human behavior at-scale. Significant effort is required to perform data analytics on experimental outputs and for computational modeling of custom experiments. Moreover, experiments and modeling are often performed in a cycle, enabling iterative experimental refinement and data modeling to uncover interesting insights and to generate/refute hypotheses about social behaviors. The current practice for social analysts is to develop tailor-made computer programs and analytical scripts for experiments and modeling. This often leads to inefficiencies and duplication of effort. In this work, we propose a pipeline framework to take a significant step towards overcoming these challenges. Our contribution is to describe the design and implementation of a software system to automate many of the steps involved in analyzing social science experimental data, building models to capture the behavior of human subjects, and providing data to test hypotheses. The proposed pipeline framework consists of formal models, formal algorithms, and theoretical models as the basis for the design and implementation. We propose a formal data model, such that if an experiment can be described in terms of this model, then our pipeline software can be used to analyze data efficiently. The merits of the proposed pipeline framework is elaborated by several case studies of networked social science experiments.

97 MATHEMATICS AND COMPUTING↗

Market-Based and System-Wide Fuel Cycle Optimization

This work introduces automated optimization into fuel cycle simulations in the Cyclus platform. This includes system-level optimizations, seeking a deployment plan that optimizes the performance over the entire transition, and market-level optimization, seeking an optimal set of material trades at each time step. These concepts were introduced in a way that preserves the flexibility of the Cyclus fuel cycle framework, one of its most important design principles.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Yang_et_al_2020_Hydrology_Data

Data supporting the paper "Impact of climate change on adaptive management decisions in the face of water scarcity" in the Journal of Hydrology.

58 GEOSCIENCES↗

Deletion of TGF-β1 Increases Bacterial Clearance by Cytotoxic T Cells in a Tuberculosis Granuloma Model

Mycobacterium tuberculosis is the pathogenic bacterium that causes tuberculosis (TB), one of the most lethal infectious diseases in the world. The only vaccine against TB is minimally protective, and multi-drug resistant TB necessitates new therapeutics to treat infection. Developing new therapies requires a better understanding of the complex host immune response to infection, including dissecting the processes leading to formation of granulomas, the dense cellular lesions associated with TB. In this work, we pair experimental and computational modeling studies to explore cytokine regulation in the context of TB. We use our next-generation hybrid multi-scale model of granuloma formation ( GranSim ) to capture molecular, cellular, and tissue scale dynamics of granuloma formation. We identify TGF-β1 as a major inhibitor of cytotoxic T-cell effector function in granulomas. Deletion of TGF-β1 from the system results in improved bacterial clearance and lesion sterilization. We also identify a novel dichotomous regulation of cytotoxic T cells and macrophages by TGF-β1 and IL-10, respectively. These findings suggest that increasing cytotoxic T-cell effector functions may increase bacterial clearance in granulomas and highlight potential new therapeutic targets for treating TB.

59 BASIC BIOLOGICAL SCIENCES↗

Architecture for Co-Simulation of Transportation and Distribution Systems with Electric Vehicle Charging at Scale in the San Francisco Bay Area

This work describes the Grid-Enhanced, Mobility-Integrated Network Infrastructures for Extreme Fast Charging (GEMINI) architecture for the co-simulation of distribution and transportation systems to evaluate EV charging impacts on electric distribution systems of a large metropolitan area and the surrounding rural regions with high fidelity. The current co-simulation is applied to Oakland and Alameda, California, and in future work will be extended to the full San Francisco Bay Area. It uses the HELICS co-simulation framework to enable parallel instances of vetted grid and transportation software programs to interact at every model timestep, allowing high-fidelity simulations at a large scale. This enables not only the impacts of electrified transportation systems across a larger interconnected collection of distribution feeders to be evaluated, but also the feedbacks between the two systems, such as through control systems, to be captured and compared. The findings are that with moderate passenger EV adoption rates, inverter controls combined with some distribution system hardware upgrades can maintain grid voltages within ANSI C.84 range A limits of 0.95 to 1.05 p.u. without smart charging. However, EV charging control may be required for higher levels of charging or to reduce grid upgrades, and this will be explored in future work.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Integrated Water-Power System Resilience Analysis in a Southeastern Idaho Irrigation District: Minidoka Case Study

This study investigates the joint water–power system resilience of an irrigation district in southeastern Idaho. Irrigation districts face difficulties in the delivery of water to farmers under drought conditions, during equipment failures, or unplanned infrastructure disruptions. The resilience of interconnected water and power systems can be better analyzed and understood through an integrated approach, using a model that connects the dependencies between the two halves of the system. Using a multi-agent system model capturing both water and power system components, as well as their linkages, we capture the interdependencies of these systems and highlight opportunities for improvement when faced with disruptions. Through simulation scenarios, we examine the system resilience using system performance, quantified as the percentage of met demand of the power and water system, when subjected to drought water year, an unforeseen water demand increase, power outage and dam failure. Scenario results indicate that the effects of low flow years are mostly felt in the power system; unexpected increases in water demand marginally impact irrigation system performance; dams and pumps present vulnerabilities of the system, causing substantial unmet demand during disruptions. Noting the interdependencies between the water–power system halves while leveraging an integrated simulation allows for an insightful analysis of the system impacts during disruptions.

13 HYDRO ENERGY↗

Distributed Solar Technoeconomic Agent Characteristics dSTAC

These data files summarize key techno-economic metrics used in the NREL dGen model for modeling adoption of distributed solar by representative residential commercial and industrial entities for each county in the continental United States. As described further below many of the metrics are derived as summaries of outputs from dGen. Specifically each county and sector in these file are summarized as a single agent that is the weighted average of 10 statistically-representative agents weighed by the statistical frequency. The dGen simulation used to derive this dataset was conducted in 2018 using the NREL 2018 Standard Scenario Mid Case assumptions https//www.nrel.gov/docs/fy19osti/71913.pdf.

agent-based modeling↗

An On-Board Off-Board Framework for Online Replanning: Applied to UAVs in Urban Environments

Autonomous systems are being used in a multitude of areas at an increasing rate and require a high level of adaptivity and intelligence to operate safely, especially under faulty conditions. This paper introduces a novel genetic algorithm tailored for UAV trajectory replanning, with an improved execution time via search space reduction based on the operating conditions of the UAV and its remaining mission. A unique characteristic of the replanning agent is its fast-start and adaptive properties, pre-seeding candidates with partial solutions and dynamically tuning elitism, crossover, and mutation rates in correspondence to the average fitness and diversity of the population. A population restart mechanism and early stopping mechanism are evaluated as well to assess their effect on solution quality and runtime. Previous work on genetic algorithms for UAV replanning were conducted with short trajectories in a small state space. Our UAV operates in a 56,000 square meter simulated urban environment, with static obstacles and a total of 53 possible waypoints. The agent increases the safety and reliability of UAV autonomy when operating under faulty conditions and when replanning is required.

Machine Learning↗

Modeling Market Interactions

This slide deck provides a high-level overview of wholesale electricity market design model development activities occurring at NREL. The motivation for this work, as well as the broader NREL modeling landscape in which it belongs, is first presented. Then the various model formulations and features are described.

agent-based simulation↗

Open Source dGen: Beta Release

This presentation provides an update on the dGen beta release as it approaches the full release in September 2020. The presentation includes the open source approach, updates for the open source, a dGen setup and demo, and the road map for the full release and upcoming reports.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Distributed Solar and Storage Adoption Modeling

The National Renewable Energy Laboratory (NREL) is analyzing the rapidly increasing role of energy storage in the electrical grid through 2050 through its Storage Futures Study. In one phase of the study, NREL used the laboratory's Distributed Generation Market (dGen) model to examine the various future distributed storage capacity adoption scenarios, results, and implications.

agent-based modeling↗

Simulation-Based Model for Facility-Scale Eagle Presence Mapping

This talk presents the recent progress in building a predictive movement model for predicting conflict between soaring raptors and wind turbines. In particular, it details the recently developed numerical tool called Stochastic Soaring Raptor Simulator for simulating updraft-subsidized paths for soaring raptors through variety of wind conditions and the associated directional intent.

agent-based model↗

Eagle Behavior and Risk Modeling for Wind Energy Webinar

NREL presents recent progress in the development and validation of new eagle behavioral models, highlighting applications for wind-plant siting and operations. This webinar features talks focused on three areas: atmospheric modeling across the spatiotemporal scales of interest, facility-scale behavioral modeling, and turbine-scale data-driven behavioral modeling. A final presentation demonstrates micrositing as an application of our completely open-source analysis framework.

agent-based movement model↗