Search NASA⌕ Search

SEARCH · Search NASA

Results for “Human Performance Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Automatic information extraction from childhood cancer pathology reports

The International Classification of Childhood Cancer (ICCC) facilitates the effective classification of a heterogeneous group of cancers in the important pediatric population. However, there has been no development of machine learning models for the ICCC classification. We developed deep learning-based information extraction models from cancer pathology reports based on the ICD-O-3 coding standard. In this article, we describe extending the models to perform ICCC classification. We developed 2 models, ICD-O-3 classification and ICCC recoding (Model 1) and direct ICCC classification (Model 2), and 4 scenarios subject to the training sample size. We evaluated these models with a corpus consisting of 29206 reports with age at diagnosis between 0 and 19 from 6 state cancer registries. Our findings suggest that the direct ICCC classification (Model 2) is substantially better than reusing the ICD-O-3 classification model (Model 1). Applying the uncertainty quantification mechanism to assess the confidence of the algorithm in assigning a code demonstrated that the model achieved a micro-F1 score of 0.987 while abstaining (not sufficiently confident to assign a code) on only 14.8% of ambiguous pathology reports. Our experimental results suggest that the machine learning-based automatic information extraction from childhood cancer pathology reports in the ICCC is a reliable means of supplementing human annotators at state cancer registries by reading and abstracting the majority of the childhood cancer pathology reports accurately and reliably.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Probing a Silent Metal: A Combined X-ray Absorption and Emission Spectroscopic Study of Biologically Relevant Zinc Complexes

As the second most common transition metal in the human body, Zinc is of great interest in research but has few viable routes for its direct structural study in biological systems. Herein, Zn valence-to-core X-ray emission spectroscopy (VtC XES) and Zn K-edge X-ray absorption spectroscopy (XAS) are presented as a means to understand the local structure of zinc in biological systems through the application of these methods to a series of biologically relevant model complexes. Taken together, the Zn K-edge XAS and VtC XES provide a means to establish the ligand identity, local geometry, and metal-ligand bond lengths. Experimental results were supported by strongly correlated density-functional-theory-based calculations, which, coupled with the complementarity of the two spectroscopic approaches, further enables future applications to protein systems to be examined in a predictive fashion. In this regard, test calculations were performed to showcase the sensitivity of these techniques to realistic biological applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Applications of Nickelate perovskites for neuromorphic computing from electronic structure and Machine Learning

While the limit of Moore's law is presently being reached with current microelectronic technologies, we need to develop new paradigms that overcome this limitation. In that respect, neuromorphic computing is a concept that emulates the neural behavior and response of the human brain, and it has been recognized as a promising alternative approach. In this research project, we will perform multi-fidelity scale bridging to explore the potential use of materials with metal to insulator transition for neuromorphic applications. In particular, rare earth nickelates are promising for such purposes, as the transition in these materials is quite sensitive to a broad set of different external stimuli. Our multi-fidelity approach will bridge the high-fidelity electronic structure calculations with classical potentials. We will bridge dynamical mean field theory with a classical atomistic representation via a deep learning force field. The neural network is trained with energies, charges, and forces obtained by accurate electronic structure theories based on Dynamical Mean Field Theory. The configurational space is generated from known crystal phases, ab initio molecular dynamics with exchange-correlation functionals corrected with the Hubbard model, disordered phases with different concentrations of oxygen vacancies, and nonsymmetrical positions and induced strain by grain interfaces or contact with a substrate. Strategies to train the model with a reduced number of training examples are obtained from active learning methods, and new structures for improving the learning process are generated by using machine learning autoencoders. This classical potential will be validated through a diversity of electronic structure methods and represents an important step to combine the flexibility and accuracy of first-principles with the speed of classical potentials. The generated multi-fidelity surrogate model will be used to understand the role of strain, oxygen vacancies, proton doping, the variation of the crystal phase, substrate effects, vibrational effects as the octahedral rotation, grain boundaries and defect effects on the response of a Metal to Insulator Transition (MIT) in correlated materials. Long time and large-scale simulations will help understand the role of different stimuli to control the hysteresis of the MIT, as it has been experimentally suggested. Selected configurations will be analyzed with higher-level theories to provide an accurate electronic description and to study how the orbitals and charges are rearranged under different conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A graph neural network (GNN) approach to basin-scale river network learning: the role of physics-based connectivity and data fusion

Abstract. Rivers and river habitats around the world are under sustained pressure from human activities and the changing global environment. Our ability to quantify and manage the river states in a timely manner is critical for protecting the public safety and natural resources. In recent years, vector-based river network models have enabled modeling of large river basins at increasingly fine resolutions, but are computationally demanding. This work presents a multistage, physics-guided, graph neural network (GNN) approach for basin-scale river network learning and streamflow forecasting. During training, we train a GNN model to approximate outputs of a high-resolution vector-based river network model; we then fine-tune the pretrained GNN model with streamflow observations. We further apply a graph-based, data-fusion step to correct prediction biases. The GNN-based framework is first demonstrated over a snow-dominated watershed in the western United States. A series of experiments are performed to test different training and imputation strategies. Results show that the trained GNN model can effectively serve as a surrogate of the process-based model with high accuracy, with median Kling–Gupta efficiency (KGE) greater than 0.97. Application of the graph-based data fusion further reduces mismatch between the GNN model and observations, with as much as 50 % KGE improvement over some cross-validation gages. To improve scalability, a graph-coarsening procedure is introduced and is demonstrated over a much larger basin. Results show that graph coarsening achieves comparable prediction skills at only a fraction of training cost, thus providing important insights into the degree of physical realism needed for developing large-scale GNN-based river network models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Performance-based earthquake early warning for tall buildings

The ShakeAlert Earthquake Early Warning (EEW) system aims to issue an advance warning to residents on the West Coast of the United States seconds before the ground shaking arrives, if the expected ground shaking exceeds a certain threshold. However, residents in tall buildings may experience much greater motion due to the dynamic response of the buildings. Therefore, there is an ongoing effort to extend ShakeAlert to include the contribution of building response to provide a more accurate estimation of the expected shaking intensity for tall buildings. Currently, the supposedly ideal solution of analyzing detailed finite element models of buildings under predicted ground-motion time histories is not theoretically or practically feasible. The authors have recently investigated existing simple methods to estimate peak floor acceleration (PFA) and determined these simple formulas are not practically suitable. Instead, this article explores another approach by extending the Pacific Earthquake Engineering Research Center (PEER) performance-based earthquake engineering (PBEE) to EEW, considering that every component involved in building response prediction is uncertain in the EEW scenario. Additionally, while this idea is not new and has been proposed by other researchers, it has two shortcomings: (1) the simple beam model used for response prediction is prone to modeling uncertainty, which has not been quantified, and (2) the ground motions used for probabilistic demand models are not suitable for EEW applications. In this article, we address these two issues by incorporating modeling errors into the parameters of the beam model and using a new set of ground motions, respectively. We demonstrate how this approach could practically work using data from a 52-story building in downtown Los Angeles. Using the criteria and thresholds employed by previous researchers, we show that if peak ground acceleration (PGA) is accurately estimated, this approach can predict the expected level of human comfort in tall buildings.

58 GEOSCIENCES↗
DOE OSTI2025

Toward equitable environmental exposure modeling through convergence of data, open, and citizen sciences: an example of air pollution exposure modeling amidst increasing wildfire smoke

Exposure modeling is critical in environmental epidemiology and human health but may face challenges (e.g., skewed data, unequal error, context-insensitive validation, and computational demands). Modeling decisions reflect the intended use of the models and the values that modelers prioritize. We aimed to provide a conceptual framework and machine learning (ML) modeling protocols that address these issues. With 500m-gridded hourly PM 2.5 and O 3 levels in Illinois before, during, and after the 2023 Canadian wildfire season as a motivating example, we conducted modeling experiments to evaluate modeling methods, guided by three domains we propose based on theories of science: 1) Data Diversity, leveraging open and citizen science data to enhance inclusivity, parsimony, and representativeness; 2) Equitable Accuracy, ensuring fairly distributed uncertainties across subpopulations; and 3) Sustainable Modeling, balancing accuracy with reducing computational demands to promote accessibility for under-resourced researchers. Here, we found that ML with publicly available data can achieve high accuracy. Depending on methods, performance may vary substantially, even with identical input data. Large but skewed data may reduce performance. Misuse of cross-validation protocols can underestimate prediction error; although we observed R 2 s of ∼98 %, the modeled estimates varied significantly, indicating the need for careful model validation. By using new modeling protocols including representativeness-considered training and validation data and a new loss function, we achieved high agreement between estimates and ground-based measurements (e.g., R 2 = ∼90 % for PM 2.5 ; ∼80 % for O 3 ), equally distributed errors across sociodemographic strata and urban–rural divides, and reduction in computation time—from several weeks or months to a few days.

Exposure assessment↗
DOE OSTI2025

Rapid Adaptation of Chemical Named Entity Recognition Using Few-Shot Learning and LLM Distillation

Named entity recognition (NER) has been widely used in chemical text mining for the automatic identification and extraction of chemical entities. However, existing chemical NER systems primarily focus on scenarios with abundant training data, requiring significant human effort on annotations. This poses challenges for applications in the chemical field, such as catalysis, where many advancements have traditionally relied on trial-and-error investigations and incremental adjustment of variables. This hinders catalysis science and technology progress in addressing emerging energy and environmental crises. In this work, we propose a few-shot NER model that can quickly adapt to extract new types of chemical entities by using only a limited number of annotated examples. Our model employs a metric-learning approach to transfer entity similarity knowledge from high-resource chemical domains (with abundant annotations) to enable effective entity recognition in low-resource specialized domains (limited annotation). We validate the effectiveness of our model on a few-shot chemical NER benchmark built based on six existing chemical NER data sets. Experiments show that the proposed few-shot NER model can achieve reasonable performance with only 5 examples per entity type and shows consistent improvement as the number of examples increases. Furthermore, we demonstrate how the proposed model can be trained with large language model (LLM) annotated data, opening a new pathway for rapid adaptation of NER systems. Furthermore, our approach leverages the knowledge broadness of large language models for chemistry while distilling this knowledge into a lightweight model suitable for efficient and in-house use.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Optimal Black Start Allocation for Power System Restoration

Equipment failures, operator errors, natural disasters and cyber-attacks can and have caused extended blackouts of the electric grid. Even though such events are rare, preparedness for them is critical because extended power outages endanger human lives, compromise national security, or result in economic losses of billions of dollars. Since most of the generating units cannot restart without connecting to an energized grid, the system operator relies on a few units with the ability to start autonomously, called Black Start (BS) units, to restore the power system. Allocating and maintaining these units is costly and can severely impact the restoration security and time. We formulate an optimization problem to optimally allocate BS units in the grid, while simultaneously optimizing over the restoration sequence. We extend existing optimal allocation models by including grid considerations such as active power nodal balance, transmission switching, nodal reactive power support and voltage limits. In order to aid the branch and bound tree that solves the resulting large scale mixed integer program, we propose a randomized heuristic that is executed multiple times in parallel on a high-performance computing environment to find feasible solutions. Here, we proceed to solve the IEEE-39, the IEEE-118, and a simplified WECC system with 225 nodes and 136 generators to near optimality.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Neuromorphic Computing is Turing-Complete

Neuromorphic computing is a non-von Neumann computing paradigm that performs computation by emulating the human brain. Neuromorphic systems are extremely energy-efficient and known to consume thousands of times less power than CPUs and GPUs. They have the potential to drive critical use cases such as autonomous vehicles, edge computing and internet of things in the future. For this reason, they are sought to be an indispensable part of the future computing landscape. Neuromorphic systems are mainly used for spike-based machine learning applications, although there are some non-machine learning applications in graph theory, differential equations, and spike-based simulations. These applications suggest that neuromorphic computing might be capable of general-purpose computing. However, general-purpose computability of neuromorphic computing has not been established yet. In this work, we prove that neuromorphic computing is Turing-complete and therefore capable of general-purpose computing. Specifically, we present a model of neuromorphic computing, with just two neuron parameters (threshold and leak), and two synaptic parameters (weight and delay). We devise neuromorphic circuits for computing all the μ-recursive functions (i.e., constant, successor and projection functions) and all the μ-recursive operators (i.e., composition, primitive recursion and minimization operators). Given that the μ-recursive functions and operators are precisely the ones that can be computed using a Turing machine, this work establishes the Turing-completeness of neuromorphic computing.

Date, Prasanna↗
DOE OSTI2023

Evaluating Impacts of the Inflation Reduction Act and Bipartisan Infrastructure Law on the U.S. Power System

The Inflation Reduction Act of 2022 (IRA) and the Infrastructure Investment and Jobs Act of 2021, commonly referred to as the 'Bipartisan Infrastructure Law (BIL),' collectively represent the largest commitment of the U.S. Federal Government to invest in the modernization and decarbonization of the U.S. energy system. The Congressional Budget Office (CBO) estimates that total support for the broad range of climate and clean energy programs, tax credits, and other incentives authorized through the two laws will exceed $430 billion from 2022 through 2031 (CRS 2022; CBO 2021, 2022). While the climate and clean energy provisions are numerous and have the potential to impact all aspects of the U.S. energy system from fuel and electricity production to final consumption in industry, transportation, and buildings, the provisions relevant to the electricity sector - in particular the suite of tax credits for clean generation, storage, and carbon dioxide ( CO 2 ) capture and storage - are expected to be some of the most consequential in terms of emissions reduction and clean energy deployment (Larsen et al. 2022; Jenkins, Mayfield, et al. 2022; Mahajan et al. 2022; Zhao et al. 2022). In this report, we detail the methods and results of a study estimating the potential impacts of key provisions of IRA and BIL on the contiguous U.S. power sector from present day through 2030. The analysis employs an advanced power system planning model, the Regional Energy Deployment System (ReEDS), to evaluate how major provisions from both laws impact investment in and operation of utility-scale generation, storage, and transmission, and, in turn, how those changes impact power system costs, emissions, and climate and health damages. While not exhaustive in capturing every provision, the analysis estimates the possible scale of power-sector impacts that could result from the modeled provisions in IRA and BIL. The study is structured around two scenarios to evaluate the potential impacts of both laws on the power sector: 1) No New Policy: A counter-factual scenario that reflects all Federal and state policies enacted as of September 2022, with exception to IRA and BIL, and assumes load growth consistent with the Energy Information Administration's Annual Energy Outlook 2022 (AEO22) Reference case (EIA 2022a); 2) IRA-BIL: A scenario reflecting all Federal and state policies enacted as of September 2022, including key IRA and BIL provisions, most notably the investment and production tax credits for zero-carbon emitting electricity generation and storage (ITC and PTC), the tax credit for CO 2 capture and storage (45Q), and the tax credit for existing nuclear plants (described further in Section 2.3). To account for the impacts of IRA and BIL on electrification, assumes increased load growth consistent with a scaled version of the Medium Electrification scenario from the Electrification Futures Study (Mai et al. 2018). These scenarios are simulated across seven sets of assumptions with varying projected future electricity market conditions, including technology costs and performance, natural gas prices, and the degree of availability, feasibility, and cost of development of renewable resources, electricity transmission, and CO 2 pipeline, injection, and storage infrastructure. In addition, we simulate two sensitivities on the 'policy' treatment in which we vary key assumptions pertaining to the realized value of the clean electricity ITC and PTC: 1) the cost of monetization of tax credits, and 2) the level of bonus crediting realized by project developers. We demonstrate that IRA and BIL have the collective potential to drive substantial growth in clean electricity by 2030, while reducing costs for consumers, mitigating climate change, and decreasing the human health impacts of power sector emissions. However, we also demonstrate that if expected cost improvements of clean technologies are not realized and/or constraints on deployment driven by factors such as supply-chain challenges, regulatory hurdles, and the social acceptability of energy infrastructure development limit the rate of clean energy and associated infrastructure deployment (such as transmission), then the share of clean generation achieved and the associated emissions benefits realized may be substantively reduced.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2018

Radiosynthesis and Biodistribution of {sup 99m}Tc-Metronidazole as an Escherichia coli Infection Imaging Radiopharmaceutical

Bacterial infection poses life-threatening challenge to humanity and stimulates to the researchers for developing better diagnostic and therapeutic agents complying with existing theranostic techniques. Nuclear medicine technique helps to visualize hard-to-diagnose deep-seated bacterial infections using radionuclide-labeled tracer agents. Metronidazole is an antiprotozoal antibiotic that serves as a preeminent anaerobic chemotherapeutic agent. The aim of this study was to develop technetium-99m-labeled metronidazole radiotracer for the detection of deep-seated bacterial infections. Radiosynthesis of {sup 99m}Tc-metronidazole was carried by reacting reduced technetium-99m and metronidazole at neutral pH for 30 min. The stannous chloride dihydrate was used as the reducing agent. At optimum radiolabeling conditions, ~ 94% radiochemical was obtained. Quality control analysis was carried out with a chromatographic paper and instant thin-layer chromatographic analysis. The biodistribution study of radiochemical was performed using Escherichia coli bacterial infection-induced rat model. The scintigraphic study was performed using E. coli bacterial infection-induced rabbit model. The results showed promising accumulation at the site of infection and its rapid clearance from the body. The tracer showed target-to-non-target ratio 5.57 ± 0.04 at 1 h post-injection. The results showed that {sup 99m}Tc-MNZ has promising potential to accumulate at E. coli bacterial infection that can be used for E. coli infection imaging.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2019

Development of a Preliminary Performance Assessment to Support Single-Shell Tank Waste Retrieval - 19446

A preliminary Performance Assessment (PA) of Single-Shell Tank (SST) Waste Management Area A-AX (WMA A-AX) located at DoE's Hanford Site in southeastern Washington is being conducted to satisfy the requirements of the Hanford Federal Facility Agreement and Consent Order (HFFACO), as well as other Federal and State requirements of closure plans and permits. The WMA A-AX PA effort is assessing the fate, transport, and impacts of radionuclides and hazardous chemicals within residual wastes left in tanks, ancillary equipment, and facilities in their assumed closed configuration, and the subsequent risks to humans into the far future. WMA A-AX includes the 241-A Tank Farm (A Farm), the 241-AX Tank Farm (AX Farm), and the ancillary equipment associated with each Farm. There are six underground SSTs in A Farm, and four underground SSTs in AX Farm. Each of these SSTs have a storage capacity of 1,000,000 gallons. A complex waste transfer system of ancillary equipment supported the transfer and storage of waste within WMA A-AX SSTs. This ancillary equipment includes transfer lines, catch tanks, diversion boxes, vaults, valve pits, and other miscellaneous structures. This paper emphasizes the development of the PA effort focused on radiological impacts to meet the requirements for a closure authorization under DOE Order 435.1. Lessons learned from retrieval and development of a recently completed PA of the nearby Waste Management Area C (WMA C) led to the decision to develop a preliminary PA for WMA A-AX prior to initiation of retrieval efforts so that a site-specific risk management capability could be available to support anticipated retrieval decisions. The technical approach for the PA analysis includes developing both a process-level model using site-specific hydrogeological data, as well as a system-level model. The system model is being developed to facilitate uncertainty and sensitivity analyses being conducted in the PA effort. Preliminary results of the DOE Order 435.1 PA are evaluating potential impacts to the groundwater and air pathways to determine radiation exposure once radionuclides are released to the environment from residual waste after closure of the tank farm. To meet other analysis requirements in DOE Order 435.1, the PA effort must also evaluate potential radiological impacts from inadvertent intruder scenarios into the closed WMA A-AX facility. The results of the PA evaluation will be compared to performance objectives and measures in the DOE Order 435.1 to support retrieval and eventual closure decisions at WMA A-AX. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2017

Quantifying the effect of interannual ocean variability on the attribution of extreme climate events to human influence

In recent years, the climate change research community has become highly interested in describing the anthropogenic influence on extreme weather events, commonly termed “event attribution.” Limitations in the observational record and in computational resources motivate the use of uncoupled, atmosphere/land-only climate models with prescribed ocean conditions run over a short period, leading up to and including an event of interest. In this approach, large ensembles of high-resolution simulations can be generated under factual observed conditions and counterfactual conditions that might have been observed in the absence of human interference; these can be used to estimate the change in probability of the given event due to anthropogenic influence. However, using a prescribed ocean state ignores the possibility that estimates of attributable risk might be a function of the ocean state. Thus, the uncertainty in attributable risk is likely underestimated, implying an over-confidence in anthropogenic influence. In this work, we estimate the year-to-year variability in calculations of the anthropogenic contribution to extreme weather based on large ensembles of atmospheric model simulations. Our results both quantify the magnitude of year-to-year variability and categorize the degree to which conclusions of attributable risk are qualitatively affected. The methodology is illustrated by exploring extreme temperature and precipitation events for the northwest coast of South America and northern-central Siberia; we also provides results for regions around the globe. While it remains preferable to perform a full multi-year analysis, these results can serve as an indication of where and when attribution researchers should be concerned about the use of atmosphere-only simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Deep learning multiphysics network for imaging CO 2 saturation and estimating uncertainty in geological carbon storage

Multiphysics inversion exploits different types of geophysical data that often complement each other and aims to improve overall imaging resolution and reduce uncertainties in geophysical interpretation. Despite the advantages, traditional multiphysics inversion is challenging because it requires a large amount of computational time and intensive human interactions for preprocessing data and finding trade-off parameters. These issues make it nearly impossible for traditional multiphysics inversion to be applied as a real-time monitoring tool for geological carbon storage. In this paper, we present a deep learning (DL) multiphysics network for imaging CO 2 saturation in real time. The multiphysics network consists of three encoders for analysing seismic, electromagnetic and gravity data and shares one decoder for combining imaging capabilities of the different geophysical data for better predicting CO 2 saturation. The network is trained on pairs of CO 2 label models and multiphysics data so that it can directly image CO 2 saturation. Here we use the bootstrap aggregating method to enhance the imaging accuracy and estimate uncertainties associated with CO 2 saturation images. Using realistic CO 2 label models and multiphysics data derived from the Kimberlina CO 2 storage model, we evaluate the performance of the deep learning multiphysics network and compare its imaging results to those from the deep learning single-physics networks. Our modelling experiments show that the deep learning multiphysics network for seismic, electromagnetic, and gravity data not only improves the imaging accuracy but also reduces uncertainties associated with CO 2 saturation images. Our results also suggest that the deep learning multiphysics network for the non-seismic data (i.e., electromagnetic and gravity) can be used as an effective low-cost monitoring tool in between regular seismic monitoring.

58 GEOSCIENCES↗
DOE OSTI2018

Temperature effect on phase state and reactivity controls atmospheric multiphase chemistry and transport of PAHs

Polycyclic aromatic hydrocarbons like benzo(a)pyrene (BaP) in atmospheric particulate matter pose a threat to human health because of their high carcinogenicity. In the atmosphere, BaP is mainly degraded through a multiphase reaction with ozone, but the fate and atmospheric transport of BaP are poorly characterized. Earlier modeling studies used reaction rate coefficients determined in laboratory experiments at room temperature, which may overestimate/underestimate degradation rates when applied under atmospheric conditions. Moreover, the effects of diffusion on the particle bulk are not well constrained, leading to large discrepancies between model results and observations. We show how regional and global distributions and transport of BaP can be explained by a new kinetic scheme that provides a realistic description of the temperature and humidity dependence of phase state, diffusivity, and reactivity of BaP-containing particles. Low temperature and humidity can substantially increase the lifetime of BaP and enhance its atmospheric dispersion through both the planetary boundary layer and the free troposphere. The new scheme greatly improves the performance of multiscale models, leading to better agreement with observed BaP concentrations in both source regions and remote regions (Arctic), which cannot be achieved by less-elaborate degradation schemes (deviations by multiple orders of magnitude). Our results highlight the importance of considering temperature and humidity effects on both the phase state of aerosol particles and the chemical reactivity of particulate air pollutants.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Automating the Analysis of Large Language Models Responses through Zero-Shot Question Answering

Recent advancements in Large Language Models (LLMs) have shown significant potential in various applications, yet their evaluation, particularly in zero-shot question answering scenarios, remains a challenging task. In this study, our objective was to explore precision metrics for Large Language Models (LLM) and design and implement a software pipeline to automatically evaluate LLMs' outputs under zero-shot question answering. Zero-shot question answering involves a model providing answers to questions about topics it hasn't seen during training. It leverages the principles of zero-shot learning by relying on semantic understanding and generalization from related knowledge. The data used was metadata from medical databases on congenital heart disease. We explored eleven LLM metrics and selected three for our evaluation: BLEU, BERTScore, and MoverScore. BLEU calculates a score based on the overlap of n-grams (contiguous sequences of n items, typically words) between the machine-generated translation and the reference translations. Higher BLEU scores indicate better correspondence between the machine-generated and human-generated translations. BERTScore is a metric used to evaluate the quality of machine-generated text by measuring the similarity of token embeddings produced by BERT (Bidirectional Encoder Representations from Transformers) between the generated text and reference text. MoverScore is a metric that quantifies the dissimilarity between the distributions of word embeddings from machine-generated text and reference text, emphasizing semantic similarity over exact token overlap. We also introduced HBKI, a composite metric summarizing these approaches. We tested five models —GPT-3, Llama-2, Gemini 1.5 Pro, Solar 10.7B, and Mixtral-8x7b. Our software pipeline, designed and implemented using Object-Oriented Programming principles, allows users to customize the selection and extraction of features for topics of interest in their own research. Our results show that MoverScore delivered the most precise evaluation of the LLM's outputs, while Mixtral-8x7b achieved the best overall performance in extracting metadata from the databases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

w18_empower-aids - HIV Envelope at Multiple Scales [Slides]

Being the sole viral protein entity expressed on the surface of the Human Immunodeficiency Virus (HIV) envelope, the Envelope Glycoprotein (Env) remains the only plausible immunological target. Nevertheless, extreme dynamic heterogeneity, structural complexity, and system size make the study of these glycoproteins immensely challenging. We have utilized the Institutional Computing (IC) resources to overcome some of these challenges in computational modeling of the Env glycoproteins. This integrated technique can sufficiently sample a physiologically relevant conformational space accessible to carbohydrates, in a very short time. This method has been validated by quantitatively comparing to experimental cryoEM maps of the HIV Env protein. We have employed graph theory to capture the glycan shield topological network, pinpoint potential interaction pathways, and identify concerted behavior of the glycans. Analyses of various network attributes, such as relative centrality of different glycan positions, identification of communities, and critical subnetwork features, have aided in detailed examination of the glycan shield. Starting from select structures modeled by the pipeline, we are performing large-scale atomistic MD simulations to study the temporal behavior of this system, which will help elucidate biologically relevant antibody behavior. This method can be seamlessly extended to benefit research in Zika, Ebola and other high-density glycosylated systems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Critical Literature Review of Quantitative Sustainability Assessment Methods for the Circular Economy

The circular economy (CE) has been proposed to be an operational framework for sustainable development that decouples economic growth from resource consumption. The CE ambition is to maximize the retention of value in products, materials, and resources in the economy over time with the help of CE strategies such as selling a service rather than a product, reusing and repairing products or their components, and recycling. The social, economic, and environmental performances of CE strategies need to be measured against their linear counterparts to avoid strategies that increase circularity but have other unintended externalities. However, there is currently no tool specifically designed to compare circular to linear systems and, thus, various methods from different fields have been applied. This session aims at reviewing, contrasting, and critiquing different methods that have been applied to assess the CE until now, along with an up to date state of the science in this field. Methods from the industrial ecology field have most often been applied to study the CE. However, the transition to CE involves both technological improvements as well as social changes. New business models such as collaborative consumption models (e.g., Uber or Airbnb) are examples of the new patterns of production and consumption of the CE, which may be difficult to analyze from a purely industrial ecology perspective. Methods from complexity science and humanities could therefore complement the industrial ecology perspective to extend the scope of the analysis. Such an approach could also answer a longstanding criticism of the CE which, in contrast with sustainability, solely focuses on the environment and the economy. Moreover, the hybridization of two or more existing methods can yield additional capabilities, which may enable the exploration of additional CE-related research questions. The 90 minutes session will have several presentations and conclude with a moderated, interactive panel discussion on how methods from different fields could be combined to harness their relative strengths.

circular economy↗