Engineering topics

Emery, Benjamin F.

Publications and source records attributed to Emery, Benjamin F..

5 records

DOE OSTI2023

Reading Between the Lines: Measuring the Effects of Linguistic-Based Indicators of Deception on Experts’ Identification and Categorization of Disinformation

There is currently very limited research into how experts analyze and assess potentially fraudulent content in their expertise areas, and most research within the disinformation space involves very limited text samples (e.g., news headlines). The overarching goal of the present study was to explore how an individual’s psychological profile and the linguistic features in text might influence an expert’s ability to discern disinformation/fraudulent content in academic journal articles. At a high level, the current design tasked experts with reading journal articles from their area of expertise and indicating if they thought an article was deceptive or not. Half the articles they read were journal papers that had been retracted due to academic fraud. Demographic and psychological inventory data collected on the participants was combined with performance data to generate insights about individual expert susceptibility to deception. Our data show that our population of experts were unable to reliably detect deception in formal technical writing. Several psychological dimensions such as comfort with uncertainty and intellectual humility may provide some protection against deception. This work informs our understanding of expert susceptibility to potentially fraudulent content within official, technical information and can be used to inform future mitigative efforts and provide a building block for future disinformation work.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

Discerning Deception: An Empirically-Driven Agent-Based Model of Expert Evaluation of Scientific Content

Both human subject experiments and computational, modeling and simulations have been used to study detection of deception. This work aims to combine these two methods by integrating empirically-derived information (from human subject experiments) into agent-based models to generate novel insights into the complex problems of detection of disinformation content. Computational experiments are used to simulate across multiple scenarios for evaluation and decision-making regarding the validity of potentially deceptive scientific documents. Factors influencing the human agent behaviors in the model were identified through a human subject experiment that was conducted to evaluate and characterize decision making related to disinformation discernment. Correlation and regression analyses were used to translate insights from the human subjects experiment to inform the parameterization of agent features and scenario development. Three scenarios were evaluated with the agent-based models to help evaluate the replicability of the simulations (validation analysis) and assess the influence of human agent and document features (sensitivity analyses). A replication of the human participant experiment demonstrated that the agent-based simulations compare favorably to empirical findings. The agent-based modeling was then used to conduct sensitivity analysis on the accuracy of deception detection as a function of document proportions and human agent features. Results indicate that precision values are adversely impacted when the proportion of deceptive documents is lower in the overall sample, whereas recall values are more sensitive to changes in human agent features. These findings indicate important nuances in accuracy evaluations that should be further considered (including consideration of potential alternate metrics) in future agent-based models of disinformation. Additional areas for future exploration include extension of simulations to consider other ways to align the agent-based model design with psychological theory and inclusion of agent-agent interactions, especially as it pertains to sharing of scientific information within an organizational context.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

Global relationships between crop diversity and nutritional stability

Nutritional stability – a food system’s capacity to provide sufficient nutrients despite disturbance – is an important, yet challenging to measure outcome of diversified agriculture. Using 55 years of data across 184 countries, we assemble 22,000 bipartite crop-nutrient networks to quantify nutritional stability by simulating crop and nutrient loss in a country, and assess its relationship to crop diversity across regions, over time and between imports versus in country production. We find a positive, saturating relationship between crop diversity and nutritional stability across countries, but also show that over time nutritional stability remained stagnant or decreased in all regions except Asia. These results are attributable to diminishing returns on crop diversity, with recent gains in crop diversity among crops with fewer nutrients, or with nutrients already in a country’s food system. Finally, imports are positively associated with crop diversity and nutritional stability, indicating that many countries’ nutritional stability is market exposed.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Climate impacts associated with reduced diet diversity in children across nineteen countries

It is widely anticipated that climate change will negatively affect both food security and diet diversity. Diet diversity is especially critical for children as it correlates with macro and micronutrient intake important for child development. Despite these anticipated links, little empirical evidence has demonstrated a relationship between diet diversity and climate change, especially across large datasets spanning multiple global regions and with more recent climate data. Here we use survey data from 19 countries and more than 107 000 children, coupled with 30 years of precipitation and temperature data, to explore the relationship of climate to child diet diversity while controlling for other agroecological, geographic, and socioeconomic factors. We find that higher long-term temperatures are associated with decreases in overall child diet diversity, while higher rainfall in the previous year, compared to the long-term average rainfall, is associated with greater diet diversity. Examining six regions (Asia, Central America, North Africa, South America, Southeast Africa, and West Africa) individually, we find that five have significant reductions in diet diversity associated with higher temperatures while three have significant increases in diet diversity associated with higher precipitation. In West Africa, increasing rainfall appears to counterbalance the effect of rising temperature impacts on diet diversity. In some regions, the statistical effect of climate on diet diversity is comparable to, or greater than, other common development efforts including those focused on education, improved water and toilets, and poverty reduction. These results suggest that warming temperatures and increasing rainfall variability could have profound short- and long-term impacts on child diet diversity, potentially undermining widespread development interventions aimed at improving food security.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Sensitivity and Uncertainty Analysis of Generator Failures under Extreme Temperature Scenarios in Power Systems

This report summarizes work done under the Verification, Validation, and Uncertainty Quantification (VVUQ) thrust area of the North American Energy Resilience Model (NAERM) Program. The specific task of interest described in this report is focused on sensitivity analysis of scenarios involving failures of both wind turbines and thermal generators under extreme cold-weather temperature conditions as would be observed in a Polar Vortex event.

17 WIND ENERGY↗