Search NASA⌕ Search

SEARCH · Search NASA

Results for “real-world evidence”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Flexible Ramping Product Procurement in Day-Ahead Markets

Flexible ramping products (FRPs) emerge as a promising instrument for addressing steep and uncertain ramping needs through market mechanisms. Initial implementations of FRPs in North American electricity markets, however, revealed several shortcomings in existing FRP designs. Here, in many instances, FRP prices failed to signal the true value of ramping capacity, most notably evident in zero FRP prices observed in a myriad of periods during which the system was in acute need for rampable capacity. These periods were marked by scheduled but undeliverable FRPs, often calling for operator out-of-market actions. On top of that, the methods used for procuring FRPs have been primarily rule-based, lacking explicit economic underpinnings. In this paper, we put forth an alternative framework for FRP procurement, which seeks to set FRP requirements and schedule FRP awards such that the expected system operation cost is minimized. Using real-world data from U.S. ISOs, we showcase the relative merits of the framework in (i) reducing the total system operation cost, (ii) improving price formation, (iii) enhancing the the deliverability of FRP awards, and (iv) reducing the need for out-of-market actions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Short-term Electricity Price Forecasting with Constrained Regressors

The volatility of electricity price presents a challenge to market participants as their decision-making process are highly depend on the accuracy of price forecasts. However, there is growing empirical evidence of increasing price volatility and price spikes in electricity markets as a result of variable renewable energy generation, extreme weather events, and other factors. The distribution shift caused by spikes in electricity price data differentiates the forecasting tasks from other renewable energy sources. Moreover, the observations may be compromised by cyberattacks and thus not available in the testing phase. To this end, we propose a Similarity-Enhanced Electricity Decomposition Forecasting model (SEED-Forecaster) to address the missing response problem and spikes capturing in short-term electricity price forecasting. The effectiveness of the proposed framework is tested on real-world electricity price data from California Independent System Operator (CAISO). Numerical results of case studies show that the proposed SEED-Forecsater can enhance forecasting performance, particularly in capturing electricity spikes, even under conditions without regressors during testing stage.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Caught in headlights: Captive white-tailed deer responses to variations in vehicle lighting during imminent collision scenarios

Vehicle collisions with deer (Odocoileus spp.) cause billions of dollars in damages and injure thousands of drivers every year in the United States, and few mitigation methods have proven effective. However, recent research suggests that vehicle lighting might influence white-tailed deer (Odocoileus virginianus; hereafter, deer) responses to oncoming vehicles. Most new vehicles are manufactured with light emitting diode (LED) headlights which differ in total radiance and wavelength of light emitted compared to the previous industry standard of tungstenhalogen (halogen) headlights. Also, frontal vehicle illumination through rear-facing lighting has shown promise in enhancing deer responses to vehicles, but its effectiveness has not been tested under various headlight conditions (headlight type or intensity). As such, it remains unclear how these aspects of vehicle lighting affect deer responses to an approaching vehicle. We used 23 captive, wild-type deer to investigate how variations in vehicle lighting affect deer responses to an approaching vehicle at night, when most collisions occur. We released deer into a 95 m long, 3 m wide chute and approached them from the opposite end with an electric golf cart outfitted with two versions of stock 2017–2020 Ford Fusion headlights (LED and halogen) and a 51 cm rear-facing lightbar to test how vehicle lighting affected deer avoidance behaviors in an imminent, head-on collision scenario. Each deer received eight lighting treatments consisting of unique combinations of headlight type (LED vs. halogen), light intensity (low vs. high beam), and rear-facing lighting (lightbar off vs. on). We measured deer alert and flight behavior using infrared videography. We found that the halogen, high beam, lightbar off treatment had the greatest probability of evoking an alert response. Furthermore, when the lightbar was off, high beams appeared to increase alert probability for halogen headlights. Also, we found evidence that high beam, halogen headlights tend to increase alert probability over high beam, LED headlights, when the lighbar was off. We found no effect of our lighting treatments on deer alert distance, flight probability, or flight initiation distance. Across all behavioral responses, the random effect deer ID explained 0.86–9.19 × more variation than our lighting treatments, reflecting large differences in responses among deer. Overall, we found that vehicle lighting can impact deer behavior during an imminent, head-on collision scenario, although lighting was ineffective at increasing favorable flight behaviors. Future research should investigate how vehicle lighting treatments affect free-ranging, wild deer in a variety of real-world scenarios and at longer approach distances.

White-tailed deer (Odocoileus virginianus) Deer be↗

Rapid biodegradation of microplastics generated from bio-based thermoplastic polyurethane

The accumulation of microplastics in various ecosystems has now been well documented and recent evidence suggests detrimental effects on various biological processes due to this pollution. Accumulation of microplastics in the natural environment is ultimately due to the chemical nature of widely used petroleum-based plastic polymers, which typically are inaccessible to biological processing. One way to mitigate this crisis is adoption of plastics that biodegrade if released into natural environments. In this work, we generated microplastic particles from a bio-based, biodegradable thermoplastic polyurethane (TPU-FC1) and demonstrated their rapid biodegradation via direct visualization and respirometry. Furthermore, we isolated multiple bacterial strains capable of using TPU-FC1 as a sole carbon source and characterized their depolymerization products. Finally, to visualize biodegradation of TPU materials as real-world products, we generated TPU-coated cotton fabric and an injection molded phone case and documented biodegradation by direct visualization and scanning electron microscopy (SEM), both of which indicated clear structural degradation of these materials and significant biofilm formation.

09 BIOMASS FUELS↗

Interplanetary Transit Simulations Using the International Space Station

We evaluated the space life sciences utility of the International Space Station (ISS) to simulate the outbound transit portion of missions to Mars and Near Earth Asteroids (NEA) to investigate biomedical and psychological aspects of such transits, to develop and test space operation procedures compatible with communication delays and outages, and to demonstrate and validate technologies and countermeasures. Two major categories of space life sciences activities can capitalize on ISS capabilities. The first includes studies that require ISS (or a comparable facility), typically for access to prolonged weightlessness. The second includes studies that do not strictly require ISS but can exploit it to maximize their scientific return more efficiently and productively than in ground-based simulations. For these studies, ISS offers a high fidelity analog for fundamental factors on future missions, such as crew composition, mission control personnel, operational tasks and workload, real-world risk, and isolation, and can mimic the effects of distance and limited accessibility. In addition to conducting Mars- and NEA-transit simulations on 6-month ISS increments, extending the current ISS increment duration from 6 months to 9 or even 12 months will provide opportunities for enhanced and focused research relevant to long duration Mars and NEA missions. Increasing the crew duration may pose little additional risk to crewmembers beyond that currently accepted on 6-month increments, but additional medical monitoring capabilities will be required beyond those currently used for ISS operations. Finally, while presenting major logistical challenges, such a simulation followed by a post-landing simulation of Mars exploration could provide quantitative evidence of capabilities in an actual mission. Thus, the use of ISS to simulate aspects of Mars and NEA missions seems practical. If it were to be implemented without major disruption of on-going ISS activities, then planning should begin soon, in close consultation with all international partners.

Charles, John B.↗

Wildfire Segmentation From Remotely Sensed Data Using Quantum-Compatible Conditional Vector Quantized-Variational Autoencoders

Wildfires represent a critical environmental hazard with multifaceted implications for ecosystems, communities, and public health [1]. The escalating frequency and intensity of wildfires globally have intensified the urgency for robust segmentation methodologies to facilitate effective mitigation, response, and recovery strategies [2]. Accurate wildfire segmentation is pivotal for delineating fire boundaries, assessing progression patterns, and prioritizing resource allocation during emergency scenarios. Furthermore, precise segmentation enables stakeholders, including policymakers, environmental scientists, and emergency responders, to formulate evidence-based strategies, thereby minimizing socio-economic disruptions and ecological degradation. Consequently, advancing wildfire segmentation techniques through innovative technological interventions remains a paramount research imperative. Although foundational in wildfire segmentation, traditional deterministic models exhibit inherent limitations that compromise their efficacy in dynamic and uncertain environments. These models often operate on rigid algorithms prioritizing deterministic classifications, thereby overlooking the inherent complexities and uncertainties associated with wildfire behavior and satellite data variability. Such deterministic frameworks tend to produce oversimplified representations that fail to capture the intricate nuances of evolving fire dynamics, spatial heterogeneity, and environmental interactions [1]. Consequently, the deterministic approach’s propensity for uncertainty collapsing [1, 3] hampers the accuracy, reliability, and applicability of segmentation outcomes in real-world scenarios. Contrastingly, stochastic models offer a more nuanced and adaptable framework for wildfire segmentation. By integrating probabilistic elements into the modeling paradigm, stochastic approaches, particularly probabilistic approaches such as variational auto encoders (VAEs) [4], facilitate comprehensive uncertainty assessment, enabling researchers to quantify and incorporate uncertainties into segmentation outcomes effectively. This probabilistic nature empowers stochastic models to encapsulate variability, account for data inconsistencies, and adapt to evolving environmental conditions, enhancing segmentation accuracy, reliability, and robustness. Embracing stochastic methodologies thus catalyzes advancements in wildfire science by fostering a more holistic, adaptive, and resilient segmentation framework. Despite VAEs demonstrating significant promise in various applications, they come with inherent limitations that have garnered attention within the machine learning community. One of the primary drawbacks lies in their reliance on static priors, which essentially assume a fixed distribution for latent variables, thereby limiting the model’s flexibility to capture complex data structures effectively [5]. This static nature leads to suboptimal representations, especially when dealing with complex and high-dimensional data. Additionally, VAEs often struggle with generating sharp and realistic samples, a phenomenon commonly referred to as mode collapse [5, 7, 6]. Furthermore, the optimization process in VAEs, which involves balancing the reconstruction loss and the regularization term, can sometimes be challenging to fine-tune [7]. In recent efforts to address these shortcomings, alternative approaches like Vector Quantized Variational Auto encoders(VQ-VAEs) [7], address the challenges by incorporating discrete latent variables and leveraging techniques that enhance the quality and diversity of generated samples while maintaining efficient training dynamics. VQ-VAEs propose a dynamic prior distribution generation mechanism that diverges from the static priors commonly associated with traditional VAEs. This dynamic approach allows for more adaptive and context-aware latent variable representations, thereby potentially capturing complex data structures more effectively. Unlike autoregressive prior models such as PixelCNN, which, despite their ability to model dependencies across data dimensions, suffer from significant computational inefficiencies and lack flexibility in handling diverse datasets. In our work, we propose to use a generative quantum-compatible approach to help alleviate the shortcomings of autoregressive prior model in VQ-VAEs. Restricted Boltzmann Machines (RBMs) are a viable alternative prior model that can learn prior distributions in a faster and more flexible manner. In this research endeavor, we meticulously curate a state-of-the-art dataset leveraging satellite MODIS data in conjunction with VIIRS fire masks, derived from Fire Radiative Power (FRP), thereby encapsulating diverse wildfire scenarios and environmental contexts. We developed a conditional VQ-VAE architecture with the RBM prior model that is trained in a supervised manner for segmenting wildfire masks. This innovative approach synergistically harnesses deep learning capabilities, enabling the generation of segmentation maps characterized by heightened precision, granularity, and contextual relevance. Furthermore, replacing the autoregressive prior learning method proposed by the original VQ-VAE with a prior density approximation via quantum-compatible RBM facilitates expedited inference processes, augments flexibility in prior sampling, optimizes computational efficiency and establishes a groundbreaking benchmark in wildfire segmentation methodologies.

quantum machine learning↗

Enhanced Safety of Heavy-Duty Vehicles on Highways through Automatic Speed Enforcement – A Simulation Study

Highway safety remains a significant concern, especially in mixed traffic scenarios involving heavy-duty vehicles (HDV) and smaller passenger cars. The vulnerability of HDVs following closely behind smaller cars is evident in incidents involving the lead vehicle, potentially leading to catastrophic rear-end collisions. Here, this paper explores how automatic speed enforcement systems, using speed cameras, can mitigate risks for HDVs in such critical situations. While historical crash data consistently demonstrates the reduction of accidents near speed cameras, this paper goes beyond the conventional notion of crash occurrence reduction. Instead, it investigates the profound impact of driver behavior changes within desired travel speed distribution, especially around speed cameras, and their contribution to the safety of trailing vehicles, with a specific focus on heavy-duty trucks in accident-prone scenarios. To conduct this analysis, we utilize SUMO, an open-source microscopic traffic simulator, enabling realistic simulations of real-world driving behaviors with and without speed cameras. The simulations also consider empirical distributions of desired headway gaps and reaction times exhibited by human drivers. This study offers a fresh perspective on highway safety by examining how the influence of automatic speed enforcement systems on driver behavior enhances the safety of HDV when faced with challenging situations. By shedding light on these dynamics, we contribute valuable insights to the ongoing research efforts on using technology to create safer roadways, ultimately promoting safer coexistence between heavy-duty and passenger vehicles.

33 ADVANCED PROPULSION SYSTEMS↗

Application of DLT cybersecurity stack to TES applications for a scalable, cybersecure, and interoperable future

Transactive Energy Systems (TES) are expected to improve upon existing grid operations and capabilities by enabling the integration of traditional grid resources with distributed energy resources (DER). Distributed Ledger Technology or DLT (e.g., blockchain) presents itself as a viable instrument to support decentralized, autonomous, and tamper-evident applications, which can be leveraged within TES's ecosystem. DLTs can provide pertinent security controls including access controls, data immutability, and traceability in addition to other well-known advantages such as decentralization and scalability. This work demonstrates the DLT Cybersecurity stack and its applicability to TES-based use-cases/applications. The seven-layer DLT cybersecurity stack is a DLT-agnostic framework that can quickly be used to classify and group the individual needs of an application into the different processing and cybersecurity layers offered by a DLT using a common taxonomy and an architectural mapping framework. This enables application engineers to demystify and strengthen the overall security aspects of their systems while maintaining an open perspective towards features and drawbacks that may hinder their performance in real-world scenarios. The paper leverages the work performed by the IEEE P2418.5 - Blockchain for Energy Standards working group.

Blockchain, blockchain interoperability, Cybersecu↗

Federated benchmarking of medical artificial intelligence with MedPerf

Medical artificial intelligence (AI) has tremendous potential to advance healthcare by supporting and contributing to the evidence-based practice of medicine, personalizing patient treatment, reducing costs, and improving both healthcare provider and patient experience. Unlocking this potential requires systematic, quantitative evaluation of the performance of medical AI models on large-scale, heterogeneous data capturing diverse patient populations. Here, to meet this need, we introduce MedPerf, an open platform for benchmarking AI models in the medical domain. MedPerf focuses on enabling federated evaluation of AI models, by securely distributing them to different facilities, such as healthcare organizations. This process of bringing the model to the data empowers each facility to assess and verify the performance of AI models in an efficient and human-supervised process, while prioritizing privacy. We describe the current challenges healthcare and AI communities face, the need for an open platform, the design philosophy of MedPerf, its current implementation status and real-world deployment, our roadmap and, importantly, the use of MedPerf with multiple international institutions within cloud-based technology and on-premises scenarios. Finally, we welcome new contributions by researchers and organizations to further strengthen MedPerf as an open benchmarking platform.

60 APPLIED LIFE SCIENCES↗

Electrochemical Characterization of Dissolved Oxides in Molten FLiNaK

Molten fluoride salts have long been the subject of investigation given their application in a variety of industrial processes. Oxides are a common exogeneous impurity within these systems, and can lead to many operational and regulatory concerns. In recent studies, the electro-oxidation of dissolved metallic oxides has been attributed to a single step oxygen evolution reaction despite voltametric evidence suggesting otherwise. Here, we first use square wave voltammetry to confirm that the oxidation of dissolved oxides in fluorides proceeds via a two-electron transfer reaction and then demonstrate that the presence of a peroxide-mediated redox reaction better explains the electrochemical data. Numerical simulations were then used to support the determination of improved diffusion coefficients to enable electroanalytical measurements of the oxide concentration across at a variety of temperatures. A linear Arrhenius relationship was observed when the experimental data was corrected for ohmic resistance effects. Concentration measurements using the corrected square wave voltammetry data demonstrated high accuracy across a large range of concentrations, while the uncorrected data showed plateauing and high errors. In total, this work serves to rectify previously misconstrued electrochemical data of oxides in molten salts and demonstrate how accurate, in situ concentration measurements can be achieved in real-world systems.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗

A comprehensive academic and industrial survey of blockchain technology for the energy sector using fuzzy Einstein decision-making

The global energy sector is undergoing a significant transformation driven by decarbonization and digitalization, leading to the emergence of Distributed Ledger Technology (DLT) — particularly blockchain — as a promising tool for enhancing transparency, security, and efficiency in modern power systems. This study aims to provide a comprehensive academic and industrial survey of blockchain applications in the energy sector and develop a robust decision-making framework to identify and prioritize the most promising real-world use cases based on multidisciplinary criteria. A three-stage methodology was adopted: (i) a literature and market review encompassing over 300 academic publications and commercial blockchain initiatives in energy, (ii) an in-depth evaluation of the evolution and viability of blockchain initiatives in energy with the help of expert surveys, and (iii) a novel decision-making model using a q-rung orthopair fuzzy Multi-Attributive Border Approximation (q-ROF-MABAC) method under the Einstein operator. The results were compared with existing decision models to validate consistency and robustness. Nine key blockchain use case categories were identified and ranked based on technical, economic, and governance dimensions. The results demonstrated that integrating expert insights into a fuzzy logic framework helps filter out overhyped claims in the literature and prioritize realistic and high-impact applications such as green certificates, grid services, and peer-to-peer energy trading. The model’s rankings remained stable across varying weight configurations, confirming the robustness of the methodology. This study provides an evidence-based decision-support tool for researchers, industry stakeholders, and policymakers to better understand, evaluate, and adopt blockchain technologies in the energy sector.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Global Explainability of A Deep Abstaining Classifier for Cancer Pathology Reports

We present a global explainability method to characterize sources of errors in a real-world multitask deep abstaining classifier (DAC), in the context of cancer histology prediction. Our multitask classifier, currently deployed for automated annotation of cancer pathology reports from NCI-SEER registries, was trained and evaluated on 1.04 million hand-annotated samples and makes simultaneous predictions of cancer site, subsite, histology, laterality, and behavior for each report. The DAC framework enables the model to abstain on ambiguous reports and confusing classes to achieve the target accuracy on the retained (non-abstained) samples, but at the cost of decreased coverage. Requiring 97% accuracy on the histology task caused our model to retain only 22% of all samples, mostly the less ambiguous and common classes. Local explainability with the GradInp technique provided a computationally efficient way of obtaining contextual reasoning for hundreds of thousands of individual predictions. Our method, involving dimensionality reduction of approximately 13000 aggregated local explanations (ALE), offers a tractable path to true global explainability. It enabled identification of sources of errors in histology classification, globally, as hierarchical complexity among classes, label noise, insufficient information, and conflicting evidence. This suggests several strategies for iterative improvement of our DAC, including well-designed exclusion criteria, focused annotation, and reduced penalties for errors involving hierarchically related classes.

59 BASIC BIOLOGICAL SCIENCES↗

Robust Anthropogenic Signal Identified in the Seasonal Cycle of Tropospheric Temperature

Previous work identified an anthropogenic fingerprint pattern in T AC (x, t), the amplitude of the seasonal cycle of mid- to upper-tropospheric temperature (TMT), but did not explicitly consider whether fingerprint identification in satellite T AC (x, t) data could have been influenced by real-world multidecadal internal variability (MIV). Here we address this question here using large ensembles (LEs) performed with five climate models. LEs provide many different sequences of internal variability noise superimposed on an underlying forced signal. Despite differences in historical external forcings, climate sensitivity, and MIV properties of the five models, their T AC (x, t) fingerprints are similar and statistically identifiable in 239 of the 240 LE realizations of historical climate change. Comparing simulated and observed variability spectra reveals that consistent fingerprint identification is unlikely to be biased by model underestimates of observed MIV. Even in the presence of large (factor of 3–4) intermodel and inter-realization differences in the amplitude of MIV, the anthropogenic fingerprints of seasonal cycle changes are robustly identifiable in models and satellite data. This is primarily due to the fact that the distinctive, global-scale fingerprint patterns are spatially dissimilar to the smaller-scale patterns of internal T AC (x, t) variability associated with the Atlantic multidecadal oscillation and El Niño–Southern Oscillation. The robustness of the seasonal cycle detection and attribution results shown here, taken together with the evidence from idealized aquaplanet simulations, suggest that basic physical processes are dictating a common pattern of forced T AC (x, t) changes in observations and in the five LEs. The key processes involved include GHG-induced expansion of the tropics, lapse-rate changes, land surface drying, and sea ice decrease.

54 ENVIRONMENTAL SCIENCES↗

Model-Form Epistemic Uncertainty Quantification for Modeling with Differential Equations: Application to Epidemiology

Modeling real-world phenomena to any degree of accuracy is a challenge that the scientific research community has navigated since its foundation. Lack of information and limited computational and observational resources necessitate modeling assumptions which, when invalid, lead to model-form error (MFE). The work reported herein explored a novel method to represent model-form uncertainty (MFU) that combines Bayesian statistics with the emerging field of universal differential equations (UDEs). The fundamental principle behind UDEs is simple: use known equational forms that govern a dynamical system when you have them; then incorporate data-driven approaches – in this case neural networks (NNs) – embedded within the governing equations to learn the interacting terms that were underrepresented. Utilizing epidemiology as our motivating exemplar, this report will highlight the challenges of modeling novel infectious diseases while introducing ways to incorporate NN approximations to MFE. Prior to embarking on a Bayesian calibration, we first explored methods to augment the standard (non-Bayesian) UDE training procedure to account for uncertainty and increase robustness of training. In addition, it is often the case that uncertainty in observations is significant; this may be due to randomness or lack of precision in the measurement process. This uncertainty typically manifests as “noisy” observations which deviate from a true underlying signal. To account for such variability, the NN approximation to MFE is endowed with a probabilistic representation and is updated using available observational data in a Bayesian framework. By representing the MFU explicitly and deploying an embedded, data-driven model, this approach enables an agile, expressive, and interpretable method for representing MFU. In this report we will provide evidence that Bayesian UDEs show promise as a novel framework for any science-based, data-driven MFU representation; while emphasizing that significant advances must be made in the calibration of Bayesian NNs to ensure a robust calibration procedure.

97 MATHEMATICS AND COMPUTING↗

Improving the Fidelity of Capability & Resource Weighting in A Probalistic Risk Assessment Model for Spaceflight

INTRODUCTION NASA’s Informing Mission Planning via Analysis of Complex Tradespaces (IMPACT) tool uses Probabilistic Risk Assessment (PRA) to provide an evidence-based, data-driven estimate of how medical system capabilities affect mission outcomes. IMPACT maps condition incidence to available resources thereby facilitating the calculation of outcome metrics that allow the estimation of mission medical risk. Conditions can be nominally categorized as either treated or untreated depending on the availability of necessary diagnostic and therapeutic capabilities. This categorization enables IMPACT to estimate the effect of various medical system configurations on mission outcomes such as crew mortality, disability, crew member down-time, return to duty/recovery, and need for evacuation. IMPACT currently employs an equal weighting, “partial credit” approach to define treatment in which each of the capabilities associated with a given condition contributes an equal amount to management of the condition. This feature enables IMPACT to report values in between “fully untreated” and “fully treated” based on the proportion of capabilities available within the model. However, as is normal in medical/clinical practice, not all individual capabilities contribute equally to medical care. For example, the ability to provide intramuscular epinephrine during an anaphylactic episode contributes more likelihood of overall management success than does the administration of oral diphenhydramine. We hypothesize that weighting the relative contribution of each capability to each specific condition will improve outcome prediction and therefore will better provide mission planners with more nuanced and accurate options when designing space medical systems. METHODS Using a five-point Fibonacci scaling sequence (1, 2, 3, 5, 8) subject matter experts from NASA’s Exploration Medical Capabilities (ExMC) element assigned relative contribution weighting values to each identified capability within IMPACT. Since the relative importance of each capability varies depending on the specific condition, the resulting “partial” weighting was completed for more than 1,600 individual weighting assignments for 666 capabilities across 121 conditions. Each assignment required three-physician concurrence based on the overall importance of the capability to the diagnosis and management of the condition being considered and the difficulty with which it could be improvised by the crew. Once complete, 100,000 IMPACT simulations were run for a 6-month Lunar mission with a 30-day surface stay to evaluate the effect of this modification of the model. RESULTS Partial weighting significantly decreased predicted task time loss (TTL), evacuation, and loss of crew life without causing significant changes to the recommended medical system design. CONCLUSIONS The paucity of real-world referent data to support long-duration space missions of this type limits the ability to judge one predictive analytics method as superior to another. However, since the proposed method significantly reduces and optimizes outcome risks—without changing the medical system design—incorporating a partial weighting methodology is likely to provide a more accurate and operationally-relevant representation of medical risk without compromising IMPACTs ability to inform overarching medical system requirements.

Steller JG↗

Is the testing effect ready to be put to work? Evidence from the laboratory to the classroom.

The testing effect refers to the benefits to retention that result from structuring learning activities in the form of a test. As educators consider implementing test-enhanced learning paradigms in real classroom environments, we think it is critical to consider how an array of factors affecting test-enhanced learning in laboratory studies bear on test-enhanced learning in real-world classroom environments. As such, this review discusses the degree to which test feedback, test format (of formative tests), number of tests, level of the test questions, timing of tests (relative to initial learning), and retention duration have import for testing effects in ecologically valid contexts (e.g., classroom studies). Attention is also devoted to characteristics of much laboratory testing-effect research that may limit translation to classroom environments, such as the complexity of the material being learned, the value of the testing effect relative to other generative learning activities in classrooms, an educational orientation that favors criterial tests focused on transfer of learning, and online instructional modalities. We consider how student-centric variables present in the classroom (e.g., cognitive abilities, motivation) may have bearing on the effects of testing-effect techniques implemented in the classroom. We conclude that the testing effect is a robust phenomenon that benefits a wide variety of learners in a broad array of learning domains. Still, studies are needed to compare the benefit of testing to other learning strategies, to further characterize how individual differences relate to testing benefits, and to examine whether testing benefits learners at advanced levels.

60 APPLIED LIFE SCIENCES↗

Sustainable Manufacturing and the Circular Economy

The term "zero waste" can be somewhat misleading, as it implies an idealization of a concept that may never be achieved in real-world practice. According to Waste360 , "many in the solid waste industry think zero waste is an impossible goal. (Zero-waste advocates) believe just the opposite that a zero-waste approach makes the most economical and environmental sense...Most everyone agrees, however, that actually reaching the point where absolutely no waste is created is unlikely" (Leroux 2001). "Zero waste is a goal. It's completely unachievable...It's not about perfection; it's about making better choices" (Kellogg 2018). The immediate value of moving towards a zero-waste society is not immediately clear, but since the world we live in is finite in its resources, at what point does that value become evident? How do we broaden our value analysis to better incorporate the longer-term view? What are strategies that we can easily incorporate now that will significantly increase that longer term value and mitigate the impacts for future generations? This report considers these questions through a series of case studies from different parts of the U.S. manufacturing sector.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗