Search NASA⌕ Search

SEARCH · Search NASA

Results for “scoring system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Development and Validation of a Scoring System for Abnormalities in the Gopher Frog (Rana capito)

Headstarting efforts are thought to be critical in supplementing populations of the at-risk Gopher Frog (Rana capito); however, recent efforts have occasionally resulted in juveniles with developmental abnormalities. In response, we developed a scoring system to collect quantitative data on the presence and severity of these developmental abnormalities. Our objective was to describe and validate the abnormality scoring system so that it can be used by all Gopher Frog headstarting facilities. The scoring system covers five primary conditions encompassing commonly observed abnormalities. Two groups of participants with different levels of prior experience working with Gopher Frogs assigned scores to a set of images presented to them for each condition. We used intra-class correlation coefficients (ICC) to test the scoring system for inter- and intra-rater agreement as well as agreement with the benchmark standard (established by the authors). We found high ICC values for inter-rater agreement, intra-rater agreement, and agreement to the benchmark standard indicating either excellent or good reliability for all five conditions and for all raters when grouped together. These findings support the reliability and validity of the proposed developmental abnormality scoring system. Gopher Frog headstarting facilities can implement this scoring system to assist in tracking the frequency and severity of abnormalities observed in future headstarting efforts. We hope that by creating a reliable scoring system for Gopher Frogs, it can provide an overall framework and serve as a valuable resource to evaluate abnormalities across any amphibian species.

abnormality↗
DOE OSTI2021

Improving Data and Prediction Quality of High-Throughput Perovskite Synthesis with Model Fusion

Combinatorial fusion analysis (CFA) is an approach for combining multiple scoring systems using the rank-score characteristic function and cognitive diversity measure. One example is to combine diverse machine learning models to achieve better prediction quality. In this work, we apply CFA to the synthesis of metal halide perovskites containing organic ammonium cations via inverse temperature crystallization. Using a data set generated by high-throughput experimentation, four individual models (support vector machines, random forests, weighted logistic classifier, and gradient boosted trees) were developed. We characterize each of these scoring systems and explore 66 possible combinations of the models. When measured by the precision on predicting crystal formation, the majority of the combination models improves the individual model results. The best combination models outperform the best individual models by 3.9 percentage points in precision. In addition to improving prediction quality, we demonstrate how the fusion models can be used to identify mislabeled input data and address issues of data quality. In particular, we identify example cases where all single models and all fusion models do not give the correct prediction. Experimental replication of these syntheses reveals that these compositions are sensitive to modest temperature variations across the different locations of the heating element that can hinder or enhance the crystallization process. In summary, we demonstrate that model fusion using CFA can not only identify a previously unconsidered influence on reaction outcome but also be used as a form of quality control for high-throughput experimentation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

A Novel DNA Repair Gene Signature for Immune Checkpoint Inhibitor-Based Therapy in Gastric Cancer

Gastric cancer is a heterogeneous group of diseases with only a fraction of patients responding to immunotherapy. The relationships between tumor DNA damage response, patient immune system and immunotherapy have recently attracted attention. Accumulating evidence suggests that DNA repair landscape is a significant factor in driving response to immune checkpoint blockade (ICB) therapy. In this study, to explore new prognostic and predictive biomarkers for gastric cancer patients who are sensitive and responsive to immunotherapies, we developed a novel 15-DNA repair gene signature (DRGS) and its related scoring system and evaluated the efficiency of the DRGS in discriminating different molecular and immune characteristics and therapeutic outcomes of patients with gastric adenocarcinoma, using publicly available datasets. The results demonstrated that DRGS high score patients showed significantly better therapeutic outcomes for ICB compared to DRGS low score patients (p < 0.001). Integrated analysis of multi-omics data demonstrated that the patients with high DRGS score were characteristic of high levels of anti-tumor lymphocyte infiltration, tumor mutation burden (TMB) and PD-L1 expression, and these patients exhibited a longer overall survival, as compared to the low-score patients. Results obtained from HPA and IHC supported significant dysregulation of the genes in DRGS in gastric cancer tissues, and a positive correlation in protein expression between DRGS and PD-L1. Therefore, the DRGS scoring system may have implications in tailoring immunotherapy in gastric cancers. A preprint has previously been published (Yuan et al., 2021).

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Evaluating Nuclear Forensic Signatures for Advanced Reactor Deployment: A Research Priority Assessment

The development and deployment of a new generation of nuclear reactors necessitates a thorough evaluation of techniques used to characterize nuclear materials for nuclear forensic applications. Advanced fuels proposed for use in these reactors present both challenges and opportunities for the nuclear forensic field. Many efforts in pre-detonation nuclear forensics are currently focused on the analysis of uranium oxides, uranium ore concentrates, and fuel pellets since these materials have historically been found outside of regulatory control. The increasing use of TRISO particles, metal fuels, molten fuel salts, and novel ceramic fuels will require an expansion of the current nuclear forensic suite of signatures to accommodate the different physical dimensions, chemical compositions, and material properties of these advanced fuel forms. In this work, a semi-quantitative priority scoring system is introduced to identify the order in which the nuclear forensics community should pursue research and development on material signatures for advanced reactor designs. This scoring system was applied to propose the following priority ranking of six major advanced reactor categories: (1) molten salt reactor (MSR), (2) liquid metal-cooled reactor (LMR), (3) very-high-temperature reactor (VHTR), (4) fluoride-salt-cooled high-temperature reactor (FHR), (5) gas-cooled fast reactor (GFR), and (6) supercritical water-cooled reactor (SWCR).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Assessment of oil and gas fields in California as potential CO 2 storage sites

California's total annual greenhouse gas (GHG) emissions (425.3 MtCO 2 e) in 2018 were about 6.4% of the US total (6,677 MtCO 2 e) and around 1% of global emissions. About 39% of 2018 GHG emissions in California were from the industrial and electrical sectors. Many of these emissions were from large stationary point sources and were suitable for carbon capture retrofit with subsequent storage of the captured carbon dioxide (CO 2 ) in geological formations. Previous studies of California found suitable geology and CO 2 storage resource. This study refines and furthers prior work using a three-stage screening process of oil fields, gas fields, and underground natural gas storage (UGS) sites by combining criteria from previous studies while excluding sites that pose technical risk or are located in regions with surface restrictions including sensitive habitats and dense populations. In the first stage, 129 CO 2 storage sites in California were identified using qualification criteria based upon formation properties including geological conditions and pore pressure. The second stage identified sensitive sites by applying conservative screens including seismic activity, faulting, population density, restricted lands, and sensitive habitats. During the third stage, 61 CO 2 potential storage sites were identified by subtraction of stage 2 areas from stage 1. The potential storage volume in the third stage ranged from 1.0 to 2.0 GtCO 2 . Finally, we applied a scoring system with seven parameters to rank the 61 potential sites based on subsurface technical criteria. The scored sites are classified as high priority, medium priority, and sites for future study. Prospective CO 2 storage sites with high and moderate priority were selected and linked to CO 2 sources. There are 14 prospective sites (above 20 MtCO 2 storage resource per site) with a total storage resource of 1024 MtCO 2 distributed in Northern and Southern California. Of these sites, there are 9 potential CO 2 -EOR sites and 1 depleted oil field with a total estimated CO 2 storage volume of ~800 MtCO 2 in the Southern San Joaquin and Ventura Basin. These 10 prospective sites with a storage resource greater than 20 MtCO 2 could potentially deliver more than 20 years of storage with an average injection rate of 40 MtCO 2 /year. The remaining 4 highly prospective sites are in Northern California. Additionally, study results suggest that saline formations should be re-evaluated in concert with storage in oil, gas, and natural gas storage reservoirs.

58 GEOSCIENCES↗
DOE OSTI2021

Genetic background influences the effect of thirdhand smoke exposure on anxiety and memory in Collaborative Cross mice

Growing evidence indicates that thirdhand smoke (THS) exposure induces many adverse health effects. However, it is unclear how THS exposure affects behavior and how host genetic background modulates phenotypic changes. Here we used the Collaborative Cross (CC) mouse population-based model to assess behavioral alterations immediately after THS exposure from 4 to 9 weeks of age. We first measured anxiety-like behavior in six strains using light/dark box combined with a custom multivariate mouse tracking system. We developed an anxiety risk scoring system based on anxiety-related traits and then evaluated the THS impact on them. THS exposure significantly decreased anxiety risk in CC019 ( P = 0.002) and CC051 ( P = 0.009), but increased anxiety risk in CC036 ( P < 0.001), while the other three strains did not show significant changes in anxiety-related traits. Such differences were driven by female mice for the six measures of anxiety-like behavior. Memory potential was measured in the same cohort of mice using the passive avoidance assay. Both THS-exposed male and female CC019 mice displayed significant memory loss compared to controls while no significant changes were found in the other five strains. This study provides strong evidence that THS exposure leads to strain-dependent changes in anxiety-like behavior and memory, suggesting that host genetic variations play a critical role in individual susceptibility to THS-induced effects.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

An iterative learning and inference approach to managing dynamic cyber-vulnerabilities of complex systems

As modern systems become increasingly reliant on cyber-technologies and continue to be integrated with physical systems, managing risks from deliberate and non-deliberate sources is a significant research challenge. Unlike strictly physical systems, cyber-enabled physical systems are influenced by dynamic and evolving technologies, environments, and attack mechanisms. As a result, vulnerabilities are rapidly changing and difficult to detect and manage. While there is recent interest in the dynamic properties of performance through resilience analysis, limited research addresses the dynamic nature of cyber-system vulnerability. This paper presents a dynamic iterative learning approach to evaluate the state of health for systems as related to cyber-vulnerabilities. These time-varying system health characteristics may not be visible, but can be inferred using observable characteristics. The approach recognizes that multiple types of vulnerabilities need to be included in a holistic system health assessment. The methods are applied to the Common Vulnerability Scoring System database containing over 100,000 documented cybersecurity vulnerabilities. This work is the first to acknowledge the dynamic properties of cyber-vulnerability, while also inferring system health using observable data and hidden states of system health. This work will be of interest to managers of large-scale cyber-enabled physical systems who are seeking to prioritize system health investments.

Chatterjee, Samrat↗
DOE OSTI2026

Blueprint: Stakeholder-Specific Vulnerability Categorization Guidance

Vulnerability management is a process of discovering, analyzing, and handling new or reported security vulnerabilities in systems to prevent the systems from being exploited, to reduce risk, and to protect assets. For vulnerability analysis, handling, and response, the prioritization of organizational and analyst resources must precede. The Common Vulnerability Scoring System (CVSS) is a standard prioritization method that is used to rate the severity of security vulnerabilities in systems by assigning numerical severity scores, but it does not provide clear guidelines of how the numerical severity scores might inform decisions. The Stakeholder-Specific Vulnerability Categorization (SSVC) provides a method for prioritizing vulnerabilities based on the needs of the stakeholders involved in the vulnerability management process. Instead of the numerical scoring used in the CVSS, the SSVC focuses on contextual decision-making to determine how quickly and effectively an organization should respond to vulnerabilities. The main functionality of the SSVC accommodates the diversity of the stakeholders in the vulnerability management process, including finders, vendors, coordinators, deployers, and others. So, the SSVC should be designed to be used by any of these stakeholders, and it should be customizable to enable specific stakeholder decision models and risk appetites.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Do Remote Camera Arrangements and Image Capture Settings Improve Individual Identification of Golden Eagles?

Individual identification of animals from camera traps has become an important task in wildlife research, but camera deployment methods often do not facilitate this important undertaking. Identification of individual golden eagles (Aquila chrysaetos) is possible using uniquely marked rectrices, but no studies have explored methods to maximize the rate of individual identification from camera images. Furthermore, our objectives were to assess whether different camera heights (1 m vs. 3 m), image capture settings (one image after a 1-min delay vs. burst of 5 images after a 30 sec delay), and arrangements relative to bait (dorsally vs. ventrally aimed) affected views of rectrices on golden eagles and our ability to identify individuals. We conducted our study from 15 December 2016 to 3 March 2017 on the Savannah River Site, South Carolina. First, we developed a scoring system based on views of rectrices and used a linear mixed-effects model to compare image scores among different camera arrangements and image settings. Next, after identifying individual eagles, we used generalized linear mixed-effects models to compare total individual eagle detections, total days an individual was detected, and probability of obtaining an unknown individual identification among camera arrangements and settings. Overall, we scored a total of 27,499 images, with 8,083 providing views of marked rectrices that allowed identification of 18 individual eagles. Average image scores and proportion of images suitable for individual identification were higher from elevated (3 m) camera arrangements than standard arrangements (1 m) across sites. Regardless of camera height, faster frequency of image capture provided more images that could be used to identify individuals and the most trap days per individual. Researchers and managers should consider deploying elevated cameras traps with faster frequency of image capture to improve data quality and potential for analysis of golden eagle populations and trends across the species’ range.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Clinically applicable 53-Gene prognostic assay predicts chemotherapy benefit in gastric cancer: A multicenter study

BACKGROUND:We previously established a 53-gene prognostic signature for overall survival (OS) of gastric cancer patients. This retrospective multi-center study aimed to develop a clinically applicable gene expression detection assay and to investigate the prognostic value of this signature. METHODS:A TCGA gastric adenocarcinoma cohort (TCGA-STAD) was used for comparing 53-gene signature with other gene signatures. A high-throughput mRNA hybridization gene expression assay was developed to quantify the expression of 53-genes in formalin-fixed paraffin-embedded tissues of 540 patients enrolled from three hospitals. 180 patents were randomly selected from two hospitals to build a prognostic prediction model based on the 53-gene signature using leave-p-out (one-third out) cross-validation method together with Cox regression and Kaplan-Meier analysis, and the model was assessed on three validation cohorts. FINDINGS:In the evaluation phase, studies based on TCGA-STAD showed that the 53-gene signature was significantly superior to other three prognostic signatures and was independent of TCGA molecular subtypes and clinical factors. For clinical validation and utility, the prognostic scores were generated using the newly developed assay, which was reliable and sensitive, in 100 sampling training sets and were significantly associated with OS in 100 sampling validation sets. The scores were significantly associated with OS in three independent and combined validation cohorts, and in patients with stages II and III/IV. The multivariate Cox regression demonstrated that the prognostic power of the score was independent of clinical factors, consistent with those findings in the TCGA dataset. Finally, patients with good prognostic scores exhibited significantly a better 5-year OS rate from adjuvant FOLFOX chemotherapy after surgery than from other chemotherapies. INTERPRETATION:The 53-gene prognostic score system is clinically applicable for predicting the OS of patients independent of clinical factors in gastric cancers, which could also be a promising predictive biomarker for FOLFOX regimen. FUNDING:Chinese National Science and Technology, National Natural Science Foundation and Natural Science Foundation of Jiangsu Province.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Genetic variations and their interaction with thirdhand smoke exposure on anxiety and memory in Collaborative Cross mice

Thirdhand smoke (THS) is linked to adverse health effects, but the effect of genetic variations on behavioral outcomes is poorly understood. To investigate this, we assessed anxiety- and memory-related behaviors in 820 mice from 21 strains of the genetically diverse Collaborative Cross (CC) mouse that were exposed to THS from 4 through 10 weeks of age. Anxiety was evaluated with a light/dark box assay with a previously established risk score system. Females were generally more sensitive: THS reduced anxiety risk in strains CC013, CC019, and CC051, but increased risk in CC036 and CC061, while males showed no significant effects. Memory was tested using passive avoidance: impairments were observed in both sexes in CC016 and CC019, with sex-dependent effects in CC002 and CC051. A genome-wide association study identified 2,347 SNPs associated with anxiety and 1,568 SNPs with memory, with 32 and 85 SNPs, respectively, interacting with THS exposure. Enrichment analyses revealed distinct biological processes underlying susceptibility, including axonogenesis, synapse organization, cognition, and learning and memory. KEGG pathway analysis identified distinct genetic pathways, including GTPase binding and GTPase regulatory activity, that act as critical molecular switches in the brain that regulate synaptic plasticity, dendritic spine structure, and neuronal signaling, directly influencing anxiety-like behaviors and memory formation. These findings show that THS exposure affects neurobehavioral outcomes in a sex- and genotype-dependent manner, highlighting critical gene-environment interactions and providing a foundation for mechanistic insights into THS neurotoxicity

Anxiety↗
DOE OSTI2020

Overcharge-to-thermal-runaway behavior and safety assessment of commercial lithium-ion cells with different cathode materials: A comparison study

In this paper, overcharge behaviors and thermal runaway (TR) features of large format lithium-ion (Li-ion) cells with different cathode materials (LiFePO 4 (LFP), Li[Ni 1/3 Co 1/3 Mn 1/3 ]O 2 (NCM111), Li[Ni 0.6 Co 0.2 Mn 0.2 ]O 2 (NCM622) and Li[Ni 0.8 Co 0.1 Mn 0.1 ]O 2 (NCM811)) were investigated. The results showed that, under the same overcharge condition, the TR of LFP Li-ion cell occurred earlier compared with the NCM Li-ion cells, indicating its poor overcharge tolerance and high TR risk. However, when TR occurred, LFP Li-ion cell exhibited lower maximum temperature and mild TR response. All NCM Li-ion cells caught fire or exploded during TR, while the LFP Li-ion cell only released a large amount of smoke without fire. According to the overcharge behaviors and TR features, a safety assessment score system was proposed to evaluate the safety of the cells. In short, NCM Li-ion cells have better performance in energy density and overcharge tolerance (or low TR risk), while LFP Li-ion cell showed less severe response to overcharging (or less TR hazards). For NCM Li-ion cells, as the ratio of nickel in cathode material increases, the thermal stability of the cathode materials becomes poorer, and the TR hazards increase. Such a comparison study on large format Li-ion cells with different cathode materials can provide deeper insights into the overcharge behaviors and TR features, and provide guidance for engineers to reasonably choose battery materials in automotive applications.

25 ENERGY STORAGE↗
DOE OSTI2025

Beyond Optimization: Exploring Novelty Discovery in Autonomous Experiments

Autonomous experiments (AEs) are transforming how scientific research is conducted by integrating artificial intelligence with automated experimental platforms. Current AEs primarily focus on the optimization of a predefined target; while accelerating this goal, such an approach limits the discovery of unexpected or unknown physical phenomena. Here, we introduce a novel framework, INS 2 ANE (Integrated Novelty Score−Strategic Autonomous Non-Smooth Exploration), to enhance the discovery of novel phenomena in autonomous microscopy experimentation. Our method integrates two key components: (1) a novelty scoring system that evaluates the uniqueness of experimental results and (2) a strategic sampling mechanism that promotes exploration of under-sampled regions even if they appear less promising by conventional criteria. We validate this approach on a preacquired data set with a known ground truth comprising of image−spectral pairs. We further implement the process on autonomous scanning probe microscopy experiments. INS 2 ANE significantly increases the diversity of explored phenomena in comparison to conventional optimization routines, enhancing the likelihood of discovering previously unobserved phenomena. These results demonstrate the potential for autonomous microscopy experiments to enhance the scientific discovery by navigating complex experimental spaces to uncover novel phenomena.

Materials↗
DOE OSTI2026

An interactive machine learning platform for analyzing multi-particle coincidence data from cold target recoil ion momentum spectroscopy

We present SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training), a comprehensive software platform for analyzing tabulated high-dimensional multi-particle coincidence data from Cold Target Recoil Ion Momentum Spectroscopy (COLTRIMS) experiments. The software addresses critical challenges in modern momentum spectroscopy by integrating advanced machine learning techniques with physics-informed analysis in an interactive web-based environment. SCULPT implements uniform manifold approximation and projection for non-linear dimensionality reduction to reveal correlations in high-dimensional data. We also discuss potential extensions to deep autoencoders for feature learning and genetic programming for automated discovery of physically meaningful observables. A novel adaptive confidence scoring system provides quantitative reliability assessments by evaluating user-selected clustering quality metrics with predefined weights that reflect each metric’s robustness. The platform features configurable molecular profiles for different experimental systems, interactive visualization with selection tools, and comprehensive data filtering capabilities. Utilizing a subset of SCULPT’s capabilities, we analyze photo-double-ionization data measured using the COLTRIMS method for three-body dissociation of the D 2 O molecule, revealing distinct fragmentation channels and their correlations with physics parameters. The software’s modular architecture and web-based implementation make it accessible to the broader atomic and molecular physics community, significantly reducing the time required for complex multi-dimensional analyses. This opens the door to finding and isolating rare events exhibiting non-linear correlations on the fly during experimental measurements, which can help steer exploration and improve the efficiency of experiments.

Artificial neural networks↗
DOE OSTI2024

Mitigative Strategies for Recovering From Large Language Model Trust Violations

In this study, we investigated strategies to address trust issues arising from errors in large language models (LLMs). The study examined the impact of confidence scores, system capability explanations, and user feedback on trust restoration post-error. 68 participants viewed the responses of an LLM to 20 general trivia questions, with an error introduced on the third trial. Each participant was presented with one mitigation strategy. Participants rated their overall trust in the model and the reliability of the answer. Results showed an immediate drop in trust after the error; however, there were no differences across the three strategies in trust recovery. All conditions had a logarithmic trend in trust recovery following error. Differences in overall trust were predicted by perceived reliability of the answer, suggesting that participants were evaluating results critically and using that to inform their trust in the model. Qualitative data supported this finding; participants expressed lasting distrust despite the LLM’s later accuracy. Results showcase the need to prioritize accuracy in LLM deployment, because early errors may irrevocably damage user trust calibration and later adoption.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Predicting nepheline precipitation in waste glasses using ternary submixture model and machine learning

Nepheline precipitation in nuclear waste glasses during vitrification can be detrimental due to its negative effect on chemical durability. Developing models to accurately predict nepheline precipitation from compositions is important to increase waste loading since existing models can be overly conservative. In this study, an expanded dataset containing 955 glasses was compiled from literature data, where 355 glasses are for high-level waste (HLW). Previously developed submixture models were refitted using the new dataset, where a misclassification rate of 7.8% was achieved. Nine machine learning (ML) algorithms (e.g., k-nearest neighbor, Gaussian process regression, artificial neural network, support vector machine, decision tree, etc.) were applied to evaluate their ability of predicting nepheline precipitation from compositions. Model accuracy, precision, recall/sensitivity, and F1 score were systemically compared between different ML algorithms and modeling protocols. Good model prediction with an accuracy ~0.9 (misclassification rate of ~10%) was observed with different algorithms under certain protocol. This study evaluated various ML models to predict nepheline precipitations in waste glasses, highlighting the importance of data preparation, modeling protocol, and their effect on model stability and reproducibility. The results provide insights into applying ML to predict glass properties and suggest areas for future research on modeling nepheline precipitations.

Lu, Xiaonan↗