Search NASA⌕ Search

SEARCH · Search NASA

Results for “assessment procedures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Study of quark and gluon jet substructure in Z+jet and dijet events from pp collisions

Measurements of jet substructure describing the composition of quark- and gluon-initiated jets are presented. Proton-proton (pp) collision data at √s = 13 TeV collected with the CMS detector are used, corresponding to an integrated luminosity of 35.9 fb -1 . Generalized angularities are measured that characterize the jet substructure and distinguish quark- and gluon-initiated jets. These observables are sensitive to the distributions of transverse momenta and angular distances within a jet. The analysis is performed using a data sample of dijet events enriched in gluon-initiated jets, and, for the first time, a Z+jet event sample enriched in quark-initiated jets. The observables are measured in bins of jet transverse momentum, and as a function of the jet radius parameter. Additionally, each measurement is repeated applying a “soft drop” grooming procedure that removes soft and large angle radiation from the jet. Using these measurements, the ability of various models to describe jet substructure is assessed, showing a clear need for improvements in Monte Carlo generators.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

The Precision of Product Consistency Tests with Environmental Assessment Glass

Several series of triplicate tests conducting following the ASTM C1285 product consistency test method have been performed using samples of Environmental Assessment glass in Teflon™ and steel test vessels. The results of tests with test parameters within the ranges specified in the PCT method A procedure were used to calculate repeatability and reproducibility precision statistics for tests in each type of vessel. These show the test response and test precision attained in tests conducted in Teflon™ and stainless steel test vessels are statistically indistinguishable.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Subsurface stress criticality associated with fluid injection and determined using machine learning

Machine-learning methods and apparatus are disclosed to determine critical state or other parameters related to fluid-driven failure of a terrestrial locale impacted by anthropogenic activities such as hydraulic fracturing, hydrocarbon extraction, wastewater disposal, or geothermal harvesting. Acoustic emission, seismic waves, or other detectable indicators of microscopic processes are sensed. A classifier is trained using time series of microscopic data along with corresponding data of critical state or failure events. In disclosed examples, random forests and artificial neural networks are used, and grid-search or EGO procedures are used for hyperparameter tuning. Once trained, the classifier can be applied to live data from a fluid injection locale in order to assess a frictional state, assess seismic hazard, assess permeability, make predictions regarding a future fluid-driven failure event, or drive engineering solutions for mitigation or remediation. Variations are disclosed.

Johnson, Paul Allan↗
DOE OSTI2023

Bison Verification and Validation Activities for TRISO

Numerical modeling and simulation (M&S) tools play a key role in the research, development, and overall safety assessments of next-generation nuclear energy systems. One such tool, Bison, is a nuclear fuel performance code that is applicable to many fuel forms (e.g., light-water reactor fuel, oxide and metallic fuel for fast reactors, tri-structural isotropic (TRISO) fuel, and plate fuel), and it uses the finite element method to model the thermo- mechanical response of nuclear fuels. One fuel form widely utilized in Generation-IV high-temperature gas-cooled and fluoride- salt-cooled nuclear reactor concepts is TRISO fuel. Recently, Bison’s capabilities were significantly expanded to enable it to model the performance of TRISO particles and compacts. It is important that Bison’s computational results be reliable and predictive, since this code is used to inform high-consequence decisions. The various processes developed to address this issue generally entail two fundamental steps: verification and validation (V&V). Verification ensures that the code functions correctly and is reliable. Code/solution verification, code benchmark, and software quality assurance exercises are examples of verification activities. On the other hand, validation is the process of assessing a code’s capability to accurately model physical problems. Comparisons between code results and experiments quantify the validation level. Application of V&V procedures is crucial to the development of computational tools that are free of coding mistakes and can accurately represent reality. The current study presents an overview of Bison V&V activities relevant to the TRISO fuel concept, which include code/solution verification exercises, CRP-6 Benchmark—a Coordinated Research Program through the International Atomic Energy Agency (IAEA)—exercises, and validation exercises with the Advanced Gas Reactor (AGR)- 1/2/3/4 experiment series.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Quick-and-Easy Validation of Protein–Ligand Binding Models Using Fragment-Based Semiempirical Quantum Chemistry

Electronic structure calculations in enzymes converge very slowly with respect to the size of the model region that is described using quantum mechanics (QM), requiring hundreds of atoms to obtain converged results and exhibiting substantial sensitivity (at least in smaller models) to which amino acids are included in the QM region. As such, there is considerable interest in developing automated procedures to construct a QM model region based on well-defined criteria. However, testing such procedures is burdensome due to the cost of large-scale electronic structure calculations. Here, we show that semiempirical methods can be used as alternatives to density functional theory (DFT) to assess convergence in sequences of models generated by various automated protocols. The cost of these convergence tests is reduced even further by means of a many-body expansion. We use this approach to examine convergence (with respect to model size) of protein–ligand binding energies. Fragment-based semiempirical calculations afford well-converged interaction energies in a tiny fraction of the cost required for DFT calculations. Two-body interactions between the ligand and single-residue amino acid fragments afford a low-cost way to construct a “QM-informed” enzyme model of reduced size, furnishing an automatable active-site model-building procedure. This provides a streamlined, user-friendly approach for constructing ligand binding-site models that needs neither a priori information nor manual adjustments. Extension to model-building for thermochemical calculations should be straightforward.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

An Integrated Risk Assessment Process of Safety-Related Digital I&C Systems in Nuclear Power Plants

Upgrading the existing analog instrumentation and control (I&C) systems to state-of-the-art digital I&C (DI&C) systems will greatly benefit existing light water reactors. However, the issue of software common cause failure (CCF) remains an obstacle in terms of qualification for digital technologies. Existing analyses of CCFs in I&C systems mainly focus on hardware failures. With the application and upgrading of new DI&C systems, design flaws could cause software CCFs to become a potential threat to plant safety, considering that most redundancy designs use similar digital platforms or software in their operating and application systems. With complex multilayer redundancy designs to meet the single failure criterion, these I&C safety systems are of particular concern in U.S. Nuclear Regulatory Commission licensing procedures. In Fiscal Year 2019, the Risk-Informed Systems Analysis (RISA) Pathway of the U.S. Department of Energy’s Light Water Reactor Sustainability Program initiated a project to develop a risk assessment strategy for delivering a strong technical basis to support effective, licensable, and secure DI&C technologies for digital upgrades and designs. An integrated risk assessment for the DI&C process was proposed for this strategy to identify potential key digital-induced failures, implement reliability analyses of related digital safety I&C systems, and evaluate the unanalyzed sequences introduced by these failures (particularly software CCFs) at the plant level. Here this paper summarizes these RISA efforts in the risk analysis of safety-related DI&C systems at Idaho National Laboratory.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Technical Specification Surveillance Interval Extension Using Self-Diagnostics

As part of the Light Water Reactor Sustainability program, an ongoing research effort is being conducted on technical specifications surveillance interval extension of digital equipment in nuclear power plants. The research team is led by Idaho National Laboratory and includes Pacific Northwest National Laboratory, Technology Resources, and Oak Ridge National Laboratory. This research focuses on developing methods for applying the U.S. Nuclear Regulatory Commission (NRC)–approved guidance to implement a licensee-controlled, risk-informed surveillance frequency change program in digital instrumentation and control (I&C) systems that include self-diagnostics and online monitoring (OLM) capabilities. Although approved methods exist for extending technical specifications (TS) surveillance test intervals (STIs) for general equipment, including analog I&C equipment, gaps remain in technology and guidance on crediting newer digital equipment’s internal self-diagnostics and OLM characteristics. Previous research described a general methodology for crediting internal self-diagnostics for extending surveillance test intervals. The methodology used self-diagnostics to detect—and credited recovery from—failure. Self-diagnostics were also applied for performance monitoring during the extended surveillance interval. This report discusses the status of recent activities to evaluate the previously developed methodology using a pilot study. Although both a utility partner for a pilot study and a specific digital asset were identified in FY2020, delays in obtaining proprietary information resulted in a limited ability to fully evaluate the methodology, and further interactions were complicated by the COVID pandemic. Therefore, at that time, the use of public-domain information—along with current processes for surveillance interval extension through a surveillance frequency control program—identified the need to fully assess diagnostic coverage as part of the pilot study. Furthermore, self-diagnostics were also identified as a potential option to replace the drift analyses conducted as part of current STI extension procedures. In FY2022, the project was reconstituted with the industry partner, and information and data were made available by the industry partner to the research team for review. The shared information included failure event descriptions and data for a digital I&C system since its implementation, as well as recent STI extension interval reports developed by the utility partner on that digital I&C system. This report presents an evaluation of this information and data and describes an application of the proposed methodology cited above. The methodology seeks to take advantage of the self-diagnostics and OLM capabilities to reduce risk or reduce the level of qualitative monitoring assessment needed to perform a risk-informed STI extension using existing NRC approved guidance or both. Addressing these issues of STI extension by crediting self-diagnostics is likely to result in benefits for current and future nuclear power plant (NPP) operations, including lowering the barriers to adoption of digital I&C systems and increasing cost savings by deferring or eliminating unneeded preventive maintenance (tasks or checks or activities). Specifically, self-diagnostic and OLM capabilities of newer digital equipment being installed in non-safety and safety applications are designed to detect failures, provide early warning of potential failures, and notify plant operators to take appropriate action to reduce out of service (OOS) time thus protecting safety margins. Moreover, the equipment is expected to provide information that time-related operational degradation is identified early to ensure timely and planned corrective actions instead of a reactive and unplanned approach ahead of an extended-surveillance interval.

42 ENGINEERING↗
DOE OSTI2022

Aggregation bias and its drivers in large‐scale flood loss estimation: A Massachusetts case study

Abstract Large‐scale estimations of flood losses are often based on spatially aggregated inputs. This makes risk assessments vulnerable to aggregation bias, a well‐studied, sometimes substantial outcome in analyses that model fine‐grained spatial phenomena at coarse spatial units. To evaluate this potential in the context of large‐scale flood risk assessments, we use data from a high‐resolution flood hazard model and structure inventory for over 1.3 million properties in Massachusetts and examine how prominent data aggregation approaches affect the magnitude and spatial distribution of flood loss estimates. All considered aggregation approaches rely on aggregate structure inventories but differ in whether flood hazard is also aggregated. We find that aggregating only structure inventories slightly underestimates overall losses (−10% bias), and when flood hazard data is spatially aggregated to even relatively small spatial units (census block), statewide aggregation bias can reach +366%. All aggregation‐based procedures fail to capture the spatial covariation of inputs distributions in the upper tails that disproportionately generate total expected losses. Our findings are robust to several key assumptions, add important context to published risk assessments and highlight opportunities to improve flood loss estimation uncertainty quantification.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Improved Solid-State Reaction Method for Scaled-Up Synthesis of Ceramic Proton-Conducting Electrolyte Materials

Protonic ceramic electrochemical cells (PCECs) represent promising technologies in the production of clean electricity, decarbonized hydrogen, chemicals, and fuels at intermediate temperatures. One of the challenges in commercializing PCECs is to produce the electrolyte materials on a large scale. The conventional solid-state reaction (SSR) method suffers from tedious synthesis procedures and low phase purity of the products due to the formation of unwanted secondary phases. Herein, we report an improved SSR (i-SSR) method for kilogram-scale production of high phase-purity electrolyte material BaZr 0.4 Ce 0.4 Y 0.1 Yb 0.1 O 3–δ (BZCYYb4411). In this method, the ball-milled precursor powders are pelletized prior to calcination, which effectively reduces the length of the diffusion paths between the components during perovskite phase formation. In this study, the synthesis procedure and calcination temperature are carefully optimized for efficient and repeatable production based on the powder crystallization behavior. A combined technoeconomic analysis and life cycle assessment modeling suggest that the i-SSR method could reduce the total production cost and greenhouse gas emissions by up to 19% and 39%, respectively, compared to the conventional SSR method. The high quality of the synthesized electrolyte material is corroborated by the excellent electrical conductivity and electrochemical performance of the fabricated PCEC cells.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Exploration of a Potential Desirability of Outcome Ranking Endpoint for Complicated Intra-Abdominal Infections Using 9 Registrational Trials for Antibacterial Drugs

Abstract Background Desirability of outcome ranking (DOOR) is a novel approach to clinical trial design that incorporates safety and efficacy assessments into an ordinal ranking system to evaluate overall outcomes of clinical trial participants. Here, we derived and applied a disease-specific DOOR endpoint to registrational trials for complicated intra-abdominal infection (cIAI). Methods Initially, we applied an a priori DOOR prototype to electronic patient-level data from 9 phase 3 noninferiority trials for cIAI submitted to the US Food and Drug Administration between 2005 and 2019. We derived a cIAI-specific DOOR endpoint based on clinically meaningful events that trial participants experienced. Next, we applied the cIAI-specific DOOR endpoint to the same datasets and, for each trial, estimated the probability that a participant assigned to the study treatment would have a more desirable DOOR or component outcome than if assigned to the comparator. Results Three key findings informed the cIAI-specific DOOR endpoint: (1) a significant proportion of participants underwent additional surgical procedures related to their baseline infection; (2) infectious complications of cIAI were diverse; and (3) participants with worse outcomes experienced more infectious complications, more serious adverse events, and underwent more procedures. DOOR distributions between treatment arms were similar in all trials. DOOR probability estimates ranged from 47.4% to 50.3% and were not significantly different. Component analyses depicted risk-benefit assessments of study treatment versus comparator. Conclusions We designed and evaluated a potential DOOR endpoint for cIAI trials to further characterize overall clinical experiences of participants. Similar data-driven approaches can be utilized to create other infectious disease–specific DOOR endpoints.

Immunology↗
DOE OSTI2023

Application of multi-criteria decision analysis techniques and decision support framework for informing plant select agent designation and decision making

The United States Department of Agriculture (USDA) Division of Agricultural Select Agents and Toxins (DASAT) established a list of biological agents (Select Agents List) that threaten crops of economic importance to the United States and regulates the procedures governing containment, incident response, and the security of entities working with them. Every 2 years the USDA DASAT reviews their select agent list, utilizing assessments by subject matter experts (SMEs) to rank the agents. We explored the applicability of multi-criteria decision analysis (MCDA) techniques and a decision support framework (DSF) to support the USDA DASAT biennial review process. The evaluation includes both current and non-select agents to provide a robust assessment. We initially conducted a literature review of 16 pathogens against 9 criteria for assessing plant health and bioterrorism risk and documented the findings to support this analysis. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for ensuring accuracy. Scoring criteria were adopted to ensure consistency. The MCDA supported the expectation that select agents would rank high on the relative risk scale when considering the agricultural consequences of a bioterrorism attack; however, application of analytical thresholds as a basis for designating select agents led to some exceptions to current designations. A second analytical approach used agent-specific data to designate key criteria in a DSF logic tree format to identify pathogens of low concern that can be ruled out for further consideration as select agents. Both the MCDA and DSF approaches arrived at similar conclusions, suggesting the value of employing the two analytical approaches to add robustness for decision making.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

INTEGRATED RISK ASSESSMENT OF DIGITAL I&C SAFETY SYSTEMS FOR NUCLEAR POWER PLANTS

Upgrading the existing analog instrumentation and control (I&C) systems to state-of-the-art digital I&C (DI&C) systems provides the foremost means to improve performance and reduce costs for existing light-water reactors (LWRs). However, qualification of digital technologies remains a challenge?especially the issue of software common cause failure (CCF), which has been difficult to address. Existing analyses of CCFs in I&C systems mainly focus on hardware failures. With the application and upgrading of new DI&C systems, software CCFs due to design flaws might become a potential threat to plant safety, considering that most redundancy designs use similar digital platforms or software in their operating and application systems. With complex multi-layer redundancy designs to meet the single failure criterion, these I&C safety systems are of particular concern in U.S. Nuclear Regulatory Commission (NRC) licensing procedures. In 2019, the Risk-Informed Systems Analysis (RISA) Pathway of the U.S. Department of Energy?s (DOE?s) Light Water Reactor Sustainability (LWRS) Program initiated a project to develop a risk assessment strategy for delivering a strong technical basis to support effective, licensable, secure DI&C technologies for digital upgrades/designs. An integrated risk assessment for the DI&C (RADIC) process was proposed for this strategy to identify potential key digital-induced failures, implement reliability analyses of related digital safety I&C systems, and evaluate the unanalyzed sequences introduced by these failures (particularly software CCFs) at the plant level. This paper summarizes these RISA efforts in the risk analysis of safety-related DI& systems at Idaho National Laboratory.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Optimisation of large-radius jet reconstruction for the ATLAS detector in 13 TeV proton–proton collisions

Jet substructure has provided new opportunities for searches and measurements at the LHC, and has seen continuous development since the optimization of the large-radius jet definition used by ATLAS was performed during Run 1. A range of new inputs to jet reconstruction, pile-up mitigation techniques and jet grooming algorithms motivate an optimisation of large-radius jet reconstruction for ATLAS. In this paper, this optimisation procedure is presented, and the performance of a wide range of large-radius jet definitions is compared. The relative performance of these jet definitions is assessed using metrics such as their pileup stability, ability to identify hadronically decaying W bosons and top quarks with large transverse momenta. A new type of jet input object, called a ‘unified flow object’ is introduced which combines calorimeter- and inner-detector-based signals in order to achieve optimal performance across a wide kinematic range. Large-radius jet definitions are identified which significantly improve on the current ATLAS baseline definition, and their modelling is studied using pp collisions recorded by the ATLAS detector at √s = 13 TeV

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Analysis of the MST-16 crimp process on cold 304L stainless steel

The purpose of this report is to assess the quality of the MST-16 crimp process through a series of cold experiments and metallographic analyses. Common practice in MST-16 uses a mechanical crimp on 304L stainless steel tubes to prevent radioactive contamination from escaping the tube interior for a variety of experiments. The crimped tubes must pass a leak check to demonstrate their radiological safety. Cold (i.e. non-radioactive samples) 304L tube samples were tested using two different approved crimping devices to assess the quality of the crimps. Each crimp was leak checked, followed by destructive metallographic analysis to determine the quality of both the crimp equipment and procedures used by MST-16 personnel.

42 ENGINEERING↗
DOE OSTI2023

Legacy Site 377 (Former Building 377) Soil Sampling and Analysis Plan Addendum 1 (April 2023)

The purpose of this addendum is to address data gaps identified in the Legacy Site 377 (Former Building 377) Soil Sampling and Analysis Plan (SAP) (LLNL-AM-826971) (LLNL 2021a) and the Phase II Site Assessment Report for Legacy Slab 377 (LLNL-TM-828194) (LLNL 2021b). This addendum will be used in conjunction with the 2021 SAP. All policies and procedures set forth in the SAP that are not modified in this addendum will remain in effect for the duration of the project, where applicable.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Results from a multi-laboratory ocean metaproteomic intercomparison: effects of LC-MS acquisition and data analysis procedures

Metaproteomics is an increasingly popular methodology that provides information regarding the metabolic functions of specific microbial taxa and has potential for contributing to ocean ecology and biogeochemical studies. A blinded multi-laboratory intercomparison was conducted to assess comparability and reproducibility of taxonomic and functional results and their sensitivity to methodological variables. Euphotic zone samples from the Bermuda Atlantic Time-series Study (BATS) in the North Atlantic Ocean collected by in situ pumps and the autonomous underwater vehicle (AUV) Clio were distributed with a paired metagenome, and one-dimensional (1D) liquid chromatographic data-dependent acquisition mass spectrometry analysis was stipulated. Analysis of mass spectra from seven laboratories through a common bioinformatic pipeline identified a shared set of 1056 proteins from 1395 shared peptide constituents. Quantitative analyses showed good reproducibility: pairwise regressions of spectral counts between laboratories yielded R 2 values averaged 0.62±0.11, and a Sørensen similarity analysis of the top 1000 proteins revealed 70 %–80 % similarity between laboratory groups. Taxonomic and functional assignments showed good coherence between technical replicates and different laboratories. A bioinformatic intercomparison study, involving 10 laboratories using eight software packages, successfully identified thousands of peptides within the complex metaproteomic datasets, demonstrating the utility of these software tools for ocean metaproteomic research. Lessons learned and potential improvements in methods were described. Future efforts could examine reproducibility in deeper metaproteomes, examine accuracy in targeted absolute quantitation analyses, and develop standards for data output formats to improve data interoperability. Together, these results demonstrate the reproducibility of metaproteomic analyses and their suitability for microbial oceanography research, including integration into global-scale ocean surveys and ocean biogeochemical models.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

2019 Megasun Illumination System. Modifications and Operating Procedure Updates [Slides]

The original operating procedure was nearly 20 years old, though it was on a semi-annual review schedule. Some electrical categories had changed, as well as their risk management assessments. The IWD did not reflect these updated guidelines. No injuries have been reported during nearly 20 years of operation (not a bad record), however, several abnormal conditions came to surface during our Hazard Analysis conversations. One of which included an oil based capacitor malfunction which cracked it’s housing and leaked oil within the 2001 system. Our training and qualifications were updated to reflect LANL’s current standards.

42 ENGINEERING↗
DOE OSTI2023

Site 300 Water Line - Zone 3 In Fill Assessment Soil Sampling and Analysis Plan (Addendum 1, March 2023)

The purpose of this addendum is to expand the Site 300 Water Line Project – Zone 3 In Fill Assessment Soil Sampling and Analysis Plan (SAP), (LLNL-AM-826971), dated August 2021. This addendum will be used in conjunction with the SAP. All policies and procedures set forth in the SAP that are not modified in this addendum will remain in effect for the duration of the project, where applicable.

54 ENVIRONMENTAL SCIENCES↗