Search NASA⌕ Search

SEARCH · Search NASA

Results for “methodology development”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

ARC-100 Reactor Security-by-Design Summary 2025

This report applies the security-by-design methodology developed in a previous National Nuclear Security Administration–sponsored work to the ARC-100, a sodium-cooled fast reactor (SFR) being developed by ARC Clean Technology, Inc (ARC). The report contains no proprietary information specific to the ARC 100 reactor. The insights developed in this report are high-level, and generally applicable to other sodium fast reactor designs. The information presented here is the result of a qualitative safety-based analysis and would not inform any potential adversary beyond what would be found in a docketed safety analysis report. The scope of this present report covers ARC-100’s reactor core, used fuel storage, used fuel assembly wash station, cesium trap, sodium cold trap, noble gas decay tanks, used fuel dry storage facility, damaged fuel storage facility, and radioactive waste building. These systems are also compared to a generic SFR design assumed in the previous study. The security assessment results show changes in structures, systems, and components (SSCs) safety importance relative to the generic SFR SSCs. Several SSCs have higher importance rankings than others, and it is recommended that protection efforts are prioritized for these SSCs. Results from this work will furnish a technical justification for the feasibility of these solutions for the ARC reactor's design and, where applicable, identify any regulatory benefits conferred by the proactive design aspect within a risk management framework. This initiative will contribute to a more secure design of the ARC reactor and support its licensing process.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2024

A Methodology for determining optimal milling parameters for low-taper microtensile sample production

Femtosecond lasers are beginning to see an increase in interest for industrial and high throughput microsample milling applications. Despite this, much of the literature regarding removal rate studies for ultrashort pulse laser milling continues to focus on single-pulse or similar experiments that have a very small time on target. The material volume removal rates of femtosecond milling can vary wildly depending on parameters like laser scan speed, hatch spacing, z-axis step size, and pulses on the material. Currently, there is no established methodology for determining the optimal values of these parameters for micromilling applications. This methodology was developed in this study. The methodology consists of a pulse study, a repeat study, and a z-step study that will return the milling parameters that resulted in the largest volume removal rate for the laser used for this research. The methodology was created for the laser system used in this study, and was tested on 316 Stainless Steel, but was developed in such a way that it may be adapted to any material, and with some tweaking of variables might be used in other laser systems. The laser system used in this study utilizes a novel positioning stage that introduces 6 degrees of freedom to the translation of laser samples, being able to tilt and move in all three axes. Using both the developed methodology and the unique capabilities of the laser microtensile samples were produced with taper angles of <1° in 316 Stainless Steel.

Barker, Zachary Wayne↗
DOE OSTI2021

Bio-project “derisking” through development of systematic methodologies and frameworks for risk assessment

One of the primary hindrances to producing a viable, sustainable domestic biomass industry for renewable biofuels, bio-products and bio-power is the lack of understanding and quantification of the risks associated with both the biomass supply chain and preprocessing and conversion technologies. Currently a consistent method for assessing, comparing, and quantifying risks in biomass supply chains does not exist, creating a major investment barrier to bioenergy projects in the U.S. The lack of a standardized approach has resulted in bioenergy stakeholders independently using inconsistent approaches and evaluation criteria, leading to unreliable and incomparable assessments of risks and financing barriers to bio-project development. Along with the challenges of inconsistent risk assessment for supply chain risk, technology specific risks based on variability in biomass properties are not fully understood and can pose significant unforeseen challenges for bioenergy projects. In many cases these properties have not yet been identified and the impacts on the proposed technology and products unquantified. This is particularly challenging for emerging preprocessing and conversion technologies. Without a firm understanding of the preprocessing/conversion technology-specific critical properties, the risk of a proposed bio-project cannot be fully evaluated. To address inconsistent risk evaluation in the biomass supply chain supporting project financing, a Biomass Supply Chain Risk Standards (BSCRS) framework was developed. The BSCRS framework includes a comprehensive list of known and perceived risks (Risk Indicators) to the supply chain developed through 100’s of interviews with bioenergy industry experts spanning from feedstock growers and suppliers to representatives from the financial sector. These risks have been organized into a manageable hierarchy of Risk Categories and Risk Factors that can be practically assessed. This BSCRS framework also provides mitigation strategies for multiple Risk Indicators from best available industry practices and research findings. Additionally, a risk quantification methodology for each Risk Factor, Risk Category, and the bio-project as a whole was developed to enable capital markets to assess feedstock risk more efficiently and more accurately. Multiple case studies representing existing bio-projects have been used to evaluate and verify the BSCRS framework and scoring methodology. To address technological risk along with the supply chain risk captured in the developed BSCRS framework, this work also focuses on development of a systematic criticality assessment tool using well-accepted, quantitative risk analysis methods to evaluate bioenergy feedstock critical properties impacting system unit operations. The proposed Failure Mode and Effect Analysis (FMEA) approach uses a team of subject area experts (SAEs) for each targeted unit operation within a system. Collectively, the team will develop and use a quantitative scoring system to assess the material attributes, process parameters, and quality attributes for key unit operations that have already been identified. The FMEA process generates Risk Priority Numbers (RPNs) for the various failures and predominant causes for each material/process unit/product combination resulting in a semi-quantitative, standardized methodology for assessing technological risk and biomass properties contributing to that risk.

09 BIOMASS FUELS↗
DOE OSTI2020

Methodology for the development of empirical models relating 13C NMR spectral features to fuel properties

Effective formulation of new gasoline or diesel fuels for internal combustion engines would benefit from the development of reliable models for predicting key fuel properties based on a set of molecular descriptors obtained from a single measurement. This is particularly relevant in the case of renewable fuels, where the available fuel sample quantity may be limited. In this work, we present a statistically-based methodology for building empirical models to predict multiple properties from one-dimensional 13C nuclear magnetic resonance (NMR) spectra measured on around 200 microliters of a liquid fuel. NMR spectra contain information about the molecular composition of a sample and the carbon types and molecular substructures therein. Our approach uses this information to build sparse, interpretable models, where the predicted properties are linked to specific molecular features. The approach takes into consideration the constrained nature of the features making up the one-dimensional NMR spectrum, which, after standardization, represent a relative fuel composition. We point to the limitations in interpretability that arise when building this type of empirical predictive model and suggest how these limitations may be diminished. Among the many properties important for maximizing engine performance and minimizing emissions, we build models that predict derived cetane number and distillation temperatures as these are of particular interest because of their links to fuel economy, drivability, and engine-out emissions. Results suggest that the properties of interest may be impacted by only a few of the 27 13C NMR regions represented in the data, pointing to new directions for further testing in the development of improved fuels.

predictive models, biofuels., NMR Analysis↗
DOE OSTI2025

Developing a Prototype Methodology to Rank CO2-EOR Wells and Assess Their Reuse Potential for Geologic Carbon Sequestration

This study presents a prototype methodology for evaluating the reuse potential of Class II CO₂-enhanced oil recovery (CO₂-EOR) wells as Class VI wells for geologic carbon sequestration. The approach focuses on assessing wellbore construction materials—casing, cement, tubing, and packers—based on U.S. Environmental Protection Agency (EPA) Class VI well conversion guidelines. Utilizing Python scripts and JSON representations, the methodology automates checks on digitized Texas Railroad Commission (TRRC) data to rank wells based on regulatory and integrity criteria. Key factors include casing integrity, cementing techniques, tubing compatibility, and packer selection. Due to limitations in digitized data, manual verification is required for certain sections. Future enhancements include incorporating non-digitized data via web scraping and machine learning. This research provides a practical framework for well owners and regulators, supporting informed decision-making for sustainable CO₂ storage.

carbon sequestration↗
DOE OSTI2021

A METHODOLOGY TO SUPPORT THE DEVELOPMENT OF A NEW STATE VISION FOR THE UNITED STATES NUCLEAR INDUSTRY

A new strategy in the way in which the United States nuclear power plants (NPPs) are operated, maintained, and supported is needed. One such strategy is to transform the NPP operating model through a business-driven approach that leverages technology to enable new capabilities that improve performance and reduce cost. This paper presents a methodology for developing an achievable yet transformative new state vision that ensures continued safe and efficient operations of the United States NPP fleet. This work builds on existing guidance and leverages previous research to comprehensively address both bottom-up (i.e., utility needs) and top-down (i.e., first principles) considerations important for developing a new state vision. The proposed methodology is intended to provide industry-wide guidance for developing a new state vision that leverages both the selected vendor’s capabilities in a way that meets the utility’s modernization goals while ensuring state-of-the-art systems engineering and human factors engineering principles are applied that promote overall plant safety, performance, and efficiency.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

A Methodology to Support the Development of a New State Vision for the U.S. Nuclear Industry

Recent changes in natural gas prices combined with reduced capital costs for solar and wind systems has created challenges for the continued operation of existing nuclear power plants (NPPs) in the United States. A new strategy in the way in which U.S. NPPs are operated, maintained, and supported is needed. One such strategy is to transform the NPP operating model through a business-driven approach that leverages technology to enable new capabilities that improve performance and reduce costs. This paper presents a methodology for developing an achievable yet transformative new state vision that ensures the continued safe and efficient operations of the U.S. NPP fleet. Here this work builds on existing guidance and leverages previous research to comprehensively address both utility needs and high-level human factors engineering design principles when developing a new state vision. The proposed methodology is intended to provide industry-wide guidance for developing a new state vision that leverages both the selected vendor’s capabilities in a way that meets the utility’s modernization goals while ensuring state-of-the-art systems engineering and human factors engineering principles are applied that promote overall plant safety, performance, and efficiency.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

A ranking methodology for the coupling of pressurized water nuclear reactors and molten salt thermal energy storage

Thermal energy storage (TES) systems are a proposed solution to electricity market demand fluctuations and can be coupled to nuclear power plants to enable load following. Here, this work focuses on developing a methodology for evaluating potential designs for integrating a TES system into an existing pressurized water nuclear power plant. The proposed ranking methodology allows a group of experts to postulate and weigh designs based on ranking criteria derived from literature. The methodology developed in this study can aid in the final selection of a TES design for an existing nuclear power plant. The same process could be used to analyze other TES and nuclear reactor designs. The determined optimum design from this methodology was to place the TES system after the steam generator and to utilize the steam generated from the nuclear power plant to heat a molten salt TES unit. Another conclusion of this research was that human bias is prevalent during design selection, and actions such as standardized ranking criteria and large groups of experts should be used to minimize this error.

25 ENERGY STORAGE↗
DOE OSTI2023

Development of Building Design Optimization Methodology: Residential Building Applications

Building design optimization is a highly complex problem, requiring long computational running processes because of the many options that exist when a building is being designed. This paper introduces an integrated approach through which to perform this optimization within an acceptable time frame. The approach includes the methods of variable selection, model simplification, and a sequential optimization process. Using singular value decomposition, a large number of design variables is reduced to a smaller subset that can be solved more quickly through the optimization algorithm. To expedite the variable selection process, a modeling approach that quickly simulates annual energy consumption was developed to replace full annual energy simulations. The developed methodology was applied to two residential buildings in the US, and the results are discussed herein. To assess the accuracy of the integrated optimization methodology, the optimized life cycle costs are compaa variables demonstrating the strongest contributions in the optimization study were identified. The proposed methodology significantly shortened the time requirements for the optimization processes of the two case studies by 74% and 84%; the optimized life cycle costs were within 0.05% and 0.06%, respectively, of the optimum point.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Visual Modeling for Complex System Valuation: Implementation Guidance

Within the Transactive Systems Program (TSP) at Pacific Northwest National Laboratory (PNNL) the need to incorporate a valuation analysis design early within the research process of transactive energy systems led to development of a valuation methodology. This methodology allows the modeling of economic exchanges within a complex system and supports the evaluation of individual stakeholder economic outcomes in addition to systemwide costs and benefits. The use of visual modeling practices enables the research team to reach common understanding and agreement on the analysis design within the complex system. While this methodology was developed for the valuation of transactive energy systems, it can be applied to any complex system where a granular economic analysis is desired. It allows for the inclusion of equity analyses and ties individual activities and microeconomic outcomes with the systemwide macroeconomic impacts. This document serves as implementation guidance for analysts planning to deploy the methodology within a research study. The appendixes provide specific guidance on how this methodology is deployed within the TSP at PNNL for analysts seeking guidance for deployment within that context.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Exploring the Nature of f-Element Soft Donor Interactions Using Electronically Tunable Azolate Ionic Liquids

This project was undertaken to advance the understanding of how f-elements interact with moderately soft donors, a heavily investigated yet open question which is of prime importance in spent nuclear fuel processing and fundamental inorganic chemistry. During the course of the project, based on exciting results, a stretch goal was developed to study the hydrolysis products of transuranic actinide metals, a somewhat understudied field even with its significance in nuclear fuel cycle and impacts in environmental chemistry. The stretch goal was to take our serendipitous discovery of an easy route to isolation of crystalline multinuclear ƒ-element hydrolysis products, and apply it to gaining a mechanistic understanding of Pu(III/IV) colloid formation. The simplicity of our techniques should lend themselves to the remote handling required for study of many transuranic elements. We developed several methodologies using azolium azolate chemistry to overcome ƒ-element hydrolysis problems that prohibit the isolation of ƒ-element soft donor complexes and to build a crystallographic library of ƒ-element N-donor complexes as a means to understand the fundamental differences between actinide and lanthanide interactions with moderately soft donor ligands. Our next major endeavor will be to transfer this chemistry from 4ƒ elements to transuranic elements, particularly in the study of hydrolysis of Pu(III/IV). While our work is fundamental in nature, applications of the knowledge we are generating should be felt in such diverse fields as catalysis, separations in general, nuclear waste remediation specifically, and many other applications in f-element magnetic and luminescent properties. The potential ramifications of the consistent and robust formation of hydrolysis controlled hexanuclear lanthanide structures are enormous, with future uses being catalyst formation, higher-nuclearity structure synthesis using our hexanuclear motif as a fundamental building block, Pu waste remediation, separations, and many other potential applications resulting from characteristic magnetic and luminescent properties of lanthanide polynuclear structures. Three synthetic methodologies (direct mixing with variable stoichiometries, use of volatile solvent, metathesis) were developed starting with 7 acidic and 6 basic azoles to obtain ionic liquids suitable for f-element coordination. Proton transfer by acidic/basic azole combination led to suitable low melting salts and two cocrystals. Acid/base reaction of azoles with soft-donor permanent cations of ([X 4444 ][OH] (where [X 4444 ] + = tetrabutylammonium [N 4444 ] + or tetrabutylphosphonium [P 4444 ] + ) with weakly acidic azoles including imidazole, 1,2,3-triazole, 1,2,4-triazole, 5-aminotetrazole, 4,5-dicyanoimidazole, and 2-amino-4,5-dicyanoimidazole) revealed several suitable low-melting salts. Metathesis reactions of Na(azolate) were conducted by first using weakly acidic azoles including 4,5-dicyanoimidazole, 2-amino-4,5-dicyanoimidazole, 5-aminotetrazole, and 1,2,4-triazole to form sodium or lithium salts using group(I) hydroxides in methanolic solutions. The best results were obtained by reacting the basic and acidic azoles directly in 1:1 or 3:1 ratios at elevated temperatures. Twenty-two azole mixtures were identified which are either low melting solids or room temperature liquids. Each of the low melting solids was confirmed to be a new solid phase, each of which is being further characterized. The liquids and solids are anticipated to be ILs, eutectics, or partially ionized systems, all of which will be suitable for the dissolution of f-element salts. Five new synthetic methodologies were developed to finding suitable crystallization conditions for f-element complexation with the goal of finding simple one pot reaction syntheses and crystallization strategies that could be used under the demanding conditions of transuranic chemistries. These synthetic methods yield many new crystalline phases which were studied by single crystal X-ray diffraction.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

A Review of the Evaluation of Building Energy Code Compliance in the United States

Building energy codes are essential tools for achieving energy efficiency in buildings. However, the full energy savings potential of these codes can only be realized if buildings are constructed in compliance with them. Therefore, evaluating building energy code compliance is crucial in bridging the gap between the energy efficiency requirements set by energy codes and the actualized energy savings achieved. An energy code compliance evaluation serves as a mechanism to assess construction practices, evaluate the effectiveness of code enforcement, identify gaps in compliance, and guide strategies for improvement through training and education. Conducting code compliance evaluation activities involves field studies that require careful design and significant resources. Historically, more emphasis has been placed on developing and adopting building energy codes, while efforts to evaluate compliance have been relatively limited and lacking consistent approaches. The passage of the 2009 American Recovery and Reinvestment Act (ARRA), which mandated that states create plans for achieving 90% compliance within eight years, stimulated the need for an energy code compliance evaluation. As a result, federal, state, and local governments, and utilities have invested in the development of methodologies and tools for code compliance evaluation studies. This paper reviews the code compliance evaluation studies conducted in the United States over the past three decades. It describes and compares the methodologies and metrics used to assess building energy code compliance, summarizes the general elements and steps involved in the evaluation process, and discusses common issues in these studies. Over time, code compliance evaluation methodologies have evolved from isolated development within individual states, regions, and utilities, to widely accepted protocols applicable across different states and local jurisdictions. There has been a transition in compliance metrics, shifting from historical compliance rates to energy-consumption-oriented approaches.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Development of an Assessment Methodology That Enables the Nuclear Industry to Evaluate Adoption of Advanced Automation

Nuclear power has a crucial role in providing safe, reliable, and economical carbon-free electricity for today and the future. For continued operation, many of the existing United States nuclear power plants will begin the subsequent license renewal process for extending their operating license periods. As plants extend their expected operating lifetimes, there is a significant opportunity to modernize. These plants have a much stronger business case with these extended mission periods to modernize and significantly enhance their economic viability in current and future energy markets by implementing digital technologies that support innovation, efficiency gains, and business-model transformation. Ensuring continued safety and reliability is crucial. Transformative digital technologies—including automation—that fundamentally change the concept of operation for the nuclear power plant operating model requires a critical focus on the human and technology integration element. Further, the nuclear industry has historically been reluctant to modernize due to having a risk adverse culture and lack of clarity for a transformative new state vision (Joe & Remer, 2019; Thomas et al., 2020). Common barriers include (1) the perceived value and return on investment (ROI) of digital technology, (2) the perceived risk associated with licensing, regulatory, and cybersecurity, and (3) insufficient guidance for performing digital modifications to power generation systems. This work presents a methodology to address these barriers and support the industry in adopting advanced automation and digital technology through developing a transformative vision and implementation strategy that will address the human and technology integration element. This research leverages previous LWRS Program and industry results. It draws specifically on previous LWRS Program research in the areas of advanced alarm systems, computer-based procedures, model informed decision support, and advanced human-system interface displays (e.g., overviews and task-based). The modernization methodology can be used to guide transformative thinking when integrating a set of vendor-specific capabilities to support a new concept of operations and a utility’s end-state vision. The results of this research are organized into six major sections: - Section 1 introduces the need for supporting large-scale digital modifications that will renew the technology base for extended operating life beyond 60 years - Section 2 describes the challenges that the nuclear industry is enduring with modernizing. - Section 3 summarizes the primary standards and guidance. - Section 4 presents earlier work from the LWRS Program regarding the development of a transformative conceptual design for an advanced control room of a hybrid plants. - Section 5 presents a methodology that is designed at addressing the challenges in the industry today in achieving a transformative new state vision and concept of operations. - Conclusions and next steps of this research are provided in Section 6.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

RANGERS: Modeling Report on Integrity and Performance Assessment of Engineered Barrier Systems in a Salt Repository for HLW/SNF

The Engineered Barrier System (EBS) plays an important role in ensuring the long-term safety and containment of high-level waste (HLW) and spent nuclear fuel (SNF) in deep geological repositories in salt formation. As part of a multi-barrier system, the EBS works alongside the natural barrier, which is the salt formation itself and the technical barrier comprising the disposal casks. The primary function of the EBS is to maintain containment during a defined period until the backfill used in the repository made of crushed salt, develops its sealing capacity through compaction. Over the time, the backfill eventually compacts to a state of low porosity and permeability, acting as a long-term seal. However, until this process is complete, the EBS must retain its structural and functional integrity. Regulatory guidelines in Germany currently require the EBS to remain effective for up to next ice age, that is expected in 50,000 years. The significant hydro-geological and topographic changes expected during an ice age could make it impossible to accurately predict the hydro-chemical conditions within the repository system at that time. In response to these challenges, BGE TECHNOLOGY GmbH (BGE TEC) and Sandia National Laboratories (SNL) have jointly developed a comprehensive methodology for the design and safety assessment of engineered barrier systems within the scope of the RANGERS project. This methodology is tailored for repositories in salt formations. The developed methodology provides a structured approach for designing and assessing the performance of the EBS in salt-based repositories. It begins with defining a sealing concept based on the geological characteristics of the selected site and the overall repository design. The entire repository system, comprising the geological site, repository infrastructure, and EBS, is then subjected to a Features, Events, and Processes (FEP) analysis, focusing solely on those FEPs that affect the EBS. The derived FEPs help identify the loads and stresses acting on the EBS, which serve as the foundation for conducting an integrity assessment. This analysis helps predict the EBS’s evolution and performance over the regulatory time frame, feeding into integrated performance assessment simulations.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Modeling the impact of the fuel injection strategy on the combustion and performance characteristics of a heavy-duty GCI engine

Gasoline compression ignition (GCI) is a promising strategy to achieve high thermal efficiency and low emissions with limited modifications to the conventional diesel engine hardware. It is a partially premixed concept, which derives its superiority from higher volatility and longer ignition delay of gasoline-like fuels combined with higher compression ratio typical of diesel engines. Here, the present study investigates the combustion process in a GCI engine operating with different injection strategies using computational fluid dynamics (CFD). Simulations are carried out on a single cylinder of a multi cylinder heavy-duty compression ignition engine, which operates at a compression ratio of 17:1 and an engine speed of 1038 rev/min. Two different injection strategies viz., late injection (LI), and early pilot injection (EP) are investigated to understand their impact on combustion and performance of the engine. Renormalized group (RNG) k-ε model is used to describe in-cylinder turbulence and KH RT model is used to simulate the fuel spray breakup. The developed CFD methodology is validated against relevant experimental data under a wide range of operating conditions for each injection strategy. The developed CFD methodology was found to capture the engine combustion behavior quite well. Based on the validated CFD model, the differences in the progress of combustion event for the two injection strategies is highlighted. It was found that a larger pilot fuel mass fraction results in a steeper rise in the initial heat release rate which in turn influences the transition to mixing controlled combustion. In line with the experimental data, the study showed that the late pilot injection strategy with three injection pulses, results in higher performance compared to the other conditions.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Design of an Integrated Solids Handling System to Maximize Syngas Process Reliability (Cooperative Research and Development Final Report)

The National Renewable Energy Laboratory (NREL), in partnership with Wonderful Renewable Energy (WRE) and Idaho National Laboratory (INL), plans to develop a general methodology for designing integrated biorefinery solids preprocessing, handling, and feeding systems based on the chemical, physical, and mechanical attributes of the starting biomass material. This attribute-driven approach will include detailed feedstock property measurements, iterative computational modeling, and bench-scale testing to design systems for preprocessing, handling, and reactor in-feed, up to and including the selection of the conversion reactor. The initial tests and system design will be conducted using waste material from almond and pistachio growing and production operations (shells, hulls, and wood), targeting the conversion of this material to syngas for electricity production. The methodology will then be generalized to other feedstocks. The purpose of this project is to design an integrated solids handling system to maximize the process reliability of converting almond and pistachio waste to electricity. The design methodology and workflow developed from this example will then be applied to the Feedstock Conversion Interface Consortium (FCIC) benchmark loblolly pine residues, thus demonstrating the robustness of the overall design approach and providing insight and guidance for future conversion systems. V-Grid Energy Systems was brought on as a subcontractor to provide gasifiers and labor to complete gasifier runs.

09 BIOMASS FUELS↗
DOE OSTI2022

Development and testing of a performance evaluation methodology to assess the reliability of occupancy sensor systems in residential buildings

With the emergence of advanced occupancy sensor technologies to better detect occupancy in buildings, a universal methodology and metrics are required to evaluate and report sensor systems’ reliability and compare the performance across multiple sensor systems. Herein this research presents a methodology to assess the reliability of occupancy sensor systems in residential buildings in a controlled laboratory environment, including both “typical” and “failure” testing scenarios. The developed methodology was then implemented to evaluate a novel occupancy detection sensor system’s reliability. “Typical” testing evaluates the overall accuracy of the sensor system, which suggest how reliable the occupancy sensor system is over time. Results show that on average, the precision and recall are 0.75 and 0.70, indicating similar numbers of false positives and false negatives across the dataset. The overall accuracy of the tested sensor system was 62.4% to 76.4%. Failure testing results indicate whether there are influential variables impacting the sensor performance. For the tested sensor system, the number of occupants, presence of large objects, presence of interior light sources, and number of doors are not influential, while lighting level, location of occupants, additional door in the entry/exit area, and having the TV on are variables determined to impact the sensor system performance.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Method for Generating Expert Derived Confidence Scores

We executed a pilot demonstration of a methodology for developing a new confidence metric to help operators calibrate their trust in ML event classifiers. This confidence metric was derived from domain expert judgment and was accompanied with a qualitative description describing the reason for each confidence rating. After learning the boundaries of an ML’s performance by studying a subset of events an SME rated his confidence in the ML’s ability to classify similar events and provided an explanation for his ratings. To demonstrate this methodology, we developed our expert driven confidence scores for the ML event classifier within the ESAMS. Next, we assessed the accuracy of the human expert confidence scores relative to the ML’s uncertainty quantification scores. This report includes a description of our methodology, summary of our findings and future directions.

97 MATHEMATICS AND COMPUTING↗