Search NASA⌕ Search

SEARCH · Search NASA

Results for “metric categorization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Onboard Decision-Making for Nominal and Contingency sUAS Flight

This study presents an onboard decision-making architecture for small unmanned aerial systems (sUAS). The decision-maker is part of NASA's SAFE50 project that is working under the UAS Traffic Management (UTM) Technical Capability Level (TCL) 4 to provide autonomous point-to-point UAV flight in BVLOS, high-density urban environments. The decision-maker monitors various metrics to determine the safety and feasibility of the mission and categorizes flight states as Nominal, Off-Nominal, Alternate Land, and Land Now in a finite state machine. Changes in the monitored metrics serve as transitions in the state machine and trigger replanning. Navigation degradation and communication failure are simulated to show the feasibility of the decision-maker framework in appropriately switching the flight state.

Baculi, Joshua↗

Determining Component Probability using Problem Report Data for Ground Systems used in Manned Space Flight

During the shuttle era NASA utilized a failure reporting system called the Problem Reporting and Corrective Action (PRACA) it purpose was to identify and track system non-conformance. The PRACA system over the years evolved from a relatively nominal way to identify system problems to a very complex tracking and report generating data base. The PRACA system became the primary method to categorize any and all anomalies from corrosion to catastrophic failure. The systems documented in the PRACA system range from flight hardware to ground or facility support equipment. While the PRACA system is complex, it does possess all the failure modes, times of occurrence, length of system delay, parts repaired or replaced, and corrective action performed. The difficulty is mining the data then to utilize that data in order to estimate component, Line Replaceable Unit (LRU), and system reliability analysis metrics. In this paper, we identify a methodology to categorize qualitative data from the ground system PRACA data base for common ground or facility support equipment. Then utilizing a heuristic developed for review of the PRACA data determine what reports identify a credible failure. These data are the used to determine inter-arrival times to perform an estimation of a metric for repairable component-or LRU reliability. This analysis is used to determine failure modes of the equipment, determine the probability of the component failure mode, and support various quantitative differing techniques for performing repairable system analysis. The result is that an effective and concise estimate of components used in manned space flight operations. The advantage is the components or LRU's are evaluated in the same environment and condition that occurs during the launch process.

Monaghan, Mark W.↗

Negative hydrogen ion sources for particle accelerators: Sustainability issues and recent improvements in long-term operations

High brightness, negative hydrogen ion sources are used extensively in scientific facilities operating worldwide. Negative hydrogen beams have become the preferred means of filling circular accelerators and storage rings as well as enabling efficient extraction from cyclotrons. Several well-known facilities now have considerable experience with operating a variety of sources such as RF-, filament-, magnetron- and Penning-type H- ion sources. These facilities include the US Spallation Neutron Source (SNS), Japan Proton Accelerator Research Complex (J-PARC), Rutherford Appleton Laboratory (RAL-ISIS), Los Alamos Neutron Science Center (LANSCE), Fermi National Accelerator Laboratory (FNAL), Brookhaven National Laboratory (BNL), numerous installations of D-Pace (licenced by TRIUMF) ion sources used mainly on cyclotrons and, most recently, the CERN-LINAC-1 injector. This report first summarizes the current performance of these ion sources in routine, daily operations with attention toward source service-periods and availability metrics. Sustainability issues encountered at each facility are also reported and categorized to identify areas of common concern and key issues. Recent ion source improvements to address these issues are also discussed as well as plans for meeting future facility upgrade requirements.

Welton, Robert F.↗

Simulated Changes in Tropical Cyclone Size, Accumulated Cyclone Energy and Power Dissipation Index in a Warmer Climate

Detection, attribution and projection of changes in tropical cyclone intensity statistics are made difficult from the potentially decreasing overall storm frequency combined with increases in the peak winds of the most intense storms as the climate warms. Multi-decadal simulations of stabilized climate scenarios from a high-resolution tropical cyclone permitting atmospheric general circulation model are used to examine simulated global changes from warmer temperatures, if any, in estimates of tropical cyclone size, accumulated cyclonic energy and power dissipation index. Changes in these metrics are found to be complicated functions of storm categorization and global averages of them are unlikely to easily reveal the impact of climate change on future tropical cyclone intensity statistics.

Wehner, Michael (ORCID:0000000159910082)↗

The Potential of Quantum Annealing for Rapid Solution Structure Identification [Slides]

This presentation covers a framework for categorizing heuristics including neighborhood size, iterated local search, and performance metrics. The question, "How does Quantum Annealing stack up?" is addressed through Random with Fields (RANF-1), Biased Ferromagnet (BFM), and Corrupted Biased Ferromagnet (CBFM). Concluding thoughts are then given.

97 MATHEMATICS AND COMPUTING↗

Warpage of Large Curved Composite Panels due to Manufacturing Anomalies

This paper discusses the influences of a misaligned layer, a resin-rich slightly thicker layer, and a small thermal gradient on the thermally-induced deformations of large curved composite panels during cooldown from their cure temperature. The deformations represent warpage of the panels due to anomalies that occur during layup, consolidation, and cure. Two-dimensional finite element analyses are used The deformations are categorized as to their impact on circumferential and twist warpage metrics. The results are intended to highlight the sensitivity of manufactured panel shape to the various unwanted effects that can occur during manufacturing.

Starnes, James H., Jr.↗

Public Reference Data for Megawatt-Scale Hydrogen Electrolysis - NLR Historical Wind

The U.S. Department of Energy and the National Laboratory of the Rockies (NLR) demonstrate hydrogen electrolysis from variable sources, hydrogen compression and storage, and hydrogen fuel cell power production using megawatt-scale equipment at NLR’s Flatirons Campus as part of the Advanced Research on Integrated Energy Systems (ARIES) initiative. This dataset represents part of that effort and is intended for academic, national laboratory, industrial, and other stakeholders to plan, design, and validate models of megawatt-scale hydrogen technologies and diverse energy infrastructure nationwide. These data provide a baseline for how existing hydrogen electrolysis technologies perform when coupled with various energy technologies. Future datasets will demonstrate how existing hydrogen fuel cell technologies can provide controllable, dispatchable, and variable power output for artificial intelligence (AI) data centers and other variable loads. This dataset entry describes hydrogen production by conducting a statistical analysis of historical wind data over a five-year period (2020-2025) from a single 1.5MW turbine manufactured by General Electric (GE) located at NLR’s Flatirons Campus, to generate an experimental test profile that was deployed on a 1.25-MW proton exchange membrane type MC250 electrolyzer system manufactured by Nel Hydrogen . [1] While the electrolyzer balance-of-plant supports up to 2.5 MW of electrolysis, NLR only has a single 1.25-MW electrolysis stack. The historical wind data provided several metrics, however, the analysis particularly focused on the measured power output by the wind turbine. The power output time series of data for each day was categorized by total energy generation and standard deviation, and the day that represented the highest combination of these two metrics was chosen – December 25th, 2022. This process was then repeated for a moving four-hour window within this day to identify the most statistically variable period. Finally, this four-hour period was scaled by 65% to match the 1.25 MW electrolyzer. The electrolysis system controls hydrogen production by varying DC current applied to the stack, from a maximum of 3000 A to a minimum safe operation of 300 A, or 10%. Because the current – voltage characteristic changes as the stack ages and efficiency degrades, the actual minimum safe operating power changes over time. The historical wind profiles were translated from power (kilowatts) to current (amperes) using a curve fit with calibration data and sent to the electrolyzer power supply at 1 Hz frequency. For more details on the statistical analysis process, see the presentation labeled “ Public Reference Data for Megawatt-Scale Hydrogen Electrolysis” provided with each data entry. These datasets report relevant hydrogen balance-of-plant and system data, all captured at 1 Hz, including hydrogen mass production measured with an Emerson Coriolis flow meter. Each .zip file represents a single wind turbine electrolysis experiment and is formatted as follows: {technology}_{scaling factor}-{electrolyzer ramp rate in amperes/second} For instance, “wind-GE1.5MW_0.65-400.zip” represents the hour-long experiment using historical data from the wind-GE1.5MW turbine, scaled to 65%, with the electrolyzer power supply set to a maximum ramp rate (gain and slew) of 400 A/s. Each .zip folder contains the following files: A .csv file containing raw data An .xlsx file explaining all the fields in the raw data. A .png plot showing the time series of hydrogen production, electrolysis power consumption, and wind power input. A PDF file detailing the historical wind data statistical analysis used to generate the wind profile. An experiment labeled “characterization_200.zip” demonstrates the MC250 electrolyzer steady-state response with 30-minute load steps for a total duration of 5 hours. Finally, a .csv file is provided with all simulated wind experiments combined into one dataset labeled "combined_historical_wind_experiments.csv". NLR also built an AI/machine-learning predictive model based on these datasets. The model ingests the electrolyzer current command in amperes, as well as various pressures and temperatures across the system, and predicts hydrogen output in kilograms per hour. The complete model can be found at https://huggingface.co/NatLabRockies/ptmelt-hydrogen-electrolysis [1] nelhydrogen.com/product/mc-series-electrolyser .

08 HYDROGEN↗

Bayesian event categorization matrix approach for explosion monitoring

Current efforts to correctly categorize natural events from suspected explosion sources with data that is collected by ground- or space-based sensors presents historical challenges that remain unaddressed by the Event Categorization Matrix (ECM) model. Smaller historical events (lower yield explosions) may have data available from fewer measurement techniques than are available today, and therefore, a historical event record can lack a complete set of discriminants. The covariance structures can also differ between such observations of event (source-type) categories. Both obstacles are problematic for the classic ECM model. Our work addresses this gap and presents a Bayesian update to the previous ECM model, termed the Bayesian Event Categorization Matrix model, which can be trained on partial observations and does not rely on a pooled covariance structure. We further augment the ECM model with Bayesian Decision Theory so that false negative or false positive rates of an event categorization can be reduced in an intuitive manner. To demonstrate improved categorization rates for the Bayesian Event Categorization Matrix model, we compare an array of Bayesian and classic models with multiple performance metrics using Monte Carlo experiments. We use both synthetic and real data. Our Bayesian models show consistent gains in overall accuracy and lower false negative rates relative to the classic ECM model. Here, we propose future avenues to improve Bayesian Event Categorization Matrix models’ decision making and predictive capability.

58 GEOSCIENCES↗

Using Qualitative Hazard Analysis to Guide Quantitative Safety Analysis

Quantitative methods can be beneficial in many types of safety investigations. However, there are many difficulties in using quantitative m ethods. Far example, there may be little relevant data available. This paper proposes a framework for using quantitative hazard analysis to prioritize hazard scenarios most suitable for quantitative mziysis. The framework first categorizes hazard scenarios by severity and likelihood. We then propose another metric "modeling difficulty" that desc ribes the complexity in modeling a given hazard scenario quantitatively. The combined metrics of severity, likelihood, and modeling difficu lty help to prioritize hazard scenarios for which quantitative analys is should be applied. We have applied this methodology to proposed concepts of operations for reduced wake separation for airplane operatio ns at closely spaced parallel runways.

Shortle, J. F.↗

Satellite Conjunction "Probability," "Possibility," and "Plausibility": A Categorization of Competing Conjunction Assessment Risk Assessment Paradigms

A number of different conjunction assessment (CA) risk analysis methods and metrics have been proposed in the critical literature, and they vary widely in purport and form. However, they tend to be proposed individually and episodically, so that it is difficult for a CA practitioner to take stock of the possibilities, under- stand their fundamental differences, and make informed choices for their particular CA risk assessment enterprise. The present study seeks to collect the major proposals for risk assessment methods and parameters and organize them categorically, under the proposed divisions of “probability,” “plausibility,” and “possibility,” as well as formulate what appears for each to be its fundamental question and, where applicable, null hypothesis. This activity can, through a bottom-up approach, provide some of the building blocks for an overarching CA philosophy, as well as establish concepts and terminology potentially useful to the broader discussion of these topics.

Hejduk, M. D.↗

Satellite Conjunction “Probability,” “Plausibility,” and “Possibility”: A Categorization of Competing Satellite Conjunction Assessment Risk Analysis Paradigms

A number of different conjunction assessment (CA) risk analysis methods and metrics have been proposed in the critical literature, and they vary widely in purport and form. However, they tend to be proposed individually and episodically, so that it is difficult for a CA practitioner to take stock of the possibilities, under- stand their fundamental differences, and make informed choices for their particular CA risk assessment enterprise. The present study seeks to collect the major proposals for risk assessment methods and parameters and organize them categorically, under the proposed divisions of “probability,” “plausibility,” and “possibility,” as well as formulate what appears for each to be its fundamental question and, where applicable, null hypothesis. This activity can, through a bottom-up approach, provide some of the building blocks for an overarching CA philosophy, as well as establish concepts and terminology potentially useful to the broader discussion of these topics.

Hejduk, M. D.↗

Variable Resource Resilience: How Systems Experience Increased Resilience from Variable and Hybrid Resources

Variable resources like wind and solar are often seen as detriments to system resilience rather than benefits because they may not be available with the capacities or services required during a high-impact low-frequency (HILF) event, whether that is a physical threat, natural disaster, or cyber attack. However, resilience goals and metrics are inadequate for electric energy delivery systems with inverter-based resources. Examination of this topic reveals that renewable resources are well suited to combat many resilience hazards due to local resource availability. Metrics that demonstrate the resilience value of variable resources are presented and categorized for resource (wind, solar, storage, hybrid) and installation type (bulk utility scale, behind-the-meter, front-of-the-meter, isolated). Distributed and hybrid systems can further enhance resilience benefits my maximizing resource potential for a locality. A case study demonstrating quantitative resilience benefits from wind alone is provided for St. Mary's, AK, which concludes that hundreds of thousands of dollars are saved by the addition of a wind turbine in the face of realistic fuel shortage and extreme winter weather scenarios.

17 WIND ENERGY↗

Austin Sustainable and Holistic Integration of Energy Storage and Solar PV [Austin SHINES]. Final Report, Version 2

The Austin SHINES project and solution is a software management platform, for an electric grid with a high penetration of dispersed photovoltaic (PV) solar generation sites, which maintains the traditional power quality and reliability associated with grid service. This project developed and deployed the platform as a Distributed Energy Resource Management System (DERMS), engaging multiple advanced controls, to evaluate operation and optimization of a fleet of diverse DER assets, installed at several locations among Austin Energy’s customers and distribution system. The project also produced a methodology to create a replicable DERMS template, adaptable to other regions and market structures. Last, Austin SHINES aimed to demonstrate the solution’s methodology would enable the DER grid ecosystem to serve load at a technical cost (System Levelized Cost of Electricity, or System LCOE) of less than the U.S. Department of Energy SHINES program metric of $0.14/kWh, in a defined boundary, while enabling a high penetration of distributed PV. Research was categorized in 6 reports (Final Deliverables = FD) listed below, with titles and descriptions indicating which area of understanding was investigated: FD-1: System Levelized Cost of Electricity (System LCOE) Methodology The creation and use of the System LCOE to Serve Load metric that encompasses the holistic, system-level costs and benefits of all resources, and enables them to be evaluated based on their ability to support an efficient and low-cost integrated grid ecosystem. FD-2: Software Platform Product Description The creation of new DER control methodologies deployable within a utility-grade software platform that enable DER's to maximize their benefit within a grid, that is capable of serving load enabling a high penetration of distributed PV generation. FD-3: Optimal Design Methodology Optimal design methodologies for individual DER installations that enable utilities to determine the optimal combinations and sizing for individual DER sites. FD-4: Austin SHINES Ownership and Operation Models for DER System Performance A comparison of multiple DER aggregation and ownership methodologies including direct utility control, third-party aggregator, and autonomous. FD-5: Economic Modeling & Optimization A comparison of multiple DER technology mixes and configurations within the distribution system, providing insight into an optimal blend of technologies that best enable the distribution system to serve load at the lowest cost at high penetrations of solar. FD-6: Fielded Assets Deployed DER assets within the Austin Energy SHINES circuits. Austin SHINES provided an opening for state-of-the-art technology products to be deployed, providing a rich opportunity for improving how each of the products perform as stand-alone products, and in concert with other complementary products. The Austin SHINES project comprised of two key metrics for System LCOE: SystemLCOE_SHINES<$0.14/kWh Modeled ΔSystemLCOE_SHINES/ΔSystemLCOE_Base≥20% at same solar penetration The System LCOE calculation uses the costs of the utility-owned infrastructure as it exists today, the cost of the DERs that exist in the system today, and the cost of the purchase of energy from ERCOT wholesale markets over the course of the calendar year. All costs are on an annualized basis. The capital and operating costs are derived from the rate case, which produces a yearly cost. The net cost of energy and services imported to the system is integrated over the test year, as is the load served and solar penetration. The first metric was easily achieved by every scenario considered. The goal was set when the Department of Energy’s SHINES Funding Opportunity Announcement was written in 2015 and was a more difficult target at the time. Due mostly to rapidly declining costs for DERs and the significant decrease in the Electric Reliability Council of Texas (ERCOT) energy market prices, which results in lower net cost of energy purchases, the System LCOE is well below this target for all scenarios considered. A fleet of DERs can assume different mixtures, each of which serves the load at a different LCOE. The optimal mixture of DERs serves load at the smallest System LCOE. The second metric (hereinafter %delta metric) asks that the holistic DERMS controls reduce the incremental cost above the baseline of going to a high solar penetration future by at least 20% as compared to the case of a DER deployment with no sophisticated controls (autonomous). Many comparison sets were created throughout this project. Physical technology was installed for informing utility engineering and testing several types of operational control schemes, through the DERMS. The types of operational control which were compared for valuation of the System LCOE Metric were: Holistic control = using the full suite of the DERMS platform to decide and optimize how/why the systems operate depending on weather, market, and reliability signal input. Autonomous control = a local mode at the asset site, wherein a schedule operates the asset, with visibility into performance only No control = the baseline for comparing value against the other two types of control The types of ownership control included: Direct Utility control = the utility dispatches a signal to each asset Third-Party Aggregator = a third party aggregates a fleet of assets and the utility dispatches one signal for all Autonomous = a local mode is set for operation at the asset site, wherein a schedule operates the asset, with visibility into performance only The types of control methodologies deployable within a utility-grade software platform included: Utility Peak Load Reduction = Lower transmission cost obligation Day-Ahead Energy Arbitrage = Realize economic value through price differential Real-Time Price Dispatch = Realize economic value from real-time price spikes Voltage support = Reduce losses and increase solar generation Distribution Congestion Management = Increase local grid reliability Demand Charge Reduction = Lower customer bills and realize system benefit The fielded assets deployed for the project were: Utility Scale Kingsbery Energy Storage System: 1.5 MW / 3 MWh Li-Ion battery storage Mueller Energy Storage System: 1.75 MW / 3.2 MWh Li-Ion battery storage, 7 Energy Storage Units (250 kW each) La Loma Community Solar: 2.6 MW Commercial Scale Aggregated storage installations at 3 sites, with existing solar (300+ kW): One 18 kW / 36 kWh Li-Ion battery storage Two 72 kW / 144 kWh Li-Ion battery storage Residential Scale Aggregated storage installations: -Six stationary battery storage systems (10 kWh each) at homes with existing solar -One Electric Vehicle installed as Vehicle-to-Grid (V2G) Utility-Controlled Solar via Smart Inverters at 12 homes Autonomously-Controlled Smart Inverters at 6 homes Over the course of the project, Austin SHINES undertook installing more than 3 MW of distributed battery energy storage, smart PV inverters, a DER control platform, and other enabling technologies utilizing customer and utility locations and aggregation models. All of these resources were to be integrated and optimized at the utility level. DER assets and control methodologies were designed to achieve a credible pathway to a System LCOE for energy delivered to load of $0.14//kWh or less by 2020, while maximizing distributed solar generation and maintaining acceptable standards of power quality. The project also established a template for other regions to follow, to maximize the adoption of distributed solar PV in support of an economic and efficient grid. In total, the Austin SHINES project added value to the DER subject area in each layer of integration. From utility, to commercial to residential scales, the sheer hierarchy of communication and coordination was a significant accomplishment in addition to learnings from what these communications revealed was unique to each. Economically, the most effective method demonstrated was the criticality of planning phases. Contingencies and multiple projection scenarios helped guide the project to deploy optimal design as close as feasible, in real world conditions. The project and reports will serve public benefit by outlining specific areas of DER strategy and installation where many stakeholders and needs can be addressed with improved efficiency. Overall, communities and utilities should use the results to guide the increasing options available for powering the grid with DER, renewables, and carbon considerate energy.

14 SOLAR ENERGY↗

Improving the Fidelity of Capability & Resource Weighting in A Probalistic Risk Assessment Model for Spaceflight

INTRODUCTION NASA’s Informing Mission Planning via Analysis of Complex Tradespaces (IMPACT) tool uses Probabilistic Risk Assessment (PRA) to provide an evidence-based, data-driven estimate of how medical system capabilities affect mission outcomes. IMPACT maps condition incidence to available resources thereby facilitating the calculation of outcome metrics that allow the estimation of mission medical risk. Conditions can be nominally categorized as either treated or untreated depending on the availability of necessary diagnostic and therapeutic capabilities. This categorization enables IMPACT to estimate the effect of various medical system configurations on mission outcomes such as crew mortality, disability, crew member down-time, return to duty/recovery, and need for evacuation. IMPACT currently employs an equal weighting, “partial credit” approach to define treatment in which each of the capabilities associated with a given condition contributes an equal amount to management of the condition. This feature enables IMPACT to report values in between “fully untreated” and “fully treated” based on the proportion of capabilities available within the model. However, as is normal in medical/clinical practice, not all individual capabilities contribute equally to medical care. For example, the ability to provide intramuscular epinephrine during an anaphylactic episode contributes more likelihood of overall management success than does the administration of oral diphenhydramine. We hypothesize that weighting the relative contribution of each capability to each specific condition will improve outcome prediction and therefore will better provide mission planners with more nuanced and accurate options when designing space medical systems. METHODS Using a five-point Fibonacci scaling sequence (1, 2, 3, 5, 8) subject matter experts from NASA’s Exploration Medical Capabilities (ExMC) element assigned relative contribution weighting values to each identified capability within IMPACT. Since the relative importance of each capability varies depending on the specific condition, the resulting “partial” weighting was completed for more than 1,600 individual weighting assignments for 666 capabilities across 121 conditions. Each assignment required three-physician concurrence based on the overall importance of the capability to the diagnosis and management of the condition being considered and the difficulty with which it could be improvised by the crew. Once complete, 100,000 IMPACT simulations were run for a 6-month Lunar mission with a 30-day surface stay to evaluate the effect of this modification of the model. RESULTS Partial weighting significantly decreased predicted task time loss (TTL), evacuation, and loss of crew life without causing significant changes to the recommended medical system design. CONCLUSIONS The paucity of real-world referent data to support long-duration space missions of this type limits the ability to judge one predictive analytics method as superior to another. However, since the proposed method significantly reduces and optimizes outcome risks—without changing the medical system design—incorporating a partial weighting methodology is likely to provide a more accurate and operationally-relevant representation of medical risk without compromising IMPACTs ability to inform overarching medical system requirements.

Steller JG↗

TriTruss Packaging and Deployment Trade Study

An architecture and feasibility study of next generation In-Space Assembled Telescopes (iSAT) concluded that robotic in-space assembly of modular components is necessary to enable large (>15-meter diameter) primary apertures. The iSAT study recommended that the foundational structure be assembled from modular TriTruss modules that are packaged for launch, deployed on-orbit and robotically assembled into the final configuration. This paper will describe and summarize the results of a trade study that investigated viable concept of operations (ConOps) for the packaging and deployment (P&D) of individual planar TriTruss modules that could be assembled to form a large aperture iSAT. The ideal TriTruss P&D concept is defined as one that: allows for efficient packaging; has sufficient geometric versatility to be launch vehicle independent; provides a stiff and lightweight structure; has low mechanical complexity; and has component modularity. The P&D concept should allow for prelaunch subsystem or utility integration if required. The concept would be kinematically simple and be robotically deployed using a minimum number of specialized tools. In this first phase of an ongoing more comprehensive trade study, concepts were proposed and then evaluated based on initial metrics representing features of an ideal P&D concept. The P&D concepts evaluated are categorized as: core collapse, face collapse, and erectable structures. Sub-scale models were constructed to help understand the kinematics and mechanical complexity required to enable P&D. Based on a weighting scale, the most promising candidate P&D concepts have selected and will undergo more rigorous structural design, analysis, and testing in the study’s next phase. The ultimate goal of the comprehensive trade study will be to recommend a single TriTruss design and associated P&D concept that will be built and evaluated at NASA Langley Research Center’s In-Space Assembly Laboratory.

in-space assembly (ISA)↗

Comparative Analysis of ML Techniques for Data-Driven Anomaly Detection, Classification and Localization in Distribution System

High penetration of Distributed Energy Resources (DERs), fundamental load behavior changes, controllable loads, and significant increase in Electrical Vehicles (EVs) lead to complex dynamic behavior of the electric distribution system. Increasing number of components also means more measurements, more data and more data anomalies. Detecting, classifying and localizing these anomalies are important for situational awareness, and at the same time, very challenging given increasing complexity of the system. Highly accurate and high-resolution analytical techniques are needed to support anomaly detection, classification and localization (AD-C-L) for monitoring, root cause analysis and decision making. This paper provides comprehensive review and analysis of the existing spatio-temporal AD-C-L techniques within the distribution system. Challenges for specific problems in AD-C- L have been also discussed in this paper. Existing AD-C- L techniques have been categorized and synthesized for specific merits and limitations of multiple Machine Learning (ML) methodologies using common developed metrics of performance. The comparative analysis is summarized and presented with the open research challenges and path forward for future research needs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Predicting measures of soil health using the microbiome and supervised machine learning

Soil health encompasses a range of biological, chemical, and physical soil properties that sustain the commercial and ecological value of agroecosystems. Monitoring soil health requires a comprehensive set of diagnostics that can be cost-prohibitive for routine analyses. The soil microbiome provides a rich source of information about soil properties, which can be assayed in a high-throughput, cost-effective way. We evaluated the accuracy of random forest (RF) and support vector machine (SVM) regression and classification models in predicting 12 measures of soil health, tillage status, and soil texture from 16S rRNA gene amplicon data with an operationally relevant sample set. We validated the efficacy of the best performing models against independent datasets and also tested best practices for processing microbiome data for use in machine learning. Soil health metrics could be predicted from microbiome data with the best models achieving a Kappa value of ~0.65, for categorical assessments, and a R2 value of ~0.8, for numerical scores. Biological health ratings were better predicted than chemical or physical ratings. Validation with independent datasets revealed that models had general predictive value for soil properties, including yield. The ecological profiles of several taxa important for model accuracy matched the observed relationships with soil health, including Pyrinomonadaceae, Nitrososphaeraceae, and Candidatus Udeaobacter. Models trained at the highest taxonomic resolution proved most accurate, with losses in accuracy resulting from rarefying, sparsity filtering, and aggregating at higher taxonomic ranks. Furthermore, our study provides the groundwork for developing scalable technology to use microbiome-based diagnostics for the assessment of soil health.

16S rRNA gene↗

Status Report on Regulatory Criteria Applicable to the Use of Artificial Intelligence (AI) and Machine Learning (ML)

Although the interest in the use of artificial intelligence (AI) and machine learning (ML) in nuclear energy is increasing rapidly, at present their implementation is limited. This rapid increase in interest is not surprising considering that implementing AI and ML technology would allow for continuous monitoring, facilitate the implementation of predictive maintenance with optimized staffing plans, enable automation and autonomy opportunities that could drastically reduce fixed operation and maintenance costs, and provide training for operations and maintenance. Other industries are using AI for construction, and in the nuclear arena AI could provide great benefit in decommissioning activities. The ability of AI and ML to operate in real time vastly increases their potential impact. Before AI can be used in design, operations, or as a regulatory tool, the specifics on the regulations applicable to the use of AI for nuclear power applications need to be established. The difficulty is that the specific use cases will dictate the applicability of regulations. For example, even within the application domain associated with operations, the regulations might vary if the AI is used to create a virtual reference for plant operations or is used for training, optimization of maintenance intervals, prioritization of maintenance activities, etc. Different still is if the AI is to be used for design or setting technical specifications, which will introduce additional requirements. US Nuclear Regulatory Commission (NRC) licensing reviews are based on an applicant’s design meeting its performance assessment based on (1) safety goals and objectives, (2) deterministic and/or probabilistic analysis of accident scenarios, and (3) quantitative assessment of design alternatives against the safety goals and objectives using accepted engineering tools, methodologies, and performance criteria. The current regulatory framework does not explicitly address AI or autonomous control. However, as implementing AI technology will require the use of a digital platform, it must meet the requirements of an instrumentation and control (I&C) system. The regulatory requirements for AI, which will be incorporated into the I&C system, will be very dependent on how it is used (i.e., its functionality, safety classification, etc.). The licensing process is primarily risk-based with the identification of components and systems as nonsafety, important to safety, or safety related. A risk-informed approach allows further gradation of components and systems based on risk metrics such as core damage frequency or large early release fractions. Thus, the use cases and the risk categorization of impacted systems and components will determine the regulatory requirements. Regardless of how AI is used it presents new opportunities for risk-informing operating, maintenance, and regulatory decisions. Trustworthiness, transparency, and the ability to validate and verify the results will be paramount in showing that the systems and plant still meet their performance requirements. This report describes the results of research to identify regulatory implications of AI technologies and their uses. Specifically, this report reviews current regulatory guidance relevant to the application of AI for design (including design changes or new designs including advanced reactors), construction, operations, training, maintenance, research, testing, and as a regulatory tool. AI can be automated at different levels from purely informative purposes to autonomous controls. The focus of this review included determination of constraints on the application of AI technology, identification of any regulatory gaps or uncertainties, and clarification of anticipated technical basis information likely to be important for regulatory acceptance of these technologies. Currently, any use of AI at nuclear power plants is focused on nonsafety-related applications. The NRC and other regulatory bodies are evaluating providing guidance to address gaps rather than create new regulations to address the use of AI and ML. This approach seems to be the best to encourage AI development without adding regulatory uncertainty.

97 MATHEMATICS AND COMPUTING↗