Search NASA⌕ Search

SEARCH · Search NASA

Results for “System Safety Assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Babcock and Wilcox assessment of the Pratt and Whitney XNR2000

Babcock & Wilcox performed four subtasks related to the assessment of the Pratt & Whitney XNR2000 nuclear reactor as follows: (1) cermet fuel element fabricability assessment; (2) mechanical design review of the reactor system; (3) neutronic analysis review; and (4) safety assessment. The results of the mechanical and physics reviews have been integrated into the reactor design. The results of the fuel and safety assessments are presented.

Westerman, Kurt O.↗

GDSA Framework Development and Process Model Integration FY2024

The Disposal Research & Development (Disposal R&D) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Spent Fuel & High-Level Waste Disposition is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). A high priority for Disposal R&D is disposal system modeling (Sassani et al. 2023). The Geologic Disposal Safety Assessment (GDSA) work package is charged with developing a disposal system modeling and analysis capability for evaluating generic disposal system performance for nuclear waste in geologic media.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Benchmarking Framework for Evaluating Large Language Model Capabilities in Nuclear Reactor Safety Applications

Large language models (LLMs) are increasingly capable of answering technical questions, synthesizing domain knowledge, and supporting engineering workflows. For nuclear science and engineering, these capabilities require careful, domain-specific evaluation before they can be credibly incorporated into safety-related activities, regulatory review, or technical decision support. This paper presents preliminary results from benchmarking framework for evaluating LLM capabilities in nuclear contexts. The framework is organized into three evaluation categories: nuclear fundamentals, general dual-use knowledge, and plant specific knowledge. These categories are intended to distinguish general nuclear engineering competence from broader technical reasoning and more context-dependent nuclear knowledge. Initial evaluations focus on nuclear fundamentals using questions representative of the knowledge expected of a nuclear professional engineer. Results indicate that contemporary frontier models perform at a high level and substantially exceed the performance of older model generations, with some models approaching saturation of the current benchmark. These findings suggest both the rapid improvement of LLM capabilities in specialized technical domains and the need for more discriminating evaluation methods. The paper presents the benchmark structure, preliminary model-comparison results, and ongoing work. This work supports development of verifiable, responsible, and safety-conscious methods for assessing AI systems in nuclear engineering applications.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

NASA Engineering and Safety Center Technical Bulletin No. 20-06: Material Compatibility Assessment of Spacecraft Oxidizer Systems

Recently designed oxidizer systems used in spacecraft propulsion are pushing the limits of materials and operating conditions. As a result, nitrogen tetroxide (NTO) oxidizer systems are exhibiting failures driven by ignition mechanisms similar to oxygen systems. Oxidizer systems (e.g., O 2 , N 2 O 4 , N 2 O H 2 O 2 ) have generally been designed and operated within industry experience for material corrosion concerns without a complete understanding or regard for the concerns regarding potential material ignition and burning. To compound the problem, the effects of varying parameters on ignition and the kindling chain have not been studied, and there is a very limited amount of published data to help with the understanding. NASA-sponsored testing is actively researching ignition mechanisms, determining thresholds, and defining operating envelopes to inform the aerospace community.

NESC↗

NASA Space Technology Draft Roadmap Area 13: Ground and Launch Systems Processing

This slide presentation reviews the technology development roadmap for the area of ground and launch systems processing. The scope of this technology area includes: (1) Assembly, integration, and processing of the launch vehicle, spacecraft, and payload hardware (2) Supply chain management (3) Transportation of hardware to the launch site (4) Transportation to and operations at the launch pad (5) Launch processing infrastructure and its ability to support future operations (6) Range, personnel, and facility safety capabilities (7) Launch and landing weather (8) Environmental impact mitigations for ground and launch operations (9) Launch control center operations and infrastructure (10) Mission integration and planning (11) Mission training for both ground and flight crew personnel (12) Mission control center operations and infrastructure (13) Telemetry and command processing and archiving (14) Recovery operations for flight crews, flight hardware, and returned samples. This technology roadmap also identifies ground, launch and mission technologies that will: (1) Dramatically transform future space operations, with significant improvement in life-cycle costs (2) Improve the quality of life on earth, while exploring in co-existence with the environment (3) Increase reliability and mission availability using low/zero maintenance materials and systems, comprehensive capabilities to ascertain and forecast system health/configuration, data integration, and the use of advanced/expert software systems (4) Enhance methods to assess safety and mission risk posture, which would allow for timely and better decision making. Several key technologies are identified, with a couple of slides devoted to one of these technologies (i.e., corrosion detection and prevention). Development of these technologies can enhance life on earth and have a major impact on how we can access space, eventually making routine commercial space access and improve building and manufacturing, and weather forecasting for example for the effect of these process improvements on our daily lives.

Clements, Greg↗

An intelligent control system for failure detection and controller reconfiguration

We present an architecture of an intelligent restructurable control system to automatically detect failure of system components, assess its impact on system performance and safety, and reconfigure the controller for performance recovery. Fault detection is based on neural network associative memories and pattern classifiers, and is implemented using a multilayer feedforward network. Details of the fault detection network along with simulation results on health monitoring of a dc motor have been presented. Conceptual developments for fault assessment using an expert system and controller reconfiguration using a neural network are outlined.

Biswas, Saroj K.↗

Systematic Enterprise Risk Management by Integrating the RISMC Toolkit and Cost-Benefit Analysis (Final Report)

The goal of this research is to theorize and quantify the relationships between safety and the financial performance of nuclear power plants (NPPs). The Socio-Technical Risk Analysis (SoTeRiA) theoretical framework, which connects the social aspects (e.g., safety culture) and structural features (e.g., safety practices) of an organization with organizational safety and financial risks, is used to theorize the direct and indirect relationships between safety and the financial performance of NPPs. An Integrated Enterprise Risk Management (I-ERM) methodological framework is developed to operationalize SoTeRiA to quantify NPP safety and financial performance in a unified platform where their underlying physical degradation mechanisms, coupled with maintenance performance (considering human and organizational factors), are explicitly incorporated to depict the interconnections and dependencies between safety and financial performance. In this study, NPP safety refers to both occupational safety and system safety (estimated from Probabilistic Risk Assessment, PRA), and financial performance refers to the monetary values associated with NPP operation and maintenance (O&M) strategies. This report covers a case study demonstrating the feasibility of the I-ERM methodological framework. More detailed development of one of the I-ERM modules, i.e., Probabilistic Physics-of-Failure (PPoF) analysis, and its connection with other I-ERM modules is demonstrated in a second case study. The outcome of this research will help NPP decision-makers create cost-saving maintenance strategies while maintaining safety by providing cost- and risk-informed recommendations regarding maintenance work processes and operational strategies.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

GDSA Framework Development and Process Model Integration FY2023

The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Spent Fuel & Waste Disposition (SFWD) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). A high priority for SFWST disposal R&D is disposal system modeling (Sassani et al. 2021). The SFWST Geologic Disposal Safety Assessment (GDSA) work package is charged with developing a disposal system modeling and analysis capability for evaluating generic disposal system performance for nuclear waste in geologic media.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Spaceborne power systems preference analyses. Volume 1: Summary

Sixteen alternative spaceborne nuclear power system concepts were ranked using multiattribute decision analysis to identify promising concepts for further technology development. Four groups interviewed were: safety, systems definition and design, technology assessment, and mission analysis. The ranking results were consistent from group and for different utility function models for individuals.

Smith, J. H.↗

Spaceborne power systems preference analyses. Volume 2: Decision analysis

Sixteen alternative spaceborne nuclear power system concepts were ranked using multiattribute decision analysis. The purpose of the ranking was to identify promising concepts for further technology development and the issues associated with such development. Four groups were interviewed to obtain preference. The four groups were: safety, systems definition and design, technology assessment, and mission analysis. The highest ranked systems were the heat-pipe thermoelectric systems, heat-pipe Stirling, in-core thermionic, and liquid-metal thermoelectric systems. The next group contained the liquid-metal Stirling, heat-pipe Alkali Metal Thermoelectric Converter (AMTEC), heat-pipe Brayton, liquid-metal out-of-core thermionic, and heat-pipe Rankine systems. The least preferred systems were the liquid-metal AMTEC, heat-pipe thermophotovoltaic, liquid-metal Brayton and Rankine, and gas-cooled Brayton. The three nonheat-pipe technologies selected matched the top three nonheat-pipe systems ranked by this study.

Smith, J. H.↗

Lunar Dust Simulant in Mechanical Component Testing - Paradigm and Practicality

Due to the uniquely harsh lunar surface environment, terrestrial test activities may not adequately represent abrasive wear by lunar dust likely to be experienced in mechanical systems used in lunar exploration. Testing to identify potential moving mechanism problems has recently begun within the NASA Engineering and Safety Center Mechanical Systems Lunar Dust Assessment activity in coordination with the Exploration Technology and Development Program Dust Management Project, and these complimentary efforts will be described. Specific concerns about differences between simulant and lunar dust, and procedures for mechanical component testing with lunar simulant will be considered. In preparing for long term operations within a dusty lunar environment, the three fundamental approaches to keeping mechanical equipment functioning are dust avoidance, dust removal, and dust tolerance, with some combination of the three likely to be found in most engineering designs. Methods to exclude dust from contact with mechanical components would constitute mitigation by dust avoidance, so testing seals for dust exclusion efficacy as a function of particle size provides useful information for mechanism design. Dust of particle size less than a micron is not well documented for impact on lunar mechanical components. Therefore, creating a standardized lunar dust simulant in the particulate size range of ca. 0.1 to 1.0 micrometer is useful for testing effects on mechanical components such as bearings, gears, seals, bushings, and other moving mechanical assemblies. Approaching actual wear testing of mechanical components, it is beneficial to first establish relative wear rates caused by dust on commonly used mechanical component materials. The wear mode due to dust within mechanical components, such as abrasion caused by dust in grease(s), needs to be considered, as well as the effects of vacuum, lunar thermal cycle, and electrostatics on wear rate.

Jett, T.↗

Arc Flash Evaluation Poster

Arc flash evaluation is a key aspect of assessing the safety of an electrical system. An arc flash occurs when a short circuit results in large amounts of unexpected current in a conductor leading to a massive release of energy. By conducting an arc flash evaluation engineers are able to design safer systems and determine the level of protective equipment that a worker needs to wear in order to survive an arc flash incident.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Assessment of the impact of dipped guideways on urban rail transit systems: Ventilation and safety requirements

The ventilation and fire safety requirements for subway tunnels with dipped profiles between stations as compared to subway tunnels with level profiles were evaluated. This evaluation is based upon computer simulations of a train fire emergency condition. Each of the tunnel configurations evaluated was developed from characteristics that are representative of modern transit systems. The results of the study indicate that: (1) The level tunnel system required about 10% more station cooling than dipped tunnel systems in order to meet design requirements; and (2) The emergency ventilation requirements are greater with dipped tunnel systems than with level tunnel systems.

Source record↗

A Survey Protocol to Assess Meaningfulness and Usefulness of Automated Topic Finding in the NASA Aviation Safety Reporting System

Context: The NASA Aviation Safety Reporting System (ASRS) is a voluntary confidential aviation safety reporting system. The ASRS receives reports from pilots, air traffic controllers, flight attendants and other involved in aviation operations. The reports are de-identified and coded by ASRS expert safety analysts and a short descriptive synopsis is written to describe the safety issue. The de-identified reports are then disseminated to the aviation community in a number of ways including entry into an online database, Safety Alert Bulletins and For Your Information Notices, and the CALLBACK newsletter. Key to these publications are the timely processing (de-identification, coding and summarization) of new reports, which is currently done by ASRS expert safety analysts. Thus, we believe topic modelling could decrease effort in ASRS, if topics are comprehensible. Aim: We propose a methodology to evaluate whether automated topic finding using topic modelling provides meaningful and useful topics. Method: We extend the total error survey methodology to evaluate user topic comprehension of machine learning outputs. To accomplish this we performed a literature review to identify existing methods and define a construct for topic comprehension, utilizing existing ASRS synopsis writing practices to more precisely define meaningfulness and usefulness. Results: A survey protocol was created that addresses the limitations of other survey protocols found in the literature review, which we found lacking in rationale and clear protocol definition. Conclusion: The surveying of user understanding in machine learning outputs presents challenges due to the explosion of parameters to control for and the lack of systematic approach presented in the literature. More reproducible work and survey protocols are needed in the literature and our work is one step towards that direction.

topic finding↗

Creating Formal Characterizations of Routine Contingency Management in Commercial Aviation

The identification, modelling, and analysis of root causes of accidents and incidents dominate conventional safety management approaches. However, the effect of humans’ safety-producing behavior on the overall resilience of the system is often neglected. Additionally, emerging aviation markets are giving rise to concepts of operation, such as urban air mobility and optionally piloted air cargo operations, that are leading to a shift in locus of control between humans and automation. Without an understanding of the human contribution to safety, it is difficult to assess the effects of these novel role allocations on overall system safety. In this work, safety-producing behaviors are identified and abstracted into resilient performance strategies. Production rules that encapsulate these strategies are then generated and classified in the Soar cognitive architecture. The strategies are then applied to a remotely-operated air cargo example to demonstrate how safe learning is facilitated. The learned rules and strategies are then formally verified.

Safety Critical Systems↗

Lander Lighting Solution to Reduce Pilot & Autonomous Approach Errors

The south pole lighting environment will have harsh low inclination sunlight, making overhead judgement of surface features difficult. Autonomous solutions are great, however, the need for visual monitoring and independent go/no-go decisions remain. Our project proposes that lunar landing systems will be better served by including a powerful landing light system that improves visibility of surfaces from overhead by illuminating the ground at critical distances for the crew to make last minute decisions regarding an approach. The project utilized computer-based optical modeling software to predict requirements for a potential landing light system. The analysis based the lamp prediction from commercially available LED chip sets and lamp optics. The goal was to illustrate a method to raise the surface contrast of a landing site within an acceptable contrast threshold for most camera systems and human observers to recognize hazards that would not be noticed with low inclination sunlight alone. The Apollo lunar landings benefitted from overhead sun or dark conditions. The surface lighting at the Lunar South Pole is a harsh environment where surfaces are lit from a low inclination angle by the sun (from the side). This change in lighting condition precipitates a need for updated lunar landing systems that facilitate improved recognition of landing sites, and thereby increase pilot awareness of landing hazards. The reliance on LIDAR and other autonomous mechanisms alone is risky given the known usage of visual monitoring for operator concurrence on current spacecraft programs and present-day autonomous land-based vehicles. Visual monitoring via cameras or windows requires the surface contrast to be within 3 orders of magnitude for reasonable recognition of objects. Artificial overhead illumination, when sufficiently sized, provides a means to even out contrast problems created by low inclination sunlight, potentially reducing piloting errors. Current vehicle requirements do not specify this type of guidance for the purpose of increasing mission success. An optical ray-trace simulation model was developed in Zemax Optics Studio to predict the best combination of LED power, LED optics, lamp quantity, and lamp location to raise the surface contrast to within 2 orders of magnitude from 3 orders required to further increased visibility and reduce risk. The project considered the following design constraints: potential base diameter of lander, approach distance(s) for a go-no-go decision point (200 meter), solar inclination angle (2-7), lunar surface reflectance (10%), LED chip sets, LED focusing optics, LED power, lamp quantity, lamp locations, and illumination diameter of lunar surface landing zone. The results can be used to establish minimum design constraints for vehicle landing light systems. With a solar inclination angle ranging from 2-7 degrees, the horizontal illumination of the lunar surface is attenuated by about 10% when compared to overhead illumination from the Sun. This modifies the sun's maximum of 130,000 lux to 13,000 lux horizontal illuminance. The artificial lighting system was designed to provide an 18-meter-wide illumination zone, to create viewing clearances around a 6-meter-wide lander. The system provides an average illuminance of 300 lux, meeting the 2 orders of magnitude criteria. The solution utilized modern Chip On Board LEDs, that each utilized 17 watts, with focusing Total Internal Reflection (TIR) lenses. A lighting system of 300 LEDs was arrayed along the "bottom" of a “lander”. With 17 watts per LED, the system is estimated to require 5100 watts. This is a large amount of power, but it would only be needed during critical phases during the landing. LED lighting systems can be dimmed, and it is assumed that as the lander arrives closer to the landing site, the lighting system power can be adjusted as needed to produce the necessary surface illuminance. The designed reduction of contrast improves reliability of safety assessments using real time visible light camera systems and out the window viewing by the crew.

T A Clark↗

Impact of Thermal Scattering Law on Similarity Assessment in Light-Water or Polyethylene-Moderated Systems

A collaborative effort between Pacific Northwest National Laboratory (PNNL) and Oak Ridge National Laboratory (ORNL) is underway to provide a technical basis and methodology for the criticality safety community to use the sum of fractions (SoF) method for generating limits for mixtures of “selected actinide nuclides” included in the ANSI/ANS 8.15 standard. The PNNL scope in this project is to define a range of mixtures of 233 U, 235 U, and 239 Pu moderated with either light water or polyethylene and to examine the critical masses for these mixtures. The ORNL scope is primarily to provide validation support for these studies. More complete discussion of the project and its validation aspects will be presented at the upcoming International Conference on Nuclear Criticality Safety (ICNC) this Fall in Sendai, Japan. Clear differences in benchmark similarity to application systems as assessed by the integral parameter ck are noted in the validation studies performed as part of this project as a function of moderator. The c k value is a correlation coefficient that represents that amount of shared uncertainty in k eff due to cross sections between two systems. Individual nuclide-reaction contributions between the two systems can be simply summed to arrive at the total c k value. Specifically, the c k values for light-water–moderated solution experiments are higher for a water-moderated application than for a polyethylene-moderated application. This result is neither totally unexpected nor surprising, but the magnitude of the difference was difficult to anticipate. The TSUNAMI sequence, in the SCALE 6.2.4 code package developed by ORNL, was used to generate eigenvalues and reactivity effects with perturbation-theory based approach through sensitivity coefficients for all nuclides in the system with all reactions and energy groups. The TSUNAMI-Indices and Parameters (IP) sequence then uses the sensitivity data generated through TSUNAMI to generate relational parameters (i.e., c k ) to determine the degree of similarity between systems. One detail of the SCALE material and data implementation must be discussed at this point. Several thermal scattering laws (TSLs) are available for 1 H. SCALE uses a different nuclide ID number for each TSL; essentially, each version of 1 H is treated as a unique nuclide. For example, 1 H bound in water ( 1 H-H2O) is assigned the nuclide ID 1001, whereas 1 H bound in polyethylene (h-poly) is assigned the nuclide ID 9001001. The same cross section data are used for all reactions in 1 H, regardless of TSL, except for scattering below the TSL cutoff energy. TSUNAMI-IP treats different nuclide IDs as different nuclides; thus, no uncertainty is shared between 1 H-H2O and h-poly, despite much of the same data, including covariance data, being used for both nuclides. This presents a question: how much of the difference in assessed similarity between water- and polyethylene-moderated systems is due to the moderators, and how much is caused by the treatment of 1 H-H2O and h poly with cross section and covariance data. The extended edits generated by TSUANMI-IP allow for an investigation of this issue specifically, as well as a demonstration of the general techniques available within TSUNAMI to understand the results of the similarity assessment. This paper presents and analyzes the similarity assessment of both water- and polyethylene-moderated systems for a single benchmark: PST-002-001.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Establishing the Assurance Efficacy of Automated Risk Mitigation Strategies

Verification and validation of increasingly autonomous aviation systems is a major challenge. Traditional techniques for the assurance of high-confidence, safety-critical systems are not equipped to handle the complexity, uncertainty, and lack of predictability inherent in non-deterministic systems. Techniques such as run time monitoring, formal methods, and testing and simulation have been applied to some effect, but it is difficult to properly assess the success of such measures. The authors propose the concept of Assurance Efficacy to address this gap. Assurance Efficacy is seen as a parameter, criteria, or perspective by which to evaluate, identify and explore safety risk mitigation strategies and operational assurance architectures. Validation of the utility of this concept through flight testing is a first step in determining its potential role in assessing the overall safety of complex, increasingly autonomous systems that cannot be fully assured in the design phase.

system safety↗