Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reliability model generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Integrating Machine Learning into a Crowdsourced Model for Earthquake-Induced Damage Assessment

On January 12th, 2010, a catastrophic 7.0M earthquake devastated the country of Haiti. In the aftermath of an earthquake, it is important to rapidly assess damaged areas in order to mobilize the appropriate resources. The Haiti damage assessment effort introduced a promising model that uses crowdsourcing to map damaged areas in freely available remotely-sensed data. This paper proposes the application of machine learning methods to improve this model. Specifically, we apply work on learning from multiple, imperfect experts to the assessment of volunteer reliability, and propose the use of image segmentation to automate the detection of damaged areas. We wrap both tasks in an active learning framework in order to shift volunteer effort from mapping a full catalog of images to the generation of high-quality training data. We hypothesize that the integration of machine learning into this model improves its reliability, maintains the speed of damage assessment, and allows the model to scale to higher data volumes.

crowdsourcing↗

Stochastic Microgrid Scheduling With Chance‐Constrained Resilience Consideration

Traditionally, it is assumed that microgrids transition seamlessly from grid‐connected operation to islanded mode in the event of sudden main grid outages. In reality, the islanding process, especially unintentional islanding, is rarely seamless. Instead, it is subject to voltage and frequency fluctuations caused by the instantaneous disconnection of the point of common coupling (PCC) switch, variations in loads and renewable generation output and even the protection tripping of distributed energy resources (DERs). To mitigate these fluctuations and facilitate a smooth islanding process, we propose a stochastic microgrid scheduling model that incorporates chance‐constrained resilience measures. Specifically, the resilience measure is defined as the probability of successful islanding (PSI), that is, the probability that a microgrid can mitigate the generation‐demand imbalance caused by the disconnection of the PCC switch, variations in load and renewable generation and DER tripping. This measure is modelled using chance constraints. Unlike existing reliability and resilience indices, which typically neglect the possibility of microgrid/DER failure under extreme events and assume their survival while primarily focussing on reducing impact duration or magnitude, the proposed PSI‐based framework explicitly addresses microgrid and DER survival during the islanding transition. The formulated nonlinear chance constraints are approximated using a multiinterval approach and equivalently represented as a mixed‐integer linear programming (MILP) formulation. Case study results validate the proposed method, showing that the PSI estimation error is reduced to less than 8%, compared to approximately 28% with existing methods. Various sensitivity analyses on the DER tripping rate and PSI settings were performed to validate the robustness of the proposed method. In particular, the necessity of accounting for DER tripping in the PSI calculation was demonstrated.

chance constrained optimization↗

Wholesale Electricity Market Design to Support Resource Adequacy

Wholesale electricity markets are intended to incentivize system generation investments and operations outcomes that meet evolving system needs. In this work, we evaluate the effectiveness of wholesale market structures, rules and policies in achieving system resource adequacy (RA) and clean energy targets in the presence of self-interested generation investors using the Electricity Markets and Investment Suite Agent-based Simulation (EMIS-AS) model. Results highlight that both capacity markets and operating reserve demand curves (ORDCs) can help achieve a reliable system but with different RA compliance timelines and distribution of generation technologies. Structures with capacity markets tend to favor more capital-intensive peaking technologies while reducing wind and solar build-outs due to suppressed energy and clean energy market prices, particularly in the absence of strong clean energy targets. Conversely, ORDCs improve the commitment of available generation units, but this comes at the expense of higher system costs and renewable generation curtailment. We also find that well-calibrated static capacity demand curves can yield similar reliability and total cost compared to capacity market demand curves informed dynamically by resource adequacy while also yielding stable annual capacity prices. Different approaches to formulating ORDC curves can also yield key trade-offs, namely that a more efficient treatment of storage chronology results in lower ORDC curves and prices, yielding less investment and cost but at the expense of reliability. Finally, the effectiveness of wholesale electricity markets in practically achieving very high clean energy generation targets highly depends on the cost-competitiveness of clean energy technologies that can support critical balancing needs across multiple timescales.

agent based modeling↗

SmileyLlama: modifying large language models for directed chemical space exploration

Here we show that large language models (LLMs) can be transformed via supervised fine-tuning of engineered prompts into SmileyLlama for exploring the chemical space of drug molecules. We benchmark SmileyLlama against pretrained LLMs and chemical language models trained from scratch for generating valid and novel drug-like molecules, and use direct preference optimization to both improve SmileyLlama’s adherence to a prompt and as part of the iMiner reinforcement learning framework to predict molecules with optimized three-dimensional conformations and high binding affinity to drug targets. By training an LLM to speak directly as a chemical language model, while retaining most of its natural language capabilities, we show that SmileyLlama can reliably generate molecules with user-specified properties rather than acting only as a chatbot with knowledge of chemistry or as a virtual assistant. While SmileyLlama is geared toward drug discovery, the supervised fine-tuning/direct preference optimization/LLM framework can be extended to other chemical, biological and materials applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

AI-Driven Frameworks for Characterizing Urban Energy Systems

We develop AI-driven frameworks to characterize urban energy systems with the goal of transforming planning by reducing the labor of model generation, scaling scenario exploration, and improving accuracy for localized analysis. The approach integrates top-down and bottom-up data to train different AI models that predict missing information and generate inputs and targeted scenarios for district-scale models. The result is a scalable framework that provides actionable insights for reliable and efficient planning.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Development and Validation of a Slosh-Based Ullage Collapse Model

Ullage collapse modeling is an essential tool for the success of spacecraft powered by cryogenic propellants. The degree of ullage collapse can have a major impact on the design of cryogenic propellant tanks as well as the mission’s concept of operations. Additional commodities (e.g., helium gas for pressure control) and their quantities are dependent on the amount of heat transfer and phase change of propellants expected during flight. Currently, high-fidelity computational fluid dynamics (CFD) with heat transfer and phase change is the most accurate method for predicting ullage collapse. CFD simulations of this kind, however, can become very costly for problems requiring large domains, long simulation times, or significant liquid motion. Consequently, there is a need for a reduced order model to provide fast responses which can be used in engineering design decisions. The proposed numerical model is a nodal approach, augmented by outputs from CFD analyses that are generated rapidly and reliably. These outputs include transient values for liquid-vapor interface area, interface velocity, and liquid position using a volume of fluid (VoF) method. There are several benefits of combining a nodal approach with slosh predictions from CFD simulations: leveraging of the Loci/STREAM-VoF solver that has been validated in high-g and low-g environments, rapid modeling of VoF with isothermal propellant simplifications and relatively coarse meshes, and improved model predictions from the nodal tool. The nodal approach, informed by the slosh predictions from CFD, assumes uniform conditions in the liquid and gas domains. Modifications to account for temperature stratification in the liquid and gas may be implemented as a future improvement. Thermodynamic changes within the tank are solved at user-defined timesteps. First, impacts due to mass entering or leaving the control volume are captured. Second, heat transfer impacts are accounted for by tracking the volume of the gas which has been contacted by liquid in that timestep and rebalancing the internal energy. Finally, phase change is approximated using the area and velocity of the interface. The tank conditions are re-computed by conserving mass and energy. Calibration of the model to several test flights and experiments are required to baseline the predictive power and uncertainty. The final product will enable designers and engineers to create quick-turnaround predictions for ullage collapse and inform design feasibility.

Computational Fluid Dynamics↗

Measurement of $\nu_\mu$ CC Interactions With Two-Proton Final State in MINERvA

This dissertation presents a measurement of charged–current (CC) muon–neutrino interactions with exactly two protons and no pions in the final state (CC~$2p\,0\pi$), using data collected by the MINERvA detector in the NuMI medium–energy beam at Fermilab. Such two–proton topologies are a sensitive probe of nuclear dynamics in the few–GeV regime, including multi–nucleon correlations (npnh, notably $2p2h$) and intranuclear final–state interactions (FSI) such as pion absorption and nucleon rescattering. A precise experimental characterization of these processes is essential both for neutrino–interaction theory and for reducing systematic uncertainties in oscillation experiments that rely on accurate modeling of neutrino–nucleus interactions. Events are selected by requiring a $\nu_\mu$ CC interaction with a reconstructed $\mu^-$ and two proton tracks originating from a common vertex in MINERvA’s finely segmented scintillator tracker, with no reconstructed mesons. Muon charge and momentum are constrained by matching to the MINOS Near Detector, while proton identification exploits energy–loss profiles and stopping–proton features. Backgrounds from pion–producing channels that enter the signal region through FSI or reconstruction effects are constrained with data–driven sidebands (Michel–electron and isolated–cluster “blob” samples) and tuned via a simultaneous fit across signal and sideband regions. To correct detector resolution and acceptance effects, the analysis employs iterative Bayesian unfolding with extensive validation: statistical pseudo–experiments, and robustness checks against generator systematic “universes” and additional strong shape warps. Single–differential cross sections are reported for three observables tailored to the two–proton final state: the opening–angle cosine $\cos\!\left(\theta_{pp}\right)$, the leading–proton momentum, and the subleading–proton momentum. Systematic uncertainties include contributions from neutrino flux, interaction modeling (e.g., npnh and resonance parameters, pion FSI), and detector response (calibration, reconstruction efficiencies). The resulting distributions provide targeted constraints on the interplay of multi–nucleon dynamics and FSI that shape CC~$2p\,0\pi$ final states on hydrocarbon. Comparisons to modern GENIE–based simulations highlight kinematic regions where model components require refinement. These measurements thus inform generator tuning and improve the reliability of neutrino–energy reconstruction strategies for current and future long–baseline oscillation programs.

Syrotenko, Vladyslav S. [Tufts U.]↗

The fragmentation of 510 MeV/nucleon iron-56 in polyethylene. II. Comparisons between data and a model

The results of a Monte Carlo model for calculating fragment fluences and LET spectra are compared to data taken with 600 MeV/nucleon iron ions incident on an accelerator beamline configured for irradiation of biological samples, with no target and with 2, 5 and 8 cm of polyethylene. The model uses a multi-generation nuclear fragmentation code, coupled with a formulation of ionization energy loss based on the Bethe-Bloch equation. In the region where the data are reliable and the experimental acceptance is well understood, many of the features of the experimental spectra are well replicated by the model. To obtain good agreement with the experimental data, the model must allow for at least two generations of fragment production in the target.

NASA Discipline Number 99-99↗

An Integrated Framework for Risk Assessment of Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants: Methodology Advancement and Application

This report documents activities performed by Idaho National Laboratory (INL) during fiscal year (FY) 2024 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, Digital Instrumentation and Control (DI&C) Risk Assessment project. The goal of the RISA Pathway is to optimize safety margins and minimize uncertainties to achieve economic efficiencies while maintaining high levels of safety. This is accomplished by providing scientific basis to better represent safety margins and factors that contribute to cost and safety, and by developing new technologies that reduce operating costs. The research efforts for FY 2024 encompass methodology refinement and exploration. The efforts include: (1) The implementation of a natural language processing tool to expedite key aspects of the reliability analysis methods developed by INL; (2) advances to support intersystem CCF analysis by providing guidance for and identification of coupling mechanisms that may contribute to CCF; (3) the investigation of how generative artificial intelligence tools can aid in hazard analysis and diversity and defense in depth (i.e., D3) assessments; (4) Industry collaboration, allowing the demonstration of and INL's risk assessment tools to support risk assessment of DI&C systems at early and late stages of development; (4) a roadmap for the development of a software for each of INL's risk assessment tools; (5) The development of a theory and methodology manual for a risk quantification methodology; (6) the development of a reliability analysis for machine learning (ML)-integrated control systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Results of software error-data experiments

In order to evaluate existing software reliability models and proposed modeling approaches, a search was conducted for data on the software failure process. This search revealed that the data necessary for this evaluation were not available. As a result, a research effort was initiated by NASA to generate data on which to base the development of credible methods for assessing the reliability of software targeted for flight-crucial applications. Two sets of software error-data experiments were conducted by different research groups. The results of the experiments were consistent: errors caused by different faults in a program occurred at widely varying rates; program failure rates exhibited a log-linear trend with respect to the number of faults corrected; some faults were found to interact in either concealing or revealing ways; and contiguous regions of the input space which cause a program to generate errors, called error crystals, were found and characterized for some faults. Collectively, these experiments have produced information on software failure which must be accounted for in software reliability modeling approaches.

Finelli, George B.↗

Learning reliable manipulation strategies without initial physical models

A description is given of a robot, possessing limited sensory and effectory capabilities but no initial model of the effects of its actions on the world, that acquires such a model through exploration, practice, and observation. By acquiring an increasingly correct model of its actions, it generates increasingly successful plans to achieve its goals. In an apparently nondeterministic world, achieving reliability requires the identification of reliable actions and a preference for using such actions. Furthermore, by selecting its training actions carefully, the robot can significantly improve its learning rate.

Christiansen, Alan D.↗

Exploring the Limits of the Data-Model-Theory Synergy: “Hot” MW Transitions for Rovibrational IR Studies

In order to further improve the accuracy of rovibrational IR line lists generated from the “Best Theory +Reliable High-resolution Experiment” (BTRHE) strategy from 0.01-0.05 cm-1, or 300-1500 MHz, to ~10 MHz, we explore the current limits of the Data-Model-Theory synergy by examining the accuracy and consistency of existing data, then propose that “hot” bands in microwave (MW) spectra is the solution we need for future enhancements. The Ames SO2 J=0-20 rovibrational energy levels computed on the semi-empirically refined Ames-2 potential energy surface (PES) are fit to the Effective Hamiltonian (EH) model regularly used in the experimental infrared (IR) analysis for SO2 isotopologues. In the fitted EH(Ames) model, the rotational constants A/B/C and all 5 quartic centrifugal distortion constants display clear, systematic, and consistent patterns along the vibrational state energy or quanta. Such consistent patterns may facilitate the vibrational assignments for MW hot bands and extract more information from high temperature MW spectra. Some EH(Expt) analyses were carried out with the lowest order Coriolis Coupling term, C1. Their constants should not be directly compared with other EH(Expt) and EH(Ames) results. After excluding them, our  = EH(Ames)- EH(Expt) analyses for 5 isotopologues (626, 636, 646, 628 and 828) indicates some loss of accuracy and consistency starting from vibrational states as low as 22 or 1000 cm-1. Some EH parameters, e.g. K, may have relative deviations as large as 50-100% and totally lose any recognizable patterns. This simply means that current EH(Expt) models do not have the system-wide consistency we need to further refine the EH(Ames) and Ames rovibrational IR line lists. A large part of such defects are probably inherited from the limited precision of experimental line positions, i.e. 1E-3 ~ 1E-4 cm-1, or 3-30 MHz. This is confirmed in a series of truncation tests using the Ames data. Although the EH(Ames) consistency may help identify unreliable rovibrational EH(Expt) parameters, and make reliable predictions for minor isotopologues and unobserved vibrational bands, we believe only the highly accurate “hot” MW transitions can provide real enhancements for EH(Expt) accuracy and consistency. “Hot” MW spectra should play a more significant role in the future synergy of Data, Model, and Theory in the field of rovibrational IR studies.

Xinchuan Huang↗

Semi-Markov adjunction to the Computer-Aided Markov Evaluator (CAME)

The rule-based Computer-Aided Markov Evaluator (CAME) program was expanded in its ability to incorporate the effect of fault-handling processes into the construction of a reliability model. The fault-handling processes are modeled as semi-Markov events and CAME constructs and appropriate semi-Markov model. To solve the model, the program outputs it in a form which can be directly solved with the Semi-Markov Unreliability Range Evaluator (SURE) program. As a means of evaluating the alterations made to the CAME program, the program is used to model the reliability of portions of the Integrated Airframe/Propulsion Control System Architecture (IAPSA 2) reference configuration. The reliability predictions are compared with a previous analysis. The results bear out the feasibility of utilizing CAME to generate appropriate semi-Markov models to model fault-handling processes.

Rosch, Gene↗

Lessons Learned from OSIRIS-Rex Autonomous Navigation Using Natural Feature Tracking

The Origins, Spectral Interpretation, Resource Identification, Security-Regolith Explorer (Osiris-REx) spacecraft is scheduled to launch in September, 2016 to embark on an asteroid sample return mission. It is expected to rendezvous with the asteroid, Bennu, navigate to the surface, collect a sample (July 20), and return the sample to Earth (September 23). The original mission design called for using one of two Flash Lidar units to provide autonomous navigation to the surface. Following Preliminary design and initial development of the Lidars, reliability issues with the hardware and test program prompted the project to begin development of an alternative navigation technique to be used as a backup to the Lidar. At the critical design review, Natural Feature Tracking (NFT) was added to the mission. NFT is an onboard optical navigation system that compares observed images to a set of asteroid terrain models which are rendered in real-time from a catalog stored in memory on the flight computer. Onboard knowledge of the spacecraft state is then updated by a Kalman filter using the measured residuals between the rendered reference images and the actual observed images. The asteroid terrain models used by NFT are built from a shape model generated from observations collected during earlier phases of the mission and include both terrain shape and albedo information about the asteroid surface. As a result, the success of NFT is highly dependent on selecting a set of topographic features that can be both identified during descent as well as reliably rendered using the shape model data available. During development, the OSIRIS-REx team faced significant challenges in developing a process conducive to robust operation. This was especially true for terrain models to be used as the spacecraft gets close to the asteroid and higher fidelity models are required for reliable image correlation. This paper will present some of the challenges and lessons learned from the development of the NFT system which includes not just the flight hardware and software but the development of the terrain models used to generate the onboard rendered images.

Navigation↗

Strategies for Quantifying Human Space Flight Performance in the Crew Health and Performance System

The Crew Health and Performance-Probabilistic Risk Assessment (CHP-PRA) team at NASA Glenn Research Center is planning a customized approach to quantify human spaceflight performance changes with respect to changes to the CHP system functions and capabilities. Using the Directed Acyclic Graphs (DAG) initiated by NASA’s Human Systems Risk Board (HSRB) [1], the team is surveying potential candidate models and novel strategies that generate metrics suitable for supporting decision making related to how the CHP system may influence human system performance risk. One such investigation includes classic Human Reliability Analysis (HRA) models. Traditionally, HRA methods estimate the occurrence of human errors and their impact on the success of an activity when designing and operating a system. While humans perceive, interpret, decide on, and carry out a course of action, the factors affecting performance and error likelihood are commonly referred to as performance shaping factors (PSFs). Originally developed to alleviate safety concerns related to nuclear power plant operations, HRA methods such as THERP [2] and CREAM [3] dismantle an activity into tasks, requiring elemental steps to be executed, and assess their failure due to predefined PSFs. In this study, we compare generic HRA methods and those that incorporate some human spaceflight aspects, such as sleep conditions (SCREAM [4]), with respect to how they may be adopted to capture performance with an intention to mitigate detrimental outcomes elucidated by the HSRB DAGs. We suggest strategies to quantify astronaut performance specific to spaceflight activities and illustrate how such concepts may help in optimizing the CHP system capabilities with respect to Artemis missions.

dag↗

Fitness for Service Assessment of a Corroded Heat Exchanger

Fermilab s Main Injector Accelerator has used shell & tube heat exchangers to cool various beamline components since its construction in the late 1990s. Many of the heat exchangers still around today are original to the machine. Untreated pond water has been used to exchange heat with the Low Conductivity Water. Throughout the lifetime of Fermilab s heat exchangers, they have undergone significant material degradation in the carbon steel end channels due to corrosion. Wall thickness measurements (per API 510) of each heat exchanger were used to generate a 3D model of the corroded surfaces. In order to continue their safe and reliable operation, ASME FFS-1/API 579 (Fitness-For-Service) was implemented to address their integrity. The assessments consisted of finite element analysis techniques outlined in ASME Section VIII Div. 2 (design by analysis methods for pressure vessels), in accordance with the requirements of ASME FFS-1 Part 4: General Metal Loss, Part 5: Local Metal Loss, and Part 9: Crack Like Flaws. The assessments concluded that each heat exchanger is coined Fit For Service . The Fitness-For-Service standard offers a unique opportunity to facilities and institutions within the DOE National Lab complex to properly and safely assess the integrity of aging equipment necessary to conduct science and research. This poster demonstrates the assessment process and techniques used to determine the heat exchangers are fit for service.

Humenik, Alex [Fermilab]↗

NASTRAN analysis of Tokamak vacuum vessel using interactive graphics

Isoparametric quadrilateral and triangular elements were used to represent the vacuum vessel shell structure. For toroidally symmetric loadings, MPCs were employed across model boundaries and rigid format 24 was invoked. Nonsymmetric loadings required the use of the cyclic symmetry analysis available with rigid format 49. NASTRAN served as an important analysis tool in the Tokamak design effort by providing a reliable means for assessing structural integrity. Interactive graphics were employed in the finite element model generation and in the post-processing of results. It was felt that model generation and checkout with interactive graphics reduced the modelling effort and debugging man-hours significantly.

Miller, A.↗

Failure Analysis and Products in a Model-Based Environment

The work presented in this paper describes an approach, including a methodology and tools, which allows system engineers to capture failure-related information in a model and generate automatically key failure analysis products: the Failure Modes, Effects and Criticality Analysis (FMECA) and the Fault Tree Analysis (FTA). The work has been developed by Tietronix Software, Inc. and the NASA’s Jet Propulsion Laboratory (JPL), and the resulting auto-generated artifacts shown in this paper demonstrate the ability to obtain powerful reliability and fault management products in a model-based environment.

Castet, Jean-Francois↗