Search NASA⌕ Search

SEARCH · Search NASA

Results for “Assessment Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events

Accurate forecasting of the arrival time and subsequent geomagnetic impacts of coronal mass ejections (CMEs) at Earth is an important objective for space weather forecasting agencies. Recently, the CME Arrival and Impact working team has made significant progress toward defining communit yagreed metrics and validation methods to assess the current state of CME modeling capabilities. This will allow the community to quantify our current capabilities and track progress in models over time. First, it is crucial that the community focuses on the collection of the necessary metadata for transparency and reproducibility of results. Concerning CME arrival and impact we have identified six different metadata types: 3D CME measurement, model description, model input, CME (non)arrival observation, model output data, and metrics and validation methods. Second, the working team has also identified a validation time period, where all events within the following two periods will be considered: 1 January 2011 to 31 December 2012 and January 2015 to 31 December 2015. Those two periods amount to a total of about 100 hit events at Earth and a large amount of misses. Considering a time period will remove any bias in selecting events and the event set will represent a sample set that will not be biased by user selection. Lastly, we have defined the basic metrics and skill scores that the CME Arrival and Impact working team will focus on.

Verbeke, C.↗

Development and Use of Engineering Standards for Computational Fluid Dynamics for Complex Aerospace Systems

Computational fluid dynamics (CFD) and other advanced modeling and simulation (M&S) methods are increasingly relied on for predictive performance, reliability and safety of engineering systems. Analysts, designers, decision makers, and project managers, who must depend on simulation, need practical techniques and methods for assessing simulation credibility. The AIAA Guide for Verification and Validation of Computational Fluid Dynamics Simulations (AIAA G-077-1998 (2002)), originally published in 1998, was the first engineering standards document available to the engineering community for verification and validation (V&V) of simulations. Much progress has been made in these areas since 1998. The AIAA Committee on Standards for CFD is currently updating this Guide to incorporate in it the important developments that have taken place in V&V concepts, methods, and practices, particularly with regard to the broader context of predictive capability and uncertainty quantification (UQ) methods and approaches. This paper will provide an overview of the changes and extensions currently underway to update the AIAA Guide. Specifically, a framework for predictive capability will be described for incorporating a wide range of error and uncertainty sources identified during the modeling, verification, and validation processes, with the goal of estimating the total prediction uncertainty of the simulation. The Guide's goal is to provide a foundation for understanding and addressing major issues and concepts in predictive CFD. However, this Guide will not recommend specific approaches in these areas as the field is rapidly evolving. It is hoped that the guidelines provided in this paper, and explained in more detail in the Guide, will aid in the research, development, and use of CFD in engineering decision-making.

Lee, Hyung B.↗

Development of algorithms for augmenting and replacing conventional process control using reinforcement learning

Here, this work seeks to allow for the online operation and training of model-free reinforcement learning (RL) agents but limit the risk to system equipment and personnel. The parallel implementation of RL alongside more conventional process control (CPC) allows for the RL algorithm to learn from CPC. The past performance of both methods are assessed on a continuous basis allowing for a transition from CPC to RL and, if needed, transitioning back to CPC from RL. This allows for the RL algorithm to slowly and safely assume control of the process without significant degradation in control performance. It is shown that the RL can derive a near optimal policy even when coupled with a suboptimal CPC. It is also demonstrated that the coupled RL-CPC algorithm learns at a faster rate than traditional RL methods of exploration while the algorithm’s performance does not deteriorate below CPC, even when exposed to an unknown operating condition.

30 DIRECT ENERGY CONVERSION↗

Vortex lattice prediction of subsonic aerodynamics of hypersonic vehicle concepts

The vortex lattice method introduced by Lamar and Gloss (1975) was applied to the prediction of subsonic aerodynamic characteristics of hypersonic body-wing configurations. The reliability of the method was assessed through comparison of the calculated and observed aerodynamic performances of two National Hypersonic Flight Research Facility craft at Mach 0.2. The investigation indicated that a vortex lattice model involving 120 or more panel elements can give good results for the lift and induced drag coefficients of the craft, as well as for the pitching moment at angles of attack below 10 to 15 deg. Automated processes for calculating the local slopes of mean-camber surfaces may also render the method suitable for use in preliminary design phases.

Pittman, J. L.↗

Determination of left ventricular volume, ejection fraction, and myocardial mass by real-time three-dimensional echocardiography

Reconstructed three-dimensional (3-D) echocardiography is an accurate and reproducible method of assessing left ventricular (LV) functions. However, it has limitations for clinical study due to the requirement of complex computer and echocardiographic analysis systems, electrocardiographic/respiratory gating, and prolonged imaging times. Real-time 3-D echocardiography has a major advantage of conveniently visualizing the entire cardiac anatomy in three dimensions and of potentially accurately quantifying LV volumes, ejection fractions, and myocardial mass in patients even in the presence of an LV aneurysm. Although the image quality of the current real-time 3-D echocardiographic methods is not optimal, its widespread clinical application is possible because of the convenient and fast image acquisition. We review real-time 3-D echocardiographic image acquisition and quantitative analysis for the evaluation of LV function and LV mass.

NASA Discipline Cardiopulmonary↗

Towards a Global Water Scarcity Risk Assessment Framework: Incorporation of Probability Distributions and Hydro-Climatic Variability

Changing hydro-climatic and socioeconomic conditions increasingly put pressure on fresh water resources and are expected to aggravate water scarcity conditions towards the future. Despite numerous calls for risk-based water scarcity assessments, a global-scale framework that includes UNISDR's definition of risk does not yet exist. This study provides a first step towards such a risk based assessment, applying a Gamma distribution to estimate water scarcity conditions at the global scale under historic and future conditions, using multiple climate change and population growth scenarios. Our study highlights that water scarcity risk, expressed in terms of expected annual exposed population, increases given all future scenarios, up to greater than 56.2% of the global population in 2080. Looking at the drivers of risk, we find that population growth outweigh the impacts of climate change at global and regional scales. Using a risk-based method to assess water scarcity, we show the results to be less sensitive than traditional water scarcity assessments to the use of fixed threshold to represent different levels of water scarcity. This becomes especially important when moving from global to local scales, whereby deviations increase up to 50% of estimated risk levels.

Populations↗

The Surface Albedo of Sea Ice in CMIP6 and the Implications for the Surface Albedo Feedback

The Arctic has experienced rapid sea ice loss and a substantial decline in surface albedo, significantly impacting its radiation budget. Climate models from the Coupled Model Intercomparison Project (CMIP6) reproduce these changes. However, inconsistencies remain among models regarding the magnitude, spatial distribution, and seasonal patterns of Arctic surface albedo evolution. This study investigates these discrepancies by comparing model outputs with observation from the Clouds and the Earth's Radiant Energy System (CERES). We develop a decomposition method to assess the contributions of sea ice albedo, sea ice concentration, and sea ice extent to Arctic surface albedo. Over land, differences in snow cover account for the substantial inter-model spread in surface albedo, while over the ocean, sea ice albedo, concentration, and extent all contribute. Comparisons between CMIP6 and the Atmospheric Model Intercomparison Project (AMIP) simulations, which use identically prescribed sea ice concentrations, reveals considerable inter-model spread in Arctic Ocean surface albedo due to differences in sea ice albedo. Applying the decomposition method to projections shows that models predicting larger decreases in sea ice concentration and extent, especially in the Central Arctic, exhibit lower surface albedo and stronger sea ice albedo feedback. Beyond 2050, Arctic Ocean surface albedo decline is mainly influenced by sea ice extent indicating that the retreat of the ice edge is the most important process to constrain the surface albedo feedback. This study provides insights into factors contributing to the spread and changes in Arctic surface albedo and the associated sea ice albedo feedback.

Patrick C Taylor↗

Sonic boom acceptability studies

The determination of the magnitude of sonic boom exposure which would be acceptable to the general population requires, as a starting point, a method to assess and compare individual sonic booms. There is no consensus within the scientific and regulatory communities regarding an appropriate sonic boom assessment metric. Loudness, being a fundamental and well-understood attribute of human hearing was chosen as a means of comparing sonic booms of differing shapes and amplitudes. The figure illustrates the basic steps which yield a calculated value of loudness. Based upon the aircraft configuration and its operating conditions, the sonic boom pressure signature which reaches the ground is calculated. This pressure-time history is transformed to the frequency domain and converted into a one-third octave band spectrum. The essence of the loudness method is to account for the frequency response and integration characteristics of the auditory system. The result of the calculation procedure is a numerical description (perceived level, dB) which represents the loudness of the sonic boom waveform.

Shepherd, Kevin P.↗

Elements of Nondestructive Examination for the Visual Inspection of Composite Structures

Visual inspection (VI) of composite structures provides an effective, wide field survey to ensure design and material compliance is maintained for the entire service life of the manufactured component. Visual inspection is one of the most commonly used nondestructive inspection methods to assess surface defects on composites. By applying visual inspection elements, mechanical damage that could affect component residual strength can be identified and a disposition reached before a potentially catastrophic event occurs. This technique is non-contact and applied at all stages of the composite structure s processing and use. Additionally, VI is required to be performed in all service environments until decommission. By following Level I and Level II damage accept/reject criteria set forth in this document, the material review (MR) process can be initiated. This nondestructive evaluation (NDE) method should be complemented with additional NDE methods to best understand the nature of the observed indications. When VI identification is followed by interrogation using effective complimentary NDE methods, the final Material Review Board (MRB) disposition of the component can be effectively achieved. Although elements of the visual inspection method are discussed and expressly required by the various range standards (KNPR 8715.3 and AFSPCMAN 91-710), emphasis should be placed on supporting the interpretation of recorded visual observations. Sound engineering practices and procedures should be applied with the interpretation of nondestructive testing (NDT) results when the residual strength data specific to a vessel design is incomplete or absent.

Tommy B. Yoder↗

Validating a Dynamic PWR Safety and Security Model?

Nuclear power plants (NPPs) are assessed for safety and security using separate models that cannot capture how an attacker's decisions and a plant's response unfold together in real time, leaving regulators and operators without a complete picture of true plant vulnerability. Traditional probabilistic risk assessment (PRA) methods treat adversarial events as fixed initiators with predetermined outcomes, and are structurally incapable of representing the time-dependent interplay between physical security events, safety system response, and operator mitigative actions. At Idaho National Laboratory (INL), I contributed to the development and validation of Modeling and Analysis for Safety and Security using the Dynamic EMRALD Framework (MASS-DEF). Where static PRA relies on event-tree logic that cannot evolve mid-scenario, MASS-DEF couples a time-dependent dynamic PRA tool EMRALD (Event Modeling Risk Assessment using Linked Diagrams) with attack simulation software, allowing attacker behavior, plant system states, and operator actions to interact across time. My work focused on validating a general Pressurized Water Reactor (PWR) model. I traced model logic against PWR plant to identified errors in logic and confirm accuracy. I then built and tested attack scenarios against a general PWR model to verify that the model produced expected outcomes across all logical pathways. I also contributed a section to a related technical paper applying the same EMRALD platform to radiation dose modeling. Results show that MASS-DEF can quantitatively demonstrate that many plants exceed their regulatory security thresholds. This demonstrated margin provides a technically defensible basis for reducing the number of guards without compromising regulatory compliance. Physical security costs represent roughly 10% of annual operating budgets, making such reductions directly meaningful to INL's mission of sustaining existing commercial NPPs. This internship strengthened my understanding of nuclear systems, probabilistic modeling, and technical writing, and has solidified my pursuit of a career at a national laboratory.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗

UNDERSTANDING THE SEMI-PROBABILISTIC APPROACHES IN STRUCTURAL RELIABILITY USED TO SET DESIGN RELIABILITY TARGETS FOR GRAPHITE COMPONENTS USING ASME BPVC METHODS

Graphite is a quasi-brittle material, resulting in random variability in tensile strength distributions. To account for the random variability in strength, HHA-3000 of the ASME BPVC provides two semi-probabilistic methods for qualifying nuclear graphite components in the design stage, the simplified and full assessments. The full and simplified assessments apply statistical methods to engineering-based design problems. This is often referred to as reliability-based design. Reliability-based design (RBD) is a method to develop reliable designs by accounting for uncertainties and result in small chances of failure when also considering safety factors. RBDs provide reliability targets using semi-probabilistic approaches. RBD is implemented in ASME BPVC HHA-3000 for nuclear graphite components, but is not specific to that application. There has been much confusion around the methods implemented in ASME BPVC HHA-3000 for qualifying nuclear graphite components. To address the confusion, this paper takes a hierarchical approach. First, the general RBD framework is presented. Then, the semi-probabilistic methods and the underlying assumptions implemented in the assessments are presented. The semi-probabilistic methods are separated from the engineering modifications that have been made to the assessments. After building the framework and underlying assumptions, the specific methods in the full and simplified assessments are explained in three steps: inputs, methods, outputs. The methods are applied to an H-451 reflector block. Tensile strength properties for other graphite grades are provided.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Low-Rank QTT-based Finite Element Method for Elasticity Problems

We present an efficient and robust numerical algorithm for solving the linear elasticity problem that combines the Quantized Tensor Train format and a domain partitioning strategy. This approach makes it possible to solve the linear elasticity problem on a computational domain that is more general than a square. By integrating Z-ordering and subdomain concatenation, our method substantially decreases memory usage and achieves a notable reduction in rank compared to established Finite Element implementations like the FEniCS platform. This efficiency is maintained while still guaranteeing exponential convergence with respect to the number of degrees of freedom. This performance gain, however, requires a fundamental rethinking of how core finite element operations are implemented. This includes changes to mesh discretization, node and degree of freedom ordering, stiffness matrix and internal nodal force assembly, and the execution of algebraic matrix-vector operations. In this work, we discuss all these aspects in detail and assess the method’s performance in the numerical approximation of three representative test cases.

97 MATHEMATICS AND COMPUTING↗

Practical Application of PRA as an Integrated Design Tool for Space Systems

This paper presents the application of the first comprehensive Probabilistic Risk Assessment (PRA) during the design phase of a joint NASA/NOAA weather satellite program, Geostationary Operational Environmental Satellite Series R (GOES-R). GOES-R is the next generation weather satellite primarily to help understand the weather and help save human lives. PRA has been used at NASA for Human Space Flight for many years. PRA was initially adopted and implemented in the operational phase of manned space flight programs and more recently for the next generation human space systems. Since its first use at NASA, PRA has become recognized throughout the Agency as a method of assessing complex mission risks as part of an overall approach to assuring safety and mission success throughout project lifecycles. PRA is now included as a requirement during the design phase of both NASA next generation manned space vehicles as well as for high priority robotic missions. The influence of PRA on GOES-R design and operation concepts are discussed in detail. The GOES-R PRA is unique at NASA for its early implementation. It also represents a pioneering effort to integrate risks from both Spacecraft (SC) and Ground Segment (GS) to fully assess the probability of achieving mission objectives. PRA analysts were actively involved in system engineering and design engineering to ensure that a comprehensive set of technical risks were correctly identified and properly understood from a design and operations perspective. The analysis included an assessment of SC hardware and software, SC fault management system, GS hardware and software, common cause failures, human error, natural hazards, solar weather and infrastructure (such as network and telecommunications failures, fire). PRA findings directly resulted in design changes to reduce SC risk from micro-meteoroids. PRA results also led to design changes in several SC subsystems, e.g. propulsion, guidance, navigation and control (GNC), communications, mechanisms, and command and data handling (C&DH). The fault tree approach assisted in the development of the fault management system design. Human error analysis, which examined human response to failure, indicated areas where automation could reduce the overall probability of gaps in operation by half. In addition, the PRA brought to light many potential root causes of system disruptions, including earthquakes, inclement weather, solar storms, blackouts and other extreme conditions not considered in the typical reliability and availability analyses. Ultimately the PRA served to identify potential failures that, when mitigated, resulted in a more robust design, as well as to influence the program's concept of operations. The early and active integration of PRA with system and design engineering provided a well-managed approach for risk assessment that increased reliability and availability, optimized lifecyc1e costs, and unified the SC and GS developments.

Kalia, Prince↗

Finite-element boundary-integral simulation of thin wires and inhomogeneous penetrable bodies in subsurface multilayered anisotropic media

With the prevailing presence of drilling wells near the subsurface in mature oil and gas fields, the application of electromagnetic methods can be particularly challenging where the electromagnetic field is affected by the steel casing. In the past decades, borehole-to-surface and crosswell electromagnetic methods have been utilized for monitoring of reservoir and underground CO 2 storage. This paper presents a unified finite-element boundary-integral (FEBI) method capable of simultaneously modeling the complex electromagnetic interactions between thin metallic wires (representing steel casings) with 3D trajectory and arbitrary 3D inhomogeneous penetrable bodies (such as CO 2 plumes or hydrocarbon reservoirs) within anisotropic multilayered subsurface environments. Unlike existing approaches that treat these components separately or require dense discretization, or are limited to vertical wells, our unified formulation preserves flexible electromagnetic coupling while delivering improved computational efficiency. Assuming the background formation is multilayered anisotropic media, the surface integral equation method is applied to model the thin wires and boundaries of the inhomogeneous bodies. Meanwhile, the finite element method is applied to model the volume of inhomogeneous bodies. Here, the performance of the proposed FEBI method is assessed through comparison with reference numerical results and its practical significance is demonstrated through CO 2 plume monitoring scenarios.

97 MATHEMATICS AND COMPUTING↗

Development of a Boundary Layer Property Interpolation Tool in Support of Orbiter Return To Flight

A new tool was developed to predict the boundary layer quantities required by several physics-based predictive/analytic methods that assess damaged Orbiter tile. This new tool, the Boundary Layer Property Prediction (BLPROP) tool, supplies boundary layer values used in correlations that determine boundary layer transition onset and surface heating-rate augmentation/attenuation factors inside tile gouges (i.e. cavities). BLPROP interpolates through a database of computed solutions and provides boundary layer and wall data (delta, theta, Re(sub theta)/M(sub e), Re(sub theta)/M(sub e), Re(sub theta), P(sub w), and q(sub w)) based on user input surface location and free stream conditions. Surface locations are limited to the Orbiter s windward surface. Constructed using predictions from an inviscid w/boundary-layer method and benchmark viscous CFD, the computed database covers the hypersonic continuum flight regime based on two reference flight trajectories. First-order one-dimensional Lagrange interpolation accounts for Mach number and angle-of-attack variations, whereas non-dimensional normalization accounts for differences between the reference and input Reynolds number. Employing the same computational methods used to construct the database, solutions at other trajectory points taken from previous STS flights were computed: these results validate the BLPROP algorithm. Percentage differences between interpolated and computed values are presented and are used to establish the level of uncertainty of the new tool.

Greene, Francis A.↗

Converging Indicators for Assessing Individual Differences in Adaptation to Extreme Environments: Preliminary Report

This paper describes the development and validation of a new methodology for assessing the deleterious effects of spaceflight on crew health and performance. It is well known that microgravity results in various physiological alterations, e.g., headward fluid shifts which can impede physiological adaptation. Other factors that may affect crew operational efficiency include disruption of sleep-wake cycles, high workload, isolation, confinement, stress and fatigue. From an operational perspective, it is difficult to predict which individuals will be most or least affected in this unique environment given that most astronauts are first-time flyers. During future lunar and Mars missions space crews will include both men and women of multi-national origins, different professional backgrounds, and various states of physical condition. Therefore, new methods or technologies are needed to monitor and predict astronaut performance and health, and to evaluate the effects of various countermeasures on crew during long duration missions. This paper reviews several studies conducted in both laboratory and operational environments with men and women ranging in age between 18 to 50 years. The studies included the following: soldiers performing command and control functions during mobile operations in enclosed armored vehicles; subjects participating in laboratory tests of an anti-motion sickness medication; subjects exposed to chronic hypergravity aboard a centrifuge, and subject responses to 36-hours of sleep deprivation. Physiological measurements, performance metrics, and subjective self-reports were collected in each study. The results demonstrate that multivariate converging indicators provide a significantly more reliable method for assessing environmental effects on performance and health than any single indicator.

Cowings, Patricia S.↗

Revisiting the Role of Ocean Circulation Changes in Polar Ocean Heat Transport Anomalies under Global Warming

In response to greenhouse gas forcing, climate models predict that poleward ocean heat transport (OHT) weakens in the Southern Ocean but increases in the Arctic. The role of ocean circulation changes in this OHT response has been evaluated by decomposing OHT anomalies into a dynamic component (holding ocean temperature fixed while circulation evolves) and a thermodynamic component (holding ocean circulation fixed while temperature evolves). However, ocean temperature changes are themselves shaped by circulation changes through redistribution of the existing heat reservoir and subsequent effects on air–sea heat fluxes. The thermodynamic component can therefore be influenced by circulation changes, making the standard thermodynamic–dynamic decomposition incomplete for isolating the role of circulation changes in OHT anomalies. To address this issue, we use a passive–active decomposition to assess the relative contributions of ocean circulation and passive ocean temperature changes to polar OHT anomalies in a fully coupled climate model. Passive temperature changes are defined as those thermally forced by the atmosphere in the absence of circulation changes. In this passive–active decomposition, an advective term involving both circulation and passive temperature changes remains ambiguous—classifying it as active implies circulation changes dominate Southern Ocean OHT anomalies, whereas classifying it as passive implies temperature changes dominate. However, both interpretations imply that ocean circulation changes have a much weaker effect on polar OHT anomalies than inferred from the standard decomposition. In conclusion, these results help reconcile conclusions from studies using the standard decomposition with those using passive tracer methods to assess the role of circulation changes in polar OHT anomalies.

Arctic↗

Implementing EVM Data Analysis Adding Value from a NASA Project Manager's Perspective

Data Analysis is one of the keys to an effective Earned Value Management (EVM) Process. Project Managers (PM) must continually evaluate data in assessing the health of their projects. Good analysis of data can assist PMs in making better decisions in managing projects. To better support our P Ms, National Aeronautics and Space Administration (NASA) - Marshall Space Flight Center (MSFC) recently renewed its emphasis on sound EVM data analysis practices and processes, During this presentation we will discuss the approach that MSFC followed in implementing better data analysis across its Center. We will address our approach to effectively equip and support our projects in applying a sound data analysis process. In addition, the PM for the Space Station Biological Research Project will share her experiences of how effective data analysis can benefit a PM in the decision making process. The PM will discuss how the emphasis on data analysis has helped create a solid method for assessing the project s performance. Using data analysis successfully can be an effective and efficient tool in today s environment with increasing workloads and downsizing workforces

Counts, Stacy↗