Search NASA⌕ Search

SEARCH · Search NASA

Results for “Judgment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Error Localization Examples: Looking for a Needle in a Haystack

Finite element models (FEM) are routinely developed and used during fabrication of high dollar-value hardware. NASA, as part of the pre-flight certification of launch vehicles, routinely conducts vibration and static tests to calibrate models used for flight-risk assessments. During model calibration, certain areas of the model are modified, using engineering judgment and sensitivity analysis, to match the test results. Unfortunately, tools to identify problem areas in the FEM using test data directly are scarce and infrequently applied. Over the years, error localization algorithms have been proposed with very limited success. Recently, the Analytical Dynamics Model Improvement (ADMI) algorithm, which computes closed-form mass and stiffness corrections to match the test data exactly, have been shown to be an effective Error Localization Algorithm (ELA). The paper discusses three examples where ELA is used with simulated test data to locate problem areas. To gain confidence in the approach, the exact answer is shown along with ELA results. Results show that ELA is able to identify general problem areas consistent with known problem areas. In all examples, the ELA identified area is larger than the exact problem area. Nonetheless, with proper optimization tools, calibration results using the ELA identified areas provide excellent results.

model calibration↗
NASA NTRS2021

Measurement Uncertainty Analysis of 6x9 Icing Research Tunnel (IRT)

This paper presents the results of the measurement uncertainty analysis that was performed on the aero-thermal characteristics of the 6- by 9-Foot Icing Research Tunnel (IRT) at the NASA Glenn Research Center. The engineering judgments and statistical methods used to determine the elemental uncertainties are described. Instrumentation uncertainty was quanti ed using MANTUS (Measurement Analysis Tool for Uncertainty in Systems) and instrument speci cation sheets. The Monte Carlo method was used to propagate systematic components of uncertainty in order to quantify the uncertainty of the Variables of Interest (VOI). A detailed description of the Monte Carlo method and the MANTUS tool can be found in the Uncertainty Analysis of the NASA Glenn 8x6 Supersonic Wind Tunnel report [1]. Detailed uncertainty results for test section airspeed and temperature as well as other variables of interest are described within this document.

6x9 Icing Research Tunnel↗
NASA NTRS2021

Uncertainty Analysis of the CE-12 Free-Jet Probe Calibration Facility

This paper presents methods and results of a detailed measurement uncertainty analysis thf at was performed for the Free Jet Calibration Facility (CE-12) located at the NASA Glenn Research Center. Results for systematic uncertainty estimates in a number of fluid properties of the free jet flow are presented. Systematic uncertainty captures inaccuracies due to measurement process, calibration, installation effects or other similar sources which may introduce bias. MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation uncertainty and engineering judgment was used to quantify other systematic uncertainty sources. The Monte Carlo method was used to propagate systematic uncertainties to determine the uncertainties of various calculated variables of interest.

CE-12↗
NASA NTRSDate not supplied

The Death of Airmanship: The Urgent Need to Understand Pilot Skills and Knowledge

Aviation awards a special name—airmanship—for the quality of being highly competent in foundational piloting skills, which seem to comprise primarily judgment, decision making, stick-and-rudder skills, and a bit of intuition. The term, which has a mystical quality, has historically resisted analysis; airmanship is acquired solely through experience. The graying of the Boomers and the extreme turbulence of the last few years in commercial aviation have led to a significant loss of those pilots who started out in simpler, round-dial airplanes and made a tortured transition to glass. Those pilots were comfortable disengaging the autopilot at any time, and more importantly, they continued to stay mentally engaged with flight and systems management even as automation continued to encroach on traditional pilot roles. As an industry, we need to prepare for the loss of these pilots by understanding the elements of airmanship and finding a way to replace the competency. The goal is to eliminate “airmanship” by understanding it...by demystifying it. Human factors/cognitive engineering offers tools and methods to develop a system interface that supports skilled performance from the human/technology team. In this presentation, I will talk about my efforts to understand the elements of skilled performance so that they can be trained, or supported by the interface in a seamless manner Specific topics will include the limits of SOP, monitoring for flight path management, alerting non-normals, and autoflight/mode confusion.

pilot skills↗
NASA NTRSDate not supplied

Methods for Developing Successful Systems Engineers

Systems Engineering (SE) is a complex and challenging field that incorporates the knowledge of systems engineering processes, the ability to synthesize a wide-range of engineering disciplines, and the ability to lead a team of people to successfully accomplish the goals of a project. It requires hard technical skills and soft-skill leadership savvy. As a result, three main development needs are identified: 1) Knowledge of SE processes, the benefits of these processes to a project and their tailored application 2) Knowledge of a wide-range of engineering disciplines, how they interrelate in a system, and the development of sound technical judgement 3) Team leadership to direct and motivate a team of subsystem and discipline experts This paper describes the establishment of a comprehensive training and development program for Systems Engineers at NASA Ames Research Center that addresses in part each of these three areas from the perspective of the implementing manager. A variety of methods have been utilized including the establishment of a SE Community of Practice, a unique and innovative web tool, on-line videos, classroom training in NASA’s 17 Common Technical Processes, guidance on the tailored application of these processes, monthly technical talks, mentoring in both technical judgment and team leadership, and NASA’s Leadership Development Programs. While much of professional SE development must come through project experience, the approaches listed above can accelerate development. The diversity of skills required of Systems Engineering demands a multi-faceted approach to successfully train and develop this critical skill.

development↗
NASA NTRSDate not supplied

Methods for Developing Successful Systems Engineers

Systems Engineering (SE) is a complex and challenging field that incorporates the knowledge of systems engineering processes, the ability to synthesize a wide-range of engineering disciplines, and the ability to lead a team of people to successfully accomplish the goals of a project. It requires hard technical skills and soft-skill leadership savvy. As a result, three main development needs are identified: 1. Knowledge of SE processes, the benefits of these processes to a project and their tailored application 2. Knowledge of a wide-range of engineering disciplines, how they interrelate in a system, and the development of sound technical judgement 3. Team leadership to direct and motivate a team of subsystem and discipline experts This paper describes the establishment of a comprehensive training and development program for Systems Engineers at NASA Ames Research Center that addresses in part each of these three areas from the perspective of the implementing manager. A variety of methods have been utilized including the establishment of a SE Community of Practice, a unique and innovative web tool, on-line videos, classroom training in NASA’s 17 Common Technical Processes, guidance on the tailored application of these processes, monthly technical talks, mentoring in both technical judgment and team leadership, and NASA’s Leadership Development Programs. While much of professional SE development must come through project experience, the approaches listed above can accelerate development. The diversity of skills required of Systems Engineering demands a multi-faceted approach to successfully train and develop this critical skill.

development↗
NASA NTRSDate not supplied

EMU Helmet Free Water Transport Assessment for the HAB in Support of Eva 80

After water was reported in the EMU helmet during ISS US EVA-80, mitigation strategies were created to attempt to arrest the motion of any droplets that enter the helmet for future Extravehicular Activities (EVAs). This included adding absorbent materials into the interior of the helmet. To assess the effectiveness of this strategy, a computational fluid dynamics (CFD) model of a human mannikin head in the EMU helmet was used to track water droplets and quantify how much water is likely to be caught by the absorbent material. A combination of engineering judgment, tests, and CFD results were used to develop the expected path of droplets in the helmet, to account for the simplifications necessary in modeling two-phase flow.

Abigail Rose Baukus↗
NASA NTRSDate not supplied

Low-cost Quantification of Fluid Flow Parameter Sensitivity using Reduced-order Modeling

Uncertainty quantification of computational fluid dynamics (CFD) simulations is a complicated procedure which still relies in many cases on engineering judgment and factors of safety. This is in part because the computational cost of measuring the simulation's sensitivity to all meaningful parameters (e.g., body surface roughness) and hyperparameters (e.g., subiteration convergence criterion) is intractable for even a single simulation. Reduced-order modeling dramatically lowers this computational cost of simulating fluid flows, but usually only where similar data is already available. In this work, fluid reduced-order models are utilized to quantify a flow's sensitivity to certain physical parameters for the purposes of improved uncertainty quantification. Characteristic observability and sensitivity are both explored. The resulting sensitivity quantifications enable more informed CFD frameworks and more rigorous uncertainty bounds on the resulting data.

uncertainty quantification↗
NASA NTRSDate not supplied

Low-cost Quantification of Fluid Flow Parameter Sensitivity using Reduced-order Modeling

Uncertainty quantification of computational fluid dynamics (CFD) simulations is a complicated procedure which still relies in many cases on engineering judgment and factors of safety. This is in part because the computational cost of measuring the simulation's sensitivity to all meaningful parameters (e.g., body surface roughness) and hyperparameters (e.g., subiteration convergence criterion) is intractable for even a single simulation. Reduced-order modeling dramatically lowers this computational cost of simulating fluid flows, but usually only where similar data is already available. In this work, fluid reduced-order models are utilized to quantify a flow's sensitivity to certain physical parameters for the purposes of improved uncertainty quantification. Characteristic observability and sensitivity are both explored. The resulting sensitivity quantifications enable more informed CFD frameworks and more rigorous uncertainty bounds on the resulting data.

uncertainty quantification↗
NASA NTRS2023

A Summary of the Development and Validation of the Scale for Habitat Usability (SHU)

Usability is an important concept to consider when designing space habitats/vehicles. In addition to objective outcomes (success rate, net habitable volume etc.), collecting users’ subjective judgments via comments and questionnaires can provide valuable data for evaluating conceptual designs, identifying potential layout issues, improving concept of operations, substantiating design changes, or selecting between competing mockups. Historically at NASA, there has been no “gold standard” questionnaire for capturing users’ subjective viewpoint regarding habitat design. To address this gap a Human Research Program (HRP) study was conducted to create a new measurement tool: the Scale for Habitat Usability (SHU).

Usability↗
NASA NTRS2023

Uncertainty Analysis of the NASA Glenn 8- by 6-Foot Supersonic Wind Tunnel 2019 Characterization Test 14-Foot, 5.8 Percent Test Section Porosity

This paper presents methods and results of a measurement uncertainty analysis that was performed for the 8- by 6-foot Supersonic Wind Tunnel located at the NASA Glenn Research Center. The uncertainty analysis is based on data collected during a characterization test following major structural modifications to the facility and upgrades to the facility’s data and control systems. The statistical methods and engineering judgments used to estimate elemental uncertainties are described in this report. The Monte Carlo method of propagating uncertainty was selected to determine the uncertainty of calculated variables of interest. A description of the Monte Carlo method as applied for this analysis is provided. The primary variable of interest (VOI) for this facility is free stream Mach number. In addition to determining the uncertainty in Mach number, the uncertainty in free stream values of static pressure, total pressure, dynamic pressure, total temperature, static temperature, Reynolds number, and air speed were also calculated. Uncertainty results are presented as random (unpredictable variation in repeated measurements), systematic (potential offset between observed and true value), and total (random and systematic combined) uncertainty for Mach number. Systematic uncertainty results are presented for the other VOIs. Individual uncertainty sources are presented both dimensionally and as percent contributions to uncertainty in all VOIs, to aid in the identification of primary uncertainty sources.

Uncertainty Analysis↗
NASA NTRSDate not supplied

EMU Helmet Free Water Transport Assessment for the HAB in Support of Eva 80

After water was reported in the EMU helmet during ISS US EVA-80, mitigation strategies were created to attempt to arrest the motion of any droplets that enter the helmet for future Extravehicular Activities (EVAs). This included adding absorbent materials into the interior of the helmet. To assess the effectiveness of this strategy, a computational fluid dynamics (CFD) model of a human mannikin head in the EMU helmet was used to track water droplets and quantify how much water is likely to be caught by the absorbent material. A combination of engineering judgment, tests, and CFD results were used to develop the expected path of droplets in the helmet, to account for the simplifications necessary in modeling two-phase flow.

Abigail Baukus↗
NASA NTRSDate not supplied

Probabilistic Approach to Assessing CCRS Capture System Performance Margin

In the aerospace industry, there are standard design principles and/or rule-of-thumb targets that define healthy levels of margins required at each developmental milestone for traditional metrics, such as mass, thermal, and power margins. When the technical resource is “non-traditional” in the sense that guiding margin principles are non-existent, systems engineering judgment is required to internally generate performance targets and methodologies to assess the system against the derived targets. This paper presents a probabilistic approach for assessing complex time-critical operations in order to apply global sensitivity analyses to identify input parameters that should (or should not) serve as design drivers.

Performance Margins↗
NASA NTRSDate not supplied

EMU Helmet Free Water Transport Assessment for the HAB in Support of Eva 80

After water was reported in the EMU helmet during ISS US EVA-80, mitigation strategies were created to attempt to arrest the motion of any droplets that enter the helmet for future Extravehicular Activities (EVAs). This included adding absorbent materials into the interior of the helmet. To assess the effectiveness of this strategy, a computational fluid dynamics (CFD) model of a human mannikin head in the EMU helmet was used to track water droplets and quantify how much water is likely to be caught by the absorbent material. A combination of engineering judgment, tests, and CFD results were used to develop the expected path of droplets in the helmet, to account for the simplifications necessary in modeling two-phase flow.

Abigail Baukus↗
NASA NTRSDate not supplied

LSKnowledge: Nexus for Transformative Scientific Discoveries and Enhanced Information Retrieval in NASA Life Sciences Portal

We stand at the brink of an extraordinary transformation in the field of AI, driven by the convergence of generative AI and semantic technologies (e.g., knowledge graphs). This fusion holds immense potential and could redefine the future of scientific exploration, particularly in the realm of life sciences research. In this context, we shed light on the pivotal roles that Large Language Models (LLMs) and semantic technologies will play in advancing research, unearthing and comprehending life sciences information through innovative approaches, and empowering researchers to extract insights from NASA's extensive Life Sciences Data Archive. Within the NASA Life Sciences Portal (NLSP), the integration of LLMs and semantic technologies unlocks several advanced capabilities. First and foremost, it equips scientists with sophisticated tools to manage the ever-expanding wealth of scientific literature and data. Furthermore, it facilitates the creation of knowledge graphs that visually represent intricate relationships among biological entities, enabling comprehensive systems-level analysis. Additionally, the fusion of generative AI (including LLMs) and semantic technology can significantly benefit NASA's life sciences research by enhancing information retrieval and hypothesis generation. These tools enhance natural language understanding, facilitating knowledge discovery within NLSP. The overarching vision is to establish a cohesive knowledge ecosystem within NLSP, harnessing the power of LLMs and semantic technologies to synthesize and cross-reference data from diverse missions, disciplines, and research domains. This holistic approach ultimately deepens our understanding of how space environments impact life sciences data. To advance this initiative, we have launched LSKnowledge, aimed at enhancing the information retrieval capabilities of NLSP. In the short term, our primary goal is to develop a robust semantic search system. This system will empower HRP (Human Research Program) researchers to navigate NLSP data repositories more efficiently and precisely, catalyzing the process of hypothesis formation and scientific breakthroughs. To achieve this, we have employed pre-trained LLMs as part of a semantic search tool that can rank and highlight the most relevant records for user queries. To assess the tool's performance, we have curated a set of approximately 200 queries from subject matter experts (SMEs) and manually ranked the top records retrieved by both the current search system and the new semantic search, using SME judgments as the gold standard for relevancy. Herein, we present the results of our comparative analysis and illustrate how these findings have informed the fine-tuning of the system for enhanced performance. In the long term, our objectives include 1) retrieving publicly available information and integrating it with NLSP data to provide more precise answers to user queries, and 2) incorporating non-textual information from the NLSP database into our approach. In conclusion, the fusion of LLMs and semantic technologies within NLSP represents a pioneering stride towards reshaping the landscape of scientific discovery. This synergy not only equips researchers with powerful tools to navigate the burgeoning sea of information but also facilitates a deeper understanding of complex biological relationships, all while accelerating hypothesis generation and knowledge discovery. Through our initiative, LSKnowledge, we are committed to continually refining and expanding these capabilities, with the aim of not only enhancing information retrieval but also integrating diverse data sources to provide more precise insights. In the grand vision, NLSP strives to become the cornerstone of a comprehensive knowledge ecosystem, unraveling the enigmatic intricacies of life sciences phenomena in the context of space environments.

Life Sciences↗
NASA NTRSDate not supplied

Distortion of Perceived Visual Space after Eccentric Gaze Holding

Previous studies have shown that rebound nystagmus can be a behavioral probe into the adaptive properties of the gaze-holding mechanism, showing that after prolonged eccentric gaze holding and upon return to central gaze the eye tends to drift towards the previously held position. It is not known whether perception of visual space is also affected by similar adaptation mechanisms. The current study seeks to elucidate if eccentric gaze holding changes the perception of space in a relative spatial judgment task. To measure their spatial bias, twelve subjects were asked to report which among two short vertical lines flashed to the left or to the right of the display was closer to a third central line. Perception was assessed after holding eccentric gaze at 40 degrees towards the left or right and compared with control trials without eccentric gaze holding. Subjects showed a significant difference in spatial bias between the leftward and rightward gaze holding conditions (p = 0.04), suggesting that the visual space changes differently with respect to the side where gaze was held. While we did not observe an overall bias (p = 0.327) under no gaze holding we did observe a significant correlation between handedness and spatial bias (r2 = 0.4, p = 0.04). We conclude that gaze holding temporarily distorts the perception of space in a mechanism that may be related to the adaptation of the gaze holding mechanism.

perception↗
DOE OSTI2024

Immersive Visualization for Scientific Data Analysis

We will present the use of immersive visualization at the National Renewable Energy Laboratory (NREL), showcasing how immersive visualization is advancing scientific research and engineering practices and transforming our day-to-day operations. We are leveraging immersive visualization to support scientific discovery and engineering in various domains, including material design, computational fluid dynamics, immersive analytics, grid modernization, digital twins, and situated visualization. We have observed several benefits across four key areas: enhanced spatial judgments, improved understanding through interaction, increased capacity to embed high-dimensional data, and improved collaboration.

immersive analytics↗
DOE OSTI2024

An Approach to Dynamic Human Reliability Analysis and Its Data Collection Framework

Human reliability analysis (HRA) is a method for evaluating human errors in a variety of complex systems such as nuclear power plants, military systems, aircraft, and chemical plants. Most HRA methods currently used by regulatory institutes or utilities are called static HRA and are carried out by simple worksheets or simple calculators. To date, there are many unsolved or intrinsic challenges in static HRA. For example, existing static HRA does not realistically model and evaluate human actions as they would be performed at actual systems. There is no method with HRA to objectively estimate the time required for human actions despite being essential to HRA processes. In addition, many HRA methods still rely on a dataset generated prior to the 1980s, from unrelated industry experience or simply from expert judgment. Accordingly, this study attempted to research how to overcome the challenges of existing HRA via dynamic risk assessment (a.k.a., simulation-based or computation-based risk assessment) techniques. First, this study developed a dynamic HRA method, named as PRocedure-based Investigation Method of EMRALD Risk Assessment – HRA (PRIMERA-HRA). The PRIMERA-HRA mainly concentrates on providing HRA analysts with specific guidelines on how to reasonably model human actions, assign human reliability data and evaluate output of simulation within a dynamic probabilistic risk assessment tool, called as Event Modeling Risk Assessment using Linked Diagrams (EMRALD). Second, this study also developed a module for performance shaping factors (i.e., the key concept in HRA quantification) applicable to dynamic HRA, then implemented it based on PRIMERA-HRA within the EMRALD tool. Third, this study developed an HRA data collection framework to support dynamic HRA, called as Simplified Human Error Experimental Program (SHEEP). Originally, the SHEEP study aimed to support static HRA and its data collection, but recently extended the scope to the new technologies such as dynamic HRA or HRA for advanced reactors. SHEEP focuses on the use of data collected from simplified simulators to complement—but not replace—data collection studies using full-scope simulators and actual operators. To date, many experiments were conducted under the SHEEP framework. Multiple analyses, such as human performance analysis, human error analysis, task complexity analysis, learning effect analysis and time distribution analysis, were also carried out using the collected data. Then, based on the major insights, an approach to inferring full-scope data based on simplified simulator data was proposed. The PRIMERA-HRA and SHEEP research are expected to evaluate human actions more realistically than existing static HRA, provide an opportunity to collect more HRA data with reasonable cost and labor, then contribute to enhance the quality of HRA.

99 - GENERAL AND MISCELLANEOUS↗