Results for “Assessment Methods” — Page 10

NASA NTRS2005

Self port scanning tool : providing a more secure computing Environment through the use of proactive port scanning

Secure computing is a necessity in the hostile environment that the internet has become. Protection from nefarious individuals and organizations requires a solution that is more a methodology than a one time fix. One aspect of this methodology is having the knowledge of which network ports a computer has open to the world, These network ports are essentially the doorways from the internet into the computer. An assessment method which uses the nmap software to scan ports has been developed to aid System Administrators (SAs) with analysis of open ports on their system(s). Additionally, baselines for several operating systems have been developed so that SAs can compare their open ports to a baseline for a given operating system. Further, the tool is deployed on a website where SAs and Users can request a port scan of their computer. The results are then emailed to the requestor. This tool aids Users, SAs, and security professionals by providing an overall picture of what services are running, what ports are open, potential trojan programs or backdoors, and what ports can be closed.

nMap↗

NASA NTRS2007

Guide for Oxygen Compatibility Assessments on Oxygen Components and Systems

Understanding and preventing fire hazards is necessary when designing, maintaining, and operating oxygen systems. Ignition risks can be minimized by controlling heat sources and using materials that will not ignite or will not support burning in the end-use environment. Because certain materials are more susceptible to ignition in oxygen-enriched environments, a compatibility assessment should be performed before the component is introduced into an oxygen system. This document provides an overview of oxygen fire hazards and procedures that are consistent with the latest versions of American Society for Testing and Materials (ASTM) Standards G63 (1999) and G94 (2005) to address fire hazards associated with oxygen systems. This document supersedes the previous edition, NASA Technical Memorandum 104823, Guide for Oxygen Hazards Analyses on Components and Systems (1996). The step-by-step oxygen compatibility assessment method described herein (see Section 4) enables oxygen-system designers, system engineers, and facility managers to determine areas of concern with respect to oxygen compatibility and, ultimately, prevent damage to a system or injury to personnel.

Rosales, Keisa R.↗

NASA NTRS2007

Fundamental Technology Development for Gas-Turbine Engine Health Management

Integrated vehicle health management technologies promise to dramatically improve the safety of commercial aircraft by reducing system and component failures as causal and contributing factors in aircraft accidents. To realize this promise, fundamental technology development is needed to produce reliable health management components. These components include diagnostic and prognostic algorithms, physics-based and data-driven lifing and failure models, sensors, and a sensor infrastructure including wireless communications, power scavenging, and electronics. In addition, system assessment methods are needed to effectively prioritize development efforts. Development work is needed throughout the vehicle, but particular challenges are presented by the hot, rotating environment of the propulsion system. This presentation describes current work in the field of health management technologies for propulsion systems for commercial aviation.

Mercer, Carolyn R.↗

NASA NTRS2000

International Space Station: Meteoroid/Orbital Debris Survivability and Vulnerability

This slide presentation reviews the surviability and vulnerability of the International Space Station (ISS) from the threat posed by meteoroid and orbital debris. The topics include: (1) Space station natural and induced environments (2) Meteoroid and orbital debris threat definition (3) Requirement definition (4) Assessment methods (5) Shield development and (6) Component vulnerability

Graves, Russell↗

NASA NTRS2011

NASA Applications and Lessons Learned in Reliability Engineering

Since the Shuttle Challenger accident in 1986, communities across NASA have been developing and extensively using quantitative reliability and risk assessment methods in their decision making process. This paper discusses several reliability engineering applications that NASA has used over the year to support the design, development, and operation of critical space flight hardware. Specifically, the paper discusses several reliability engineering applications used by NASA in areas such as risk management, inspection policies, components upgrades, reliability growth, integrated failure analysis, and physics based probabilistic engineering analysis. In each of these areas, the paper provides a brief discussion of a case study to demonstrate the value added and the criticality of reliability engineering in supporting NASA project and program decisions to fly safely. Examples of these case studies discussed are reliability based life limit extension of Shuttle Space Main Engine (SSME) hardware, Reliability based inspection policies for Auxiliary Power Unit (APU) turbine disc, probabilistic structural engineering analysis for reliability prediction of the SSME alternate turbo-pump development, impact of ET foam reliability on the Space Shuttle System risk, and reliability based Space Shuttle upgrade for safety. Special attention is given in this paper to the physics based probabilistic engineering analysis applications and their critical role in evaluating the reliability of NASA development hardware including their potential use in a research and technology development environment.

Safie, Fayssal M.↗

NASA NTRS2011

Evaluation of Technologies to Prevent Precipitation During Water Recovery from Urine

The International Space Station (ISS) Urine Processor Assembly (UPA) experienced a hardware failure in the Distillation Assembly (DA) in October 2010. Initially the UPA was operated to recover 85% of the water from urine through distillation, concentrating the contaminants in the remaining urine. The DA failed due to precipitation of calcium sulfate (gypsum) which caused a loss of UPA function. The ISS UPA operations have been modified to only recover 70% of the water minimizing gypsum precipitation risk but substantially increasing water resupply needs. This paper describes the feasibility assessment of several technologies (ion exchange, chelating agents, threshold inhibitors, and Lorentz devices) to prevent gypsum precipitation. The feasibility assessment includes the development of assessment methods, chemical modeling, bench top testing, and validation testing in a flight-like ground UPA unit. Ion exchange technology has been successfully demonstrated and has been recommended for further development. The incorporation of the selected technology will enable water recovery to be increased from 70% back to the original 85% and improve the ISS water balance.

Broyan, James L., Jr.↗

NASA NTRS2013

Analysis of Operational Hazards and Safety Requirements for Traffic Aware Strategic Aircrew Requests (TASAR)

Safety analyses of the Traffic Aware Strategic Aircrew Requests (TASAR) Electronic Flight Bag (EFB) application are provided to establish its Failure Effects Classification which affects certification and operational approval requirements. TASAR was developed by NASA Langley Research Center to offer flight path improvement opportunities to the pilot during flight for operational benefits (e.g., reduced fuel, flight time). TASAR, using own-ship and network-enabled information concerning the flight and its environment, including weather and Air Traffic Control (ATC) system constraints, provides recommended improvements to the flight trajectory that the pilot can choose to request via Change Requests to ATC for revised clearance. This study reviews the Change Request process of requesting updates to the current clearance, examines the intended function of TASAR, and utilizes two safety assessment methods to establish the Failure Effects Classification of TASAR. Considerable attention has been given in this report to the identification of operational hazards potentially associated with TASAR.

Koczo, Stefan, Jr.↗

NASA NTRS2016

Simulation Credibility: Advances in Verification, Validation, and Uncertainty Quantification

Decision makers and other users of simulations need to know quantified simulation credibility to make simulation-based critical decisions and effectively use simulations, respectively. The credibility of a simulation is quantified by its accuracy in terms of uncertainty, and the responsibility of establishing credibility lies with the creator of the simulation. In this volume, we present some state-of-the-art philosophies, principles, and frameworks. The contributing authors involved in this publication have been dedicated to advancing simulation credibility. They detail and provide examples of key advances over the last 10 years in the processes used to quantify simulation credibility: verification, validation, and uncertainty quantification. The philosophies and assessment methods presented here are anticipated to be useful to other technical communities conducting continuum physics-based simulations; for example, issues related to the establishment of simulation credibility in the discipline of propulsion are discussed. We envision that simulation creators will find this volume very useful to guide and assist them in quantitatively conveying the credibility of their simulations.

Simulation Credibility↗

NASA NTRS2018

Using Remote Sensing Mapping and Growth Response to Environmental Variability to Aide Aquatic Invasive Plant Management

Management of aquatic weeds in complex watersheds and river systems present many challenges to assessment, planning and implementation of management practices for floating and submerged aquatic invasive plants. The Delta Region Areawide Aquatic Weed Project (DRAAWP), a USDA sponsored area-wide project, is working to enhance planning, decision-making and operational efficiency in the California Sacramento-San Joaquin Delta. Satellite and airborne remote sensing are used map (area coverage and biomass density), direct operations, and assess management impacts on plant communities. Archived satellite records enable review of results following previous climate and management events and aide in developing long-term strategies. Examples of remote sensing aiding effectiveness of aquatic weed management will be discussed as well as areas for potential technological improvement. Modeling at local and watershed scales using the SWAT modeling tool provides insight into land-use effects on water quality (described by Zhang in same Symposium). Controlled environment growth studies have been conducted to quantify the growth response of invasive aquatic plants to water quality and other environmental factors. Environmental variability occurs across a range of time scales from long-term climate and seasonal trends to short-term water flow mediated variations. Response time for invasive species response are examined at time scales of weeks, day, and hours using a combination of study duration and growth assessment techniques to assess water quality, temperature (air and water), nitrogen, phosphorus, and light effects. These provide response parameters for plant growth models in response to the variation and interact with management and economic models associated with aquatic weed management. Plant growth models are to be informed by remote sensing and applied spatially across the Delta to balance location and type of aquatic plant, growth response to altered environments and phenology. Initial utilization of remote sensing tools developed for mapping of aquatic invasive plants improved operational efficiency in management practices. These assessment methods provide a comprehensive and quantitative view of aquatic invasive plants communities in the California Delta.

Remote Sensing↗

NASA NTRS2018

Using Remote Sensing to Assess of Growth and Distribution for Floating Invasive Plants and Growth Response Times to Altered Environments

Management of aquatic weeds in complex watersheds and river systems present many challenges to assessment, planning and implementation of management practices for aquatic invasive plants. The Delta Region Areawide Aquatic Weed Project (DRAAWP), a USDA (U. S. Dept. of Agriculture)-sponsored area-wide project, is working to enhance planning, decision-making and operational efficiency of invasive plant management in the California Sacramento-San Joaquin Delta. Satellite and airborne remote sensing are used to map area of plant coverage and estimate biomass density to aid operations and assess management impacts on plant communities. Modeling at local and watershed scales using the SWAT (Soil Water Assessment Tool) modeling tool provides insight into land-use effects on water quality. Environmental variability in the Delta occurs across a range of time scales from long-term climate and seasonal trends to short-term water flow mediated variations. Controlled environment growth studies have been conducted to quantify the growth response of invasive aquatic plants to water quality and other environmental factors. Response time for invasive species response are examined at time scales of weeks, day, and hours using a combination of study duration and growth assessment techniques to assess water quality, temperature (air and water), and light effects. These provide response parameters for plant growth models in response to environmental variation and interact with management and economic models associated with aquatic weed management. Plant growth models are to be informed by remote sensing and applied spatially across the Delta to balance location and type of aquatic plant, growth response to altered environments and phenology. Initial utilization of remote sensing tools developed for mapping of aquatic invasive plants improved operational efficiency in management practices. These assessment methods provide a comprehensive and quantitative view of aquatic invasive plant communities in the California Delta.

Floating↗

NASA NTRSDate not supplied

Knowledge Discovery for Early Failure Assessment of Complex Engineered Systems Using Natural Language Processing

Emerging complex engineered systems may have unexpected safety issues due to novel operational environments, increasing autonomy, human-machine interaction, and other factors. To prevent failures in operation or testing that necessitate costly redesign, it is desirable to predict likely failure modes early in the design process. Information about past engineering failures in natural language format presents one possible solution by enabling the retrieval of information that can inform new designs. However, identifying documents containing usable information and extracting the required information can be prohibitively time-consuming when implemented at scale. In this research, an automated natural language processing (NLP) framework is proposed to discover relevant knowledge from documents containing failure-related design information. The framework is applied to NASA’s Lessons Learned Information System (LLIS),which is publicly available. Documents containing usable information are filtered using two different NLP-based models. Next, from the identified usable documents, a failure taxonomy is extracted using a partitioned hierarchical topic modeling approach. Partitions of the document describe different sections of the failure taxonomy – i.e., failure, cause of failure, and recommendations – as indicated by the structure of the original document. The extracted failure taxonomy can be leveraged in early design failure assessment methods. Moreover, the framework can be used to identify documents containing usable failure-related design information from other databases and extract relevant information from these documents.

Documentation and Information Science↗

NASA NTRSDate not supplied

Knowledge Discovery for Early Failure Assessment of Complex Engineered Systems Using Natural Language Processing

Emerging complex engineered systems may have unexpected safety issues due to novel operational environments, increasing autonomy, human-machine interaction, and other factors. To prevent failures in operation or testing that necessitate costly redesign, it is desirable to predict likely failure modes early in the design process. Information about past engineering failures in natural language format presents one possible solution by enabling the retrieval of information that can inform new designs. However, identifying documents containing usable information and extracting the required information can be prohibitively time-consuming when implemented at scale. In this research, an automated natural language processing (NLP) framework is proposed to discover relevant knowledge from documents containing failure-related design information. The framework is applied to NASA’s Lessons Learned Information System (LLIS),which is publicly available. Documents containing usable information are filtered using two different NLP-based models. Next, from the identified usable documents, a failure taxonomy is extracted using a partitioned hierarchical topic modeling approach. Partitions of the document describe different sections of the failure taxonomy – i.e., failure, cause of failure, and recommendations – as indicated by the structure of the original document. The extracted failure taxonomy can be leveraged in early design failure assessment methods. Moreover, the framework can be used to identify documents containing usable failure-related design information from other databases and extract relevant information from these documents.

Documentation and Information Science↗

NASA NTRSDate not supplied

TROPOMI Methane Validation in the GeoCarb Domain

Objective: GeoCarb validation •Purpose: •Do the four TCCON sites in the GeoCarb domain characterize satellite validation? •Method: •Assess the error estimates globally vs. in the GeoCarb domain •Assess the use of GML/DOE aircraft for CH4 validation •Systematic error estimate (from Kulawik, 2016): •+ regional bias (stdevof average bias versus validation at each station) •+ correlated error (stdev of daily average versus validation) •-co-location error (above quantities for model@satelliteminus model@valid) •-validation error (systematic error of validation estimates, e.g. model extension) Aircraft validation error •CH4 profile extension error estimate: 7 ppb •Extend aircraft observations to the top of the atmosphere with different model configurations •CAMS, scaling to stratosphere, then taking stratosphere •Extend by repeating top aircraft value to the troposphere, then taking CAMS •Extend with GEOS-Chem run (from 2010). •Difference CAMS-Scale vs. CAMS-Tropo: •3.6 +-5.5 ppb •Systematic error: 6.6 ppb •Extending aircraft to tropopause is blatantly wrong, but these two have the same stratosphere. •Difference CAMS-Scale vs. GEOS-Scale: •6.2 +-8.7 ppb •Do not consider bias since model is 10 years off. Systematic error ~8.7 ppb. •Estimate of systematic error from profile extension (possibly underestimated, resulting in possibly higher TROPOMI error estimate) •7 ppb •Would likely vary some by season, site, other conditions •Aircraft measurement error: 1 ppb •1 ppb from measurement error3

TROMPOMI↗

NASA NTRSDate not supplied

Mass Spectrometer Observing Lunar Operations (MSoLo)

Introduction: In 2019, the National Aeronautics and Space Administration (NASA) announced that it would seek to have humans return to the moon by 2024 in the hopes of establishing a more sustainable lunar presence by 2028. This goal comes with many challenges, one of upmost importance will be to utilize resources that can be found on the moon. Water, which has been identified in the lunar Polar Regions, will be a key resource for in-situ resource utilization (ISRU), as it is capable of being processed for vehicular fuel, as well as life support systems materials such as oxygen. Upcoming Commercial Lunar Payload Services (CLPS) missions will be critical for these resource assessments. Methods: A modified commercial off-the-shelf (COTS) mass spectrometer developed at Kennedy Space Center known as MSolo, consisting of a quadrupole mass filter and space rated electronics undergoes testing and modifications in order to study operational parameters to unconventional approaches needed in flight situations. In general, MSolo operates in the 0-100 m/z range with the ability to detect with a faraday cup (FC) or an electron multiplier (EM) for enhanced detection. A crossbeam (XB) ionization source is used. Preliminary Data: Prior to construction, little information was available on how the MSolo system would perform at lunar like environments, factors such as temperatures (possible fluctuations from 70 to -45 °C), vibrations from launch and their side effects, the general ability to operate while the entire system (hardware and electronic components) were in a vacuum environment, were factors that while know to flight instruments, were something new to a modified COTS system. As components start to warm up, temperature becomes a key factor (ie. heat can no longer escape the electronics as no atmosphere is present), therefore it becomes crucial to find new ways to maintain stable signals and keep the instrument tuned. Calibration itself becomes an important parameter that needs to be performed while maintaining all flight like characteristics. Even the structure itself of MSolo’s sensor needed to be changed to survive the verification parameters needed to be approved for flight. Most important, all the modifications made to the COTS system have to keep the instrument working at the same specifications of the standard commercial systems. Novel Aspect: Results gathered provide key parameters that will assist to the unconventional mass spectrometry approaches of the upcoming CLPS missions to which MSolo has been selected to.

MSolo↗

NASA NTRSDate not supplied

Space Launch System (SLS) Human Factors Engineering Modeling & Analysis

The Human Systems Integration & Engineering (HSI&E) team at NASA’s Marshall Space Flight Center (MSFC) strives to advocate for the humans in the loop of Space Launch System’s (SLS) ground operations. Using assessment methods like human simulation, virtual reality, and physical mockups, both flight hardware and ground support equipment (GSE) are evaluated for human integration. Those ranging from 5th percentile female (approximately 5’2” tall) to 95th percentile male (approximately 6’2” tall) should be able to perform all SLS stacking operations. Operations include element physical mates, element electrical mates, and testing activities. The primary human simulation software used is Process Simulate Human (PSH) made by Siemens. This software supplies highly accurate human manikins that can interact with CAD models. PSH was used to evaluate the Transportation and Integration Platform’s (TIP) side opening that was designed for access to the Payload Adapter (PLA) cables. Technicians will need to access these cables for testing purposes before element stacking at Kennedy Space Center (KSC). After performing an analysis in PSH using the TIP side opening, it was found that neither a 5th percentile female or a 95th percentile male could perform the task as the designers had intended. There is a C-beam that blocks access to the cables (both physically and visually). An alternative analysis was performed using PSH to look at another access point to the PLA cables. Although this method would disrupt already established procedures and produce more work, the designers confirmed it was an option. Instead of technicians accessing the cables through the side opening in the TIP, a human simulation was performed for going through a panel opening in the bottom of the TIP. This method requires removal of a TIP panel and a stepladder of at least 36 inches for a 5th percentile female to access the cables.

human factors↗

DOE OSTI2025

Cyber-Informed Engineering (CIE) Guide for States

The Cyber-Informed Engineering (CIE) Guide for States provides state energy offices, public utility commissions, and partner organizations with a structured framework for integrating cyber-resilient engineering practices into energy planning, grantmaking, interconnection processes, and workforce development. As grid digitalization and the adoption of distributed energy resources accelerate, states face expanding cyber-physical risks that traditional cybersecurity measures alone cannot fully address. CIE offers a proactive, consequence-focused engineering methodology that emphasizes eliminating or mitigating high-impact failure modes through design, physical controls, and operational safeguards. The guide outlines the 12 core CIE principles, demonstrates their application through state-focused use cases—including grant evaluation rubrics, interconnection reviews, allow-list development, and training programs—and provides practical tools such as scoring frameworks, impact assessment methods, and implementation checklists. It also highlights pathways for state–utility collaboration and opportunities for technical assistance from national laboratories. By adopting CIE, states can enhance grid reliability, reduce lifecycle costs, strengthen supply-chain assurance, and foster a security-aware engineering culture that aligns with broader resilience and modernization goals. November 2025

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2025

Cyber-Informed Engineering (CIE) Guide for States

The Cyber-Informed Engineering (CIE) Guide for States provides state energy offices, public utility commissions, and partner organizations with a structured framework for integrating cyber-resilient engineering practices into energy planning, grantmaking, interconnection processes, and workforce development. As grid digitalization and the adoption of distributed energy resources accelerate, states face expanding cyber-physical risks that traditional cybersecurity measures alone cannot fully address. CIE offers a proactive, consequence-focused engineering methodology that emphasizes eliminating or mitigating high-impact failure modes through design, physical controls, and operational safeguards. The guide outlines the 12 core CIE principles, demonstrates their application through state-focused use cases—including grant evaluation rubrics, interconnection reviews, allow-list development, and training programs—and provides practical tools such as scoring frameworks, impact assessment methods, and implementation checklists. It also highlights pathways for state–utility collaboration and opportunities for technical assistance from national laboratories. By adopting CIE, states can enhance grid reliability, reduce lifecycle costs, strengthen supply-chain assurance, and foster a security-aware engineering culture that aligns with broader resilience and modernization goals. November 2025

29 - ENERGY PLANNING, POLICY AND ECONOMY↗

NASA NTRS1994

A new test method for the assessment of the arc tracking properties of wire insulation in air, oxygen enriched atmospheres and vacuum

Development of a new test method suitable for the assessment of the resistance of aerospace cables to arc tracking for different specific environmental and network conditions of spacecraft is given in view-graph format. The equipment can be easily adapted for tests at different realistic electrical network conditions incorporating circuit protection and the test system works equally well whatever the test atmosphere. Test results confirm that pure Kapton insulated wire has bad arcing characteristics and ETFE insulated wire is considerably better in air. For certain wires, arc tracking effects are increased at higher oxygen concentrations and significantly increased under vacuum. All tests on different cable insulation materials and in different environments, including enriched oxygen atmospheres, resulted in a more or less rapid extinguishing of all high temperature effects at the beginning of the post-test phase. In no case was a self-maintained fire initiated by the arc.

Koenig, Dieter↗