Search NASA⌕ Search

SEARCH · Search NASA

Results for “SAFETY STANDARDS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Systems Engineering and Management Applications of ISO 9001:2015 for Government

The manufacturing segment of the business world is busy assessing the impact of ISO 9001:2015, and updating their management systems to meet the required compliance date. What does the new revision mean for government agencies that deliver large engineering projects rather than mass production? In fact, the standard, especially the new revision, can be used quite readily for government agencies, or applied to specific projects, once it is understood in terms of the similarities with systems engineering and project management. From there it can be extrapolated to "mission realization" systems, and a Quality Management System (QMS) is a logical result that can bring order to processes and systems that likely already exist in some fashion. ISO 9001:2015 is less product-oriented than previous versions. It can be more broadly applied to public organizations as well as private; and to services (missions) as well as products. The emphasis on risk management in the revised standard provides the needed balance for weighing decisions with respect to cost, schedule, technical, safety, and regulatory compliance; so if this is not part of agency governance already, this is a good place to start, especially for large engineering projects. The Systems Engineering standard used for this analysis is from NASA's NPR 7123.1 NASA Systems Engineering Processes and Requirements; however, those who are more familiar with ISO/IEC 26702 Systems Engineering-application and management of the systems engineering process, or SAE/EIA 632 Processes for Engineering a System will also recognize the similarities. In reality, the QMS outlined by ISO 9001 reinforces the systems engineering processes, and serves to ensure that they are adequately implemented, although most of the ISO 9001 literature emphasizes the production and process aspects of the standard. Rather than beginning with ISO 9001and getting lost in the vocabulary, it is useful to begin with the systems engineering lifecycle. Identification of stakeholder expectations, identifying solutions, creating specific product or service designs, production of the product or service, delivery to the public, and the associated management, planning, and control processes, are a familiar place to begin thinking of the overall system of identifying, designing, and competing a project or mission. Lining up this lifecycle with the ISO requirements (see Figure 1) illustrates how a quality management system is concerned with the same processes, and provides a governance and assurance function. If implemented properly, there are cost savings resulting from less rework, repair, reprocessing, failures, misplaced documents, and similar types of deficiencies1. Starting with an organization's systems engineering processes allows the organization to use their own terminology for a QMS plan, and tailor the plan to their own project or organization, so that it is more easily developed, understood, and implemented.

Shepherd, Christena C.↗

Safety Assessment of a Machine Learning-Based Aircraft Emergency Braking System: A Case Study

Machine Learning (ML) is revolutionizing many technological fields, but its use in aviation remains restricted due to stringent certification requirements. Efforts by the aviation community to establish standards for certifying ML-based systems are progressing, yet challenges persist, particularly with safety assessment methods for ML-based systems. This research addresses these challenges through a case study of an autonomous emergency braking system utilizing a computer vision deep neural network (DNN). We demonstrate a safety assessment process tailored to ML-specific concerns, such as low integrity and performance variability in quantitative safety analysis. This study can serve as an illustrative example to facilitate the discussion and convergence on certification aspects for ML-based systems within the aviation community.

Safety certification↗

Fire safety concerns in space operations

This paper reviews the state-of-the-art in fire control techniques and identifies important issues for continuing research, technology, and standards. For the future permanent orbiting facility, the space station, fire prevention and control calls for not only more stringent fire safety due to the long-term and complex missions, but also for simplified and flexible safety rules to accommodate the variety of users. Future research must address a better understanding of the microgravity space environment as it influences fire propagation and extinction and the application of the technology of fire detection, extinguishment, and material assessment. Spacecraft fire safety should also consider the adaptation of methods and concepts derived from aircraft and undersea experience.

Friedman, Robert↗

A Summary of Results from Vertical Drop Testing of Hybrid III and WIAMan ATDs

With the development and maturation of the Urban Air Mobility (UAM) market, many new types of electric vertical take-off and landing (eVTOL) vehicles will be flying in the national airspace carrying goods, people or conducting operations for a variety of missions. These types of vehicles are unlike current aircraft due to their novel design and operational profile. Several considerations must be examined in areas including noise, comfort and safety in order for these vehicles to be utilized and accepted into the current airspace system. Researchers at NASA Langley Research Center (LaRC) have conducted sub-scale and full-scale tests on representative eVTOL airframes and seats under a variety of dynamic impact conditions. These tests were conducted to generate data necessary to inform the development of standards in the areas specific to crashworthiness of eVTOL vehicle systems and safety. The data in this report relates to occupant responses obtained during a test campaign utilizing various makes, models, and sizes of Anthropomorphic Test Devices (ATD’s, a.k.a. crash test dummies) undergoing vertical impacts in a variety of seats. The data is intended to provide occupant behavior response and injury metrics for several anticipated impact scenarios that may occur in eVTOL operations. This report will present test data highlighting the effects of several variables on the test results. Discussions on the ATD sizes, along with comparisons between different ATD makes and types will be included. The performance of an in-house developed energy absorbing seat will be detailed, and discussions pertaining to the applicability in various loading conditions will be presented. Finally, a discussion as to the applicability of the tested results to eVTOL full-scale conditions will be included.

Dynamic Drop Testing↗

Revealing the ISO/IEC 9126-1 Clique Tree for COTS Software Evaluation

Previous research has shown that acyclic dependency models, if they exist, can be extracted from software quality standards and that these models can be used to assess software safety and product quality. In the case of commercial off-the-shelf (COTS) software, the extracted dependency model can be used in a probabilistic Bayesian network context for COTS software evaluation. Furthermore, while experts typically employ Bayesian networks to encode domain knowledge, secondary structures (clique trees) from Bayesian network graphs can be used to determine the probabilistic distribution of any software variable (attribute) using any clique that contains that variable. Secondary structures, therefore, provide insight into the fundamental nature of graphical networks. This paper will apply secondary structure calculations to reveal the clique tree of the acyclic dependency model extracted from the ISO/IEC 9126-1 software quality standard. Suggestions will be provided to describe how the clique tree may be exploited to aid efficient transformation of an evaluation model.

Morris, A. Terry↗

Spinoff 2013

Topics covered include: Innovative Software Tools Measure Behavioral Alertness; Miniaturized, Portable Sensors Monitor Metabolic Health; Patient Simulators Train Emergency Caregivers; Solar Refrigerators Store Life-Saving Vaccines; Monitors Enable Medication Management in Patients' Homes; Handheld Diagnostic Device Delivers Quick Medical Readings; Experiments Result in Safer, Spin-Resistant Aircraft; Interfaces Visualize Data for Airline Safety, Efficiency; Data Mining Tools Make Flights Safer, More Efficient; NASA Standards Inform Comfortable Car Seats; Heat Shield Paves the Way for Commercial Space; Air Systems Provide Life Support to Miners; Coatings Preserve Metal, Stone, Tile, and Concrete; Robots Spur Software That Lends a Hand; Cloud-Based Data Sharing Connects Emergency Managers; Catalytic Converters Maintain Air Quality in Mines; NASA-Enhanced Water Bottles Filter Water on the Go; Brainwave Monitoring Software Improves Distracted Minds; Thermal Materials Protect Priceless, Personal Keepsakes; Home Air Purifiers Eradicate Harmful Pathogens; Thermal Materials Drive Professional Apparel Line; Radiant Barriers Save Energy in Buildings; Open Source Initiative Powers Real-Time Data Streams; Shuttle Engine Designs Revolutionize Solar Power; Procedure-Authoring Tool Improves Safety on Oil Rigs; Satellite Data Aid Monitoring of Nation's Forests; Mars Technologies Spawn Durable Wind Turbines; Programs Visualize Earth and Space for Interactive Education; Processor Units Reduce Satellite Construction Costs; Software Accelerates Computing Time for Complex Math; Simulation Tools Prevent Signal Interference on Spacecraft; Software Simplifies the Sharing of Numerical Models; Virtual Machine Language Controls Remote Devices; Micro-Accelerometers Monitor Equipment Health; Reactors Save Energy, Costs for Hydrogen Production; Cameras Monitor Spacecraft Integrity to Prevent Failures; Testing Devices Garner Data on Insulation Performance; Smart Sensors Gather Information for Machine Diagnostics; Oxygen Sensors Monitor Bioreactors and Ensure Health and Safety; Vision Algorithms Catch Defects in Screen Displays; and Deformable Mirrors Capture Exoplanet Data, Reflect Lasers.

Source record↗

Small, Optically-Driven Power Source

Power transmitted along fiber-optic cables. Transmitted as infrared light along fiber-optic cable, converted to electricity to supply small electronic circuit. Power source and circuit remains electrically isolated from each other for safety or reduces electromagnetic interference. Array of diodes made by standard integrated-circuit techniques and packaged for mounting at end of fiber-optic cable.

Cockrum, Richard H.↗

Relation of Hydrogen and Methane to Carbon Monoxide in Exhaust Gases from Internal-Combustion Engines

The relation of hydrogen and methane to carbon monoxide in the exhaust gases from internal-combustion engines operating on standard-grade aviation gasoline, fighting-grade aviation gasoline, hydrogenated safety fuel, laboratory diesel fuel, and auto diesel fuel was determined by analysis of the exhaust gases. Two liquid-cooled single-cylinder spark-ignition, one 9-cylinder radial air-cooled spark-ignition, and two liquid-cooled single-cylinder compression-ignition engines were used.

Gerrish, Harold C↗

Review of the probabilistic failure analysis methodology and other probabilistic approaches for application in aerospace structural design

Probabilistic structural analyses and design methods are steadily gaining acceptance within the aerospace industry. The safety factor approach to design has long been the industry standard, and it is believed by many to be overly conservative and thus, costly. A probabilistic approach to design may offer substantial cost savings. This report summarizes several probabilistic approaches: the probabilistic failure analysis (PFA) methodology developed by Jet Propulsion Laboratory, fast probability integration (FPI) methods, the NESSUS finite element code, and response surface methods. Example problems are provided to help identify the advantages and disadvantages of each method.

Townsend, J.↗

Flight Simulation Model Exchange

The NASA Engineering and Safety Center Review Board sponsored an assessment of the draft Standard, Flight Dynamics Model Exchange Standard, BSR/ANSI-S-119-201x (S-119) that was conducted by simulation and guidance, navigation, and control engineers from several NASA Centers. The assessment team reviewed the conventions and formats spelled out in the draft Standard and the actual implementation of two example aerodynamic models (a subsonic F-16 and the HL-20 lifting body) encoded in the Extensible Markup Language grammar. During the implementation, the team kept records of lessons learned and provided feedback to the American Institute of Aeronautics and Astronautics Modeling and Simulation Technical Committee representative. This document contains the results of the assessment.

Murri, Daniel G.↗

Flight Simulation Model Exchange: Appendices - Volume 2

The NASA Engineering and Safety Center Review Board sponsored an assessment of the draft Standard, Flight Dynamics Model Exchange Standard, BSR/ANSI-S-119-201x (S-119) that was conducted by simulation and guidance, navigation, and control engineers from several NASA Centers. The assessment team reviewed the conventions and formats spelled out in the draft Standard and the actual implementation of two example aerodynamic models (a subsonic F-16 and the HL-20 lifting body) encoded in the Extensible Markup Language grammar. During the implementation, the team kept records of lessons learned and provided feedback to the American Institute of Aeronautics and Astronautics Modeling and Simulation Technical Committee representative. This document contains the appendices to the main report.

Murri, Daniel G.↗

IEEE 802.16J-Relay Fortified Aeromacs Networks; Benefits and Challenges

Aeronautical Mobile Airport Communications System (AeroMACS) is an IEEE 802.16 standard-based (WiMAX) broadband aviation transmission technology, developed to provide safety critical communications coverage for airport surface in support of fixed and mobile ground to ground applications and services. We have previously demonstrated that IEEE 802.16j-amendment-based WiMAX is most feasible for AeroMACS applications. The principal argument in favor of application of IEEE 802.16j technology is the flexible and cost effective extension of radio coverage that is afforded by relay fortified WiMAX networks, with virtually no increase in the power requirements. In this article, following introductory remarks on airport surface communications, WiMAX and AeroMACS; the IEEE 802.16j-based WiMAX technology and multihop relay systems are briefly described. The two modes of relay operation supported by IEEE 802.16j amendment; i.e., transparent (TRS) and non-transparent (NTRS) modes, are discussed in some detail. Advantages and disadvantages of using TRS and NTRS in AeroMACS networks are summarized in a table. Practical issues vis--vis the inclusion of relays in AeroMACS networks are addressed. It is argued that the selection of relay type may affect a number of network parameters. A discussion on specific benefits and challenges of inclusion of relays in AeroMACS networks is provided. The article concludes that in case it is desired or necessary to exclusively employ one type of relay mode for all applications throughout an AeroMACS network, the proper selection would be the non-transparent mode.

Networks↗

Preparation for Pick-and-Eat Food Production on the International Space Station: Flight Definition for the VEG-04 and VEG-05 Missions

Growth of fresh, nutritious, palatable produce for crew consumption during spaceflight may provide health-promoting, bioavailable nutrients and enhance the dietary experience as we move toward longer-duration missions. Tending plants also may serve as a countermeasure for crew psychological stresses associated with long duration spaceflight. However, requirements to support consistent growth of a variety of high quality, nutritious crops under spaceflight environmental conditions is unknown. This study is exploring the potential to grow plants for food production on the International Space Station (ISS) using the Veggie vegetable production system. Ground testing is underway to compare the impacts of several fertilizer and lighting treatments on growth, quality, and nutritional composition of the leafy green crop mizuna, and the dwarf tomato crop Red Robin when subjected to Veggie ISS environmental conditions. Early testing focused on the leafy crop Tokyo Bekana Chinese cabbage, but ground tests indicated that this plant suffered from stress responses when grown under LEDs and the chronically elevated CO2 levels found on the ISS. Mizuna, a related leafy variety that grows well in the presence of high CO2, and has excellent organoleptic characteristics, was selected as an alternate crop. Tomato crops have been grown using two fertilizer formulations and two pollination techniques, and growth tests using different red:blue lighting environments are underway. Chemical analysis is also being conducted and these data, when coupled with the growth results, will be used to down-select to the two best lighting treatments and best fertilizer treatment for future testing of each crop on the ISS. Additionally, seed-source testing has become important, with mizuna seeds from two different vendors growing very differently. A seed source has been selected, and seed-surface-sanitizing methods have been confirmed for mizuna, but these remain under development for tomato. A crop-handling protocol is also being evaluated to support food safety. All harvests reserve a subset of samples for microbial analysis to determine baseline microbial levels and help establish critical control points for food safety. Testing was initially conducted in hardware analogs of the standard Veggie plant pillows. However, a new Veggie watering system, the Passive Orbital Nutrient Delivery System or PONDS, has been designed and is being prepared for future flight experiments. With the selection of this growth system, ground tests have shifted to analog PONDS systems. Crop tests on ISS, designated VEG-04 for mizuna and VEG-05 for tomato, are planned in 2018 to evaluate any additional impacts of spaceflight on the light and fertilizer conditions down-selected from ground tests. A set of Veggie-specific questions has been developed to characterize the psychological impacts of plant growth and plant-care activities during spaceflight. Organoleptic questionnaires have been developed to assess produce attributes in microgravity taste sessions. These tests for plants growing in the Veggie hardware on ISS will help to mitigate the risk of an inadequate food supply for long duration missions by developing methods and determining hardware requirements to integrate fresh vegetables as a dietary supplement. This research was co-funded by the Human Research Program and Space Biology (MTL1075) in the ILSRA 2015 NRA call.

Veggie↗

Preparation for Pick-and-Eat Food Production on the International Space Station: Flight Definition for the VEG-04 and VEG-05 Missions

Growth of fresh, nutritious, palatable produce for crew consumption during spaceflight may provide health-promoting, bioavailable nutrients and enhance the dietary experience as we move toward longer-duration missions. Tending plants also may serve as a countermeasure for crew psychological stresses associated with long duration spaceflight. However, requirements to support consistent growth of a variety of high quality, nutritious crops under spaceflight environmental conditions is unknown. This study is exploring the potential to grow plants for food production on the International Space Station (ISS) using the Veggie vegetable production system. Ground testing is underway to compare the impacts of several fertilizer and lighting treatments on growth, quality, and nutritional composition of the leafy green crop mizuna, and the dwarf tomato crop "Red Robin" when subjected to Veggie ISS environmental conditions. Early testing focused on the leafy crop "Tokyo Bekana" Chinese cabbage, but ground tests indicated that this plant suffered from stress responses when grown under LEDs and the chronically elevated CO2 levels found on the ISS. Mizuna, a related leafy variety that grows well in the presence of high CO2, and has excellent organoleptic characteristics, was selected as an alternate crop. Tomato crops have been grown using two fertilizer formulations and two pollination techniques, and growth tests using different red:blue lighting environments are underway. Chemical analysis is also being conducted and these data, when coupled with the growth results, will be used to down-select to the two best lighting treatments and best fertilizer treatment for future testing of each crop on the ISS. Additionally, seed-source testing has become important, with mizuna seeds from two different vendors growing very differently. A seed source has been selected, and seed-surface-sanitizing methods have been confirmed for mizuna, but these remain under development for tomato. A crop-handling protocol is also being evaluated to support food safety. All harvests reserve a subset of samples for microbial analysis to determine baseline microbial levels and help establish critical control points for food safety. Testing was initially conducted in hardware analogs of the standard Veggie plant pillows. However, a new Veggie watering system, the Passive Orbital Nutrient Delivery System or PONDS, has been designed and is being prepared for future flight experiments. With the selection of this growth system, ground tests have shifted to analog PONDS systems. Crop tests on ISS, designated VEG-04 for mizuna and VEG-05 for tomato, are planned in 2018 to evaluate any additional impacts of spaceflight on the light and fertilizer conditions down-selected from ground tests. A set of Veggie-specific questions has been developed to characterize the psychological impacts of plant growth and plant-care activities during spaceflight. Organoleptic questionnaires have been developed to assess produce attributes in microgravity taste sessions. These tests for plants growing in the Veggie hardware on ISS will help to mitigate the risk of an inadequate food supply for long duration missions by developing methods and determining hardware requirements to integrate fresh vegetables as a dietary supplement. This research was co-funded by the Human Research Program and Space Biology (MTL#1075) in the ILSRA 2015 NRA call.

LED light↗

22 N HPGP Thruster Life Testing

In the ever-changing paradigm of efficient and capable spacecraft design, scientific missions continue pushing the envelope enabling spacecraft subsystems to deliver effective solutions to meet challenging new mission/spacecraft needs. From an in-space storable liquid chemical propulsion perspective, monopropellant hydrazine has been, and continues to be, a dependable propellant with considerable flight heritage, a variety of engine thrust classes available from multiple vendors, with repeatable and reliable performance. Additionally, the space propulsion industry has learned to successfully handle hydrazine, its regulations, the safety protocols, the personnel protective equipment, and the unique training standards–all requisite for loading spacecraft propulsion systems with toxic hypergolic hydrazine. The question now arises as to “what is next for in-space chemical propulsion?” Further, with the evolution and concrete advancements in innovative in-space green propellant technologies, capable of providing realizable benefits to scientific missions, concern over the reliability and availability of this higher performing and safer to handle class of propellants is waning. As science missions move forward with the potential flight in fusion of High Performance Green Propulsion (HPGP), NASA and its industry partners are working to address any gaps in system reliability, performance, or unique operational considerations. Propellant technology that offers both higher performance and significant reduction in personnel hazards compared to hydrazine presents an attractive propulsion subsystem design opportunity. Increased propulsion subsystem performance can result in lower spacecraft launch mass, larger scientific payloads, or extended on-orbit lifetimes. Mission trades using green propulsion technologies have been documented on multiple NASA Goddard Space Flight Center (GSFC) mission classes, examining various parameters and requirements to support mission architectures in Low Earth Orbit (LEO), High Earth Orbit (HEO), geostationary, lunar, planetary, and Quasi-halo orbit around Sun-Earth Lagrange point (L2). The results of these trade studies show promising, attainable benefits. The perceived programmatic risk of flying a newer propulsion technology has, unfortunately, not outweighed the benefits to date. To take advantage of the improved performance and mitigate programmatic risk, HPGP engines must demonstrate life testing at higher propellant throughputs than have currently been demonstrated. In an effort to proactively address the challenges with technology infusion into a risk-averse community, NASA and the Swedish National Space Agency (SNSA) outlined a collaborative Implementing Arrangement (IA) for the respective agencies to pursue increased HPGP technology maturation. This initial IA effort began in 2013, fresh off the heels of the successful PRISMA HPGP technology demonstration mission. The IA targeted objective is to reduce risk to potential future HPGP missions and fully characterize the LMP-103S propellant and associated engine performance. Over the past eight years, HPGP has flown in propulsion systems on twenty-five(25) spacecraft from seven(7) different Launch Ranges around the globe and on seven (7) different Launch Vehicles. Six(6) of these launches involved multiple loading operations for multiple spacecraft. For U.S. Range operations, nine (9) HPGP systems have been processed at Vandenberg Space Force Base(VSFB):six(6) in 2017, and three (3) in 2018. Six (6) more have been processed at Cape Canaveral Air Force Station (CCAFS)in May 2020, with three (3) systems launched in June 2020 and the remaining three (3) system were left loaded and ready until their launch in August of 2020. Three (3) more systems have been processed at Wallops Flight Facility(WFF)and launched in June 2021. In addition, these propulsion subsystems employed heritage propulsion subsystem component such as valves, filters, and pressure transducers, and have further demonstrated nominal functionality in both diaphragm and Propellant Management Device (PDM) propellant tanks. Based on these successes, HPGP technology continues to be considered for NASA Science Mission Directorate missions at GSFC. The work presented herein represents many years of development and collaborative efforts to successfully align higher performance, low toxicity hydrazine alternatives into scientific missions. NASA GSFC Propulsion Engineering, in collaboration with Bradford ECAPS, has developed mission specific thruster design and testing requirements to establish GSFC’s desired test conditions and firing sequences.In2017, the first flight-like 22N HPGP thruster Engineering Qualification Model (EQM-1)was designed and built by Bradford ECAPS to prove out the thruster design, materials, build process, and test campaign with respect to NASA GSFC critical component and mission requirements. This test program was developed to comprehensively test the thruster, the technology, and ultimately increase the 22N HPGP Technology Readiness Level(TRL). EQM-1was tested to environmental qualification levels prior to hot fire performance testing to represent the relevant end-to-end environment (launch to on-orbit operation)with required margin. This thruster demonstrated steady-state and pulse mode operational capability with propellant thruster throughput up to~53kg.At this throughput level, the EQM-1 engine began to present off-nominal performance and the test campaign was halted to allow for non-destructive testing and identify the root cause for the an omalous performance. Capitalizing on the successful elements of the EQM-1 campaign, an upgraded 22N HPGP EQM-2 has been manufactured by Bradford ECAPS to meet the complete GSFC requirements. The EQM-2 thruster’s test campaign has further demonstrated the robustness of the HPGP propulsion technology and increased the Technology Readiness Level (TRL) by undergoing a full acceptance test program, then proceeding into qualification, including environmental testing (vibration and shock to qualification levels),as well as hot-fire life testing, operating at steady-state and pulse modes with increased propellant thruster throughput to~150kg. The HPGP thruster performance testing enables effective HPGP thruster readiness evaluation to meet NASA candidate mission requirements in the future.

High↗

Exploitation of a Validation Hierarchy for Modeling and Simulation

Across engineering there is an evolving need to increase reliance on physics-based simulation to develop, design and optimize engineering systems. This increased reliance on modeling and simulation has highlighted a growing need to transform the confidence that modeling and simulation analysts have in their results into credibility for systems engineers to design and field systems more quickly and with less physical testing. For isolated components of a complex system, where a single discipline may drive product design, this is less of a concern as the relationship is often straightforward and easy to explain. However, when these isolated components are integrated, and are expected to operate in a multi-disciplinary context in which safety critical systems are involved, new concepts and model assurance standards are required. In this paper we address this challenge by showing how a model validation hierarchy can be exploited to identify those model validation experiments that will contribute most to increasing confidence and credibility of modeling and simulation predictions. The approach that is adopted contains four main steps. The first step is the construction of a model validation hierarchy that links subsystems, assemblies, and components to a hierarchy of physical experiments that can be used support model validation. This hierarchy connects the concerns of systems engineers to those of the modeling and simulation analyst in a clear and logical way. The structure and content of this hierarchy is then used in a second step to establish which physical phenomena have the greatest impact on overall system performance metrics. A gap analysis technique, based upon modeling and simulation concerns, is then used to prioritize the important physical phenomenon. Unfortunately, a common outcome of such gap analyses is the identification of many important gaps and so, in the final step of our process, we advocate the use of a global sensitivity analysis as a means to complete the prioritization.

Verification and Validation↗

Exploitation of a Validation Hierarchy for Modeling and Simulation

Across engineering there is an evolving need to increase reliance on physics-based simulation to develop, design and optimize engineering systems. This increased reliance on modeling and simulation has highlighted a growing need to transform the confidence that modeling and simulation analysts have in their results into credibility for systems engineers to design and field systems more quickly and with less physical testing. For isolated components of a complex system, where a single discipline may drive product design, this is less of a concern as the relationship is often straightforward and easy to explain. However, when these isolated components are integrated, and are expected to operate in a multi-disciplinary context in which safety critical systems are involved, new concepts and model assurance standards are required. In this paper we address this challenge by showing how a model validation hierarchy can be exploited to identify those model validation experiments that will contribute most to increasing confidence and credibility of modeling and simulation predictions. The approach that is adopted contains four main steps. The first step is the construction of a model validation hierarchy that links subsystems, assemblies, and components to a hierarchy of physical experiments that can be used support model validation. This hierarchy connects the concerns of systems engineers to those of the modeling and simulation analyst in a clear and logical way. The structure and content of this hierarchy is then used in a second step to establish which physical phenomena have the greatest impact on overall system performance metrics. A gap analysis technique, based upon modeling and simulation concerns, is then used to prioritize the important physical phenomenon. Unfortunately, a common outcome of such gap analyses is the identification of many important gaps and so, in the final step of our process, we advocate the use of a global sensitivity analysis as a means to complete the prioritization.

Verification and Validation↗

Perceive: Proactive Exploration of Risky Concept Emergence for Identifying Vulnerabilities & Exposures

National databases that collect various kinds of textual threat reports such as ASRS, CERT, and NVD manually process their reports individually. They then offer data products to disseminate the aggregate information, like newsletters, alerts or individual report searching. The goal of this research is to connect these individual reports thematically and temporally to identify emerging or recurring threats, by analyzing large collections of text, source code, collaboration and communication patterns. This capability, I argue, enables us to identify the emergence and recurrence of such themes, and the contexts in which they re-occur, facilitating faster and more capable mitigation. I propose two models to shed light on this goal: An empirical model of vulnerabilities as bugs, the commit flow model, and one of the vulnerabilities and aviation safety threats as topics, the topic flow model. I use as gold standard existing manual workflows in both domains, reflected in the existing data products by these organizations, and empirically evaluate if the automated model scan match or outperform existing manual practices.

ASRS↗