Search NASA⌕ Search

SEARCH · Search NASA

Results for “Systems Engineering and Program Integration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

1,582 records · Page 88

Connecting Research and Practice: An Experience Report on Research Infusion with SAVE

NASA systems need to be highly dependable to avoid catastrophic mission failures. This calls for rigorous engineering processes including meticulous validation and verification. However, NASA systems are often highly distributed and overwhelmingly complex, making the software portion of these systems challenging to understand, maintain, change, reuse, and test. NASA's systems are long-lived and the software maintenance process typically constitutes 60-80% of the total cost of the entire lifecycle. Thus, in addition to the technical challenges of ensuring high life-time quality of NASA's systems, the post-development phase also presents a significant financial burden. Some of NASA's software-related challenges could potentially be addressed by some of the many powerful technologies that are being developed in software research laboratories. Many of these research technologies seek to facilitate maintenance and evolution by for example architecting, designing and modeling for quality, flexibility, and reuse. Other technologies attempt to detect and remove defects and other quality issues by various forms of automated defect detection, architecture analysis, and various forms of sophisticated simulation and testing. However promising, most such research technologies nevertheless do not make the transition from the research lab to the software lab. One reason the transition from research to practice seldom occurs is that research infusion and technology transfer is difficult. For example, factors related to the technology are sometimes overshadowed by other types of factors such as reluctance to change and therefore prohibits the technology from sticking. Successful infusion might also take very long time. One famous study showed that the discrepancy between the conception of the idea and its practical use was 18 years plus or minus three. Nevertheless, infusing new technology is possible. We have found that it takes special circumstances for such research infusion to succeed: 1) there must be evidence that the technology works in the practitioner's particular domain, 2) there must be a potential for great improvements and enhanced competitive edge for the practitioner, 3) the practitioner has to have strong individual curiosity and continuous interest in trying out new technologies, 4) the practitioner has to have support on multiple levels (i.e. from the researchers, from management, from sponsors etc), and 5) to remain infused, the new technology has to be integrated into the practitioner's processes so that it becomes a natural part of the daily work. NASA IV&V's Research Infusion initiative sponsored by NASA's Office of Safety & Mission Assurance (OSMA) through the Software Assurance Research Program (SARP), strives to overcome some of the problems related to research infusion.

Lindvall, Mikael↗

Graphical User Interface Development for Representing Air Flow Patterns

In the Turbine Branch, scientists carry out experimental and computational work to advance the efficiency and diminish the noise production of jet engine turbines. One way to do this is by decreasing the heat that the turbine blades receive. Most of the experimental work is carried out by taking a single turbine blade and analyzing the air flow patterns around it, because this data indicates the sections of the turbine blade that are getting too hot. Since the cost of doing turbine blade air flow experiments is very high, researchers try to do computational work that fits the experimental data. The goal of computational fluid dynamics is for scientists to find a numerical way to predict the complex flow patterns around different turbine blades without physically having to perform tests or costly experiments. When visualizing flow patterns, scientists need a way to represent the flow conditions around a turbine blade. A researcher will assign specific zones that surround the turbine blade. In a two-dimensional view, the zones are usually quadrilaterals. The next step is to assign boundary conditions which define how the flow enters or exits one side of a zone. way of setting up computational zones and grids, visualizing flow patterns, and storing all the flow conditions in a file on the computer for future computation. Such a program is necessary because the only method for creating flow pattern graphs is by hand, which is tedious and time-consuming. By using a computer program to create the zones and grids, the graph would be faster to make and easier to edit. Basically, the user would run a program that is an editable graph. The user could click and drag with the mouse to form various zones and grids, then edit the locations of these grids, add flow and boundary conditions, and finally save the graph for future use and analysis. My goal this summer is to create a graphical user interface (GUI) that incorporates all of these elements. I am writing the program in Java, a language that is portable among platforms, because it can run on different operating systems such as Windows and Unix without having to be rewritten. I had no prior experience of programming in Java at the start of my internship; I am continuously learning as I create the program. I have written the part of the program that enables a user to draw several zones, edit them, and store their locations. The next phase of my project is to allow the user to click on the side of a zone and create a boundary condition for it. A previous intern wrote a program that allows the user to input boundary conditions. I can integrate the two programs to create a larger, more usable program. After that, I will develop a way for the user to save the graph for future reference. Another eventual goal is to make the GUI capable of creating three-dimensional zones as well. Researchers such as my mentor, Dr. David Ashpis, need a quick, user-friendly

Chaudhary, Nilika↗

A Systems Analysis Approach to Understanding the Physiological Adaptation to Spaceflight

This book is a summary of interdisciplinary research (physiology, space medicine, engineering, computer science, mathematics) that spans two decades (1972-1992). The research was an attempt to use systems analysis, mathematical modeling, computer simulations, and database systems to integrate the biomedical spaceflight data that was being collected during this period. The goal of the effort was to achieve a better understanding of the human physiological response to short-term and long-term space travel. The activity was primarily devoted to analyzing the biomedical results of Skylab (1973-74), a series of three space missions which is still ranked as the most comprehensive of all long-term biomedical space studies to date. This work was begun as a coordinated effort between the National Aeronautics and Space Administration (Johnson Space Center) and the General Electric Company’s Space Division (Houston, TX). It was the intent that this multidisciplined, integrative approach could reveal aspects of the then-new science of microgravity adaptation that were not obvious by adhering to the traditional methodology of examining each organ system in isolation. Some joint work with the Russians, including the Apollo-Soyez test project and a joint bedrest study was also supported during this period. In the 1980’s the systems analysis group’s effort was redirected to support the science management of human and animal experiments on the Space Shuttle. A few examples from this era are also included in the book. Parts of this work have been published elsewhere, presented at technical meetings, and documented in reports with limited distribution. These publications will be referenced throughout the text and the interested reader is advised to use these as resource material where additional details are desired. The intent of this book is not to reproduce these documents but rather to present a coherent view of the integrative analysis under one cover. This volume contains the first detailed publication (other than in internal reports) of an extensive metabolic balance analysis of Skylab data, the development and validation of the “Whole-Body Algorithm,” and simulation studies of diverse hypogravic environments. An analysis of cardiovascular deconditioning and a description of the calcium regulatory model are also new. A long period has passed between the completion of the main body of work represented in this book and its publication in this form. It was inevitable that new research efforts would lead to developments related to the spaceflight problems addressed and thereby make some of our biomedical conclusions obsolete. Although in some cases reference to more recent work have been included, for the most part this book should be considered an historical summary demonstrating the approach and utility of systems analysis and computer modeling in the NASA Life Sciences program at the time the studies were conducted.

Leonard, Joel I.↗

Instantaneous velocity field imaging instrument for supersonic reacting flows

The technical tasks conducted to develop and demonstrate a new gas velocity measurement technique for high enthalpy reacting flows is described. The technique is based on Doppler-shifted Planar Laser-induced Fluorescence (PLIF) imaging of the OH radical. The imaging approach permits, in principle, single-shot measurements of the 2-D distribution of a single velocity component in the measurement plane, and is thus a technique of choice for applications in high enthalpy transient flow facilities. In contrast to previous work in this area, the present program demonstrated an approach which modified the diagnostic technique to function under the constraints of practical flow conditions of engineering interest, rather than vice-versa. In order to accomplish the experimental demonstrations, the state-of-the-art in PLIF diagnostic techniques was advanced in several ways. Each of these tasks is described in detail and is intended to serve as a reference in supporting the transition of this new capability to the fielded PLIF instruments now installed at several national test facilities. Among the new results of general interest in LlF-based flow diagnostics, a detailed set of the first measurements of the collisional broadening and shifting behavior of OH (1,0) band transitions in H7-air combustion environments is included. Such measurements are critical in the design of a successful strategy for PLIF velocity imaging; they also relate to accurate concentration and temperature measurements, particularly in compressible flow regimes. Furthermore, the results shed new light on the fundamental relationship between broadening and energy transfer collisions in OH A(sup 2)Sigma(+)v(sup ') = 1. The first single-pulse, spectrally-resolved measurements of the output of common pulsed dye lasers were also produced during the course of this effort. As with the OH broadening measurements, these data are a significant aspect of a successful velocity imaging strategy, and also have potential implications for many other LIF measurement techniques. Our results indicated the need to modify the commercially available laser cavity in order to accommodate the constraints imposed by typical SCRAMJET combustion characteristics as well as to increase the instrument's velocity dynamic range to span an intra-image range in excess of 2 km/s. The various technical efforts were brought together in a series of experiments demonstrating the applicability of the technique in a high pressure, high temperature H2-air combustion system. The resultant images were compared with 2-D flow simulations in order to determine the accuracy of the instrument. Mean velocity imaging in flows with an axis of symmetry was demonstrated with an accuracy of +/- 50 m/s out of an intra-image dynamic range of 1600 m/s, including reversed flow. A more complex configuration amenable to single-shot imaging in flows without an axis of symmetry was also demonstrated. Limitations imposed by available equipment resulted in an accuracy of about +/- 200 m/s out of 1750 m/s in these demonstrations. Minor modifications to the present configuration were suggested to improve this performance. Each technical task is described in detail, along with significance of the results for the overall imaging velocimeter configuration. This report should allow the user community to integrate this new measurement capability in their existing instrumentation platforms.

Allen, M. G.↗

The Rapid Response Radiation Survey (R3S) Mission Using the HiSat Conformal Satellite Architecture

The Rapid Response Radiation Survey (R3S) experiment, designed as a quick turnaround mission to make radiation measurements in Low Earth Orbit (LEO), will fly as a hosted payload in partnership with NovaWurks using their Hyper-integrated Satlet (HISat) architecture. The need for the mission arises as the Nowcast of Atmospheric Ionization Radiation for Aviation Safety (NAIRAS) model moves from a research effort into an operational radiation assessment tool. Currently, airline professionals are the second largest demographic of radiation workers and to date their radiation exposure is undocumented in the USA. The NAIRAS model seeks to fill this information gap. The data collected by R3S, in addition to the complementary data from a NASA Langley Research Center (LaRC) atmospheric balloon mission entitled Radiation Dosimetry Experiment (RaD-X), will validate exposure prediction capabilities of NAIRAS. The R3S mission collects total dose and radiation spectrum measurements using a Teledyne μDosimeter and a Liulin-6SA2 LED spectrometer. These two radiation sensors provide a cross correlated radiometric measurement in combination with the Honeywell HMR2300 Smart Digital Magnetometer. The magnetometer assesses the Earth's magnetic field in the LEO environment and allows radiation dose to be mapped as a function of the Earth's magnetic shielding. R3S is also unique in that the radiation sensors will be exposed on the outer surface of the spacecraft, possibly making this the first measurements of the LEO radiation environment with bare sensors. Viability of R3S as an extremely fast turnaround mission is due, in part, to the nature of the robust, well-defined interfaces of the conformal satellite HiSat Architecture. The HiSat architecture, which was developed with the support of the Defense Advanced Research Projects Agency's (DARPA's) Phoenix Program, enabled the R3S system to advance from the first concept to delivery of preliminary design review (PDR) level documents in 29 calendar days. The architecture allows for interface complexities between the specific devices and the satellite bus to be resolved in a standardized interface control document (ICD). The ICD provided a readymade framework to interface to the modular satellite bus. This modularity allowed for approximately 90% of the R3S system to be designed and fabricated in two months without constraint of the hosting satellite's development cycle. This paper discusses the development of the R3S experiment as made possible by use of the HiSat architecture. The system design and operational modes of the experiment are described, as well as the experiment interfaces to the HiSat satellite via the user defined adapter (UDA) provided by NovaWurks. This paper outlines the steps taken by the project to execute the R3S mission in the 4 months of design, build, and test. Additionally portrayed is the ground work done at LaRC to posture the organization for a fast response and the process by which the opportunity was identified as aligning with key strategic goals. Finally, a description of the engineering process is provided, including the use of facilitated rapid/concurrent engineering sessions, the associated documentation, and the review process employed.

Miller, Nathanael A.↗

NASA's Space Launch System: Deep-Space Delivery for Smallsats

Designed for human exploration missions into deep space, NASA's Space Launch System (SLS) represents a new spaceflight infrastructure asset, enabling a wide variety of unique utilization opportunities. While primarily focused on launching the large systems needed for crewed spaceflight beyond Earth orbit, SLS also offers a game-changing capability for the deployment of small satellites to deep-space destinations, beginning with its first flight. Currently, SLS is making rapid progress toward readiness for its first launch in two years, using the initial configuration of the vehicle, which is capable of delivering 70 metric tons (t) to Low Earth Orbit (LEO). On its first flight test of the Orion spacecraft around the moon, accompanying Orion on SLS will be small-satellite secondary payloads, which will deploy in cislunar space. The deployment berths are sized for "6U" CubeSats, and on EM-1 the spacecraft will be deployed into cislunar space following Orion separate from the SLS Interim Cryogenic Propulsion Stage. Payloads in 6U class will be limited to 14 kg maximum mass. Secondary payloads on EM-1 will be launched in the Orion Stage Adapter (OSA). Payload dispensers will be mounted on specially designed brackets, each attached to the interior wall of the OSA. For the EM-1 mission, a total of fourteen brackets will be installed, allowing for thirteen payload locations. The final location will be used for mounting an avionics unit, which will include a battery and sequencer for executing the mission deployment sequence. Following the launch of EM-1, deployments of the secondary payloads will commence after sufficient separation of the Orion spacecraft to the upper stage vehicle to minimize any possible contact of the deployed CubeSats to Orion. Currently this is estimated to require approximately 4 hours. The allowed deployment window for the CubeSats will be from the time the upper stage disposal maneuvers are complete to up to 10 days after launch. The upper stage will fly past the moon at a perigee of approximately 100km, and this closest approach will occur about 5 days after launch. The limiting factor for the latest deployment time is the available power in the sequencer system. Several NASA Mission Directorates were involved in the development of programs for the competition, selection, and development of EM-1 payloads that support directorate priorities. CubeSat payloads on EM-1 will include both NASA research experiments and spacecraft developed by industry, international and potentially academia partners. The Human Exploration and Operations Mission Directorate (HEOMD) Advanced Exploration Systems (AES) Division was allocated five payload opportunities on the EM-1 mission. Near Earth Asteroid (NEA) Scout is designed to rendezvous with and characterize a candidate NEA. A solar sail, an innovation the spacecraft will demonstrated for the CubeSat class, will provide propulsion. Lunar Flashlight will use a green propellant system and will search for potential ice deposits in the moon's permanently shadowed craters. BioSentinel is a yeast radiation biosensor, planned to measure the effects of space radiation on deoxyribonucleic acid (DNA). Lunar Icecube, a collaboration with Morehead State University, will prospect for water in ice, liquid, and vapor forms as well as other lunar volatiles from a low-perigee, highly inclined lunar orbit using a compact Infrared spectrometer. Skyfire, a partnership with Lockheed Martin, is a technology demonstration mission that will perform a lunar flyby, collecting spectroscopy, and thermography data to address questions related to surface characterization, remote sensing, and site selection. NASA's Space Technology Mission Directorate (STMD) was allocated three payload opportunities on the EM-1 mission. These slots will be filled via the Centennial Challenges Program, NASA's flagship program for technology prize competitions, which directly engages the public, academia, and industry in open prize competitions to stimulate innovation. The NASA Science Mission Directorate (SMD) was allocated two payload opportunities on the EM-1 mission. The CubeSat Mission to Study Solar Particles (CuSP) payload will study the sources and acceleration mechanisms of solar and interplanetary particles in near-Earth orbit, support space weather research by determining proton radiation levels during Solar Energetic Particle (SEP) events and identifying suprathermal properties that could help predict geomagnetic storms. The LunaH-Map payload will help scientists understand the quantity of H-bearing materials in lunar cold traps (~10 km), determine the concentration of H-bearing materials with 1m depth, and constrain the vertical distribution of H-bearing materials. The final three payload opportunities for the EM-1 mission were allocated for NASA's international space agency counterparts. The flight opportunities are intended to benefit the international space agency and NASA as well as further the collective space exploration goals. ArgoMoon is sponsored by ESA/ASI and will fly along with the ICPS on its disposal trajectory to perform proximity operations with the ICPS post-disposal, take external imagery of engineering and historical significance, and perform an optical communications demonstration. EQUULEUS, sponsored by JAXA, will fly to a libration orbit around the Earth-Moon L2 point and demonstrate trajectory control techniques within the Sun-Earth- Moon region for the first time by a nano spacecraft. The mission will also contribute to the future human exploration scenario by understanding the radiation environment in geospace and deep space, characterizing the flux of impacting meteors on the far side of the moon, and demonstrating the future deep space exploration scenario using the "deep space port" at Lagrange points. OMOTENASHI, also sponsored by JAXA, will land the smallest lunar lander to date on the lunar surface to demonstrate the feasibility of the hardware for distributed cooperative exploration system. Small landers will enable multi-point exploration, which is complimentary with large-scale human exploration. Once on the lunar surface, the OMOTENASHI spacecraft will observe the radiation and soil environments of the lunar surface by active radiation measurements and soil shear measurements. Following EM-1, Space Launch System will evolve to the more-powerful Block 1B configuration, which uses a new Exploration Upper Stage to increase the vehicle's LEO payload capability from 70 t to 105 t. With that transition, the Orion Stage Adapter, which will carry the secondary payloads on EM-1, will be phased out, and a new Universal Stage Adapter will be introduced, creating opportunities for flying larger secondary payloads. This paper will provide a brief status of SLS progress toward first launch; an overview of smallsat accommodations, integration, and operations on EM-1; information about the specific payloads flying on that launch; and a discussion of future accommodations and opportunities for secondary payloads on SLS for Exploration Mission-2 and beyond.

Robinson, Kimberly F.↗

NASA's Space Launch System: Deep-Space Opportunities for SmallSats

Designed for human exploration missions into deep space, NASA's Space Launch System (SLS) represents a new spaceflight infrastructure asset, enabling a wide variety of unique utilization opportunities. While primarily focused on launching the large systems needed for crewed spaceflight beyond Earth orbit, SLS also offers a game-changing capability for the deployment of small satellites to deep-space destinations, beginning with its first flight. Currently, SLS is making rapid progress toward readiness for its first launch in two years, using the initial configuration of the vehicle, which is capable of delivering 70 metric tons (t) to Low Earth Orbit (LEO). On its first flight test of the Orion spacecraft around the moon, accompanying Orion on SLS will be small-satellite secondary payloads, which will deploy in cislunar space. The deployment berths are sized for "6U" CubeSats, and on EM-1 the spacecraft will be deployed into cislunar space following Orion separate from the SLS Interim Cryogenic Propulsion Stage. Payloads in 6U class will be limited to 14 kg maximum mass. Secondary payloads on EM-1 will be launched in the Orion Stage Adapter (OSA). Payload dispensers will be mounted on specially designed brackets, each attached to the interior wall of the OSA. For the EM-1 mission, a total of fourteen brackets will be installed, allowing for thirteen payload locations. The final location will be used for mounting an avionics unit, which will include a battery and sequencer for executing the mission deployment sequence. Following the launch of EM-1, deployments of the secondary payloads will commence after sufficient separation of the Orion spacecraft to the upper stage vehicle to minimize any possible contact of the deployed cubesats to Orion. Currently this is estimated to require approximately 4 hours. The allowed deployment window for the cubesats will be from the time the upper stage disposal maneuvers are complete to up to 10 days after launch. The upper stage will fly past the moon at a perigee of approximately 100km, and this closest approach will occur about 5 days after launch. The limiting factor for the latest deployment time is the available power in the sequencer system. Several NASA Mission Directorates were involved in the development of programs for the competition, selection, and development of EM-1 payloads that support directorate priorities. CubeSat payloads on EM-1 will include both NASA research experiments and spacecraft developed by industry, international and potentially academia partners. The Human Exploration and Operations Mission Directorate (HEOMD) Advanced Exploration Systems (AES) Division was allocated five payload opportunities on the EM-1 mission. Near Earth Asteroid (NEA) Scout is designed to rendezvous with and characterize a candidate NEA. A solar sail, an innovation the spacecraft will demonstrated for the CubeSat class, will provide propulsion. Lunar Flashlight will use a green propellant system and will search for potential ice deposits in the moon's permanently shadowed craters. BioSentinel is a yeast radiation biosensor, planned to measure the effects of space radiation on deoxyribonucleic acid (DNA). Lunar Icecube, a collaboration with Morehead State University, will prospect for water in ice, liquid, and vapor forms as well as other lunar volatiles from a low-perigee, highly inclined lunar orbit using a compact Infrared spectrometer. Skyfire, a partnership with Lockheed Martin, is a technology demonstration mission that will perform a lunar flyby, collecting spectroscopy, and thermography data to address questions related to surface characterization, remote sensing, and site selection. NASA's Space Technology Mission Directorate (STMD) was allocated three payload opportunities on the EM-1 mission. These slots will be filled via the 2 Centennial Challenges Program, NASA's flagship program for technology prize competitions, which directly engages the public, academia, and industry in open prize competitions to stimulate innovation. The NASA Science Mission Directorate (SMD) was allocated two payload opportunities on the EM-1 mission. The CubeSat Mission to Study Solar Particles (CuSP) payload will study the sources and acceleration mechanisms of solar and interplanetary particles in near-Earth orbit, support space weather research by determining proton radiation levels during Solar Energetic Particle (SEP) events and identifying suprathermal properties that could help predict geomagnetic storms. The LunaH-Map payload will help scientists understand the quantity of H-bearing materials in lunar cold traps (~10 km), determine the concentration of H-bearing materials with 1m depth, and constrain the vertical distribution of H-bearing materials. The final three payload opportunities for the EM-1 mission were allocated for NASA's international space agency counterparts. The flight opportunities are intended to benefit the international space agency and NASA as well as further the collective space exploration goals. ArgoMoon is sponsored by ESA/ASI and will fly along with the ICPS on its disposal trajectory to perform proximity operations with the ICPS post-disposal, take external imagery of engineering and historical significance, and perform an optical communications demonstration. EQUULEUS, sponsored by JAXA, will fly to a libration orbit around the Earth-Moon L2 point and demonstrate trajectory control techniques within the Sun-Earth-Moon region for the first time by a nano spacecraft. The mission will also contribute to the future human exploration scenario by understanding the radiation environment in geospace and deep space, characterizing the flux of impacting meteors on the far side of the moon, and demonstrating the future deep space exploration scenario using the "deep space port" at Lagrange points. OMOTENASHI, also sponsored by JAXA, will land the smallest lunar lander to date on the lunar surface to demonstrate the feasibility of the hardware for distributed cooperative exploration system. Small landers will enable multi-point exploration, which is complimentary with large-scale human exploration. Once on the lunar surface, the OMOTENASHI spacecraft will observe the radiation and soil environments of the lunar surface by active radiation measurements and soil shear measurements. Following EM-1, Space Launch System will evolve to the more-powerful Block 1B configuration, which uses a new Exploration Upper Stage to increase the vehicle's LEO payload capability from 70 t to 105 t. With that transition, the Orion Stage Adapter, which will carry the secondary payloads on EM-1, will be phased out, and a new Universal Stage Adapter will be introduced, creating opportunities for flying larger secondary payloads. This paper will provide a brief status of SLS progress toward first launch; an overview of smallsat accommodations, integration, and operations on EM-1; information about the specific payloads flying on that launch; and a discussion of future accommodations and opportunities for secondary payloads on SLS for Exploration Mission-2 and beyond.

Robinson, Kimberly F.↗

Advanced Concept Studies for Supersonic Commercial Transports Entering Service in the 2018-2020 Period Phase 2

Lockheed Martin Aeronautics Company (LM), working in conjunction with General Electric Global Research (GE GR) and Stanford University, executed a 19 month program responsive to the NASA sponsored "N+2 Supersonic Validation: Advanced Concept Studies for Supersonic Commercial Transports Entering Service in the 2018-2020 Period" contract. The key technical objective of this effort was to validate integrated airframe and propulsion technologies and design methodologies necessary to realize a supersonic vehicle capable of meeting the N+2 environmental and performance goals. The N+2 program is aligned with NASA's Supersonic Project and is focused on providing system level solutions capable of overcoming the efficiency, environmental, and performance barriers to practical supersonic flight. The N+2 environmental and performance goals are outlined in the technical paper, AIAA-2014-2138 (Ref. 1) along with the validated N+2 Phase 2 results. Our Phase 2 efforts built upon our Phase 1 studies (Ref. 2) and successfully demonstrated the ability to design and test realistic configurations capable of shaped sonic booms over the width of the sonic boom carpet. Developing a shaped boom configuration capable of meeting the N+2 shaped boom targets is a key goal for the N+2 program. During the LM Phase 1 effort, LM successfully designed and tested a shaped boom trijet configuration (1021) capable of achieving 85 PLdB under track (forward and aft shock) and up to 28 deg off-track at Mach 1.6. In Phase 2 we developed a refined configuration (1044-2) that extended the under 85 PLdB sonic boom level over the entire carpet of 52 deg off-track at a cruise Mach number of 1.7. Further, the loudness level of the configuration throughout operational conditions calculates to an average of 79 PLdB. These calculations rely on propagation employing Burger's (sBOOM) rounding methodology, and there are indications that the configuration average loudness would actually be 75 PLdB. We also added significant fidelity to the design of the configuration in this phase by performing a low speed wind tunnel test at our LTWT facility in Palmdale, by more complete modelling of propulsion effects in our sonic boom analysis, and by refining our configuration packaging and performance assessments. Working with General Electric, LM performed an assessment of the impact of inlet and nozzle effects on the sonic boom signature of the LM N+2 configurations. Our results indicate that inlet/exhaust streamtube boundary conditions are adequate for conceptual design studies, but realistic propulsion modeling at similar stream-tube conditions does have a small but measurable impact on the sonic boom signature. Previous supersonic transport studies have identified aeroelastic effects as one of the major challenges associated with the long, slender vehicles particularly common with shaped boom aircraft (Ref. 3). Under the Phase 2 effort, we have developed a detailed structural analysis model to evaluate the impact of flexibility and structural considerations on the feasibility of future quiet supersonic transports. We looked in particular at dynamic structural modes and flutter as a failure that must be avoided. We found that for our N+2 design in particular, adequate flutter margin existed. Our flutter margin is large enough to cover uncertainties like large increases in engine weight and the margin is relatively easy to increase with additional stiffening mass. The lack of major aeroelastic problems probably derives somewhat from an early design bias. While shaped boom aircraft require long length, they are not required to be thin. We intentionally developed our structural depths to avoid major flexibility problems. So at the end of Phase 2, we have validated that aeroelastic problems are not necessarily endemic to shaped boom designs. Experimental validation of sonic boom design and analysis techniques was the primary objective of the N+2 Supersonic Validations contract; and in this Phase, LM participated in four high speed wind tunnel tests. The first so-called Parametric Test in the Ames 9x7 tunnel did an exhaustive look at variation effects of the parameters: humidity, total pressure, sample time, spatial averaging distance and number of measurement locations, and more. From the results we learned to obtain data faster and more accurately, and made test condition tolerances easy to meet (eliminating earlier 60 percent wasted time when condition tolerances could not be held). The next two tests used different tunnels. The Ames 11 ft tunnel was used to test lower Mach numbers of 1.2 and 1.4. There were several difficulties using this tunnel for the first time for sonic boom including having to shift the measurement Mach numbers to 1.15 and 1.3 to avoid flow problems. It is believed that the 11 ft could be used successfully to measure sonic boom but there are likely to be a number of test condition restrictions. The Glenn 8x6 ft tunnel was used next and the tunnel has a number of desirable features for sonic boom measurement. While the Ames 9x7 can only test Mach 1.55 to 2.55 and the 11 ft can only test Mach 1.3 and lower, the Glenn 8x6 can test continuously from Mach 0.3 to 2.0. Unfortunately test measurement accuracy was compromised by a reference pressure drift. Post-test analysis revealed that the drift occurred when Mach number drifted slightly. Test measurements indicated that if Mach number drift is eliminated, results from the 8x6 would be more accurate, especially at longer distances, than results from the 9x7. The fourth test in the 9x7, called LM4, used everything we learned to comprehensively and accurately measure our new 1044-02 configuration with a full-carpet shaped signature design. Productivity was 8 times greater than our Phase 1 LM3 test. Measurement accuracy and repeatability was excellent out to 42 in. However, measurements at greater distances require the rail in the aft position and become substantially less accurate. Further signature processing or measurement improvements are needed for beyond near-field signature validation.

Morgenstern, John↗

Clinical Decision Support - Concepts of Operation

We are entering a new era in space exploration to return to the moon and explore Mars. These ambitious goals will require significant changes to in-flight and habitat medical care due to constraints on mass, volume, power, crew time and medical evacuation capabilities. These constraints make it absolutely necessary to develop transformative solutions using new technologies. The Exploration Medical Capability (ExMC) Element of the Human Research Program (HRP) pushes the boundary of space medical systems to advance the care of astronauts on future exploration missions beyond low Earth orbit by identifying and testing next-generation medical care and crew health maintenance technologies. The Clinical Decision Support (CDS) project addresses the gap Medical-701 within the Inflight Medical Conditions risk: Enhance medical capabilities within an exploration medical system. For long-duration, deep space missions, computational and data resources will play an important role in maintaining crew health, wellness and performance where the crew will need to be more self-reliant. The aim of the CDS project is to develop and provide recommended requirements for an in-vehicle CDSS that acts as an assistant for delivering optimal health and performance and medical care during exploration missions. The CDSS is envisioned as a software-based tool that will augment a crewmembers’ knowledge, skills and abilities to assist in decision-making and crew health and performance (CHP) management thus increasing CHP systems capabilities. The human interface will be context aware and lessen the cognitive load to assimilate and use information as well as combine large disparate data sets in such a manner that provides the crew with actionable insight to decisions related to crew medical, health and performance management. Crew autonomy will be provided through a CDS that presents knowledge and data in a context aware manner to augment a crew members’ knowledge, skills and abilities during the process of observation, orientation, decisions and action. The CDS project addresses the need for crew members to operate independently during long duration space exploration missions that require medical Levels of Care (LoC) V, the highest level specified by NASA-STD-3001 and described in more detail by the ExMC interpretation of LoC document (NASA/TM-2017-219290), where significant changes to in-flight and habitat medical care necessitate increasing crew autonomy in decision making and task performance. The CDS project will develop and test a series of iterative and increasingly more complex system prototypes. These annual demonstrations of the data system integration with the crew health and performance domain will inform exploration medical system requirements for an on-board Clinical Decision Support System (CDSS) through a series of use cases that guide CDS prototype functionality. CDS concepts are based on ExMC Concept of Operations documents (presented separately) and will highlight architecture extensibility to other more complex analyses and tests using core crew health and performance integrated data management, processing and visualization capabilities. This approach also establishes how externally developed analyses and approaches could be added to expand a clinical decision support system and thus highlight how a comprehensive system can be commercially and/or globally developed. The CDS project will build upon the concept of an integrated data management approach based on the Medical Data Architecture (MDA) project to more fully address challenges associated with in-flight and habitat medical, health and performance care due to constraints on mass, volume, power, crew time and medical evacuation capabilities required for medical LoC V. These requirements will be derived through systems engineering approaches and software prototype developments over the course of the multi-year CDS project to address crew health and performance decision-making and task performance, often autonomously executed by the crew, in a manner that is consistent with the appropriate medical level of care for the mission. This presentation will provide an overview of the vision for the CDS project and highlight the initial accomplishments in project planning, implementation and requirements identification in fiscal year 2020.

clinical decision support↗

Clinical Decision Support - Overview and Update

We are entering a new era in space exploration to return to the moon and explore Mars. These ambitious goals will require significant changes to in-flight and habitat medical care due to constraints on mass, volume, power, crew time and medical evacuation capabilities. These constraints make it absolutely necessary to develop transformative solutions using new technologies. The Exploration Medical Capability (ExMC) Element of the Human Research Program (HRP) pushes the boundary of space medical systems to advance the care of astronauts on future exploration missions beyond low Earth orbit by identifying and testing next-generation medical care and crew health maintenance technologies. The Clinical Decision Support (CDS) project addresses the gap Medical-701 within the Inflight Medical Conditions risk: Enhance medical capabilities within an exploration medical system. For long-duration, deep space missions, computational and data resources will play an important role in maintaining crew health, wellness and performance where the crew will need to be more self-reliant. The aim of the CDS project is to develop and provide recommended requirements for an in-vehicle CDSS that acts as an assistant for delivering optimal health and performance and medical care during exploration missions. The CDSS is envisioned as a software-based tool that will augment a crewmembers’ knowledge, skills and abilities to assist in decision-making and crew health and performance (CHP) management thus increasing CHP systems capabilities. The human interface will be context aware and lessen the cognitive load to assimilate and use information as well as combine large disparate data sets in such a manner that provides the crew with actionable insight to decisions related to crew medical, health and performance management. Crew autonomy will be provided through a CDS that presents knowledge and data in a context aware manner to augment a crew members’ knowledge, skills and abilities during the process of observation, orientation, decisions and action. The CDS project addresses the need for crew members to operate independently during long duration space exploration missions that require medical Levels of Care (LoC) V, the highest level specified by NASA-STD-3001 and described in more detail by the ExMC interpretation of LoC document (NASA/TM-2017-219290), where significant changes to in-flight and habitat medical care necessitate increasing crew autonomy in decision making and task performance. The CDS project will develop and test a series of iterative and increasingly more complex system prototypes. These annual demonstrations of the data system integration with the crew health and performance domain will inform exploration medical system requirements for an on-board Clinical Decision Support System (CDSS) through a series of use cases that guide CDS prototype functionality. CDS concepts are based on ExMC Concept of Operations documents (presented separately) and will highlight architecture extensibility to other more complex analyses and tests using core crew health and performance integrated data management, processing and visualization capabilities. This approach also establishes how externally developed analyses and approaches could be added to expand a clinical decision support system and thus highlight how a comprehensive system can be commercially and/or globally developed. The CDS project will build upon the concept of an integrated data management approach based on the Medical Data Architecture (MDA) project to more fully address challenges associated with in-flight and habitat medical, health and performance care due to constraints on mass, volume, power, crew time and medical evacuation capabilities required for medical LoC V. These requirements will be derived through systems engineering approaches and software prototype developments over the course of the multi-year CDS project to address crew health and performance decision-making and task performance, often autonomously executed by the crew, in a manner that is consistent with the appropriate medical level of care for the mission. This presentation will provide an overview of the vision for the CDS project and highlight the initial accomplishments in project planning, implementation and requirements identification in fiscal year 2020.

clinical decision support system↗

2015 Space Radiation Standing Review Panel

The 2015 Space Radiation Standing Review Panel (from here on referred to as the SRP) met for a site visit in Houston, TX on December 8 - 9, 2015. The SRP met with representatives from the Space Radiation Element and members of the Human Research Program (HRP) to review the updated research plan for the Risk of Radiation Carcinogenesis Cancer Risk. The SRP also reviewed the newly revised Evidence Reports for the Risk of Acute Radiation Syndromes Due to Solar Particle Events (SPEs) (Acute Risk), the Risk of Acute (In-flight) and Late Central Nervous System Effects from Radiation Exposure (CNS Risk), and the Risk of Cardiovascular Disease and Other Degenerative Tissue Effects from Radiation (Degen Risk), as well as a status update on these Risks. The SRP would like to commend Dr. Simonsen, Dr. Huff, Dr. Nelson, and Dr. Patel for their detailed presentations. The Space Radiation Element did a great job presenting a very large volume of material. The SRP considers it to be a strong program that is well-organized, well-coordinated and generates valuable data. The SRP commended the tissue sharing protocols, working groups, systems biology analysis, and standardization of models. In several of the discussed areas the SRP suggested improvements of the research plans in the future. These include the following: It is important that the team has expanded efforts examining immunology and inflammation as important components of the space radiation biological response. This is an overarching and important focus that is likely to apply to all aspects of the program including acute, CVD, CNS, cancer and others. Given that the area of immunology/inflammation is highly complex (and especially so as it relates to radiation), it warrants the expansion of investigators expertise in immunology and inflammation to work with the individual research projects and also the NASA Specialized Center of Research (NSCORs). Historical data on radiation injury to be entered into the Watson “big data” study must be used with caution. The general scientific issues of reproducibility, details of experimental methods and data analysis from preclinical and basic research laboratories have been raised broadly over the last few years (not specific to this work) and indicate that caution must be applied in the ways these data are used. This pertains to preclinical data and also to phase 3 clinical trials in radiation oncology and medical oncology. Of course, appropriate use and analysis of these “big-data” sets also offer the potential of pinpointing limitations and extracting remaining useful information. Emphasis should be placed on the latter possibility. A key target is risk reduction from radiation exposure. Progress of the entire space program, now moving towards the Mars mission, requires timely answers to key components of human risk, which are known to be complex. Periodic review of progress should be conducted with additional resources directed into achieving critical milestones. Turning the long red bars to yellow and green (or for some risks such as CNS possibly to grey) must be high priority. That such progress will require new science and not engineering means that it should be viewed in a knowledge-based light. The technology-based aspects of engineering issues are certainly as important, however, science and knowledge-based problems are solved in a different way than engineering. Timelines for engineering are more predictable, while for science, progress can be methodical with occasional major incremental findings that can rapidly change the rate of progress. As opportunities for rapid incremental changes arise, periodic enhancement of investment is strongly recommended to enable such new knowledge to be quickly and efficiently exploited. Collaborations and linkages with National Institute of Allergy and Infectious Diseases (NIAID), the Biomedical Advanced Research and Development Authority (BARDA) and the Department of Defense (DoD) are in place and more are encouraged, where possible, with the radiation injury and medical countermeasure studies. This could include utilizing some of their animal model testing contracts to facilitate obtaining results using common platforms. Such approach will facilitate the comparison of results among laboratories, and will facilitate and accelerate the development of medical countermeasures. It is particularly noteworthy that the NASA Space Radiation Element is reaching out to the Multidisciplinary European Low Dose Initiative (MELODI) platform coordinating low dose radiation risk research, and to other international agencies that are studying low dose radiation effects in an effort to fill the void generated by the cancelation of the Department of Energy (DOE) low dose radiation program. While NASA is working actively with NIAID and BARDA to integrate their relevant findings of radiation mitigator investigations to NASA programs, the committee notes its disappointment that the United States currently lacks a dedicated low dose radiation program with clear mechanistic orientation and aimed at the quantification and mitigation of human radiation risk on Earth. This void gives to the NASA Space Radiation Program Element special societal value, but also makes its overall design more challenging.

Steinberg, Susan↗

NASA Earth Systems Digital Twins (ESDT)

"Similarly to artificial intelligence, which is now revolutionizing many aspects of our daily lives, Earth system digital twin technologies have the potential to revolutionize the way Earth Science research will be conducted in the future, and how results and knowledge from this research will provide information to support decision making and yield impactful societal benefits. An Earth System Digital Twin or ESDT is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system as accurately and timely as possible; second, allows for computing forecasts of future states under nominal assumptions and based on the current replica; and third, offers the capability to investigate many hypothetical scenarios under varying impact assumptions. In other words, an ESDT provides the integrated What-Now, What-Next, and What-If pictures of the Earth or Earth system, by continuously ingesting newly observed data and by leveraging multiple interconnected models, machine learning as well advanced computing and visualization capabilities. Digital twins have been developed in engineering since 2002, but the interest in digital twins for the Earth domain is more recent and stems from the convergence of several developments: - The huge amount of diverse data that has now been collected continuously for more than 50 years, and that is becoming more and more difficult to access, understand, and utilize. - At the same time, because of climate change and its impacts the information produced by all of this data is becoming of interest to many new non-traditional users for analyzing and predicting various phenomena. - Because of advances in computational and visualization capabilities and the parallel unprecedented development of machine learning (ML), extracting relevant information from these large amounts of data and running complex models faster has become possible. As a result, it is becoming necessary and possible to build intuitive and interactive frameworks that will enable users with various skill levels and/or organizational hierarchy levels to easily access large amounts of targeted information along with the relevant tools and models (Earth system and human activity models), to support them in analyzing and visualizing this information, to help them understand interactions among models, to visualize the potential outcomes of various impacts, and to support decision or policy making. The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. With all these interests at stake, the challenges of building optimal digital twins are many and complex. The first challenge is to determine if a Digital Twin should be global or local, and multi-domain or thematic. For example, some domains such as Climate or Weather will require a global Digital Twin or Digital Twin capabilities while science areas such as Biodiversity might be more local. We can also envision that multiple thematic ESDTs, e.g., Air Quality, Wildfires, Hydrology could be federated or provide input to other ESDTs, either on a regional level or to a more global ESDT. Overall, we can imagine a future “web” of Digital Twins co-existing in a hierarchy or in a network, and capable of being connected or federated depending on the needs. This last point brings up the very important challenge of interoperability, including standards and protocols that will need to be built into these systems from the beginning. Each individual digital twin would have full flexibility in internal construction but would need standards-based interfaces (input and output) or hooks to make it compatible with others. Another challenge when building digital twins will be to decide how to organize each digital replica. Based on the applications targeted by the DT under implementation, various amounts and types of raw data, Analysis Ready Data (ARD) and information will need to be incorporated. Depending on the required latencies and needs of the users, various solutions can be considered, including Data Cubes, Data Lakes, pointers, or computing information on demand. We envision that each ESDT will choose a solution adapted to its specific objectives. Another important challenge is the type(s) of visualization that will be used, as well as the level of interactivity and refresh rate that will be required. Again, this will depend on the objectives of the ESDT, but also on the various users’ needs. In most cases, several types of visualizations and human interfaces will need to be offered depending on the projected users of that system. In parallel to the challenges highlighted above, there are also many tools and technologies that will need to be developed or improved for all types of digital twins. Among those are improved machine learning technologies, for example providing explainability, but also ML techniques for causality and providing a better integration of physics models. Additionally, reliable uncertainty quantification methods will be needed for all ESDT components, from validating data fusion and assimilation to assessing the accuracy of ML models and weighing the values of decisions supported by those systems. This presentation introduces the ESDT concept, presents several ESDT use cases, and a proposed ESDT architecture framework, as well as various technologies being developed by the Advanced Information Systems Technology (AIST) Program."

Earth Science Remote Sensing; Information Systems↗

Harnessing Artificial Intelligence for Medical Diagnosis and Treatment During Space Exploration Missions

From May 8th to June 9th, 2023, I had the opportunity to participate in an experiential learning experience at Johnson Space Center in Houston, TX with Exploration Medical Capability (ExMC), an element of the NASA Human Research Program. During this research experience, I was not only able to work on the above titled research project, but also gain an immense exposure to the field of aerospace medicine, make numerous connections within the field, tour NASA facilities, as well as travel to the Aerospace Medical Association Annual Conference (AsMA) in New Orleans. To briefly introduce my project, it is well understood that the medical capabilities available to crew medical officers (CMOs) on the International Space Station will be different than the capabilities available and needed during deep space exploration missions to the Moon, Mars, and beyond. Ground support is particularly limited due to distance, communication delays (or lack of communication), and lack of resupply. Therefore, to support medical care by CMOs on these missions, robust clinical decision support systems (CDSSs) must be designed. The recent publication and public launch of generative artificial intelligence (AI) tools based upon large language models (LLM) such as ChatGPT provides the opportunity to create a smart assistant for onboard triage, diagnosis, and treatment of medical conditions. Ultimately, the overall purpose of the project was to research what AI tools currently exist or are in development, and to see how they might be implemented onboard during exploration class spaceflights of the future. The ExMC element is actively developing several tools to be used in preparation for and during deep space exploration missions. One of those tools, known as IMPACT, is a probabilistic risk assessment model which can be used to propose a desired medical system (based on mass and volume) and suggest the clinical outcomes likely to occur for a design reference mission (DRM). The group recently presented the IMPACT model and a DRM of interest titled “Modified Long Duration Lunar Orbital and Lunar Surface” (mLDLOLS) at the recent AsMA conference. The mLDLOLS mock mission is a 9 month and 6-day deep space exploration mission consisting of time in Moon’s orbit (3 months on the Gateway space station), on the lunar surface (3 months within habitat), and another 3 months on Gateway before return to Earth. For this DRM, IMPACT ultimately outlined a preferred medical system that was then associated with medical conditions considered to be most likely based on frequency, most likely to cause astronaut task time loss (TTL), most likely to cause return to definitive care (RTDC), and most likely cause loss of crew life (LOCL). IMPACT also highlighted the medical capabilities/skills that would be required to care for those medical conditions, such as performing a history of present illness or musculoskeletal exam with ultrasound. The primary objective of the project was to perform a survey of the AI tools and systems applicable to the conditions outlined for the proposed mLDLOLS mission. Using PubMed (including most relevant MeSH terms) and Google Scholar, we then created a robust annotated bibliography organized by condition. The 56-page and over 500 reference annotated bibliography was subsequently used to create a review outline that would become the basis for drafting of a future publication. For the review outline, we took those medical conditions researched within the annotated bibliography (condition-based approach) and deployed a systems-based approach, combining those medical conditions and related tools into ten categories. These categories included general/all-purpose CDSSs, tools to diagnose or manage respiratory, dermatologic, neurologic, auditory and vestibular, ophthalmic, musculoskeletal, infection-associated, and gynecologic conditions, as well as tools that could be deployed in the setting of trauma/emergency. With the completion of the 30-page outline, we then began drafting the review paper. To conclude the research experience, I presented the findings from our survey to the ExMC Clinical and Science team. With these objectives, I ultimately learned about the number of AI tools that exist today to assist medical professionals with the triage, diagnosis, and management of several medical conditions. These tools can span from chatbot assistants to help triage knee pain to vision transformer models that can identify ophthalmic conditions based on ocular surface images captured with a cell phone. We also highlighted the current gaps that exist in the literature alongside the advancements that are needed to make the desired CDSS for deep space exploration missions. With this experience, I certainly confirmed an existing career goal and identified several additional skills needed to become an aerospace medical doctor including knowledge of critical care in an extreme medicine setting, aerospace engineering and human integration systems, artificial intelligence, machine learning, and risk models. I also identified numerous transferable skills for this career goal including the basic knowledge of medicine (MD), deployment of the scientific method for critical thought about new scientific questions (PhD), review of published literature, including creating an annotated bibliography (PhD), as well as detailed scientific writing (PhD). The results of my research will likely guide the design of an all-encompassing onboard medical assistant for use during deep space exploration missions of the future. I plan on sharing the outcomes from this experience with my peers at a student seminar in the Fall semester on August 30th. During the seminar, I will detail the project, my experience at NASA and AsMA, as well as offer best practice guidelines for students entertaining similar experiences or careers. In conclusion, I would like to thank the WVU School of Medicine, Research and Graduate Education office, as well as NASA ExMC for the unwavering support of this life-changing experience.

Ryan A. Lacinski↗

NASA Software Engineering Benchmarking Study

To identify best practices for the improvement of software engineering on projects, NASA's Offices of Chief Engineer (OCE) and Safety and Mission Assurance (OSMA) formed a team led by Heather Rarick and Sally Godfrey to conduct this benchmarking study. The primary goals of the study are to identify best practices that: Improve the management and technical development of software intensive systems; Have a track record of successful deployment by aerospace industries, universities [including research and development (R&D) laboratories], and defense services, as well as NASA's own component Centers; and Identify candidate solutions for NASA's software issues. Beginning in the late fall of 2010, focus topics were chosen and interview questions were developed, based on the NASA top software challenges. Between February 2011 and November 2011, the Benchmark Team interviewed a total of 18 organizations, consisting of five NASA Centers, five industry organizations, four defense services organizations, and four university or university R and D laboratory organizations. A software assurance representative also participated in each of the interviews to focus on assurance and software safety best practices. Interviewees provided a wealth of information on each topic area that included: software policy, software acquisition, software assurance, testing, training, maintaining rigor in small projects, metrics, and use of the Capability Maturity Model Integration (CMMI) framework, as well as a number of special topics that came up in the discussions. NASA's software engineering practices compared favorably with the external organizations in most benchmark areas, but in every topic, there were ways in which NASA could improve its practices. Compared to defense services organizations and some of the industry organizations, one of NASA's notable weaknesses involved communication with contractors regarding its policies and requirements for acquired software. One of NASA's strengths was its software assurance practices, which seemed to rate well in comparison to the other organizational groups and also seemed to include a larger scope of activities. An unexpected benefit of the software benchmarking study was the identification of many opportunities for collaboration in areas including metrics, training, sharing of CMMI experiences and resources such as instructors and CMMI Lead Appraisers, and even sharing of assets such as documented processes. A further unexpected benefit of the study was the feedback on NASA practices that was received from some of the organizations interviewed. From that feedback, other potential areas where NASA could improve were highlighted, such as accuracy of software cost estimation and budgetary practices. The detailed report contains discussion of the practices noted in each of the topic areas, as well as a summary of observations and recommendations from each of the topic areas. The resulting 24 recommendations from the topic areas were then consolidated to eliminate duplication and culled into a set of 14 suggested actionable recommendations. This final set of actionable recommendations, listed below, are items that can be implemented to improve NASA's software engineering practices and to help address many of the items that were listed in the NASA top software engineering issues. 1. Develop and implement standard contract language for software procurements. 2. Advance accurate and trusted software cost estimates for both procured and in-house software and improve the capture of actual cost data to facilitate further improvements. 3. Establish a consistent set of objectives and expectations, specifically types of metrics at the Agency level, so key trends and models can be identified and used to continuously improve software processes and each software development effort. 4. Maintain the CMMI Maturity Level requirement for critical NASA projects and use CMMI to measure organizations developing software for NASA. 5.onsolidate, collect and, if needed, develop common processes principles and other assets across the Agency in order to provide more consistency in software development and acquisition practices and to reduce the overall cost of maintaining or increasing current NASA CMMI maturity levels. 6. Provide additional support for small projects that includes: (a) guidance for appropriate tailoring of requirements for small projects, (b) availability of suitable tools, including support tool set-up and training, and (c) training for small project personnel, assurance personnel and technical authorities on the acceptable options for tailoring requirements and performing assurance on small projects. 7. Develop software training classes for the more experienced software engineers using on-line training, videos, or small separate modules of training that can be accommodated as needed throughout a project. 8. Create guidelines to structure non-classroom training opportunities such as mentoring, peer reviews, lessons learned sessions, and on-the-job training. 9. Develop a set of predictive software defect data and a process for assessing software testing metric data against it. 10. Assess Agency-wide licenses for commonly used software tools. 11. Fill the knowledge gap in common software engineering practices for new hires and co-ops.12. Work through the Science, Technology, Engineering and Mathematics (STEM) program with universities in strengthening education in the use of common software engineering practices and standards. 13. Follow up this benchmark study with a deeper look into what both internal and external organizations perceive as the scope of software assurance, the value they expect to obtain from it, and the shortcomings they experience in the current practice. 14. Continue interactions with external software engineering environment through collaborations, knowledge sharing, and benchmarking.

Rarick, Heather L.↗

NASA System Safety Handbook: System Safety Framework and Concepts for Implementation - Volume 1

System safety assessment is defined in NPR 8715.3C, NASA General Safety Program Requirements as a disciplined, systematic approach to the analysis of risks resulting from hazards that can affect humans, the environment, and mission assets. Achievement of the highest practicable degree of system safety is one of NASA's highest priorities. Traditionally, system safety assessment at NASA and elsewhere has focused on the application of a set of safety analysis tools to identify safety risks and formulate effective controls.1 Familiar tools used for this purpose include various forms of hazard analyses, failure modes and effects analyses, and probabilistic safety assessment (commonly also referred to as probabilistic risk assessment (PRA)). In the past, it has been assumed that to show that a system is safe, it is sufficient to provide assurance that the process for identifying the hazards has been as comprehensive as possible and that each identified hazard has one or more associated controls. The NASA Aerospace Safety Advisory Panel (ASAP) has made several statements in its annual reports supporting a more holistic approach. In 2006, it recommended that "... a comprehensive risk assessment, communication and acceptance process be implemented to ensure that overall launch risk is considered in an integrated and consistent manner." In 2009, it advocated for "... a process for using a risk-informed design approach to produce a design that is optimally and sufficiently safe." As a rationale for the latter advocacy, it stated that "... the ASAP applauds switching to a performance-based approach because it emphasizes early risk identification to guide designs, thus enabling creative design approaches that might be more efficient, safer, or both." For purposes of this preface, it is worth mentioning three areas where the handbook emphasizes a more holistic type of thinking. First, the handbook takes the position that it is important to not just focus on risk on an individual basis but to consider measures of aggregate safety risk and to ensure wherever possible that there be quantitative measures for evaluating how effective the controls are in reducing these aggregate risks. The term aggregate risk, when used in this handbook, refers to the accumulation of risks from individual scenarios that lead to a shortfall in safety performance at a high level: e.g., an excessively high probability of loss of crew, loss of mission, planetary contamination, etc. Without aggregated quantitative measures such as these, it is not reasonable to expect that safety has been optimized with respect to other technical and programmatic objectives. At the same time, it is fully recognized that not all sources of risk are amenable to precise quantitative analysis and that the use of qualitative approaches and bounding estimates may be appropriate for those risk sources. Second, the handbook stresses the necessity of developing confidence that the controls derived for the purpose of achieving system safety not only handle risks that have been identified and properly characterized but also provide a general, more holistic means for protecting against unidentified or uncharacterized risks. For example, while it is not possible to be assured that all credible causes of risk have been identified, there are defenses that can provide protection against broad categories of risks and thereby increase the chances that individual causes are contained. Third, the handbook strives at all times to treat uncertainties as an integral aspect of risk and as a part of making decisions. The term "uncertainty" here does not refer to an actuarial type of data analysis, but rather to a characterization of our state of knowledge regarding results from logical and physical models that approximate reality. Uncertainty analysis finds how the output parameters of the models are related to plausible variations in the input parameters and in the modeling assumptions. The evaluation of unrtainties represents a method of probabilistic thinking wherein the analyst and decision makers recognize possible outcomes other than the outcome perceived to be "most likely." Without this type of analysis, it is not possible to determine the worth of an analysis product as a basis for making decisions related to safety and mission success. In line with these considerations the handbook does not take a hazard-analysis-centric approach to system safety. Hazard analysis remains a useful tool to facilitate brainstorming but does not substitute for a more holistic approach geared to a comprehensive identification and understanding of individual risk issues and their contributions to aggregate safety risks. The handbook strives to emphasize the importance of identifying the most critical scenarios that contribute to the risk of not meeting the agreed-upon safety objectives and requirements using all appropriate tools (including but not limited to hazard analysis). Thereafter, emphasis shifts to identifying the risk drivers that cause these scenarios to be critical and ensuring that there are controls directed toward preventing or mitigating the risk drivers. To address these and other areas, the handbook advocates a proactive, analytic-deliberative, risk-informed approach to system safety, enabling the integration of system safety activities with systems engineering and risk management processes. It emphasizes how one can systematically provide the necessary evidence to substantiate the claim that a system is safe to within an acceptable risk tolerance, and that safety has been achieved in a cost-effective manner. The methodology discussed in this handbook is part of a systems engineering process and is intended to be integral to the system safety practices being conducted by the NASA safety and mission assurance and systems engineering organizations. The handbook posits that to conclude that a system is adequately safe, it is necessary to consider a set of safety claims that derive from the safety objectives of the organization. The safety claims are developed from a hierarchy of safety objectives and are therefore hierarchical themselves. Assurance that all the claims are true within acceptable risk tolerance limits implies that all of the safety objectives have been satisfied, and therefore that the system is safe. The acceptable risk tolerance limits are provided by the authority who must make the decision whether or not to proceed to the next step in the life cycle. These tolerances are therefore referred to as the decision maker's risk tolerances. In general, the safety claims address two fundamental facets of safety: 1) whether required safety thresholds or goals have been achieved, and 2) whether the safety risk is as low as possible within reasonable impacts on cost, schedule, and performance. The latter facet includes consideration of controls that are collective in nature (i.e., apply generically to broad categories of risks) and thereby provide protection against unidentified or uncharacterized risks.

Dezfuli, Homayoon↗

Probabilistic Modeling of a Three-Stage Human Landing System Architecture

Space Policy Directive-1 has led to NASA partnerships with commercial entities on procurement which includes the development of the Human Landing System (HLS) [1]. With the goal of delivering human crew to the lunar surface by 2024, system uncertainties become an important obstacle to the maturation of multiple new, driving technologies and mission concepts of the HLS program. As unmitigated uncertainties have previously led to failed development programs, these risks and their impacts must be understood and handled to ensure program success [2]. Sources of uncertainty include novel engine designs and configurations, increased reliance on cryogenic fluid management(CFM), and refueling technologies—which propagate as high-level performance metrics such as overall propellant mass and engine performance. Also, the occurrence of operational uncertainties—e.g. launch conditions or need to abort during the mission—can cause cascading effects on the rest of the mission that are difficult to definitively quantify, and are outside the scope of control. These concrete examples and other occurrences can be categorized as either epistemic or aleatory uncertainties.Epistemic uncertainty arises due to a lack of knowledge and can be alleviated with design and program maturation. Aleatory uncertainty is due to the inherent randomness of the system and cannot be directly reduced, unlike epistemic uncertainty. Robust design and probabilistic methods can compensate for aleatory effects. A taxonomy of uncertainty is referred to for this work [3]. In this paper, a probabilistic methodology to handle uncertainties has been demonstrated on a three-element HLS concept [1, 4], which allows tracking of current best estimates of the concept and assessment of concept design robustness against uncertainties. A sample case has been completed for this abstract, and an expansion on the methodology will be included in the final paper. This methodology has two key parts: first, the creation of a dynamic architecture model of a three-element HLS concept; and second, its use with surrogate modeling and range estimating techniques to capture and propagate uncertainties. This abstract will cover the basics of the approach used, and further details and justifications will be in the final paper.The mission profile associated with this three-element concept (Fig 1) was modeled as a set of mission events that facilitated mass changes, idles, or spacecraft maneuvers. The mission profile scope starts with each element’s NRHO orbit insertion and aggregation and ends at post-sortie rendezvous with Orion. More detail on the mission profile will be in the final paper. The DYnamic Rocket EQuation Tool (DYREQT), a space systems synthesis and sizing framework used by NASA, was used as the physics framework to model the HLS architecture for applying the probabilistic methodology [5, 6]. Specifically, a parametric representation of the lander, ascent, and transfer elements and the mission profile of each element was established, with vehicle and mission parameters available as inputs to allow for a dynamic model. Each vehicle stage was modeled with high-level performance metrics, using Isp and propellant mass fraction (PMF) to remain parametric. For the probabilistic analysis, uncertainties of interest within the HLS concept were enumerated and represented as parameters within the DYREQT model as inputs for vehicle stages or mission profile events. These parameters were frozen at their nominal values for the purposes of baselining architecture performance and sizing the vehicle appropriately based on reference documentation [1]. Range estimating—a probabilistic method that combines Monte Carlo sampling, focus on critical parameters, and heuristics to assess risk and opportunities—is traditionally used with Mass Equipment Lists (MELs), but has been adapted with operational parameters as well as vehicle parameters in theDYREQT model to capture mission uncertainty alongside vehicle uncertainty [7, 3]. This method was selected due to its application and insight on a system from a bottom-up perspective, independence from historical rules of thumb, and ability to generate sensitivities based on design decisions and uncertainties. As a sample case for the abstract, the boiloff rates of the vehicle elements and the loiter times during the mission (simulating launch time variations and changing window of opportunities) were used with range estimating to provide preliminary results. To perform the range estimation portion of this methodology (depicted in Fig. 3, further details in final paper), the DYREQT model was sampled using a Design of Experiments (DoE) to efficiently explore the architecture design space with respect to the sample set of uncertainty parameters; 5,000 cases via Latin Hypercube Sampling were computed on the DYREQT architecture model. Then, the results were used to create surrogate models, multivariate regressions that can visualize hypercube trends in the design space, of the architecture with respect to the uncertainty parameters. Range estimating was applied to the surrogates instead of the actual models, which saves computational expense due to the bulk of cases needed for the Monte Carlo simulation as part of range estimating. Uncertainty parameters were sampled independently from triangular distributions using the DoE ranges as ‘min’ and ‘max’, and the nominal value as ‘most likely’. Based engineering intuition, some uncertainty parameters are correlated—e.g. if the main propellant has a high boil-off rate, the oxidizer should follow suit as both are related to CFM technology.While a Monte Carlo simulation samples all inputs as independent, the results would show model correlations; thus, it is efficient to sample the inputs as correlated. Using a correlation matrix constructed for the uncertainty parameters, previously independent samples were transformed to perform a Correlated Monte Carlo. A table for the DoE ranges and probability distribution parameters is shown in Table 1, and more details on Correlated Monte Carlo Simulations will be discussed in the final paper. The model’s resulting DoE showed that multivariate polynomial equations fit via least squares method captured its behavior accurately for the sample case. For the Correlated Monte Carlo Simulation, a positive correlation between fuel and oxidizer boiloff rates was used as a demonstration. 10,000 cases were computed with the surrogates and the launched masses for each vehicle element was collated. The results can be displayed in a probability density function (PDF), showing the impact of the uncertainty parameters chosen. Integrating the PDFs will yield a cumulative distribution function (CDF) that shows the cumulative probability of a given value on the x-axis. For the sample case, the elements’ launch mass margin was calculated and represented in as CDFs, as a demonstrated representation of figures of merit for the HLS concept. For the lander and ascent elements, the NRHO mass insertion limit is 16t; the transfer element has a limit of 30t [1]. It can be seen with Figure 2 that this probabilistic methodology can provide insight into mass margin with respect to the uncertainties being modeled. Currently, the results show that the lander (descent) vehicle element has the most restrictive design space; it is the only element to show a 10% probability of negative margin. Further analysis on the Monte Carlo results will show sensitivities for driving constraints and parameters for architecture feasibility, which can lead to establishing potential mission rules.The combination of range estimating with a parametric architecture model for HLS demonstrated the capability of this probabilistic methodology in a sample case. As the HLS development progresses, this methodology has the potential for keeping current best estimates of architecture performance for awarded concepts due to the flexibility in DYREQT’s modeling framework and its parametric nature. Concept maturation and increased epistemic knowledge can be injected into the model probabilistic modeling, and thus continue to track probability of mission success.

Stephanie Y Zhu↗