Search NASA⌕ Search

SEARCH · Search NASA

Results for “traceability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Goal-Function Tree Modeling for Systems Engineering and Fault Management

This paper describes a new representation that enables rigorous definition and decomposition of both nominal and off-nominal system goals and functions: the Goal-Function Tree (GFT). GFTs extend the concept and process of functional decomposition, utilizing state variables as a key mechanism to ensure physical and logical consistency and completeness of the decomposition of goals (requirements) and functions, and enabling full and complete traceabilitiy to the design. The GFT also provides for means to define and represent off-nominal goals and functions that are activated when the system's nominal goals are not met. The physical accuracy of the GFT, and its ability to represent both nominal and off-nominal goals enable the GFT to be used for various analyses of the system, including assessments of the completeness and traceability of system goals and functions, the coverage of fault management failure detections, and definition of system failure scenarios.

Johnson, Stephen B.↗

Building a Database for a Quantitative Model

A database can greatly benefit a quantitative analysis. The defining characteristic of a quantitative risk, or reliability, model is the use of failure estimate data. Models can easily contain a thousand Basic Events, relying on hundreds of individual data sources. Obviously, entering so much data by hand will eventually lead to errors. Not so obviously entering data this way does not aid linking the Basic Events to the data sources. The best way to organize large amounts of data on a computer is with a database. But a model does not require a large, enterprise-level database with dedicated developers and administrators. A database built in Excel can be quite sufficient. A simple spreadsheet database can link every Basic Event to the individual data source selected for them. This database can also contain the manipulations appropriate for how the data is used in the model. These manipulations include stressing factors based on use and maintenance cycles, dormancy, unique failure modes, the modeling of multiple items as a single "Super component" Basic Event, and Bayesian Updating based on flight and testing experience. A simple, unique metadata field in both the model and database provides a link from any Basic Event in the model to its data source and all relevant calculations. The credibility for the entire model often rests on the credibility and traceability of the data.

Kahn, C. Joseph↗

Overview and Summary of Advanced UVOIR Mirror Technology Development (AMTD) Project

ASTRO2010 Decadal Survey stated that an advanced large-aperture ultraviolet, optical, near-infrared (UVOIR) telescope is required to enable the next generation of compelling astrophysics and exoplanet science; and, that present technology is not mature enough to affordably build and launch any potential UVOIR mission concept. AMTD is a multiyear effort to develop, demonstrate and mature critical technologies to TRL-6 by 2018 so that a viable flight mission can be proposed to the 2020 Decadal Review. AMTD builds on the state of art (SOA) defined by over 30 years of monolithic & segmented ground & space-telescope mirror technology to mature six key technologies: center dotLarge-Aperture, Low Areal Density, High Stiffness Mirror Substrates: Both (4 to 8 m) monolithic and (8 to 16 m) segmented telescopes require larger and stiffer mirrors. center dotSupport System: Large-aperture mirrors require large support systems to ensure that they survive launch, deploy on orbit, and maintain a stable, undistorted shape. center dotMid/High Spatial Frequency Figure Error: Very smooth mirror is critical for producing high-quality point spread function (PSF) for high contrast imaging. center dotSegment Edges: The quality of segment edges impacts PSF for high-contrast imaging applications, contributes to stray light noise, and affects total collecting aperture. center dotSegment to Segment Gap Phasing: Segment phasing is critical for producing high-quality temporally-stable PSF. center dotIntegrated Model Validation: On-orbit performance is driven by mechanical & thermal stability. Compliance cannot be 100% tested, but relies on modeling. Because we cannot predict the future, AMTD is pursuing multiple design paths to provide the science community with options to enable either large aperture monolithic or segmented mirrors with clear engineering metrics traceable to science requirements

Stahl, H. Philip↗

Advanced UVOIR Mirror Technology Development (AMTD) for Very Large Space Telescopes

ASTRO2010 Decadal stated that an advanced large-aperture ultraviolet, optical, near-infrared (UVOIR) telescope is required to enable the next generation of compelling astrophysics and exoplanet science; and, that present technology is not mature enough to affordably build and launch any potential UVOIR mission concept. AMTD builds on the state of art (SOA) defined by over 30 years of monolithic & segmented ground & space-telescope mirror technology to mature six key technologies. AMTD is deliberately pursuing multiple design paths to provide the science community with op-tions to enable either large aperture monolithic or segmented mirrors with clear engineering metrics traceable to science requirements.

Stahl, H. Philip↗

Achieving Climate Change Absolute Accuracy in Orbit

The Climate Absolute Radiance and Refractivity Observatory (CLARREO) mission will provide a calibration laboratory in orbit for the purpose of accurately measuring and attributing climate change. CLARREO measurements establish new climate change benchmarks with high absolute radiometric accuracy and high statistical confidence across a wide range of essential climate variables. CLARREO's inherently high absolute accuracy will be verified and traceable on orbit to Système Internationale (SI) units. The benchmarks established by CLARREO will be critical for assessing changes in the Earth system and climate model predictive capabilities for decades into the future as society works to meet the challenge of optimizing strategies for mitigating and adapting to climate change. The CLARREO benchmarks are derived from measurements of the Earth's thermal infrared spectrum (5-50 micron), the spectrum of solar radiation reflected by the Earth and its atmosphere (320-2300 nm), and radio occultation refractivity from which accurate temperature profiles are derived. The mission has the ability to provide new spectral fingerprints of climate change, as well as to provide the first orbiting radiometer with accuracy sufficient to serve as the reference transfer standard for other space sensors, in essence serving as a "NIST [National Institute of Standards and Technology] in orbit." CLARREO will greatly improve the accuracy and relevance of a wide range of space-borne instruments for decadal climate change. Finally, CLARREO has developed new metrics and methods for determining the accuracy requirements of climate observations for a wide range of climate variables and uncertainty sources. These methods should be useful for improving our understanding of observing requirements for most climate change observations.

Wielicki, Bruce A.↗

SPRITE: A TPS Test Bed for Ground and Flight

Engineers in the Entry Systems and Technology Division at NASA Ames Research Center developed a fully instrumented, small atmospheric entry probe called SPRITE (Small Probe Reentry Investigation for TPS Engineering). SPRITE, conceived as a flight test bed for thermal protection materials, was tested at full scale in an arc-jet facility so that the aerothermal environments the probe experiences over portions of its flight trajectory and in the arc-jet are similar. This ground-to-flight traceability enhances the ability of mission designers to evaluate margins needed in the design of thermal protection systems (TPS) of larger scale atmospheric entry vehicles. SPRITE is a 14-inch diameter, 45 deg. sphere-cone with a conical aftbody and designed for testing in the NASA Ames Aerodynamic Heating Facility (AHF). The probe is a two-part aluminum shell with PICA (phenolic impregnated carbon ablator) bonded on the forebody and LI-2200 (Shuttle tile material) bonded to the aftbody. Plugs with embedded thermocouples, similar to those installed in the heat shield of the Mars Science Laboratory (MSL), and a number of distributed sensors are integrated into the design. The data from these sensors are fed to an innovative, custom-designed data acquisition system also integrated with the test article. Two identical SPRITE models were built and successfully tested in late 2010-early 2011, and the concept is currently being modified to enable testing of conformable and/or flexible materials.

Ablation↗

A Model-Driven Visualization Tool for Use with Model-Based Systems Engineering Projects

Model-Based Systems Engineering (MBSE) promotes increased consistency between a system's design and its design documentation through the use of an object-oriented system model. The creation of this system model facilitates data presentation by providing a mechanism from which information can be extracted by automated manipulation of model content. Existing MBSE tools enable model creation, but are often too complex for the unfamiliar model viewer to easily use. These tools do not yet provide many opportunities for easing into the development and use of a system model when system design documentation already exists. This study creates a Systems Modeling Language (SysML) Document Traceability Framework (SDTF) for integrating design documentation with a system model, and develops an Interactive Visualization Engine for SysML Tools (InVEST), that exports consistent, clear, and concise views of SysML model data. These exported views are each meaningful to a variety of project stakeholders with differing subjects of concern and depth of technical involvement. InVEST allows a model user to generate multiple views and reports from a MBSE model, including wiki pages and interactive visualizations of data. System data can also be filtered to present only the information relevant to the particular stakeholder, resulting in a view that is both consistent with the larger system model and other model views. Viewing the relationships between system artifacts and documentation, and filtering through data to see specialized views improves the value of the system as a whole, as data becomes information

relational databases↗

Orion MPCV Continuum RCS Heating Augmentation Model Development

The reaction control system jets of the Orion Multi Purpose Crew Vehicle can have a significant impact on the magnitude and distribution of the surface heat flux on the leeside of the aft-body, when they are fired. Changes in surface heating are expressed in terms of augmentation factor over the baseline smooth body heating. Wind tunnel tests revealed heating augmentation factors as high as 13.0, 7.6, 2.8, and 5.8 for the roll, pitch down, pitch up, and yaw jets respectively. Heating augmentation factor models, based almost exclusively on data from a series of wind tunnel tests have been developed, for the purposes of thermal protection system design. The wind tunnel tests investigated several potential jet-to-freestream similarity parameters, and heating augmentation factors derived from the data showed correlation with the jet-to-freestream momentum ratio. However, this correlation was not utilized in the developed models. Instead augmentation factors were held constant throughout the potential trajectory space. This simplification was driven by the fact that ground to flight traceability and sting effects are not well understood. Given the sensitivity of the reaction control system jet heating augmentation to configuration, geometry, and orientation the focus in the present paper is on the methodology used to develop the models and the lessons learned from the data. The models that are outlined in the present work are specific to the aerothermal database used to design the thermal protection system for the Exploration Flight Test 1 vehicle.

Heating Augmentation↗

A Long-Term and Reproducible Passive Microwave Sea Ice Concentration Data Record for Climate Studies and Monitoring

A long-term, consistent, and reproducible satellite-based passive microwave sea ice concentration climate data record (CDR) is available for climate studies, monitoring, and model validation with an initial operation capability (IOC). The daily and monthly sea ice concentration data are on the National Snow and Ice Data Center (NSIDC) polar stereographic grid with nominal 25 km × 25 km grid cells in both the Southern and Northern Hemisphere polar regions from 9 July 1987 to 31 December 2007. The data files are available in the NetCDF data format at http://nsidc.org/data/g02202.html and archived by the National Climatic Data Center (NCDC) of the National Oceanic and Atmospheric Administration (NOAA) under the satellite climate data record program (http://www.ncdc.noaa.gov/cdr/operationalcdrs.html). The description and basic characteristics of the NOAA/NSIDC passive microwave sea ice concentration CDR are presented here. The CDR provides similar spatial and temporal variability as the heritage products to the user communities with the additional documentation, traceability, and reproducibility that meet current standards and guidelines for climate data records. The data set, along with detailed data processing steps and error source information, can be found at http://dx.doi.org/10.7265/N5B56GN3.

monitoring↗

Calibrating Historical IR Sensors Using GEO, and AVHRR Infrared Tropical Mean Calibration Models

Long-term, remote-sensing-based climate data records (CDRs) are highly dependent on having consistent, wellcalibrated satellite instrument measurements of the Earth's radiant energy. Therefore, by making historical satellite calibrations consistent with those of today's imagers, the Earth-observing community can benefit from a CDR that spans a minimum of 30 years. Most operational meteorological satellites rely on an onboard blackbody and space looks to provide on-orbit IR calibration, but neither target is traceable to absolute standards. The IR channels can also be affected by ice on the detector window, angle dependency of the scan mirror emissivity, stray-light, and detector-to-detector striping. Being able to quantify and correct such degradations would mean IR data from any satellite imager could contribute to a CDR. Recent efforts have focused on utilizing well-calibrated modern hyper-spectral sensors to intercalibrate concurrent operational IR imagers to a single reference. In order to consistently calibrate both historical and current IR imagers to the same reference, however, another strategy is needed. Large, well-characterized tropical-domain Earth targets have the potential of providing an Earth-view reference accuracy of within 0.5 K. To that effort, NASA Langley is developing an IR tropical mean calibration model in order to calibrate historical Advanced Very High Resolution Radiometer (AVHRR) instruments. Using Meteosat-9 (Met-9) as a reference, empirical models are built based on spatially/temporally binned Met-9 and AVHRR tropical IR brightness temperatures. By demonstrating the stability of the Met-9 tropical models, NOAA-18 AVHRR can be calibrated to Met-9 by matching the AVHRR monthly histogram averages with the Met-9 model. This method is validated with ray-matched AVHRR and Met-9 biasdifference time series. Establishing the validity of this empirical model will allow for the calibration of historical AVHRR sensors to within 0.5 K, and thereby establish a climate-quality IR data record.

Scarino, Benjamin↗

Infrared Spectral Radiance Intercomparisons With Satellite and Aircraft Sensors

Measurement system validation is critical for advanced satellite sounders to reach their full potential of improving observations of the Earth's atmosphere, clouds, and surface for enabling enhancements in weather prediction, climate monitoring capability, and environmental change detection. Experimental field campaigns, focusing on satellite under-flights with well-calibrated FTS sensors aboard high-altitude aircraft, are an essential part of the validation task. Airborne FTS systems can enable an independent, SI-traceable measurement system validation by directly measuring the same level-1 parameters spatially and temporally coincident with the satellite sensor of interest. Continuation of aircraft under-flights for multiple satellites during multiple field campaigns enables long-term monitoring of system performance and inter-satellite cross-validation. The NASA / NPOESS Airborne Sounder Testbed - Interferometer (NAST-I) has been a significant contributor in this area by providing coincident high spectral/spatial resolution observations of infrared spectral radiances along with independently-retrieved geophysical products for comparison with like products from satellite sensors being validated. This presentation gives an overview of benefits achieved using airborne sensors such as NAST-I utilizing examples from recent field campaigns. The methodology implemented is not only beneficial to new sensors such as the Cross-track Infrared Sounder (CrIS) flying aboard the Suomi NPP and future JPSS satellites but also of significant benefit to sensors of longer flight heritage such as the Atmospheric InfraRed Sounder (AIRS) and the Infrared Atmospheric Sounding Interferometer (IASI) on the AQUA and METOP-A platforms, respectively, to ensure data quality continuity important for climate and other applications. Infrared spectral radiance inter-comparisons are discussed with a particular focus on usage of NAST-I data for enabling inter-platform cross-validation.

Larar, Allen M.↗

Assessing Air-Sea Interaction in the Evolving NASA GEOS Model

In order to understand how the climate responds to variations in forcing, one necessary component is to understand the full distribution of variability of exchanges of heat and moisture between the atmosphere and ocean. Surface heat and moisture fluxes are critical to the generation and decay of many coupled air-sea phenomena. These mechanisms operate across a number of scales and contain contributions from interactions between the anomalous (i.e. non-mean), often extreme-valued, flux components. Satellite-derived estimates of the surface turbulent and radiative heat fluxes provide an opportunity to assess results from modeling systems. Evaluation of only time mean and variability statistics, however only provides limited traceability to processes controlling what are often regime-dependent errors. This work will present an approach to evaluate the representation of the turbulent fluxes at the air-sea interface in the current and evolving Goddard Earth Observing System (GEOS) model. A temperature and moisture vertical profile-based clustering technique is used to identify robust weather regimes, and subsequently intercompare the turbulent fluxes and near-surface parameters within these regimes in both satellite estimates and GEOS-driven data sets. Both model reanalysis (MERRA) and seasonal-to-interannual coupled GEOS model simulations will be evaluated. Particular emphasis is placed on understanding the distribution of the fluxes including extremes, and the representation of near-surface forcing variables directly related to their estimation. Results from these analyses will help identify the existence and source of regime-dependent biases in the GEOS model ocean surface turbulent fluxes. The use of the temperature and moisture profiles for weather-state clustering will be highlighted for its potential broad application to 3-D output typical of model simulations.

Clayson, Carol Anne↗

Human System Risk Management for Space Flight

This brief abstract reviews the development of the current day approach to human system risk management for space flight and the development of the critical components of this process over the past few years. The human system risk management process now provides a comprehensive assessment of each human system risk by design reference mission (DRM) and is evaluated not only for mission success but also for long‐term health impacts for the astronauts. The discipline of bioastronautics is the study of the biological and medical effects of space flight on humans. In 1997, the Space Life Sciences Directorate (SLSD) initiated the Bioastronautics Roadmap (Roadmap) as the "Critical Path Roadmap", and in 1998 participation in the roadmap was expanded to include the National Space Biomedical Research Institute (NSBRI) and the external community. A total of 55 risks and 250 questions were identified and prioritized and in 2000, the Roadmap was base-lined and put under configuration control. The Roadmap took into account several major advisory committee reviews including the Institute of Medicine (IOM) "Safe Passage: Astronaut care for Exploration Missions", 2001. Subsequently, three collaborating organizations at NASA HQ (Chief Health and Medical Officer, Office of Space Flight and Office of Biological & Physical Research), published the Bioastronautics Strategy in 2003, that identified the human as a "critical subsystem of space flight" and noted that "tolerance limits and safe operating bands must be established" to enable human space flight. These offices also requested a review by the IOM of the Roadmap and that review was published in October 2005 as "A Risk Reduction Strategy for Human Exploration of Space: A Review of NASA's Bioastronautics Roadmap", that noted several strengths and weaknesses of the Roadmap and made several recommendations. In parallel with the development of the Roadmap, the Office of the Chief Health and Medical Officer (OCHMO) began a process in 2004 of evaluating the tolerance limits and safe operating bands called for in the Bioastronautics Strategy. Over the next several years, the concept of the "operating bands" were turned into Space Flight Human System Standards (SFHSS), developed by the technical resources of the SLSD at the NASA Johnson Space Center (JSC). These standards were developed and reviewed at the SLSD and then presented to the OCHMO for acceptance. The first set of standards was published in 2007 as the NASA‐STD‐3001, Volume 1, Crew Health that elaborated standards for several physiological areas such as cardiovascular, musculoskeletal, radiation exposure and nutrition. Volume 2, Human Factors, Habitability and Human Health was published in 2011, along with development guidance in the Human Integration Design Handbook (HIDH). Taken together, the SFHSS Volumes 1 and 2, and the HIDH replaced the NASA‐STD‐3000 with new standards and revisions of the older document. Three other changes were also taking place that facilitated the development of the human system risk management approach. In 2005, the life sciences research and development portfolio underwent a comprehensive review through the Exploration Systems Architecture Study (ESAS) that resulted in the reformulation of the Bioastronautics Program into Human Research Program (HRP) that was focused on appropriate mitigation results for high priority human health risks. The baseline HRP budget was established in August 2005. In addition, the OCHMO formulated the Health and Medical Technical Authority (HMTA) in 2006 that established the position of the Chief Medical Officer (CMO) at the NASA JSC along with other key technical disciplines, and the OCHMO became the responsible office for the SFHSS as noted above. The final change was the establishment in 2008 of the Human System Risk Board (HSRB), chaired by the CMO with representation from the HRP, SLSD management and technical experts. The HSRB then began to review all human system risks, established a comprehensive risk management and configuration management plan and data sharing policy. These major developments of standards, the HRP, the HMTA and a forum for review of human system risks (HSRB) facilitated the integration of human research, medical operations, systems engineering and many other disciplines in the comprehensive review of human system risks. The HSRB began a comprehensive review of all potential inflight medical conditions and events and over the course of several reviews consolidated the number of human system risks to 30 where the greatest emphasis is placed for investing program dollars for risk mitigation. The HSRB considers all available evidence from human research, medical operations and occupational surveillance in assessing the risks for appropriate mitigation and future work. All applicable DRMs (low earth orbit 6 and 12 months, deep space sortie for 30 days and 1 year, a one year lunar mission, and a planetary mission for 3 years) are considered as human system risks are modified by the hazards associated with space flight such as microgravity, exposure to radiation, distance from the earth, isolation and a closed environment. Each risk has a summary assessment representing the state of knowledge/evidence base for that risk, the available risk mitigations, traceability to the SFHSS and program requirements, and future work required. These data then can drive coordinated budgets across the HRP, the International Space Station, Crew Health and Safety and Advanced Exploration System budgets. These risk assessments were completed for 6 DRMs in December of 2014 and serve as the baseline for which subsequent research and technology development and crew health care portfolios can be assessed. The HSRB will review each risk at least annually and especially when new information is available that must be considered for effective risk mitigation. The current status of each risk can be reported to program management for operations, budget reviews and general oversight of the human system risk management program.

Davis, Jeffrey↗

Exploring Mission Concepts with the JPL Innovation Foundry A-Team

The JPL Innovation Foundry has established a new approach for exploring, developing, and evaluating early concepts called the A-Team. The A-Team combines innovative collaborative methods with subject matter expertise and analysis tools to help mature mission concepts. Science, implementation, and programmatic elements are all considered during an A-Team study. Methods are grouped by Concept Maturity Level (CML), from 1 through 3, including idea generation and capture (CML 1), initial feasibility assessment (CML 2), and trade space exploration (CML 3). Methods used for each CML are presented, and the key team roles are described from two points of view: innovative methods and technical expertise. A-Team roles for providing innovative methods include the facilitator, study lead, and assistant study lead. A-Team roles for providing technical expertise include the architect, lead systems engineer, and integration engineer. In addition to these key roles, each A-Team study is uniquely staffed to match the study topic and scope including subject matter experts, scientists, technologists, flight and instrument systems engineers, and program managers as needed. Advanced analysis and collaborative engineering tools (e.g. cost, science traceability, mission design, knowledge capture, study and analysis support infrastructure) are also under development for use in A-Team studies and will be discussed briefly. The A-Team facilities provide a constructive environment for innovative ideas from all aspects of mission formulation to eliminate isolated studies and come together early in the development cycle when they can provide the biggest impact. This paper provides an overview of the A-Team, its study processes, roles, methods, tools and facilities.

Team Eureka↗

Long-Wave Infrared Dyson Spectrometer

Preliminary results are presented for an ultra compact long-wave infrared slit spectrometer based on the dyson concentric design. The dyson spectrometer has been integrated in a dewar environment with a quantum well infrared photodetecor (QWIP), concave electron beam fabricated diffraction grating and ultra precision slit. The entire system is cooled to cryogenic temperatures to maximize signal to noise ratio performance, hence eliminating thermal signal from transmissive elements and internal stray light. All of this is done while maintaining QWIP thermal control. A general description is given of the spectrometer, alignment technique and predicated performance. The spectrometer has been designed for optimal performance with respect to smile and keystone distortion. A spectral calibration is performed with NIST traceable targets. A 2-point non-uniformity correction is performed with a precision blackbody source to provide radiometric accuracy. Preliminary laboratory results show excellent agreement with modeled noise equivalent delta temperature and detector linearity over a broad temperature range.

imaging↗

A Future Large-Aperture UVOIR Space Observatory: Reference Designs

Our joint NASA GSFC/JPL/MSFC/STScI study team has used community-provided science goals to derive mission needs, requirements, and candidate mission architectures for a future large-aperture, non-cryogenic UVOIR space observatory. We describe the feasibility assessment of system thermal and dynamic stability for supporting coronagraphy. The observatory is in a Sun-Earth L2 orbit providing a stable thermal environment and excellent field of regard. Reference designs include a 36-segment 9.2 m aperture telescope that stows within a five meter diameter launch vehicle fairing. Performance needs developed under the study are traceable to a variety of reference designs including options for a monolithic primary mirror.

exo-planets↗

Technology Readiness Level Assessment Process as Applied to NASA Earth Science Missions

Technology assessments of fourteen science instruments were conducted within NASA using the NASA Technology Readiness Level (TRL) Metric. The instruments were part of three NASA Earth Science Decadal Survey missions in pre-formulation. The Earth Systematic Missions Program (ESMP) Systems Engineering Working Group (SEWG), composed of members of three NASA Centers, provided a newly modified electronic workbook to be completed, with instructions. Each instrument development team performed an internal assessment of its technology status, prepared an overview of its instrument, and completed the workbook with the results of its assessment. A team from the ESMP SEWG met with each instrument team and provided feedback. The instrument teams then reported through the Program Scientist for their respective missions to NASA's Earth Science Division (ESD) on technology readiness, taking the SEWG input into account. The instruments were found to have a range of TRL from 4 to 7. Lessons Learned are presented; however, due to the competition-sensitive nature of the assessments, the results for specific missions are not presented. The assessments were generally successful, and produced useful results for the agency. The SEWG team identified a number of potential improvements to the process. Particular focus was on ensuring traceability to guiding NASA documents, including the NASA Systems Engineering Handbook. The TRL Workbook has been substantially modified, and the revised workbook is described.

Systems Engineering↗

Characterization of Evidence for Human System Risk Assessment

Understanding the kinds of evidence available and using the best evidence to answer a question is critical to evidenced-based decision-making, and it requires synthesis of evidence from a variety of sources. Categorization of human system risks in spaceflight, in particular, focuses on how well the integration and interpretation of all available evidence informs the risk statement that describes the relationship between spaceflight hazards and an outcome of interest. A mature understanding and categorization of these risks requires: 1) sufficient characterization of risk, 2) sufficient knowledge to determine an acceptable level of risk (i.e., a standard), 3) development of mitigations to meet the acceptable level of risk, and 4) identification of factors affecting generalizability of the evidence to different design reference missions. In the medical research community, evidence is often ranked by increasing confidence in findings gleaned from observational and experimental research (e.g., "levels of evidence"). However, an approach based solely on aspects of experimental design is problematic in assessing human system risks for spaceflight. For spaceflight, the unique challenges and opportunities include: (1) The independent variables in most evidence are the hazards of spaceflight, such as space radiation or low gravity, which cannot be entirely duplicated in terrestrial (Earth-based) analogs, (2) Evidence is drawn from multiple sources including medical and mission operations, Lifetime Surveillance of Astronaut Health (LSAH), spaceflight research (LSDA), and relevant environmental & terrestrial databases, (3) Risk metrics based primarily on LSAH data are typically derived from available prevalence or incidence data, which may limit rigorous interpretation, (4) The timeframe for obtaining adequate spaceflight sample size (n) is very long, given the small population, (5) Randomized controlled trials are unattainable in spaceflight, (6) Collection of personal and environmental data on the astronaut population may create opportunities for advanced analytics and human-environment modeling that goes beyond that achieved in isolated experimental designs; and (7) Translation of relevant research to operations is a complex, transdisciplinary enterprise in which the approach must apply across the physical, biological, behavioral, and social sciences. The approach to synthesizing evidence must address both source and fidelity of data, and reflect the most general attributes of quality of evidence in science and engineering: reliability and validity. The authors are developing a two-factor approach which includes the various kinds of evidence required to understand risks and for the integrated interpretation of all evidence that is essential to develop standards and countermeasures. A unified framework for aggregating and assessing different kinds of evidence provides a consistent, traceable, evidence-based decision-making process to translate research to operations in an environment where engineers, scientists, physicians, and managers all engage in analyzing the trade space of vehicle design, standards, requirements and solutions for spaceflight.

Steinberg, S. L.↗