Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Stacked reverberation mapping of high-redshift quasars in DESI. I. Feasibility analysis

The broad-line region of quasars has long been probed by reverberation mapping techniques that measure time lags between continuum and broad emission-line variations. Stacked reverberation mapping has been proposed as a less observationally expensive alternative to traditional methods. This ensemble approach also reduces biases from small-number statistics. The Dark Energy Spectroscopic Instrument (DESI) is conducting the most extensive spectroscopic survey of quasars to date. We create mock light curves emulating expected DESI quasar observations at redshifts $1.48\lt z\lt 5.2$ and luminosities $44.68 \le \log \lambda L_{1350 \mathring{\rm A}{}} / \mathrm{erg\, s^{-1}} \le 45.99$ to test stacked reverberation mapping feasibility using sparse spectroscopic data paired with well-sampled photometric data. The pipeline, using the lag estimation code JAVELIN (Just Another Vehicle for Estimating Lags In Nuclei), successfully recovers the simulated C IV lags within 1σ of the true values using spectroscopic light curves composed of only a few spectral epochs (2–10) with irregular cadences. We investigate how observational factors, including C IV flux error magnitude, number of stacked quasars, and spectral epoch count, affect performance. This work motivates a pathway for future stacked reverberation mapping projects with large-scale spectroscopic surveys of quasars having $\ge 2$ spectroscopic observations. Our results suggest an economical alternative for constraining and extending the radius–luminosity relation to higher redshifts and luminosities. Subsequently, this relation can be employed more reliably in single-epoch black hole mass measurements and quasar cosmology in these distant regimes.

quasars: general, quasars: supermassive black hole↗
NASA NTRS1982

The utilization of Nimbus-7 SMMR measurements to delineate rainfall over land

Based on previous theoretical calculations, an empirical statistical approach to use satellite multifrequency dual polarized passive microwave data to detect rainfall areas over land was initiated. The addition of information from a lower frequency channel (18.0 or 10.7 GHz) was shown to improve the discrimination of rain from wet ground achieved by using a single frequency dual polarized (37 GHz) channel alone. The algorithm was developed and independently tested using data from the Nimbus-7 Scanning Multichannel Microwave Radiometer. Horizontally and vertically polarized brightness temperature pairs at 37, 18, 10.7 GHz were sampled for raining areas over land (determined from ground base radar), wet ground areas (adjacent and upwind from rain areas determined from radar), and dry land regions (areas where rain had not fallen in a 24h period) over the central and eastern United States. Surface thermodynamic temperatures were both above and below 15 deg C.

Rogers, E.↗
NASA NTRS2014

Performance Comparison Between a Head-Worn Display System and a Head-Up Display for Low Visibility Commercial Operations

Research, development, test, and evaluation of flight deck interface technologies is being conducted by NASA to proactively identify, develop, and mature tools, methods, and technologies for improving overall aircraft safety of new and legacy vehicles operating in Next Generation Air Transportation System (NextGen). Under the Vehicle Systems Safety Technologies (VSST) project in the Aviation Safety Program, one specific area of research is the use of small Head-Worn Displays (HWDs) as an equivalent display to a Head-Up Display (HUD). Title 14 of the US Code of Federal Regulations (CFR) 91.175 describes a possible operational credit which can be obtained with airplane equipage of a HUD or an "equivalent" display combined with Enhanced Vision (EV). If successful, a HWD may provide the same safety and operational benefits as current HUD-equipped aircraft but for significantly more aircraft in which HUD installation is neither practical nor possible. A simulation experiment was conducted to evaluate if the HWD, coupled with a head-tracker, can provide an equivalent display to a HUD. Comparative testing was performed in the Research Flight Deck (RFD) Cockpit Motion Facility (CMF) full mission, motion-based simulator at NASA Langley. Twelve airline crews conducted approach and landing, taxi, and departure operations during low visibility operations (1000' Runway Visual Range (RVR), 300' RVR) at Memphis International Airport (Federal Aviation Administration (FAA) identifier: KMEM). The results showed that there were no statistical differences in the crews performance in terms of touchdown and takeoff. Further, there were no statistical differences between the HUD and HWD in pilots' responses to questionnaires.

Arthur, Jarvis J., III↗
DOE OSTI2020

Grid-based diffusion Monte Carlo for fermions without the fixed-node approximation

A diffusion Monte Carlo algorithm is introduced that can determine the correct nodal structure of the wave function of a few-fermion system and its ground-state energy without an uncontrolled bias. This is achieved by confining signed random walkers to the points of a uniform infinite spatial grid, allowing them to meet and annihilate one another to establish the nodal structure without the fixed-node approximation. An imaginary-time propagator is derived rigorously from a discretized Hamiltonian, governing a non-Gaussian, sign-flipping, branching, and mutually annihilating random walk of particles. The accuracy of the resulting stochastic representations of a fermion wave function is limited only by the grid and imaginary-time resolutions and can be improved in a controlled manner. Here, the method is tested for a series of model problems including fermions in a harmonic trap as well as the He atom in its singlet or triplet ground state. For the latter case, the energies approach from above with increasing grid resolution and converge within 0.015 E h of the exact basis-set-limit value for the grid spacing of 0.08 a.u. with a statistical uncertainty of 10 –5 E h without an importance sampling or Jastrow factor.

74 ATOMIC AND MOLECULAR PHYSICS↗
NASA NTRSDate not supplied

Evaluation of Correction Methods for NASA GeneLab Transcriptomic Datasets

Conducting space biology experiments aboard the International Space Station, particularly those utilizing complex model organisms like mice, is expensive and difficult due to limited crew availability, hardware, and space. As a result, sample numbers from these studies are low, reducing the statistical power of any one experiment. Aggregating spaceflight datasets serves as a method to increase sample numbers, allowing for novel insights through bioinformatic analysis of ‘omics data from merged datasets. However, aggregating datasets can introduce unwanted variation including 1) differences in sample handling, processing, and sequencing platforms between datasets (technical variation) as well as 2) differences in experimental design between datasets. In the present study, NASA GeneLab-hosted RNAseq datasets from mouse liver tissues were used to evaluate several statistical methods to correct for this unwanted variation through two approaches, reference-based and standard. The following correction algorithms were applied with (reference-based) and/or without (standard) considering Universal Mouse RNA Reference samples: ComBat and ComBat_seq from the SVA package, median polish, empirical Bayes, and ANOVA-based algorithms from the MBatch package, and negative binomial regression normalization in the DESeq2 package. For each approach, after the correction algorithm was applied, differential gene expression (DGE) analysis of flight and ground control samples was performed with the combined data. The robustness of each tool was evaluated using BatchQC to determine statistical differences between datasets before and after correction, Principal Component Analysis to evaluate global gene expression in samples before and after correction, and by comparing DGE analysis of individual datasets and combined datasets before and after correction. The results showed that the reference-based approach introduced several additional (and likely artificial) DEGs when compared with the respective standard approach. Of the methods tested, standard ComBat and DESeq2 were identified as the most robust correction methods for combining spaceflight mouse liver RNAseq datasets hosted on GeneLab.

GeneLab↗
DOE OSTI2025

Evaluation of a high-throughput method for processing sponge-stick samples to detect viable, non-spore-forming biothreat agents

After a bioterrorism incident, surface sampling is often used to determine the extent of contamination and exposure, guiding decontamination efforts and decisions for re-occupancy of affected sites. The sponge-stick (SS) is a preferred and commonly used device for sample collection to detect both spore-forming and non-spore-forming biothreat agents from non-porous surfaces. Here, in this study, a recently developed high-throughput method (HTM) for processing SS samples to detect viable Bacillus anthracis spores was adapted for detection of non-spore-forming biothreat agents, Yersinia pestis and Francisella tularensis. The scalable HTM was used to process up to 20 SS samples simultaneously, compared to the current stomacher-based method which processes one SS at a time. Comparisons of the HTM and the stomacher-based method were statistically indistinguishable for most experiments (P > 0.05) with HTM recoveries of 37–60 % for Y. pestis inoculated at 102–103 cells/SS and held 48 h at 4 °C to mimic sample transport/storage. The HTM was integrated with Rapid Viability-Polymerase Chain Reaction (RV-PCR) analysis to detect viable Y. pestis in the presence of particulate contamination (Arizona Test Dust, ATD). This approach detected Y. pestis inoculated at 20 cells/SS and ATD did not impact detection (P > 0.05). F. tularensis showed significantly lower recoveries between no-hold time and 48-h hold time (4 °C, P < 0.05) using the HTM, which further testing showed could be due to toxicity of the neutralizing buffer used for SS pre-wetting. With modifications, this method could enhance throughput capacity while maintaining similar recovery efficiencies to current methods for other non-spore-forming bacterial pathogens.

Biological and medical sciences↗
DOE OSTI2020

Accelerating quantum optics experiments with statistical learning

Quantum optics experiments, involving the measurement of low-probability photon events, are known to be extremely time-consuming. We present a methodology for accelerating such experiments using physically motivated ansatzes together with simple statistical learning techniques such as Bayesian maximum a posteriori estimation based on few-shot data. We show that it is possible to reconstruct time-dependent data using a small number of detected photons, allowing for fast estimates in under a minute and providing a one-to-two order of magnitude speed-up in data acquisition time. We test our approach using real experimental data to retrieve the second order intensity correlation function, G (2) ($τ$), as a function of time delay τ between detector counts, for thermal light as well as anti-bunched light emitted by a quantum dot driven by periodic laser pulses. The proposed methodology has a wide range of applicability and has the potential to impact the scientific discovery process across a multitude of domains.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Light potentials of photosynthetic energy storage in the field: what limits the ability to use or dissipate rapidly increased light energy?

The responses of plant photosynthesis to rapid fluctuations in environmental conditions are critical for efficient conversion of light energy. These responses are not well-seen laboratory conditions and are difficult to probe in field environments. We demonstrate an open science approach to this problem that combines multifaceted measurements of photosynthesis and environmental conditions, and an unsupervised statistical clustering approach. In a selected set of data on mint (Mentha sp.), we show that ‘light potentials’ for linear electron flow and non-photochemical quenching (NPQ) upon rapid light increases are strongly suppressed in leaves previously exposed to low ambient photosynthetically active radiation (PAR) or low leaf temperatures, factors that can act both independently and cooperatively. Further analyses allowed us to test specific mechanisms. With decreasing leaf temperature or PAR, limitations to photosynthesis during high light fluctuations shifted from rapidly induced NPQ to photosynthetic control of electron flow at the cytochrome b 6 f complex. At low temperatures, high light induced lumen acidification, but did not induce NPQ, leading to accumulation of reduced electron transfer intermediates, probably inducing photodamage, revealing a potential target for improving the efficiency and robustness of photosynthesis. We discuss the implications of the approach for open science efforts to understand and improve crop productivity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Comparative genomics of the Liberibacter genus reveals widespread diversity in genomic content and positive selection history

‘Candidatus Liberibacter’ is a group of bacterial species that are obligate intracellular plant pathogens and cause Huanglongbing disease of citrus trees and Zebra Chip in potatoes. Here, we examined the extent of intra- and interspecific genetic diversity across the genus using comparative genomics. Our approach examined a wide set of Liberibacter genome sequences including five pathogenic species and one species not known to cause disease. By performing comparative genomics analyses, we sought to understand the evolutionary history of this genus and to identify genes or genome regions that may affect pathogenicity. With a set of 52 genomes, we performed comparative genomics, measured genome rearrangement, and completed statistical tests of positive selection. We explored markers of genetic diversity across the genus, such as average nucleotide identity across the whole genome. These analyses revealed the highest intraspecific diversity amongst the ‘Ca. Liberibacter solanacearum’ species, which also has the largest plant host range. We identified sets of core and accessory genes across the genus and within each species and measured the ratio of nonsynonymous to synonymous mutations (dN/dS) across genes. We identified ten genes with evidence of a history of positive selection in the Liberibacter genus, including genes in the Tad complex, which have been previously implicated as being highly divergent in the ‘Ca. L. capsica’ species based on high values of dN.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1991

The analysis of a rocket tomography measurement of the N2+3914A emission and N2 ionization rates in an auroral arc

Techniques were developed for recovering two-dimensional distributions of auroral volume emission rates from rocket photometer measurements made in a tomographic spin scan mode. These tomographic inversion procedures are based upon an algebraic reconstruction technique (ART) and utilize two different iterative relaxation techniques for solving the problems associated with noise in the observational data. One of the inversion algorithms is based upon a least squares method and the other on a maximum probability approach. The performance of the inversion algorithms, and the limitations of the rocket tomography technique, were critically assessed using various factors such as (1) statistical and non-statistical noise in the observational data, (2) rocket penetration of the auroral form, (3) background sources of emission, (4) smearing due to the photometer field of view, and (5) temporal variations in the auroral form. These tests show that the inversion procedures may be successfully applied to rocket observations made in medium intensity aurora with standard rocket photometer instruments. The inversion procedures have been used to recover two-dimensional distributions of auroral emission rates and ionization rates from an existing set of N2+3914A rocket photometer measurements which were made in a tomographic spin scan mode during the ARIES auroral campaign. The two-dimensional distributions of the 3914A volume emission rates recoverd from the inversion of the rocket data compare very well with the distributions that were inferred from ground-based measurements using triangulation-tomography techniques and the N2 ionization rates derived from the rocket tomography results are in very good agreement with the in situ particle measurements that were made during the flight. Three pre-prints describing the tomographic inversion techniques and the tomographic analysis of the ARIES rocket data are included as appendices.

Mcdade, Ian C.↗
DOE OSTI2019

Learning-Based Inversion-Free Model-Data Integration to Advance Ecosystem Model Prediction

Ecosystem model prediction is important for understanding ecosystem responses to climate change and for management support. Model prediction and quantification of predictive uncertainty of ecosystems have long been investigated. The traditional workflow, which calibrates models to match observations and then uses the calibrated models for predictions, relies heavily on inverse modeling to constrain uncertain parameters in complex forward models. This inversion-based prediction approach is infeasible for complex models with heterogeneous parameter uncertainties and incapable of rapid integration of streaming and multiple sources of data because of the difficulty and computational cost in the model inversion, which is typically ill-posed and can require hundreds of thousands of expensive forward simulations to be performed iteratively. We propose to circumvent inverse modeling by precomputing an ensemble of unconstrained forward simulations and then using machine learning (ML) methods to learn the statistical relationship between simulated observation and prediction quantities. Once the ML model has learned the relationship, it can be used to make predictions of future system behavior with uncertainty quantification based on observations. The proposed learningbased inversion-free model prediction (LIMP) framework is computationally efficient which only requires a few thousands of fully parallelizable forward simulations. Additionally, LIMP can continually update predictions based on streaming observations from multiple locations and sources without necessarily requiring extra model simulations. In this study, we apply LIMP to a regional terrestrial ecosystem model with 47 parameters for testing, refining, and evaluating the approach. We demonstrate that LIMP can be used for efficient model prediction, rapid data assimilation, and cost-effective experimental design for improving robust predictive understanding of ecosystems.

Lu, Dan↗
NASA NTRS1982

A bootstrap approach to bump hunting

An important question in cluster analysis and pattern recognition is the determination of the number of clusters into which a given population should be divided. Frequently, particularly when certain specific clustering methods are being used, the number of clusters is taken to be equal to the number of modes, or local maxima, in the probability density function underlying the given data set. The use of kernal density estimates in mode estimation is discussed. The test statistic to be used is defined and a bootstrap technique for assessing significance is given. An illustrative application is followed by an examination of the asymptotic behavior of the test statistic.

Silverman, B. W.↗
DOE OSTI2017

Epidemiologic Study of One Million U.S. Radiation Workers and Veterans

The single most important question in radiation epidemiology is determining the level of health risks associated with radiation exposures that occur gradually over time. The study of one million early U.S. radiation workers and veterans has been designed to provide information on risk following chronic exposures by focusing on occupational groups with differing radiation exposure patterns, including intakes of radionuclides. The cost-efficient study builds on the investments made and foundations laid by investigators and government agencies over the past 30-40 years, which have established early worker cohorts that can now provide answers to questions on the lifetime human health risks associated with low-level radiation exposures. Within the overall goal of the epidemiologic study of one million U.S. radiation workers and veterans, this project had a total of nine specific aims which included studies of six populations for multiple endpoints including cancer overall mortality, leukemia and non-cancer mortality. The six populations included: Mound, Ohio, workers exposed to polonium, tritium and plutonium; nuclear power plant workers within the Landauer dosimetry and Nuclear Regulatory Commission data files; industrial radiographers; Mallinckrodt uranium workers; uranium workers who linked with the US Renal Data System; and nuclear weapons test participants. Over 400,000 workers and atomic veterans are included in these populations, with vital status being determined and analyses of all causes of death undertaken. A critical, integral component of the studies has been comprehensive evaluations of dosimetry involving, in many cases, complex dose reconstructions, and assessments of uncertainties. The work has also involved development of state-of-the art statistical approaches and modeling. All nine aims were accomplished successfully, resulting in publication of two NCRP documents, 13 literature papers, numerous Boice Reports in Health Physics News and many presentations of the work at scientific meetings. Furthermore, recommendations have been developed for an approach to integrate epidemiologic observations with radiation biology for risk assessment and biological models of radiation effect. The results of this project, as well as ongoing epidemiology studies of US radiation workers and veterans, are providing much-needed insights into complex issues regarding cancer and non-cancer health risks from low dose irradiation, how to apply a "dose and dose rate effectiveness factor" to scale the risks from the A-bomb survivor data to current occupational and environmental circumstances, and how to evaluate risk following intakes of radioactive substances. In addition to application to radiation workers, the results of the studies can provide guidance as society debates the role of nuclear energy and deals with nuclear waste, threats of terrorist attacks with nuclear/radiological devices, the remarkable increase in medical exposures to CT scans and nuclear imaging, and to NASA as radiation protection for astronauts on long-duration mission beyond low-Earth orbit is planned.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2023

Benchmarking Microscale Ductility Measurements (Final Report of the Project DE-NE0008799)

Conventional macroscale experimentation is generally considered to be straightforward with few limitations. Conversely, micro/nanoscale experimentation presents numerous challenges in loading device design, sample preparation and handling, as well as accurate understanding of grain size and local texture effects on recorded measurements. Despite these challenges, nanopillar compression, MEMs based micro-tension, and nanoindentation approaches have been able to provide fundamental contributions to the understanding of material behavior at small lengthscales. However, the overarching shortcoming of these micro/nanoscale experimentation approaches, is the inability to directly translate measurements evaluated at the nm and µm length scales (e.g., hardness) to macroscale tensile material behavior (i.e., elastic modulus, yield strength, and ductility). The objectives of the proposed study are, 1) to establish best practices for obtaining tensile microscale ductility measurements, and 2) to validate methodologies to for comparing microscale ductility measurements to macroscale ductility measurements. In order to achieve these objectives, a multi-lengthscale, multi-temperature testing protocol and simulation framework are executed first on copper as a model material to validate the following approach, and second on reactor grade Zircaloy-2. Experiments are conducted on specimens extracted from the same test piece to ensure nominally identical grain size and texture from specimens to specimen. Motivated by the need to isolate the contribution of size-effects on obtained mechanical property measurements, specimens are manufactured with thicknesses at the micro- (1-10 µm), meso- (10-100's µm), and macroscales (sub-sized ASTM E8). In-situ full-field deformation techniques (scanning electron microscopy (SEM) grid methods and optical DIC) are incorporated into testing at each specimen length-scale to capture plasticity localization and evolution. Experimental testing for all specimens is conducted at both room temperature and elevated temperatures to probe the role of thermal activation on plastic deformation accommodation processes. Simulation efforts focus on examining the mechanical behavior of microscale specimens using a finite element approach with explicitly resolved grain morphologies, and an embedded crystal plasticity model. The cost-efficient implementation method allows for the modeling of a statistically significant number of both real (i.e., digital twin) and generated microstructures to obtain an understanding of the interrelationships between specimen microstructure and geometric variables (grain size, texture, specimen geometry, etc.) on microscale mechanical behavior.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Can Simple Metrics Identify the Process(es) Driving Extreme Precipitation?

This work seeks an automatic algorithm to determine the primary meteorological cause(s) of individual extreme precipitation events. Such determinations have been made before, but required a by-hand analysis of each separate event. This is very time-consuming and the field would benefit from an automatic process. This is especially relevant when comparing different datasets to determine which ones most closely hew towards reality. This paper tests three simple metrics over the continental United States using the European Center for Medium-Range Weather Forecasting’s (ECMWF) atmospheric reanalysis (ERA5). The metrics tested measure and compare the strength of three meteorological processes associated with extreme precipitation: fronts, convection, and cyclones. A multivariate statistical technique as well as individual case studies show evidence that the three meteorological processes of interest cannot be isolated from one another using these simple physical metrics. This shows the difficulty in finding “pure” cases of these precipitation-generating processes and suggests approaching these processes with an eye toward mixed-type events.

Swenson, Leif M. (ORCID:0000000199708735)↗
NASA NTRS1992

A cloud and radiation model-based algorithm for rainfall retrieval from SSM/I multispectral microwave measurements

A hybrid statistical-physical retrieval scheme is explored which combines a statistical approach with an approach based on the development of cloud-radiation models designed to simulate precipitating atmospheres. The algorithm employs the detailed microphysical information from a cloud model as input to a radiative transfer model which generates a cloud-radiation model database. Statistical procedures are then invoked to objectively generate an initial guess composite profile data set from the database. The retrieval algorithm has been tested for a tropical typhoon case using Special Sensor Microwave/Imager (SSM/I) data and has shown satisfactory results.

Xiang, Xuwu↗
NASA NTRS2022

Recommendations on the Use of Commercial-Off-The-Shelf (COTS) Electrical, Electronic, and Electromechanical (EEE) Parts for NASA Missions - Phase II

This assessment had two Phases. Phase I captured NASA Centers’ current practices for commercial-off-the-shelf (COTS) Electrical, Electronic, and Electromechanical (EEE) parts 1 used in spaceflight systems and ground support equipment (available at https://ntrs.nasa.gov/citations/20205011579) [ref. 1]. The Phase II report provides guidance for selecting and using COTS parts in NASA missions. The approaches proposed in this report differ from current agency practices. This top-level executive summary touches on these new approaches for using COTS parts but does not provide the detailed information that is critical in understanding the rationale behind these new approaches. Readers will need to read the entire report to gain full understanding and effectively use the recommendations herein. NASA’s historical approach to selecting and applying parts has been to define certain parts, primarily specific classes of military specification (MIL-SPEC) parts, as “standard”, leaving all others, including COTS parts, as nonstandard. Standard parts typically are used without further testing (“use-as-is”). Nonstandard parts are subjected to initial screening and subsequent lot acceptance testing of representative samples from each procured lot per MIL-SPEC or similar requirements. Decades later, top-tier commercial part manufacturers have evolved significant manufacturing, statistical control, and technological improvements that can now provide parts as reliable or more reliable than MIL-SPEC parts, when used within their datasheet limits. Concurrently, the space science and exploration community’s needs demand technological advances unavailable with MIL-SPEC parts. This ongoing change necessitates using COTS parts for space missions. Properly selected COTS parts in appropriate applications can offer performance and supply availability advantages compared to MIL-SPEC parts. Their utility and demonstrated reliability result from large volumes and automated production and testing processes. However, careful review and a thorough understanding of their specifications (i.e., datasheet limitations) is needed, and verifying that manufacturer specifications and reliability meet space hardware application needs are necessary. This report recommends MIL-SPEC screening and non-radiation-related lot acceptance testing be reduced or eliminated in cases where evidence of sufficient quality and reliability exists for COTS parts. The extent of NASA's insight into COTS manufacturers and the amount and nature of the needed evidence will differ by mission and will likely be driven by a mission's resources and associated risk posture. To facilitate this goal, two new terminologies have been defined and described: “Industry Leading Parts Manufacturer (ILPM)” and “Established COTS parts.” An ILPM is a COTS manufacturer that produces high quality and reliable parts. Some parts produced by ILPMs, defined as Established COTS parts, do not need any additional MIL-SPEC or NASA screening and lot acceptance testing to be used in space applications. This report provides guidance for selecting, procuring, and applying COTS parts and for performing part-, board-, and system-level COTS parts verification. The recommendation to select Established COTS parts from ILPMs will assure those COTS parts will have comparable quality to corresponding MIL-SPEC parts. Selecting, applying, and verifying Established COTS parts from ILPMs requires a holistic team approach, engaging parts engineers, circuit designers, quality, reliability, and systems engineers, procurement specialists, radiation specialists, avionics leads, and program/project managers. A mission-specific approach tailored to a project’s Mission, Environment, Applications and Lifetime (MEAL) [ref. 2] requirements should be developed and approved by program/project managers. Any associated risks should be clearly identified, quantified, mitigated, and/or accepted. Different approaches are recommended according to program/project Risk Classes A, B, C, and D [ref. 3] and human-rated missions [ref. 4]: 1. Recommend Classes A and B and human-rated missions consider a “MIL-SPEC parts- based design” approach. ”MIL-SPEC parts-based design” approach is one in which most parts are MIL-SPEC parts and Established COTS parts from ILPMs are used only when an equivalent MIL-SPEC part does not meet functional or size, weight, and power (SWaP) or performance requirements, or is not available. 2. Recommend Classes D and Sub-D missions consider a “System of COTS” approach. “System of COTS” approach is one which most parts are Established COTS parts from ILPMs. 3. Recommend Class C missions determine which approach is the best for their projects; that is, use either a “MIL-SPEC parts-based design” approach, “System of COTS” approach, or a combined approach utilizing elements of both. This report intends to provide guidance in using COTS parts for NASA missions with risk classifications of A through D and human-rated missions; but it does not address the costs of using COTS parts. Costs of using COTS parts in different NASA mission classes can vary significantly even if the same parts are used in different risk postures, due to differing verification levels needed. The guidance does not distinguish between critical or non-critical systems, and a given project will need to apply the appropriate guidance based on their risk posture. The intended audience of this report are NASA personnel and commercial practitioners who support NASA’s spaceflight missions, including spaceflight program or project managers, parts engineers, parts manufacturers, radiation engineers, avionics engineers, system engineers, circuit design engineers, reliability engineers, safety and mission assurance (SMA) personnel, and parts procurement specialists. The NEPP Program will perform a pathfinder study to explore implementing the guidance in this NESC report. An ILPM verification process is not the same as conventional vendor qualification processes performed according to military standards and specifications. This NESC report intends to provide guidance in utilizing available parts data from ILPM manufacturers for parts assurance assessments needed for NASA missions. The report also captured the current practices from DoD and Federal Aviation Administration (FAA) in Section 10. Note each DoD and FAA report was provided by the corresponding agencies regarding their practices, which are independent from the NESC recommendations in the report.

Commercial-Off-The-Shelf↗