Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistically designed experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Analyst-to-Analyst Variability in Simulation-Based Prediction

This report describes findings from the culminating experiment of the LDRD project entitled, "Analyst-to-Analyst Variability in Simulation-Based Prediction". For this experiment, volunteer participants solving a given test problem in engineering and statistics were interviewed at different points in their solution process. These interviews are used to trace differing solutions to differing solution processes, and differing processes to differences in reasoning, assumptions, and judgments. The issue that the experiment was designed to illuminate -- our paucity of understanding of the ways in which humans themselves have an impact on predictions derived from complex computational simulations -- is a challenging and open one. Although solution of the test problem by analyst participants in this experiment has taken much more time than originally anticipated, and is continuing past the end of this LDRD, this project has provided a rare opportunity to explore analyst-to-analyst variability in significant depth, from which we derive evidence-based insights to guide further explorations in this important area.

97 MATHEMATICS AND COMPUTING↗

Processing Methodology for Double Sensor Probe in a Bubbly Flow

Bubbly flow phenomenon is the most common flow pattern in nuclear plant system. In this paper, according to Hibiki and Bartel, the experiment was designed to observe the fluid conditions surrounding nuclear rod. In recent years, double sensor probe is one of the measuring techniques for the bubbly flow. It can measure local void fraction and bubble velocity. After mathematical statistical calculation, interfacial area concentration is obtained by Kataoka. The double sensor probe method, with the advantage for measuring local interfacial area concentration, has become widely used in many measurement methods. The paper of Liu and Zhao were referred to establish the post-processing for the raw data obtained from measuring instrument. After drawing the signal of the probe, it is important to analyze the raw data for the elimination of unnecessary noise signal and highlight the characteristic signal. Based on the same experimental condition, the different filtering methods, Simple Moving Average (SMA) and Gaussian average, were compared and discussed by the double sensor probe.

42 ENGINEERING↗

Omics-Lethal Human Viruses, West Nile Experiment WGCN002

The purpose of this experiment was to evaluate the host response to wild-type West Nile virus infectious clone (WNV-NY99 clone 382) and mutant (WNVE218A) virus infection. Sample data was obtained from mouse granule cell neurons for mRNA and miRNA expression analysis. See Experiment WGCN003 for corresponding independent biological replicate study. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Transcriptomics dataset downloads have a direct relationship to a primary sample submission corresponding to a specific West Nile virus infection.

59 BASIC BIOLOGICAL SCIENCES↗

Omics-Lethal Human Viruses, West Nile Experiment WGCN003

The purpose of this experiment was to evaluate the host response to wild-type West Nile virus infectious clone (WNV-NY99 clone 382) and mutant (WNVE218A) virus infection. Sample data was obtained from mouse granule cell neurons for mRNA and miRNA expression analysis. See Experiment WGCN002 for corresponding independent biological replicate study. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Transcriptomics dataset downloads have a direct relationship to a primary sample submission corresponding to a specific West Nile virus infection.

59 BASIC BIOLOGICAL SCIENCES↗

The X-43A Flight Research Program: Lessons Learned on the Road to Mach 10

During an aerospace engineer's undergraduate studies, he or she will attend classes in aerodynamics, thermodynamics, structures, stability and control, dynamics, design, propulsion, and computer science, along with the related courses in mathematics, physics, statistics, and chemistry required to understand the material. Upon graduation, the new engineer will have acquired a basic knowledge of how to build an aerospace vehicle. What only comes through experience, however, is the understanding of the inevitable imperfect process through which an aerospace vehicle is built. This is the adventure of turning a basic concept into functional hardware. Engineers working on a project must often deal with ambiguous situations. They are routinely asked by management to provide risk assessments of a project, yet even after careful analysis uncertainties remain. The project must be accomplished within finite limits of time and money. The question an engineer answers is whether the solution to potential problem is worth the cost and schedule delay, or if the solution might actually be worse than the problem it is meant to solve. Review protocols are established to ensure that an unknown has not been overlooked. But these cannot protect against an unknown unknown. Examples of these situations can be found in the history of the X-43A Hyper-X (Hypersonic Experiment) program. In this NASA project, a supersonic combustion ramjet (scramjet) engine was flight tested on a subscale vehicle. The X-43A Hyper-X Research Vehicle (HXRV) was launched from a B-52B mothership, then boosted to the test speed by a modified Pegasus rocket first stage, called the Hyper-X Launch Vehicle (HXLV). Once at the proper speed and altitude, the X-43A separated from the booster, stabilized itself, and then the engine test began. Although wind-tunnel scramjet engine tests had begun in the late 1950s, before the Hyper-X program there had never been an actual in-flight test of such an engine integrated with an appropriate airframe. Thus, while the scramjet had successfully operated in the artificial airflow of wind tunnels, the concept had yet to be proven in real air. These conditions meant changes in density and temperature, as well as changes in angle of attack and sideslip of a free-flying vehicle. A wind tunnel is limited in its ability to simulate these subtle factures, which have a major impact on almost any vehicle, but especially that of a scramjet's performance. The Hyper-X project was to provide a real-world benchmark of the ground test data. The full scale X-43A engine would be operated in the wind tunnel, and then flown, and the data from its operation would then be compared with projections. If these matched, the wind tunnel data would be considered a reliable design tool for future scramjet. If there were significant differences, the reasons for these would have to be identified. Until such information was available, scramjets would lack the technological maturity to be considered for future space launch or high-speed atmospheric flight vehicles.

Peebles, Curtis↗

Study of Whisper Statistics for Criticality Safety Code Validation

Whisper is computational software designed to assist with validation studies with the Monte Carlo particle transport package MCNP. Historical approaches rely on expert based judgment to select benchmarks while Whisper uses sensitivity/uncertainty (S/U) methods to select relevant benchmarks to a particular application model. Whisper will also derive a calculational margin and margin of subcriticality (MOS) that may be used to generate an upper subcritical limit (USL) for a particular application model. Whisper finds benchmark experiments whose isotope sensitivity profiles align best with the MCNP model in question, and assign a correlation coefficient ('ck' in Whisper parlance) to each selected benchmark as a measure of how closely those profiles agree. When ck values are high, there is less uncertainty between model and benchmarks and a higher USL is possible, relative to cases when ck values are low. The default Whisper settings recommends a 100,000 particles per cycle run for 500 active cycles, resulting in 50 M active neutron histories per application run. This is computationally intensive and may not be necessary to produce accurate results. A Whisper statistical study was done varying the neutron histories per cycle from 10,000 to the default 100,000. A lower number of neutron histories will allow Whisper to be used on low memory systems such as laptops. The intent of this paper is to present the changes in the Whisper results as the number of neutrons histories run is varied.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Increases in Future AR Count and Size: Overview of 2 the ARTMIP Tier 2 CMIP5/6 Experiment

The Atmospheric River (AR) Tracking Method Intercomparison Project (ARTMIP) is a community effort to systematically assess how the uncertainties from AR detectors (ARDTs) impact our scientific understanding of ARs. This study describes the ARTMIP Tier 2 experimental design and initial results using the Coupled Model Intercomparison Project (CMIP) Phases 5 and 6 multi-model ensembles. We show that AR statistics from a given ARDT in CMIP5/6 historical simulations compare remarkably well with the MERRA-2 reanalysis. In CMIP5/6 future simulations, most ARDTs project a global increase in AR frequency, counts, and sizes, especially along the western coastlines of the Pacific and Atlantic oceans. We find that the choice of ARDT is the dominant contributor to the uncertainty in projected AR frequency when compared with model choice. These results imply that new projects investigating future changes in ARs should explicitly consider ARDT uncertainty as a core part of the experimental design. Plain Language Summary: Atmospheric rivers (ARs) are a type of weather pattern known to be important for moving water vapor from the warm, moist tropics to the cool, dry polar regions; when they reach midlatitudes in the winter time, they are commonly associated with heavy precipitation. Recent studies that assess the impacts of global climate change on ARs tend to agree that there will be more ARs in a warmer climate, and that ARs will tend to be more extreme. However, it has been increasingly recognized by the AR research community that these results may depend on the method used to identify ARs and the choice of climate model. This study reports results from a controlled experiment, involving an international research community, that aims to show how different AR identification methods and climate models might impact our scientific understanding of ARs in the future. This experiment shows that there will likely be more ARs in the future, and that ARs will generally have a larger spatial footprint. This experiment also shows that uncertainty in these results are large, with the uncertainty from AR identification methods outweighing that of climate models. Future efforts to better understand the physics of ARs may help us reduce this uncertainty.

T A OBrien↗

Continuous Integration Service at Fermilab

This paper describes the current architecture of Continuous Integration (CI) service developed at Fermilab, encountered successes and difficulties, as well as future development plans. The current experiment code has hundreds of contributors that provide new features, bug fixes, and other improvements. Version control systems help developers to collaborate in contributing software for their experiments, while the CI system helps developers keep their code healthy. The Fermilab CI service allows experiments and projects to test and validate their offline production and analysis code on the supported platforms. It is built on top of Jenkins, designed to be set up from a configuration file that provides implementation for each phase of the CI workflow, and able to validate experiment code through grid jobs. This CI service provides a dashboard for easy access to logs and statistical graphs. Since the CI service has been adopted by Fermilab experiments/projects, it proved to be very useful to intercept issues in their code early on and get them fixed before running it in production. Currently the CI service is in use by the ArgoNeuT, DUNE, g-2, LArIAT, MINERvA, mu2e, NOvA, SBND and uBooNE experiments and by the following projects: ART and LArSoft software suites, GENIE, and Glidein-WMS. The CI service is under active development and planning to support code profiling.

Di benedetto, Vito↗

Distributed data management on Belle II

The Belle II experiment started taking physics data in April 2018 with an estimated total volume of all files including raw events, Monte-Carlo and skim statistics of 340 petabytes expected by the end of operations in the late-2020s. Originally designed as a fully integrated component of the BelleDIRAC production system, the Belle II distributed data management (DDM) software needs to manage data across about 29 storage elements worldwide for a collaboration of nearly 1000 physicists. By late 2018, this software required significant performance improvements to meet the requirements of physics data taking and was seriously lacking in automation. Rucio, the DDM solution created by ATLAS, was an obvious alternative but required tight integration with BelleDIRAC and a seamless yet non-trivial migration. This contribution describes the work done on both DDM options, the current status of the software running successfully in production and the problems associated with trying to balance long-term operations cost against short term risk. .

97 MATHEMATICS AND COMPUTING↗

Omics-Lethal Human Viruses, West Nile Experiment WDC010

The purpose of this experiment was to evaluate the host response to wild-type West Nile virus (WNVMT) and mutant (WNVE218A) virus infection. Sample data was obtained from primary mouse myeloid dendritic cells for mRNA and proteomics expression analysis. See Experiment WDC011 (GSE75222) for corresponding independent biological replicate study. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Leveraging unique high-resolution Omics capabilities for proteomics and transcriptomics, each dataset download has a direct relationship to a primary sample submission corresponding to a specific West Nile virus infection.

59 BASIC BIOLOGICAL SCIENCES↗

Omics-Lethal Human Viruses, West Nile Experiment WDC011

The purpose of this experiment was to evaluate the host response to wild-type West Nile virus (WNVMT) and mutant (WNVE218A) virus infection. Sample data was obtained from primary mouse myeloid dendritic cells for mRNA expression analysis. See Experiment WDC010 (GSE74628) for corresponding independent biological replicate study. Secondary host-associated viral dataset downloads contain one or more statistically processed (normalization data transformation) quantitative dataset collections resulting in qualitative expression analyses of primary host-pathogen experimental study designs. Transcriptomics dataset downloads have a direct relationship to a primary sample submission corresponding to a specific West Nile virus infection.

59 BASIC BIOLOGICAL SCIENCES↗

REDUNDANT ARRAY CONFIGURATIONS FOR 21 cm COSMOLOGY

Realizing the potential of 21 cm tomography to statistically probe the intergalactic medium before and during the Epoch of Reionization requires large telescopes and precise control of systematics. Next-generation telescopes are now being designed and built to meet these challenges, drawing lessons from first-generation experiments that showed the benefits of densely packed, highly redundant arrays—in which the same mode on the sky is sampled by many antenna pairs—for achieving high sensitivity, precise calibration, and robust foreground mitigation. In this work, we focus on the Hydrogen Epoch of Reionization Array (HERA) as an interferometer with a dense, redundant core designed following these lessons to be optimized for 21 cm cosmology. We show how modestly supplementing or modifying a compact design like HERA’s can still deliver high sensitivity while enhancing strategies for calibration and foreground mitigation. In particular, we compare the imaging capability of several array configurations, both instantaneously (to address instrumental and ionospheric effects) and with rotation synthesis (for foreground removal). We also examine the effects that configuration has on calibratability using instantaneous redundancy. We find that improved imaging with sub-aperture sampling via “off-grid” antennas and increased angular resolution via far-flung “outrigger” antennas is possible with a redundantly calibratable array configuration.

79 ASTRONOMY AND ASTROPHYSICS↗

Development of NASA's Accident Precursor Analysis Process Through Application on the Space Shuttle Orbiter

Accident Precursor Analysis (APA) serves as the bridge between existing risk modeling activities, which are often based on historical or generic failure statistics, and system anomalies, which provide crucial information about the failure mechanisms that are actually operative in the system. APA docs more than simply track experience: it systematically evaluates experience, looking for under-appreciated risks that may warrant changes to design or operational practice. This paper presents the pilot application of the NASA APA process to Space Shuttle Orbiter systems. In this effort, the working sessions conducted at Johnson Space Center (JSC) piloted the APA process developed by Information Systems Laboratories (ISL) over the last two years under the auspices of NASA's Office of Safety & Mission Assurance, with the assistance of the Safety & Mission Assurance (S&MA) Shuttle & Exploration Analysis Branch. This process is built around facilitated working sessions involving diverse system experts. One important aspect of this particular APA process is its focus on understanding the physical mechanism responsible for an operational anomaly, followed by evaluation of the risk significance of the observed anomaly as well as consideration of generalizations of the underlying mechanism to other contexts. Model completeness will probably always be an issue, but this process tries to leverage operating experience to the extent possible in order to address completeness issues before a catastrophe occurs.

Maggio, Gaspare↗

Directed Design of Experiments (DOE) for Determining Probability of Detection (POD) Capability of NDE Systems (DOEPOD)

This viewgraph presentation reviews some of the problems that are encountered by designers of Non-Destructive Examination (NDE) have in determining the probability of detection. According to the author "[the] NDE community should not blindly accept statistical results due to lack of knowledge." This is an attempt to bridge the gap between people doing NDE, and statisticians.

Generazio, Edward R.↗

Decoupling of heat generated from ejected and non-ejected contents of 18650-format lithium-ion cells using statistical methods

Effective thermal management systems, designed to handle the impacts of thermal runaway (TR) and to prevent cell-to-cell propagation, are key to safe operation of lithium-ion (Li-ion) battery assemblies. Critical factors for optimizing these systems include the total energy released during a single cell TR event and the fraction of the total energy that is released through the cell casing versus through the ejecta material. A unique fractional thermal runaway calorimeter (FTRC), designed to characterize said critical factors, was utilized to examine the TR behavior of 18650-format Li-ion cells representing a variety of manufacturers, chemistries, capacities, and safety features. Primarily, the impacts of bottom vent (BV) safety features, varied cell casing thickness, and Dreamweaver cellulose based separators were assessed for select cell types. A subset of cells also had an imbedded internal short circuiting (ISC) device to allow examination of TR behavior initiated at lower temperatures (i.e. closer to field failure conditions). The impact of bottom rupture on TR behavior was also examined for experiments that resulted in this non-standard failure mechanism. Statistical analysis of the results for each cell configuration reveals that a lognormal distribution effectively characterizes the variation of total TR energy release. Typically 20%-30% of the total energy yield is released through the cell casing with the remainder through the ejecta material. Higher energy cells tend to exhibit more violent ejections and less predictable TR events. Inclusion of a BV feature reduces the overall severity of the TR event and can increase the predictability. Results also suggest that the magnitude of the TR event may not be directly proportional to the stored electrical energy, but rather has additional dependence on other design and failure mode factors.

25 ENERGY STORAGE↗

Learning protocols for the fast and efficient control of active matter

Exact analytic calculation shows that optimal control protocols for passive molecular systems often involve rapid variations and discontinuities. However, similar analytic baselines are not generally available for active-matter systems, because it is more difficult to treat active systems exactly. Here we use machine learning to derive efficient control protocols for active-matter systems, and find that they are characterized by sharp features similar to those seen in passive systems. We show that it is possible to learn protocols that effect fast and efficient state-to-state transformations in simulation models of active particles by encoding the protocol in the form of a neural network. We use evolutionary methods to identify protocols that take active particles from one steady state to another, as quickly as possible or with as little energy expended as possible. Our results show that protocols identified by a flexible neural-network ansatz, which allows the optimization of multiple control parameters and the emergence of sharp features, are more efficient than protocols derived recently by constrained analytical methods. Our learning scheme is straightforward to use in experiment, suggesting a way of designing protocols for the efficient manipulation of active matter in the laboratory.

74 ATOMIC AND MOLECULAR PHYSICS↗

AAFE man-made noise experiment project. Volume 1: Introduction experiment definition and requirements

An experiment was conducted to measure and map the man-made radio frequency emanations which exist at earth orbital altitudes. The major objectives of the program are to develop a complete conceptual experiment and developmental hardware for the collection and processing of data required to produce meaningful statistics on man-made noise level variations as functions of time, frequency, and geographic location. A wide dispersion measurement receiver mounted in a spacecraft operating in a specialized orbit is used to obtain the data. A summary of the experiment designs goals and constraints is provided. The recommended orbit for the spacecraft is defined. The characteristics of the receiver and the antennas are analyzed.

Source record↗

Statistical learning framework for safety and failure analysis of a DNN-based autonomous aircraft system

Deep Neural Networks (DNNs) and Machine Learning technology is increasingly used for safety-critical applications in the Aerospace domain. To ensure safe operations, the DNN and the system must undergo rigorous verification and validation, including advanced statistical analyses. Performance and safety of the DNN and system behavior must not only be analyzed for the nominal case, but under numerous off-nominal and failure cases. In this paper we will describe how our statistical learning framework SYSAI can efficiently perform such analyses using the tool’s unique combination of advanced learning modeling and statistical analysis techniques. SYSAI can effectively explore the high-dimensional state and failure space of the system under test; geometrical shape detection of safety regions and boundaries support explainability of the results to the designer. In this paper, we report experiments and results obtained with a vision-based DNN control system (ACT) that is capable of autonomously steering an aircraft down a runway.

Yuning He↗