Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

The Development of a Smart Distribution Grid Testbed for Integrated Information Management Systems

This paper presents a smart distribution grid testbed to test or compare designs of integrated information management systems (I2MSs). An I2MS extracts and synthesizes information from a wide range of data sources to detect abnormal system behaviors, identify possible causes, assess the system status, and provide grid operators with response suggestions. The objective of the testbed is to provide a modeling environment with sufficient data sources for the I2MS design. The testbed includes five information layers and a physical layer; it generates multi-layer chronological data based on actual measurement playbacks or simulated data sets produced by the physical layer. The testbed models random hardware failures, human errors, extreme weather events, and deliberate tampering attempts to allow users to evaluate the performance of different I2MS designs. Initial results of I2MS performance tests showed that the testbed created a close-to-real-world environment that allowed key performance metrics of the I2MS to be evaluated.

99 GENERAL AND MISCELLANEOUS↗

Evaluation of the impact of noise metrics on tiltrotor aircraft design

A subjective noise evaluation was conducted in which the test participants evaluated the annoyance of simulated sounds representative of future civil tiltrotor aircraft. The subjective responses were correlated with the noise metrics of A-weighted sound pressure level, overall sound pressure level, and perceived level. The results indicated that correlation between subjective response and A-weighted sound pressure level is considerably enhanced by combining it in a multiple regression with overall sound pressure level. As a single metric, perceived level correlated better than A-weighted sound pressure level due to greater emphasis on low frequency noise components. This latter finding was especially true for indoor noise where the mid and high frequency noise components are attenuated by typical building structure. Using the results of the subjective noise evaluation, the impact on tiltrotor aircraft design was also evaluated. While A-weighted sound pressure level can be reduced by reduction in tip speed, an increase in number of rotor blades is required to achieve significant reduction of low frequency noise as measured by overall sound pressure level. Additional research, however, is required to achieve comparable reductions in impulsive noise due to blade-vortex interaction, and also to achieve reduction in broad band noise.

Sternfeld, H.↗

Desert Research and Technology Studies 2008 Report

During the last two weeks of October 2008, the National Aeronautics and Space Administration (NASA) Johnson Space Center (JSC) Advanced Extravehicular Activity (AEVA) team led the field test portion of the 2008 Desert Research and Technology Studies (D-RATS) near Flagstaff, AZ. The Desert RATS field test activity is the year-long culmination of various individual science and advanced engineering discipline areas technology and operations development efforts into a coordinated field test demonstration under representative (analog) planetary surface terrain conditions. The 2008 Desert RATS was the eleventh RATS field test and was the most focused and successful test to date with participants from six NASA field centers, three research organizations, one university, and one other government agency. The main test objective was to collect Unpressurized Rover (UPR) and Lunar Electric Rover (LER) engineering performance and human factors metrics while under extended periods of representative mission-based scenario test operations involving long drive distances, night-time driving, Extravehicular Activity (EVA) operations, and overnight campover periods. The test was extremely successful with all teams meeting the primary test objective. This paper summarizes Desert RATS 2008 test hardware, detailed test objectives, test operations, and test results.

Romig, Barbara↗

Simulation of moderated plutonium neutron multiplicity measurements.

The purpose of this work is to improve detection methods that can reliably identify special nuclear material (SNM). One method that can be used to identify special nuclear material is neutron multiplicity analysis. This method detects multiple time-correlated neutrons released from a fission event in the SNM. This work investigates the ability of the software code MCNP-PoliMi to simulate neutron multiplicity measurements from a highly moderated SNM source. A measurement of a 4.5-kg alpha-phase metal plutonium sphere surrounded by up to 6 inches of polyethylene shells has recently been performed by Sandia National Laboratories personnel at the Nevada Test Site. A post-processing code was developed to account for dead-time effects within the detector and to determine the neutron multiplicity distributions for various time intervals. With the distributions calculated, the Feynman-Y can be determined. The Feynman-Y is a metric that measures the level of correlation present in a sample. At this time MCNP-PoliMi is able predict the Feynman-Y within 10% of the measured value.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Radiation Testing at Sandia National Laboratories: Sandia – JPL Collaboration for Europa Lander

Sandia National Laboratories (SNL) is assisting Jet Propulsion Laboratory in undertaking feasibility studies and performance assessments for the Planetary Protection aspect of the Europa Lander mission. The specific areas of interest for this project are described by task number. This white paper presents the evaluation results for Task 2, Radiation Testing, which was stated as follows: Survey SNL facilities and capabilities for simulating the Europan radiation environment and assess suitability for: A. Testing batteries, electronics, and other component and subsystems B. Exposing biological organisms to assess their survivability metrics. The radiation environment the Europa Lander will encounter on route and in orbit upon arrival at its destination consists primarily of charged particles, energetic protons and electrons with the energies up to 1 GeV. The charged particle environments can be simulated using the accelerators at the Ion Beam Laboratory. The Gamma Irradiation Facility and its annex, the Low Dose Rate Irradiation Facility, offer irradiations using Co-60 gamma sources (1.17 and 1.33 MeV), as well as Cs-137 gamma (0.661 MeV) AmBe neutron (0-10 MeV) sources.

07 ISOTOPE AND RADIATION SOURCES↗

Applying Hanford Tank Mixing Data to Define Pulse Jet Mixer Operation

Pulse jet mixed (PJM) process vessels are being developed for storing, blending, and chemical processing of nuclear waste slurries at the Waste Treatment and Immobilization Plant (WTP) to be built at Hanford, Washington. These waste slurries exhibit variable process feed characteristics including Newtonian to non-Newtonian rheologies over a range of solids loadings. Waste feed to the WTP from the Hanford Tank Farms will be accomplished via the Waste Feed Delivery (WFD) system which includes million-gallon underground storage double-shell tanks (DSTs) with dual-opposed jet mixer pumps. Experience using WFD type jet mixer pumps to mobilize actual Hanford waste in DSTs may be used to establish design threshold criteria of interest to pulse jet mixed process vessel operation. This paper describes a method to evaluate the pulse jet mixed vessel capability to process waste based on information obtained during mobilizing and suspending waste by the WFD system jet mixer pumps in a DST. Calculations of jet velocity and wall shear stress in a specific pulse jet mixed process vessel were performed using a commercial computational fluid dynamics (CFD) code. The CFD-modelled process vessel consists of a 4.9-m- (16-ft-) diameter tank with a 2:1 semi-elliptical head, a single, 10-cm (4-in.) downward facing 60-degree conical nozzle, and a 0.61-m (24-in.) inside diameter PJM. The PJM is located at 70% of the vessel radius with the nozzle stand-off-distance 14 cm (6 in.) above the vessel head. The CFD modeled fluid velocity and wall shear stress can be used to estimate vessel waste-processing performance by comparison to available actual WFD system process data. Test data from the operation of jet mixer pumps in the 23-m (75-ft) diameter DSTs have demonstrated mobilization, solid particles in a sediment matrix were moved from their initial location, and suspension, mobilized solid particles were moved to a higher elevation in the vessel than their initial location, of waste solids. Jet mixer pumps were used in Hanford waste tank 241-AZ-101, and at least 95% of the 0.46-m (18-in.) deep sediment, with a shear strength of 1,500 to 4,200 Pa, was mobilized. Solids with a median particle size of 43 μm, 90th percentile of 94μm, were suspended in tank 241-AZ-101 to at least 5.5 m (216 in.) above the vessel bottom. Analytical calculations for this jet mixer pump test were used to estimate the velocities and wall shear stress that mobilized and suspended the waste. These velocities and wall shear stresses provide design threshold criteria which are metrics for system performance that can be evaluated via testing. If the fluid motion in a specific pulse jet mixed process vessel meets or exceeds the fluid motion of the demonstrated performance in the WFD system, confidence is provided that that vessel will similarly mobilize and suspend those solids if they were within the WTP. The single PJM CFD-calculated jet velocity and wall shear stress compare favorably with the design threshold criterion estimated for the tank 241-AZ-101 process data. Therefore, for both mobilization and suspension, the performance data evaluated from the WFD system testing increases confidence that the performance of the pulse jet mixed process vessels will be sufficient to process that waste even if that waste is not fully characterized.

mixing' slurry↗

Non-Destructive Evaluation of Polyolefin Thermal Aging Using Infrared Spectroscopy

Fourier transform infrared (FTIR) spectroscopy is an information-rich method that reveals chemical bonding near the surface of polymer composites. FTIR can be used to verify composite composition, identify chemical contaminants and expose composite moisture content. Polymer matrix changes due to thermal exposure including loss of additives, chain scission, oxidation and changes in crystallinity may also be determined using FTIR spectra. Portable handheld instruments using non-contact reflectance or surface contact attenuated total reflectance (ATR) may be used for non-destructive evaluation (NDE) of thermal aging in polymer and composite materials of in-service components. We report the use of ATR FTIR to track oxidative thermal aging in ethylene-propylene rubber (EPR) and chlorinated polyethylene (CPE) materials used in medium voltage nuclear power plant electrical cable insulation and jacketing. Mechanical property changes of the EPR and CPE materials with thermal degradation for correlation with FTIR data are tracked using indenter modulus (IM) testing. IM is often used as a local NDE metric of cable jacket health. The FTIR-determined carbonyl index was found to increase with IM and may be a valuable NDE metric with advantages over IM for assessing cable remaining useful life.

aging↗

Evaluation of Response Surface Experiment Designs for Distributed Propulsion Aircraft Aero-Propulsive Modeling

Modern distributed hybrid and electric propulsion aircraft, including vertical, short, and conventional takeoff and landing configurations, exhibit significant aero-propulsive complexity and a large number of interacting test factors. This paper presents the development and evaluation of experiment designs for aero-propulsive characterization of distributed propulsion aircraft. Five different foundational response surface designs are evaluated to inform the development of two sequential design approaches tailored to complex aircraft aerodynamic characterization experiments. The first approach, which builds on sequential face-centered central composite designs, has been used previously to develop aero-propulsive models for complex aircraft using wind tunnel testing. The second approach is a new design strategy leveraging a regular I-optimal and nested I-optimal design that was developed for this study. The two sequential design strategies are compared for experiments with a large number of test factors using pre-experiment design evaluation metrics, as well as modeling results obtained from simulated wind tunnel data for the NASA LA-8 aircraft. The design evaluation metrics show that the sequential I-optimal base design has higher statistical power, lower correlation among candidate regressors, lower prediction variance, and more precise parameter estimates. The simulated wind tunnel experiments conducted using each design reveal that the sequential I-optimal base design has better predictive capability with fewer test points. The experiment design and evaluation procedures are described in detail to inform future aerodynamic characterization experiments for complex aircraft.

design of experiments↗

Commercialization Effort for 1W Consumer Electronics Power Pack

A commercial ready fuel cell charger has been further developed, demonstrated, and field tested during the three phases of this project. The work performed and demonstrated has shown the commercialization readiness of this future product and underlying technology. The tasks in phase 1 of the project focused on component cost reduction, redesign for manufacturability, performance & reliability testing, and system integration. The end of phase 1 was completed on time and was signified by passing the Go/No-Go checkpoint. As shown in the report all technical metrics have been met or exceeded and the Go/No-Go checkpoint was passed in November of 2009. The tasks in phase 2 focused on tool fabrication and tooled component prove-out in working systems. The end of Phase 2 was the accomplishment of building working systems made almost completely of tooled components. The tasks in phase 3 of the project were preparing for and executing a 75 unit field test of the DMFC charger product developed in Phase 1 and phase 2. This field test demonstrated the functionality of the DMFC in the hands of real users while also providing feedback for potential design improvements. This was the first time a significant number of MTI units were put into the field to test usability and functionality. Feedback from the field test was positive and the units functioned well in the field.

08 HYDROGEN↗

Sensor Analysis, Modeling, and Test for Robust Propulsion System Autonomy

An approach is presented supporting analysis, modeling, and test validation of operational flight instrumentation (OFI) that facilitates critical functions for the Space Launch System (SLS) main propulsion system (MPS). Certain types of OFI sensors were shown to exhibit highly nonlinear and non-gaussian noise characteristics during acceptance testing, motivating the development of advanced modeling and simulation (M&S) capability to support algorithm verification and flight certification. Hardware model and algorithm simulation fidelity was informed by a risk scoring metric; redesign of high-risk algorithms using test-validated sensor models significantly improved their expected performance as evaluated using Monte Carlo acceptance sampling methods. Autonomous functions include closed-loop ullage pressure regulation, pressurant leak detection, and fault isolation for automated safing and crew caution and warning (C&W).

Orr, Jeb S.↗

Utilizing Strain Rate Jump Testing to Predict Flow Formability of Al Alloys Sensitive to Portevin-Le Chatelier Instabilities

Predicting the flow formability of Al alloys is challenging due to the incremental deformation, complex loading path, and wide range of strain rates characteristic of the process. State-of-the-art research efforts have primarily focused on formability metrics derived from ambient temperature, constant strain rate uniaxial tensile testing. However, Al alloys in formable tempers tend to exhibit serrated Portevin-Le Chatelier (PLC) flow. The appearance of PLC instabilities implies a negative strain rate sensitivity, loss of tensile area reduction capacity, and decreased formability. Elevated temperature and interrupted strain rate tensile tests of relevant Al alloys were conducted to investigate the effects of rapid changes in strain rate (analogous to a forming increment by a passing roller) on common formability metrics. Emphasis was placed on the character/extent of PLC instabilities using digital image correlation strain measurements. The outcome of this work highlights the possibility of predicting flow formability using strain rate jump testing.

flow forming↗

Updates to the Regional Seismic Travel Time (RSTT) Model: 2. Path-dependent Travel-time Uncertainty

Abstract The regional seismic travel time (RSTT) model and software were developed to improve travel-time prediction accuracy by accounting for three-dimensional crust and upper mantle structure. Travel-time uncertainty estimates are used in the process of associating seismic phases to events and to accurately calculate location uncertainty bounds (i.e. event location error ellipses). We improve on the current distance-dependent uncertainty parameterization for RSTT using a random effects model to estimate slowness (inverse velocity) uncertainty as a mean squared error for each model parameter. The random effects model separates the error between observed slowness and model predicted slowness into bias and random components. The path-specific travel-time uncertainty is calculated by integrating these mean squared errors along a seismic-phase ray path. We demonstrate that event location error ellipses computed for a 90% coverage ellipse metric (used by the Comprehensive Nuclear-Test-Ban Treaty Organization International Data Centre (IDC)), and using the path-specific travel-time uncertainty approach, are more representative (median 82.5% ellipse percentage) of true location error than error ellipses computed using distance-dependent travel-time uncertainties (median 70.1%). We also demonstrate measurable improvement in location uncertainties using the RSTT method compared to the current station correction approach used at the IDC (median 74.3% coverage ellipse).

58 GEOSCIENCES↗

Local Control and Toxicity in a Large Cohort of Central Lung Tumors Treated With Stereotactic Body Radiation Therapy

Purpose: Stereotactic body radiation therapy (SBRT) in central lung tumors has been associated with higher rates of severe toxicity. We sought to evaluate toxicity and local control in a large cohort and to identify predictive dosimetric parameters. Methods and Materials: We identified patients who received SBRT for central tumors according to either of 2 definitions. Local failure (LF) was estimated using a competing risks model, and multivariate analysis (MVA) was used to assess factors associated with LF. We reviewed patient toxicity and applied Cox proportional hazard analysis and log-rank tests to assess whether dose-volume metrics of normal structures correlated with pulmonary toxicity. Results: One hundred twenty-five patients received SBRT for non-small cell lung cancer (n=103) or metastatic lesions (n=22), using intensity modulated radiation therapy. The most common dose was 45 Gy in 5 fractions. Median follow-up was 17.4 months. Incidence of toxicity ≥ grade 3 was 8.0%, including 5.6% pulmonary toxicity. Sixteen patients (12.8%) experienced esophageal toxicity ≥ grade 2, including 50% of patients in whom PTV overlapped the esophagus. There were 2 treatment-related deaths. Among patients receiving biologically effective dose (BED) ≥80 Gy (n=108), 2-year LF was 21%. On MVA, gross tumor volume (GTV) was significantly associated with LF. None of the studied dose-volume metrics of the lungs, heart, proximal bronchial tree (PBT), or 2 cm expansion of the PBT (“no-fly-zone” [NFZ]) correlated with pulmonary toxicity ≥grade 2. There were no differences in pulmonary toxicity between central tumors located inside the NFZ and those outside the NFZ but with planning target volume (PTV) intersecting the mediastinum. Conclusions: Using moderate doses, SBRT for central lung tumors achieves acceptable local control with low rates of severe toxicity. Dosimetric analysis showed no significant correlation between dose to the lungs, heart, or NFZ and severe pulmonary toxicity. Esophageal toxicity may be an underappreciated risk, particularly when PTV overlaps the esophagus.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

How Important Is a Reproducible Breath Hold for Deep Inspiration Breath Hold Breast Radiation Therapy?

Purpose: Deep inspiration breath hold (DIBH) for left-sided breast cancer has been shown to reduce heart dose. Surface imaging helps to ensure accurate breast positioning, but it does not guarantee a reproducible breath hold (BH) at DIBH treatments. We examine the effects of variable BH positions for DIBH treatments. Methods and Materials: Twenty-five patients who underwent free breathing (FB) and DIBH scans were reviewed. Four plans were created for each patient: FB, DIBH, FB-DIBH (the DIBH plans were copied to the FB images and recalculated, and image registration was based on breast tissue), and P-DIBH (a partial BH with the heart shifted midway between the FB and DIBH positions). The FB-DIBH plans give a “worst-case” scenario for surface imaging DIBH, where the breast is aligned by surface imaging but the patient is not holding their breath. Kolmogorov-Smirnov tests were used to compare the dose metrics. Results: The DIBH plans gave lower heart dose and comparable breast coverage versus FB in all cases. The FB-DIBH plans showed no significant difference versus FB plans for breast coverage, mean heart dose, or maximum heart dose (P≥.10). The mean heart dose differed between FB-DIBH and FB by <2 Gy for all cases, and the maximum heart dose differed by <2 Gy for 21 cases. The P-DIBH plans showed significantly lower mean heart dose than FB (P<.01). The mean heart doses for the P-DIBH plans were <FB for 22 cases, the maximum dose was <FB for 18 cases. Conclusions: A DIBH plan delivered to a FB patient setup with surface imaging will yield dosimetry similar to that of a plan created and delivered FB. A DIBH plan delivered with even a partial BH can give reduced heart dose compared with FB techniques.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Exploring the parameter space of MagLIF implosions using similarity scaling. II. Current scaling

Magnetized liner inertial fusion (MagLIF) is a magneto-inertial-fusion (MIF) concept, which is presently being studied on the Z pulsed power facility. The MagLIF platform has achieved interesting plasma conditions at stagnation and produced significant fusion yields in the laboratory. Given the relative success of MagLIF, there is a strong interest to scale the platform to higher peak currents. However, scaling MagLIF is not entirely straightforward due to the large dimensionality of the experimental input parameter space and the numerous physical processes involved in MIF implosions. Here, in this work, we propose a novel method to scale MagLIF loads to higher currents. Our method is based on similarity (or similitude) scaling and attempts to preserve much of the physics regimes already known or being studied on today's Z pulsed-power driver. By avoiding significant deviations into unexplored and/or less well-understood regimes, the risk of unexpected outcomes on future scaled-up experiments is reduced. Using arguments based on similarity scaling, we derive the scaling rules for the experimental input parameters characterizing a MagLIF load (as functions of the characteristic current driving the implosion). We then test the estimated scaling laws for various metrics measuring performance against results of 2D radiation–magneto-hydrodynamic hydra simulations. Agreement is found between the scaling theory and the simulation results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Gravitational wave signatures of the absence of an event horizon: Nonradial oscillations of a thin-shell gravastar

Gravitational waves from compact objects provide information about their structure, probing deep into strong-gravity regions. Here we illustrate how the presence or absence of an event horizon can produce qualitative differences in the gravitational waves emitted by ultracompact objects. In order to set up a straw-man ultracompact object with no event horizon, but which is otherwise almost identical to a black hole, we consider a nonrotating thin-shell model inspired by Mazur and Mottola's gravastar, which has a Schwarzschild exterior, a de Sitter interior and an infinitely thin shell with finite tension separating the two regions. As viewed from the external space-time, the shell can be located arbitrarily close to the Schwarzschild radius, so a gravastar might seem indistinguishable from a black hole when tests are only performed on its external metric. We study the linearized dynamics of the system, and, in particular, the junction conditions connecting internal and external gravitational perturbations. As a first application of the formalism we compute polar and axial oscillation modes of a thin-shell gravastar. We show that the quasinormal mode spectrum is completely different from that of a black hole, even in the limit when the surface redshift becomes infinite. Polar quasinormal modes depend on the equation of state of matter on the shell and can be used to distinguish between different gravastar models. Our calculations suggest that low-compactness gravastars could be unstable when the sound speed on the shell v{sub s}/c > or approx. 0.92.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

An Adaptive Reference Scheme to Extend the Functional Range of Optical Backscatter Reflectometry in Extreme Environments

Optical frequency domain reflectometry (OFDR) measurements are performed by recording the interference pattern of light backscattered by density fluctuations or Bragg gratings along the length of an optical fiber. Changes in local temperature or strain in the fiber cause shifts in the backscattered light spectrum, which can be calibrated to the applied temperature or strain. Comparing the backscattered optical spectra from each reflection site with a reference (unstrained) spectrum allows for quantification of local spectral shifts. While mature OFDR-based technologies can provide high-precision spatially distributed measurements over kilometer lengths, the post-processing approaches used to recover spectral shifts from raw optical intensity data can limit the use of OFDR in harsh environments. This paper presents a novel approach to post-processing OFDR data which extends the usability of optical fibers exposed to harsh environments. This approach is the first to use the spectral shift quality, calculated for two OFDR measurements, to identify an appropriate reference scan from which the spectral shift can be determined. Here, three experimental data sets are used to test the algorithm: (1) an optical fiber heated to >950°C, (2) an aluminum-embedded optical fiber under strain from differential thermal expansion, and (3) an optical fiber exposed to a total neutron flux of 2×10 13 n/cm 2 /s over 40 hours in a nuclear test reactor. Results show that using a metric of quality to select an appropriate reference measurement extends the functional range of OFDR strain and temperature sensors. Furthermore, this algorithm can be applied to existing OFDR data.

47 OTHER INSTRUMENTATION↗

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling↗