Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

Test Methods and Analysis of Anomalous Charging Currents in Polymer Tantalum Capacitors

Due to dry environments, anomalous charging currents (ACC) in polymer tantalum capacitors (PTC) could cause malfunctions or failures in space systems. Currently, there is no standard metric to assess this effect, and factors affecting ACC are not well understood. This paper discusses the benefits and drawbacks of different methods used to reveal ACC including constant voltage ramp and constant current stress and suggest a power surge testing (PST) as a procedure for screening and qualification of PTCs for space applications. The suggested test is similar to the surge current testing that is currently used for MnO2 tantalum capacitors but assures dissipation of high power in the part throughout testing. Using various types of capacitors, the reproducibility of test results for different manufacturing lots of PTCs and from sample to sample within a lot were estimated. The impact of moisture content, test temperature, stress voltages, and preconditioning were assessed. Thermal effects associated with ACC and the possibility of catastrophic failures were studied experimentally using an IR camera and calculated at adiabatic heating conditions. Possible mechanisms of the phenomenon are discussed and recommendations for testing to avoid failures related to ACC are suggested.

Alexander A.Teverovsky↗

Life Cycle Assessment of Switchgrass Cellulosic Ethanol Production in the Wisconsin and Michigan Agricultural Contexts

Spatial variability in yields and greenhouse gas emissions from soils has been identified as a key source of variability in life cycle assessments (LCAs) of agricultural products such as cellulosic ethanol. This study aims to conduct an LCA of cellulosic ethanol production from switchgrass in a way that captures this spatial variability and tests results for sensitivity to using spatially averaged results. The Environment Policy Integrated Climate (EPIC) model was used to calculate switchgrass yields, greenhouse gas (GHG) emissions, and nitrogen and phosphorus emissions from crop production in southern Wisconsin and Michigan at the watershed scale. These data were combined with cellulosic ethanol production data via ammonia fiber expansion and dilute acid pretreatment methods and region-specific electricity production data into an LCA model of eight ethanol production scenarios. Standard deviations from the spatial mean yields and soil emissions were used to test the sensitivity of net energy ratio, global warming potential intensity, and eutrophication and acidification potential metrics to spatial variability. Substantial variation in the eutrophication potential was also observed when nitrogen and phosphorus emissions from soils were varied. This work illustrates the need for spatially explicit agricultural production data in the LCA of biofuels and other agricultural products.

Acidification↗

Objective Quantification of Convective Clustering Observed During the AMIE/DYNAMO Two-Day Rain Episodes

One critical bottleneck in developing and evaluating ways to represent the mesoscale organization of convection in cumulus parameterization schemes is that there is no single accepted method of objectively quantifying the degree of convective organization or clustering from observations. This study addresses this need using high-quality S-PolKa radar data from the Atmospheric Radiation Measurement Madden-Julian Oscillation Investigation Experiment/Dynamics of the Madden-Julian Oscillation (AMIE/DYNAMO) field campaign. We first identify convective elements (contiguous convective echoes [CCEs]) from radar reflectivity observations using the rain type classification algorithm of Powell et al. (2016, https://doi.org/10.1175/JTECH-D-15-0135.1). Then we apply scalar clustering metrics, including the organization index (I org ) of Tompkins and Semie, to the radar CCEs to test their ability of quantifying convective clustering during the observed two-day rain episodes. Our results show two distinct phases of convective clustering during the two-day rain episodes, with each phase covering about 10 hr before (Phase 1) and after (Phase 2) the time of peak rain rate. In Phase 1 clustering, the number of CCEs increases and convective cells cluster as new cells form preferentially near existing convective entities. The number of CCEs decreases as the environment stabilizes in Phase 2 clustering, during which already clustered cells with associated stratiform clouds are preferred over the isolated ones. I org is capable of capturing convective clustering in both phases. The possible mechanisms for convective clustering are discussed, including cold pool-updraft feedback, moisture-convection interaction, and mesoscale circulations. Our results suggest that parameterizations of convective organization should represent the feedback processes that are responsible for the convective clustering during both phases.

54 ENVIRONMENTAL SCIENCES↗

Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs

High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as p2r, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these miniapps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Noether symmetries, energy-momentum tensors, and conformal invariance in classical field theory

In the framework of classical field theory, we first review the Noether theory of symmetries, with simple rederivations of its essential results, with special emphasis given to the Noether identities for gauge theories. With this baggage on board, we next discuss in detail, for Poincare invariant theories in flat spacetime, the differences between the Belinfante energy-momentum tensor and a family of Hilbert energy-momentum tensors. All these tensors coincide on shell but they split their duties in the following sense: Belinfante's tensor is the one to use in order to obtain the generators of Poincare symmetries and it is a basic ingredient of the generators of other eventual spacetime symmetries which may happen to exist. Instead, Hilbert tensors are the means to test whether a theory contains other spacetime symmetries beyond Poincare. We discuss at length the case of scale and conformal symmetry, of which we give some examples. We show, for Poincare invariant Lagrangians, that the realization of scale invariance selects a unique Hilbert tensor which allows for an easy test as to whether conformal invariance is also realized. Finally we make some basic remarks on metric generally covariant theories and classical field theory in a fixed curved background.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Physics-based statistical learning approach to mesoscopic model selection

In materials science and many other research areas, models are frequently inferred without considering their generalization to unseen data. Here, we apply statistical learning using cross-validation to obtain an optimally predictive coarse-grained description of a two-dimensional kinetic nearest-neighbor Ising model with Glauber dynamics (GD) based on the stochastic Ginzburg-Landau equation (sGLE). The latter is learned from GD “training” data using a log-likelihood analysis, and its predictive ability for various complexities of the model is tested on GD “test” data independent of the data used to train the model on. Using two different error metrics, we perform a detailed analysis of the error between magnetization time trajectories simulated using the learned sGLE coarse-grained description and those obtained using the GD model. We show that both for equilibrium and out-of-equilibrium GD training trajectories, the standard phenomenological description using a quartic free energy does not always yield the most predictive coarse-grained model. Moreover, increasing the amount of training data can shift the optimal model complexity to higher values. Our results are promising in that they pave the way for the use of statistical learning as a general tool for materials modeling and discovery.

36 MATERIALS SCIENCE↗

Quantitative Metrics for Grid Resilience Evaluation and Optimization

Power system resilience has become a critical topic in recent years because of the increasing trend of extreme events and the growing integration of intermittent renewable energy sources. To enhance grid resilience against high-impact, low-frequency events, two questions should be answered: how to quantify the resilience of a given grid and how to incorporate the quantification into power system planning, operation, and restoration. Here this paper develops a new set of quantitative metrics with clear physical interpretation to comprehensively evaluate power system resilience. Using microgrids as an example, an event-based corrective scheduling (ECS) model and an online model predictive control (OMPC) model are developed to integrate the proposed quantitative resilience metrics into power system optimization models for resilience enhancement. The ECS model employs extreme event data to investigate the optimal restoration solution and to help microgrid operators prepare to respond to similar events. The OMPC model provides online decision-making support for operators to handle ongoing outages in the most resilient fashion. The effectiveness and superiority of the proposed quantitative resilience metrics and the resilience enhancement models are demonstrated through simulations and comparative studies on an IEEE test feeder and a real distribution feeder in Southern California.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Effectiveness of robust optimization in intensity-modulated proton therapy planning for head and neck cancers

Purpose: Intensity-modulated proton therapy (IMPT) is highly sensitive to uncertainties in beam range and patient setup. Conventionally, these uncertainties are dealt using geometrically expanded planning target volume (PTV). In this paper, the authors evaluated a robust optimization method that deals with the uncertainties directly during the spot weight optimization to ensure clinical target volume (CTV) coverage without using PTV. The authors compared the two methods for a population of head and neck (H and N) cancer patients. Methods: Two sets of IMPT plans were generated for 14 H and N cases, one being PTV-based conventionally optimized and the other CTV-based robustly optimized. For the PTV-based conventionally optimized plans, the uncertainties are accounted for by expanding CTV to PTV via margins and delivering the prescribed dose to PTV. For the CTV-based robustly optimized plans, spot weight optimization was guided to reduce the discrepancy in doses under extreme setup and range uncertainties directly, while delivering the prescribed dose to CTV rather than PTV. For each of these plans, the authors calculated dose distributions under various uncertainty settings. The root-mean-square dose (RMSD) for each voxel was computed and the area under the RMSD-volume histogram curves (AUC) was used to relatively compare plan robustness. Data derived from the dose volume histogram in the worst-case and nominal doses were used to evaluate the plan optimality. Then the plan evaluation metrics were averaged over the 14 cases and were compared with two-sided paired t tests. Results: CTV-based robust optimization led to more robust (i.e., smaller AUCs) plans for both targets and organs. Under the worst-case scenario and the nominal scenario, CTV-based robustly optimized plans showed better target coverage (i.e., greater D{sub 95%}), improved dose homogeneity (i.e., smaller D{sub 5%}- D{sub 95%}), and lower or equivalent dose to organs at risk. Conclusions: CTV-based robust optimization provided significantly more robust dose distributions to targets and organs than PTV-based conventional optimization in H and N using IMPT. Eliminating the use of PTV and planning directly based on CTV provided better or equivalent normal tissue sparing.

60 APPLIED LIFE SCIENCES↗

TH-E-17A-07: Improved Cine Four-Dimensional Computed Tomography (4D CT) Acquisition and Processing Method

Purpose: Artifacts arising from the 4D CT acquisition and post-processing methods add systematic uncertainty to the treatment planning process. We propose an alternate cine 4D CT acquisition and post-processing method to consistently reduce artifacts, and explore patient parameters indicative of image quality. Methods: In an IRB-approved protocol, 18 patients with primary thoracic malignancies received a standard cine 4D CT acquisition followed by an oversampling 4D CT that doubled the number of images acquired. A second cohort of 10 patients received the clinical 4D CT plus 3 oversampling scans for intra-fraction reproducibility. The clinical acquisitions were processed by the standard phase sorting method. The oversampling acquisitions were processed using Dijkstras algorithm to optimize an artifact metric over available image data. Image quality was evaluated with a one-way mixed ANOVA model using a correlation-based artifact metric calculated from the final 4D CT image sets. Spearman correlations and a linear mixed model tested the association between breathing parameters, patient characteristics, and image quality. Results: The oversampling 4D CT scans reduced artifact presence significantly by 27% and 28%, for the first cohort and second cohort respectively. From cohort 2, the inter-replicate deviation for the oversampling method was within approximately 13% of the cross scan average at the 0.05 significance level. Artifact presence for both clinical and oversampling methods was significantly correlated with breathing period (ρ=0.407, p-value<0.032 clinical, ρ=0.296, p-value<0.041 oversampling). Artifact presence in the oversampling method was significantly correlated with amount of data acquired, (ρ=-0.335, p-value<0.02) indicating decreased artifact presence with increased breathing cycles per scan location. Conclusion: The 4D CT oversampling acquisition with optimized sorting reduced artifact presence significantly and reproducibly compared to the phase-sorted clinical acquisition.

60 APPLIED LIFE SCIENCES↗

SU-F-BRF-10: Deformable MRI to CT Validation Employing Same Day Planning MRI for Surrogate Analysis

Purpose: To compare rigid and deformable registrations of the prostate in the multi-modality setting (diagnostic-MRI to planning-CT) by utilizing a planning-MRI as a surrogate. The surrogate allows for the direct quantitative analysis which can be difficult in the multi-modality domain where intensity mapping differs. Methods: For ten subjects, T2 fast-spin-echo images were acquired at two different time points, the first several weeks prior to planning (diagnostic-MRI) and the second on the same day in which the planning CT was collected (planning-MRI). Significant effort in patient positioning and bowel/bladder preparation was undertaken to minimize distortion of the prostate in all datasets. The diagnostic-MRI was deformed to the planning-CT utilizing a commercially available deformable registration algorithm synthesized from local registrations. The deformed MRI was then rigidly aligned to the planning MRI which was used as the surrogate for the planning-CT. Agreement between the two MRI datasets was scored using intensity based metrics including Pearson correlation and normalized mutual information, NMI. A local analysis was performed by looking only within the prostate, proximal seminal vesicles, penile bulb and combined areas. A similar method was used to assess a rigid registration between the diagnostic-MRI and planning-CT. Results: Utilizing the NMI, the deformable registrations were superior to the rigid registrations in 9 of 10 cases demonstrating a 15.94% improvement (p-value < 0.001) within the combined area. The Pearson correlation showed similar results with the deformable registration superior in the same number of cases and demonstrating a 6.97% improvement (p-value <0.011). Conclusion: Validating deformable multi-modality registrations using spatial intensity based metrics is difficult due to the inherent differences in intensity mapping. This population provides an ideal testing ground for MRI to CT deformable registrations by obviating the need for multi-modality comparisons which are inherently more challenging. Deformable registrations generated in this work significantly outperformed rigid alignments. Research reported in this abstract was supported by the NIH National Cancer Institute R21CA153826 “MRI-Guided Radiotherapy and Biomarkers for Prostate Cancer” and Bankhead-Coley Cancer Research Program 10BT-03 “MRI-Guided Radiotherapy and Biomarkers for Prostate Cancer”.

60 APPLIED LIFE SCIENCES↗

Model Development and Analysis of Clean and Efficient Engine Combustion. 2019 Annual Progress Report

Internal combustion engine design is increasingly driven by computational models used to predict performance metrics, which previously would have been predicted by limited design intuition or expensive and timeconsuming physical testing. Improved model capabilities shorten design cycles and enable the production of cleaner and more efficient engines. This project focuses on advancing the state of the art in internal combustion engine simulations. The overarching goal is to enable predictive models and reduced time to solution for simulations that have impacts on combustion engine design.

33 ADVANCED PROPULSION SYSTEMS↗

Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs

High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as \ptor, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these mini-apps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.

Atif, Mohammad [Brookhaven] (ORCID:000000026889770↗

Space station definition and preliminary design, WP-01. Volume 1: Executive summary

System activities are summarized and an overview of the system level engineering tasks performed are provided. Areas discussed include requirements, system test and verification, the advanced development plan, customer accommodations, software, growth, productivity, operations, product assurance and metrication. The hardware element study results are summarized. Overviews of recommended configurations are provided for the core module, the USL, the logistics elements, the propulsion subsystems, reboost, vehicle accommodations, and the smart front end. A brief overview is provided for costing activities.

Lenda, J. A.↗

A non-linearly stable implicit finite element algorithm for hypersonic aerodynamics

A generalized curvilinear coordinate Taylor weak statement implicit finite element algorithm is developed for the two-dimensional and axisymmetric compressible Navier-Stokes equations for ideal and reacting gases. For accurate hypersonic simulation, air is modeled as a mixture of five perfect gases, i.e., molecular and atomic oxygen and nitrogen as well as nitric oxide. The associated pressure is then determined via Newton solution of the classical chemical equilibrium equation system. The directional semidiscretization is achieved using an optimal metric data Galerkin finite element weak statement, on a developed 'companion conservation law system', permitting classical test and trial space definitions. Utilizing an implicit Runge-Kutta scheme, the terminal algorithm is then nonlinearly stable, and second-order accurate in space and time on arbitrary curvilinear coordinates. Subsequently, a matrix tensor product factorization procedure permits an efficient numerical linear algebra handling for large Courant numbers. For ideal- and real-gas hypersonic flows, the algorithm generates essentially nonoscillatory numerical solutions in the presence of strong detached shocks and boundary layer-inviscid flow interactions.

Iannelli, G. S.↗

An Investigation of Rotorcraft Stability-Phase Margin Requirements in Hover

A cooperative study was performed to investigate the handling quality effects from reduced flight control system stability margins, and the trade-offs with higher disturbance rejection bandwidth (DRB). The piloted simulation study, perform on the NASA-Ames Vertical Motion Simulator, included three classes of rotorcraft in four configurations: a utility-class helicopter; a medium-lift helicopter evaluated with and without an external slung load; and a large (heavy-lift) civil tiltrotor aircraft. This large aircraft also allowed an initial assessment of ADS-33 handling quality requirements for an aircraft of this size. Ten experimental test pilots representing the U.S. Army, Marine Corps, NASA, rotorcraft industry, and the German Aerospace Center (DLR), evaluated the four aircraft configurations, for a range of flight control stability-margins and turbulence levels, while primarily performing the ADS-33 Hover and Lateral Reposition MTEs. Pilot comments and aircraft-task performance data were analyzed. The preliminary stability margin results suggest higher DRB and less phase margin cases are preferred as the aircraft increases in size. Extra care will need to be taken to assess the influence of variability when nominal flight control gains start with reduced margins. Phase margins as low as 20-23 degrees resulted in low disturbance-response damping ratios, objectionable oscillations, PIO tendencies, and a perception of an incipient handling qualities cliff. Pilot comments on the disturbance response of the aircraft correlated well to the DRB guidelines provided in the ADS-33 Test Guide. The A D-3S3 mid-term response-to-control damping ratio metrics can be measured and applied to the disturbance-response damping ratio. An initial assessment of LCTR yaw bandwidth shows the current Level 1 boundary needs to be relaxed to help account for a large pilot off-set from the c.g. Future efforts should continue to investigate the applicability/refinement of the current ADS-33 requirements to large vehicles, like an LCTR.

Blanken, Chris L.↗

Designing Spacecraft and Mission Operations Plans to Meet Flight Crew Radiation Dose Requirements: Why is this an "Epic Challenge" for Long-Term Manned Interplanetary Flight

Outline of presentation: (1) Radiation Shielding Concepts and Performance - Galactic Cosmic Rays (GCRs) (1a) Some general considerations (1b) Galactic Cosmic Rays (2)GCR Shielding I: What material should I use and how much do I need? (2a) GCR shielding materials design and verification (2b) Spacecraft materials point dose cosmic ray shielding performance - hydrogen content and atomic number (2c) Accelerator point dose materials testing (2d) Material ranking and selection guidelines (2e) Development directions and return on investment (point dose metric) (2f) Secondary particle showers in the human body (2f-1) limited return of investment for low-Z, high-hydrogen content materials (3) GCR shielding II: How much will it cost? (3a) Spacecraft design and verification for mission radiation dose to the crew (3b) Habitat volume, shielding areal density, total weight, and launch cost for two habitat volumes (3c) It's All about the Money - Historical NASA budgets and budget limits (4) So, what can I do about all this? (4a) Program Design Architecture Trade Space (4b) The Vehicle Design Trade Space (4c) Some Near Term Recommendations

Koontz, Steven↗

The Event Horizon General Relativistic Magnetohydrodynamic Code Comparison Project

Recent developments in compact object astrophysics, especially the discovery of merging neutron stars by LIGO, the imaging of the black hole in M87 by the Event Horizon Telescope, and high- precision astrometry of the Galactic Center at close to the event horizon scale by the GRAVITY experiment motivate the development of numerical source models that solve the equations of general relativistic magnetohydrodynamics (GRMHD). Here we compare GRMHD solutions for the evolution of a magnetized accretion flow where turbulence is promoted by the magnetorotational instability from a set of nine GRMHD codes: Athena++, BHAC, Cosmos++, ECHO, H-AMR, iharm3D, HARM-Noble, IllinoisGRMHD, and KORAL. Agreement among the codes improves as resolution increases, as measured by a consistently applied, specially developed set of code performance metrics. We conclude that the community of GRMHD codes is mature, capable, and consistent on these test problems.

relativistic processes↗

Counter Unmanned Aircraft System Metrics Tool

SAND2023-05387O The Counter Unmanned Aircraft System (CUAS) Metrics Tool consists of three applications: • The Data Collection Tool is designed to be used during testing and captures details that can be imported into the Figure Creator application. • The Unmanned Aircraft System (UAS) Log Converter converts different UAS logs into a standardized hierarchical data format with a timeline of geospatial data. • The Figure Creator develops relevant images for the test event. The application includes logic to ingest and correlate data from the Data Collection Tool and the UAS Log Converter to produce the chosen figures. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Mayle, Ashley↗