Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

CONSTRAINTS ON THE SPACETIME GEOMETRY AROUND 10 STELLAR-MASS BLACK HOLE CANDIDATES FROM THE DISK'S THERMAL SPECTRUM

In a previous paper, one of us (C. Bambi) described a code to compute the thermal spectrum of geometrically thin and optically thick accretion disks around generic stationary and axisymmetric black holes, which are not necessarily of the Kerr type. As the structure of the accretion disk and the propagation of electromagnetic radiation from the disk to the distant observer depend on the background metric, the analysis of the thermal spectrum of thin disks can be used to test the actual nature of black hole candidates. In this paper, we consider the 10 stellar-mass black hole candidates for which the spin parameter has already been estimated from the analysis of the disk's thermal spectrum under the assumption of the Kerr background, and we translate the measurements reported in the literature into constraints on the spin parameter-deformation parameter plane. The analysis of the disk's thermal spectrum can be used to estimate only one parameter of the geometry close to the compact object; therefore, it is not possible to get independent measurements of both the spin and the deformation parameters. The constraints obtained here will be used in combination with other measurements in future work with the final goal of breaking the degeneracy between the spin and possible deviations from the Kerr solution and thus test the Kerr black hole hypothesis.

79 ASTRONOMY AND ASTROPHYSICS↗

Proposal for determining the energy content of gravitational waves by using approximate symmetries of differential equations

Since gravitational wave spacetimes are time-varying vacuum solutions of Einstein's field equations, there is no unambiguous means to define their energy content. However, Weber and Wheeler had demonstrated that they do impart energy to test particles. There have been various proposals to define the energy content, but they have not met with great success. Here we propose a definition using 'slightly broken' Noether symmetries. We check whether this definition is physically acceptable. The procedure adopted is to appeal to 'approximate symmetries' as defined in Lie analysis and use them in the limit of the exact symmetry holding. A problem is noted with the use of the proposal for plane-fronted gravitational waves. To attain a better understanding of the implications of this proposal we also use an artificially constructed time-varying nonvacuum metric and evaluate its Weyl and stress-energy tensors so as to obtain the gravitational and matter components separately and compare them with the energy content obtained by our proposal. The procedure is also used for cylindrical gravitational wave solutions. The usefulness of the definition is demonstrated by the fact that it leads to a result on whether gravitational waves suffer self-damping.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Tests of gravity from imaging and spectroscopic surveys

Tests of gravity on large scales in the Universe can be made using both imaging and spectroscopic surveys. The former allow for measurements of weak lensing, galaxy clustering and cross correlations such as the integrated Sachs-Wolfe effect. The latter probe galaxy dynamics through redshift-space distortions. We use a set of basic observables, namely, lensing power spectra, galaxy-lensing and galaxy-velocity cross-spectra in multiple redshift bins (including their covariances), to estimate the ability of upcoming surveys to test gravity theories. We use a two-parameter description of gravity that allows for the Poisson equation and the ratio of metric potentials to depart from general relativity. We find that the combination of imaging and spectroscopic observables is essential in making robust tests of gravity theories. The range of scales and redshifts best probed by upcoming surveys is discussed. We also compare our parametrization to others used in the literature, in particular, the {gamma} parameter modification of the growth factor.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Performance Evaluation of a Single-Phase Grid-Forming Inverter Through Hardware Experiments: Preprint

Existing state-of-the-art of single-phase grid-forming (GFM) inverter are primarily focused on electromagnetic transient simulation, and there are very few works performing hardware test, and there is no clear understanding how the single-phase GFM inverter should behave from a hardware perspective. Therefore, this paper addresses the gap by performing hardware experiment to evaluate the performance of a single-phase GFM hardware inverter. We enrich the existing GFM testing protocols by investigating transient performance of GFM inverters under different grid dynamic events, and quantifiable performance metrics are made to have a common understanding of expected performance of single-phase GFM inverters. A commercial single-phase GFM inverter is used to verify the test protocols and understand the inverter's performance and functionalities.

dynamic events↗

Testing backreaction effects with observations

In order to quantitatively test the ability of averaged inhomogeneous cosmologies to correctly describe observations of the large-scale properties of the Universe, we introduce a smoothed template metric corresponding to a constant spatial curvature model at any time, but with an evolving curvature parameter. This metric is used to compute quantities along an approximate effective light cone of the averaged model of the Universe. As opposed to the standard Friedmann model, we parametrize this template metric by exact scaling properties of an averaged inhomogeneous cosmology, and we also motivate this form of the metric by results on a geometrical smoothing of inhomogeneous cosmological hypersurfaces. The purpose of the paper is not to demonstrate that the backreaction effect is actually responsible for the dark energy phenomenon by explicitly calculating the effect from a local model of the geometry and the distribution of matter, but rather to propose a way to deal with observations in the backreaction context, and to understand what kind of generic properties have to hold in order for a backreaction model to explain the observed features of the Universe on large scales. We test our hypothesis for the template metric against supernova data and the position of the cosmic microwave background peaks, and infer the goodness of fit and parameter uncertainties. We find that averaged inhomogeneous models can reproduce the observations without requiring an additional dark energy component (though a volume acceleration is still needed), and that current data do not disfavor our main assumption on the effective light cone structure. We also show that the experimental uncertainties on the angular diameter distance and the Hubble parameter from baryon acoustic oscillations measurements--forseen in future surveys like the proposed EUCLID satellite project--are sufficiently small to distinguish between a Friedmann-Lemaitre-Robertson-Walker template geometry and the template geometry with consistently evolving curvature.

79 ASTRONOMY AND ASTROPHYSICS↗

An Enhanced TIMESAT Algorithm for Estimating Vegetation Phenology Metrics from MODIS Data

An enhanced TIMESAT algorithm was developed for retrieving vegetation phenology metrics from 250 m and 500 m spatial resolution Moderate Resolution Imaging Spectroradiometer (MODIS) vegetation indexes (VI) over North America. MODIS VI data were pre-processed using snow-cover and land surface temperature data, and temporally smoothed with the enhanced TIMESAT algorithm. An objective third derivative test was applied to define key phenology dates and retrieve a set of phenology metrics. This algorithm has been applied to two MODIS VIs: Normalized Difference Vegetation Index (NDVI) and Enhanced Vegetation Index (EVI). In this paper, we describe the algorithm and use EVI as an example to compare three sets of TIMESAT algorithm/MODIS VI combinations: a) original TIMESAT algorithm with original MODIS VI, b) original TIMESAT algorithm with pre-processed MODIS VI, and c) enhanced TIMESAT and pre-processed MODIS VI. All retrievals were compared with ground phenology observations, some made available through the National Phenology Network. Our results show that for MODIS data in middle to high latitude regions, snow and land surface temperature information is critical in retrieving phenology metrics from satellite observations. The results also show that the enhanced TIMESAT algorithm can better accommodate growing season start and end dates that vary significantly from year to year. The TIMESAT algorithm improvements contribute to more spatial coverage and more accurate retrievals of the phenology metrics. Among three sets of TIMESAT/MODIS VI combinations, the start of the growing season metric predicted by the enhanced TIMESAT algorithm using pre-processed MODIS VIs has the best associations with ground observed vegetation greenup dates.

Tan, Bin↗

Thixotropic spectra and Ashby-style charts for thixotropy

There is no universal model for thixotropy, and comparing thixotropic effects between different fluids is a subtle yet challenging problem. We introduce a generalized (model-insensitive) framework for comparing thixotropic properties based on thixotropic spectra. A superposition of exponential stress modes distributed over thixotropic time scales is used to quantify buildup and breakdown times and mode strengths in response to step-change input. This mathematical framework is tested with several experimental step-shear rate data on colloidal suspensions. Low-dimensional metrics based on moments of the distribution reveal characteristic average thixotropic properties, which are visualized on Ashby-style diagrams. This method outlines a framework for describing thixotropy across a diverse range of microstructures, supporting scientific studies as well as material selection for engineering design applications.

Mechanics↗

A two-dimensional deformable phantom for quantitatively verifying deformation algorithms

Purpose: The incorporation of deformable image registration into the treatment planning process is rapidly advancing. For this reason, the methods used to verify the underlying deformation algorithms must evolve equally fast. This manuscript proposes a two-dimensional deformable phantom, which can objectively verify the accuracy of deformation algorithms, as the next step for improving these techniques. Methods: The phantom represents a single plane of the anatomy for a head and neck patient. Inflation of a balloon catheter inside the phantom simulates tumor growth. CT and camera images of the phantom are acquired before and after its deformation. Nonradiopaque markers reside on the surface of the deformable anatomy and are visible through an acrylic plate, which enables an optical camera to measure their positions; thus, establishing the ground-truth deformation. This measured deformation is directly compared to the predictions of deformation algorithms, using several similarity metrics. The ratio of the number of points with more than a 3 mm deformation error over the number that are deformed by more than 3 mm is used for an error metric to evaluate algorithm accuracy. Results: An optical method of characterizing deformation has been successfully demonstrated. For the tests of this method, the balloon catheter deforms 32 out of the 54 surface markers by more than 3 mm. Different deformation errors result from the different similarity metrics. The most accurate deformation predictions had an error of 75%. Conclusions: The results presented here demonstrate the utility of the phantom for objectively verifying deformation algorithms and determining which is the most accurate. They also indicate that the phantom would benefit from more electron density heterogeneity. The reduction of the deformable anatomy to a two-dimensional system allows for the use of nonradiopaque markers, which do not influence deformation algorithms. This is the fundamental advantage of this verification technique.

61 RADIATION PROTECTION AND DOSIMETRY↗

Deep learning to estimate permeability using geophysical data

Time-lapse electrical resistivity tomography (ERT) is a popular geophysical method to estimate three-dimensional (3D) permeability fields from electrical potential difference measurements. Traditional inversion and data assimilation methods are used to ingest this ERT data into hydrogeophysical models to estimate permeability. Due to ill-posedness and the curse of dimensionality, existing inversion strategies provide poor estimates and low resolution of the 3D permeability field. Recent advances in deep learning provide us with powerful algorithms to overcome this challenge. This paper presents a deep learning (DL) framework to estimate the 3D subsurface permeability from time-lapse ERT data. To test the feasibility of the proposed framework, we train DL-enabled inverse models on simulation data. Each measurement in both synthetic and field data is standardized by removing the mean and scaling the time-series to unit variance. This pre-processing step is necessary to bring simulation data closer to field observations. Subsurface process models based on hydrogeophysics are used to generate this synthetic data. Training performed on limited simulation data resulted in the DL model over-fitting. An advanced data augmentation based on mixup is implemented to generate additional training samples to overcome this issue. This mixup technique creates weakly labeled (low-fidelity) samples from strongly labeled (high-fidelity) data. The weakly labeled training data is then used to develop DL-enabled inverse models and reduce over-fitting. As both time-lapse ERT (1133048 features/realization) and 3D permeability (585453 features/realization) data samples are from a high-dimensional space, principal component analysis (PCA) is employed to reduce dimensionality. Encoded ERT and encoded permeability are generated using the trained PCA estimators. A deep neural network is then trained to map the encoded ERT to encoded permeability. This mixup training and unsupervised learning allowed us to build a fast and reasonably accurate DL-based inverse model under limited simulation data. Results show that proposed weak supervised learning can capture salient spatial features in the 3D permeability field. Quantitatively, the average mean squared error (in terms of the natural log) on the strongly labeled training, validation, and test datasets is less than 0.5. The R 2 -score (global metric) is greater than 0.75, and the percent error in each cell (local metric) is less than 10%. Finally, an added benefit in terms of computational cost is that the proposed DL-based inverse model is at least O(10 4 ) times faster than running a forward model once it is trained. Data generation, DL model training, and hyperparameter tuning to identify optimal neural network architectures utilized high-performance computing resources while the DL inference is performed on a standard laptop. Approximately, O(10 5 ) processor hours are used for generating data and DL tuning and training. We acknowledge that the data generation and DL model development are expensive. But once a DL model is trained, it can be re-used for inversion rapidly for the given system, with set physics and domain. Note that traditional inversion may require multiple forward model simulations (e.g., in the order of 10 to 1000), which are very expensive. This computational savings ≈ O(10 5 ) – O(10 7 )) makes the proposed DL-based inverse model attractive for subsurface imaging and real-time ERT monitoring applications due to fast and yet reasonably accurate estimations of permeability field.

58 GEOSCIENCES↗

Total experimental uncertainty in hydrodynamic testing of a semisubmersible wind turbine, considering numerical propagation of systematic uncertainty

Quantifying the uncertainty in experimental results is a vital step in properly validating numerical simulation tools for designing floating wind turbines; without a good understanding of the experimental uncertainties, it is impossible to confirm if numerical simulation tools can capture the physics with acceptable accuracy. Recent validation studies suggest that the wave-induced, low-frequency surge and pitch motions of semisubmersible-type floating wind turbines are consistently underpredicted by numerical simulations, but it has not been possible to state whether or not this underprediction is within the level of experimental error. Here, previously assessed systematic uncertainty components in hydrodynamic tests of the OC5-DeepCwind semisubmersible are propagated to response metrics of interest using numerical simulation tools, and combined with the system's random uncertainty to obtain the total experimental uncertainty. The uncertainty in the low-frequency response metrics is found to be most sensitive to the system properties (e.g., mooring stiffness and center of gravity), and also the wave elevation. The results of the present study suggest that the underprediction of the low-frequency response behavior observed in previous validation studies is larger than the experimental uncertainty.

17 WIND ENERGY↗

Invited: Bambu: an Open-Source Research Framework for the High-Level Synthesis of Complex Applications

This paper presents the open-source High-Level Synthesis research framework Bambu. The framework provides an open-source starting point to experiment with new ideas across High-Level Synthesis, high-level verification and debugging, FPGA/ASIC design, design flow space exploration, and parallel hardware accelerator design. The tool accepts as input standard C/C++ specifications and compiler intermediate representations (IRs) coming from the well-known Clang/LLVM and GCC com- pilers. The broad spectrum and flexibility of input formats allow the electronic design automation (EDA) research community to explore and integrate new transformations and optimizations. The easily extendable modular framework already includes many op- timizations and HLS benchmarks. The integration with synthesis and verification backends (commercial and open-source) allows researchers to quickly test any new finding and easily obtain performance and resource usage metrics for a given application. Different FPGA devices are supported from several different vendors: AMD/XILINX, Intel/Altera, Lattice Semiconductor, and NanoXplore. Finally, integration with the OpenRoad open-source end-to-end silicon compiler perfectly fits with the recent push towards open-source EDA.

Ferrandi, Fabrizio↗

A Machine Learning-Based Vulnerability Analysis for Cascading Failures of Integrated Power-Gas Systems

This article proposes a cascading failure simulation (CFS) method and a hybrid machine learning method for vulnerability analysis of integrated power-gas systems (IPGSs). The CFS method is designed to study the propagating process of cascading failures between the two systems, generating data for machine learning with initial states randomly sampled. The proposed method considers generator and gas well ramping, transmission line and gas pipeline tripping, island issue handling and load shedding strategies. Then, a hybrid machine learning model with a combined random forest (RF) classification and regression algorithms is proposed to investigate the impact of random initial states on the vulnerability metrics of IPGSs. Extensive case studies are carried out on three test IPGSs to verify the proposed models and algorithms. Simulation results show that the proposed models and algorithms can achieve high accuracy for the vulnerability analysis of IPGSs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

SU-F-R-52: A Comparison of the Performance of Radiomic Features From Free Breathing and 4DCT Scans in Predicting Disease Recurrence in Lung Cancer SBRT Patients

Purpose: There is a clinical need to identify patients who are at highest risk of recurrence after being treated with stereotactic body radiation therapy (SBRT). Radiomics offers a non-invasive approach by extracting quantitative features from medical images based on tumor phenotype that is predictive of an outcome. Lung cancer patients treated with SBRT routinely undergo free breathing (FB image) and 4DCT (average intensity projection (AIP) image) scans for treatment planning to account for organ motion. The aim of the current study is to evaluate and compare the prognostic performance of radiomic features extracted from FB and AIP images in lung cancer patients treated with SBRT to identify which image type would generate an optimal predictive model for recurrence. Methods: FB and AIP images of 113 Stage I-II NSCLC patients treated with SBRT were analysed. The prognostic performance of radiomic features for distant metastasis (DM) was evaluated by their concordance index (CI). Radiomic features were compared with conventional imaging metrics (e.g. diameter). All p-values were corrected for multiple testing using the false discovery rate. Results: All patients received SBRT and 20.4% of patients developed DM. From each image type (FB or AIP), nineteen radiomic features were selected based on stability and variance. Both image types had five common and fourteen different radiomic features. One FB (CI=0.70) and five AIP (CI range=0.65–0.68) radiomic features were significantly prognostic for DM (p<0.05). None of the conventional features derived from FB images (range CI=0.60–0.61) were significant but all AIP conventional features were (range CI=0.64–0.66). Conclusion: Features extracted from different types of CT scans have varying prognostic performances. AIP images contain more prognostic radiomic features for DM than FB images. These methods can provide personalized medicine approaches at low cost, as FB and AIP data are readily available within a large number of radiation oncology departments. R.M. had consulting interest with Amgen (ended in 2015).

60 APPLIED LIFE SCIENCES↗

Evaluation of CMIP6 Streamflow in the Arctic

Earth system models (ESMs) serve as the primary basis for projecting future streamflow changes, but they are biased in terms of the their ability to reproduce historical observations of streamflow. Rigorous downscaling and bias-correction procedures, which are time-consuming and introduce uncertainties, are commonly used to address these biases in streamflow or runoff. However, the applicable limits of streamflow projections remain largely untested through direct comparisons with observations. In this work, we compare historical streamflow time series observations with a suite of Coupled Model Intercomparison Project phase 6 (CMIP6) ESMs to assess the space and time scales at which each ESM represents historic streamflow observations. We focus our analysis on streamflow across the Arctic given the higher degree of warming experienced over this region, underscoring its importance for understanding the future changes. A series of metrics—volume, seasonality, extreme capturing streamflow variability, drought, and flooding is tested to assess ESM simulation skill for total events and overall distributions. Our results indicate that although improvements are necessary in ESM runoff and streamflow projections, the use of temporal averaging and targeting the best-fit model for comparison to observations when a suite of ESMs is considered can provide robust streamflow projections. Moreover, this work provides a basis for contextualizing the limits of ESM applicability for studies aiming to assess streamflow in the future.

54 ENVIRONMENTAL SCIENCES↗

Ground-based Nuclear Detonation Detection (GNDD) Technology Roadmap

This GNDD Technology Roadmap is intended to provide guidance to potential researchers and help management define research priorities to achieve technology advancements for ground-based nuclear explosion monitoring science being pursued by the Ground-based Nuclear Detonation Detection (GNDD) Team within the Office of Nuclear Detonation Detection in the National Nuclear Security Administration (NNSA) of the U.S. Department of Energy (DOE). Four science-based elements were selected to encompass the entire scope of nuclear monitoring research and development (R&D) necessary to facilitate breakthrough scientific results, as well as deliver impactful products. Promising future R&D is delineated including dual use associated with the Comprehensive Nuclear-Test-Ban Treaty (CTBT). Important research themes as well as associated metrics are identified along with a progression of accomplishments, represented by a selected bibliography, that are precursors to major improvements to nuclear explosion monitoring.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

A comparison of anisotropic and isotropic grain growth simulation results of Uranium dioxide and Copper

Grain boundaries migrate to reduce the total grain boundary energy in a material. However, grain boundary energy is anisotropic, such that some grain boundaries are less energy favorable in the system and tend to disappear. Idaho National Laboratory’s (INL) mesoscale fuel performance code MARMOT currently assumes isotropic (non-directionally dependent) grain boundary energy in all phase field sim- ulations of grain boundary migration. As a preliminary step to incorporating fully anisotropic grain boundary energies into MARMOT, a comparison of the results of grain growth simulations for UO 2 nuclear fuels utilizing the old isotropic MARMOT code and new code incorporating anisotropic grain boundary energies was performed. Comparisons of Copper simulations were also performed. The re- sults analyzed were from simple circle and thumb-shaped grain test cases, and polycrystalline systems using artificially generated initial conditions. The metrics used to compare the grains from isotropic and anisotropic cases include grain area and average grain boundary energy. Anisotropic behavior was observed in the systems of circle and thumb-shaped grains. Polycrystalline systems do not behave as expected, suggesting missing terms in the equation implemented in MARMOT which governs the mi- crostructural evolution of the grain boundaries.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Ceiling and visibility instrumentation within government agencies

The key systems requirements for ceilometer systems are described. The following items are included: range must be 10,000 ft.; laser emission must conform to the bureau of radiological health class I performance; system must detect two lowest cloud layers; display must be in either English or metric units; and system must be capable of self monitoring and testing performance. Based upon the requirements competitive prototype cloud height indicator systems are to be built.

Bonner, R. S.↗

Transitioning to Intel-based Linux Servers in the Payload Operations Integration Center

The MSFC Payload Operations Integration Center (POIC) is the focal point for International Space Station (ISS) payload operations. The POIC contains the facilities, hardware, software and communication interface necessary to support payload operations. ISS ground system support for processing and display of real-time spacecraft and telemetry and command data has been operational for several years. The hardware components were reaching end of life and vendor costs were increasing while ISS budgets were becoming severely constrained. Therefore it has been necessary to migrate the Unix portions of our ground systems to commodity priced Intel-based Linux servers. hardware architecture including networks, data storage, and highly available resources. This paper will concentrate on the Linux migration implementation for the software portion of our ground system. The migration began with 3.5 million lines of code running on Unix platforms with separate servers for telemetry, command, Payload information management systems, web, system control, remote server interface and databases. The Intel-based system is scheduled to be available for initial operational use by August 2004 The overall migration to Intel-based Linux servers in the control center involves changes to the This paper will address the Linux migration study approach including the proof of concept, criticality of customer buy-in and importance of beginning with POSlX compliant code. It will focus on the development approach explaining the software lifecycle. Other aspects of development will be covered including phased implementation, interim milestones and metrics measurements and reporting mechanisms. This paper will also address the testing approach covering all levels of testing including development, development integration, IV&V, user beta testing and acceptance testing. Test results including performance numbers compared with Unix servers will be included. need for a smooth transition while maintaining real-time support. An important aspect of the paper will involve challenges and lessons learned. product compatibility, implications of phasing decisions and tracking of dependencies, particularly non- software dependencies. The paper will also discuss scheduling challenges providing real-time flight support during the migration and the requirement to incorporate in the migration changes being made simultaneously for flight support. This paper will also address the deployment approach including user involvement in testing and the , This includes COTS product compatibility, implications of phasing decisions and tracking of dependencies, particularly non- software dependencies. The paper will also discuss scheduling challenges providing real-time flight support during the migration and the requirement to incorporate in the migration changes being made simultaneously for flight support.

Guillebeau, P. L.↗