Search NASA⌕ Search

SEARCH · Search NASA

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

Generalized framework for likelihood-based field-level inference of growth rate from velocity and density fields

Measuring the growth rate of large-scale structures ( f ) as a function of redshift has the potential to break degeneracies between modified gravity and dark energy models, when combined with expansion-rate probes. Direct estimates of peculiar velocities of galaxies have attracted interest as a means of estimating fσ 8 . In particular, field-level methods can be used to fit the field nuisance parameter along with cosmological parameters simultaneously. This article aims to provide the community with a unified framework for the theoretical modeling of the likelihood-based field-level inference by performing fast field covariance calculations for velocity and density fields. Our purpose is to lay the foundations for a nonlinear extension of the likelihood-based method at the field level. We have developed a generalized framework, implemented in the dedicated software flip to perform a likelihood-based inference of fσ 8 . We derived a new field covariance model, which includes wide-angle corrections. We also included the models previously described in the literature inside our framework. We compared their performance against ours, and we validated our model by comparing it with the two-point statistics of a recent N-body simulation. The tests we performed have allowed us to validate our software and determine the appropriate wavenumber range to integrate our covariance model and its validity in terms of separation. Our framework allows for a wider wavenumber coverage to be used in our calculations than in previous works, which is particularly interesting for nonlinear model extensions. Finally, our generalized framework allows us to efficiently perform a survey geometry-dependent Fisher forecast of the fσ 8 parameter. We show that the Fisher forecast method we developed gives an error bar that is 30% closer to a full likelihood-based estimation than a standard volume Fisher forecast.

Ravoux, Corentin↗

Instrument for precision long-term β-decay rate measurements

We describe an experimental setup for making precision measurements of relative β-decay rates of {sup 22}Na, {sup 36}Cl, {sup 54}Mn, {sup 60}Co, {sup 90}Sr, {sup 133}Ba, {sup 137}Cs, {sup 152}Eu, and {sup 154}Eu. The radioactive samples are mounted in two automated sample changers that sequentially position the samples with high spatial precision in front of sets of detectors. The set of detectors for one sample changer consists of four Geiger-Müller (GM) tubes and the other set of detectors consists of two NaI scintillators. The statistical uncertainty in the count rate is few times 0.01% per day for the GM detectors and about 0.01% per hour on the NaI detectors. The sample changers, detectors, and associated electronics are housed in a sealed chamber held at constant absolute pressure, humidity, and temperature to isolate the experiment from environmental variations. The apparatus is designed to accumulate statistics over many years in a regulated environment to test recent claims of small annual variations in the decay rates. We demonstrate that absent this environmental regulation, uncontrolled natural atmospheric pressure variations at our location would imprint an annual signal of 0.1% on the Geiger-Müller count rate. However, neither natural pressure variations nor plausible indoor room temperature variations cause a discernible influence on our NaI scintillator detector count rate.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Equation of state and transport properties of warm dense helium via quantum molecular dynamics simulations

The equation of state, self-diffusion, and viscosity coefficients of helium have been investigated by quantum molecular dynamics (QMD) simulations in the warm dense matter regime. Our simulations are validated through the comparison with the reliable experimental data. The calculated principal and reshock Hugoniots of liquid helium are in good agreement with the gas-gun data. On this basis, we revisit the issue for helium, i.e., the possibility of the instabilities predicted by chemical models at around 2000 GPa and 10 g/cm{sup 3} along the pressure isotherms of 6309, 15 849, and 31 623 K. Our calculations show no indications of instability in this pressure-temperature region, which reconfirm the predictions of previous QMD simulations. The self-diffusion and viscosity coefficients of warm dense helium have been systematically investigated by the QMD simulations. We carefully test the finite-size effects and convergences of statistics, and obtain numerically converged self-diffusion and viscosity coefficients by using the Kubo-Green formulas. The present results have been used to evaluate the existing one component plasma models. Finally, the validation of the Stokes-Einstein relationship for helium in the warm dense regime is discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A hybrid approach to excited-state-specific variational Monte Carlo and doubly excited states

We extend our hybrid linear-method/accelerated-descent variational Monte Carlo optimization approach to excited states and investigate its efficacy in double excitations. In addition to showing a superior statistical efficiency when compared to the linear method, our tests on small molecules show good energetic agreement with benchmark methods. We also demonstrate the ability to treat double excitations in systems that are too large for a full treatment by using selected configuration interaction methods via an application to 4-aminobenzonitrile. Finally, we investigate the stability of state-specific variance optimization against collapse to other states’ variance minima and find that symmetry, Ansatz quality, and sample size all have roles to play in achieving stability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

QUIJOTE scientific results – IV. A northern sky survey in intensity and polarization at 10–20 GHz with the multifrequency instrument

ABSTRACT We present QUIJOTE intensity and polarization maps in four frequency bands centred around 11, 13, 17, and 19 GHz, and covering approximately 29 000 deg2, including most of the northern sky region. These maps result from 9000 h of observations taken between May 2013 and June 2018 with the first QUIJOTE multifrequency instrument (MFI), and have angular resolutions of around 1°, and sensitivities in polarization within the range 35–40 µK per 1° beam, being a factor ∼2–4 worse in intensity. We discuss the data processing pipeline employed, and the basic characteristics of the maps in terms of real space statistics and angular power spectra. A number of validation tests have been applied to characterize the accuracy of the calibration and the residual level of systematic effects, finding a conservative overall calibration uncertainty of 5 per cent. We also discuss flux densities for four bright celestial sources (Tau A, Cas A, Cyg A, and 3C274), which are often used as calibrators at microwave frequencies. The polarization signal in our maps is dominated by synchrotron emission. The distribution of spectral index values between the 11 GHz and WMAP 23 GHz map peaks at β = −3.09 with a standard deviation of 0.14. The measured BB/EE ratio at scales of ℓ = 80 is 0.26 ± 0.07 for a Galactic cut |b| > 10°. We find a positive TE correlation for 11 GHz at large angular scales (ℓ ≲ 50), while the EB and TB signals are consistent with zero in the multipole range 30 ≲ ℓ ≲ 150. The maps discussed in this paper are publicly available.

Astronomy & Astrophysics↗

A unified catalogue-level reanalysis of stage-III cosmic shear surveys

ABSTRACT Cosmological parameter constraints from recent galaxy imaging surveys are reaching percent-level accuracy on the effective amplitude of the lensing signal, S8. The upcoming Legacy Survey of Space and Time (LSST) of the Vera C. Rubin Observatory will produce subpercent level measurements of cosmological parameters, providing a milestone test of the ΛCDM model. To supply guidance to the upcoming LSST analysis, it is important to understand thoroughly the results from different recent galaxy imaging surveys and assess their consistencies. In this work, we perform a unified catalogue-level reanalysis of three cosmic shear data sets: the first year data from the Dark Energy Survey (DES-Y1), the 1000 deg2 data set from the Kilo-Degree Survey (KiDS-1000), and the first year data from the Hyper Suprime-Cam Subaru Strategic Program (HSC-Y1). We utilize a pipeline developed and rigorously tested by the LSST Dark Energy Science Collaboration to perform the reanalysis and assess the robustness of the results to analysis choices. We find the S8 constraint to be robust to two different small-scale modelling approaches, and varying choices of cosmological priors. Our unified analysis allows the consistency of the surveys to be rigorously tested, and we find the three surveys to be statistically consistent. Due to the partially overlapping footprint, we model the cross-covariance between KiDS-1000 and HSC-Y1 approximately when combining all three data sets, resulting in a 1.6–1.9 per cent constraint on S8 given different assumptions on the cross-covariance.

79 ASTRONOMY AND ASTROPHYSICS↗

Impacts of floating-point non-associativity on reproducibility for HPC and deep learning applications

Run to run variability in parallel programs caused by floating-point non-associativity has been known to significantly affect reproducibility in iterative algorithms, due to accumulating errors. Non-reproducibility can critically affect the efficiency and effectiveness of correctness testing for stochastic programs. Recently, the sensitivity of deep learning training and inference pipelines to floating-point non-associativity has been found to sometimes be extreme. It can prevent certification for commercial applications, accurate assessment of robustness and sensitivity, and bug detection. New approaches in scientific computing applications have coupled deep learning models with high-performance computing, leading to an aggravation of debugging and testing challenges. Here we perform an investigation of the statistical properties of floating-point non-associativity within modern parallel programming models, and analyze performance and productivity impacts of replacing atomic operations with deterministic alternatives on GPUs. We examine the recently-added deterministic options in PyTorch within the context of GPU deployment for deep learning, uncovering and quantifying the impacts of input parameters triggering run to run variability and reporting on the reliability and completeness of the documentation. Finally, we evaluate the strategy of exploiting automatic determinism that could be provided by deterministic hardware, using the Groq LPUTM accelerator for inference portions of the deep learning pipeline. We demonstrate the benefits that a hardware-based strategy can provide within reproducibility and correctness efforts.

Shanmugavelu, Sanjif↗

SU-E-P-56: Dosimetric Comparison of Three Post Modified Radical Mastectomy Radiotherapy Techniques for Locally Advanced Left-Sided Breast Cancer and Beyond

Purpose: To compare the dosimetry of post modified radical mastectomy radiotherapy (PMRMRT) for left-sided breast cancer using 3-dimensional conformal radiotherapy (3DCRT), intensity-modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT). Methods: We created ten sets of PMRMRT plans for ten consecutive patients and utilized two tangential and one or two supraclavicular beams in 3DCRT, a total of 5 beams in IMRT and two optimized partial arcs in VMAT. The difference in results between any two of the three new plans, between new and previous 3DCRT plans were compared and analyzed by ANOVA (α =0.05) and paired-sample t-test respectively. P values less than 0.05 were considered statistically significant. Results: Both IMRT and VMAT plans had similar PTV coverage, hotspot area and conformity (all p>0.05), and significantly higher PTV coverage compared with new 3DCRT (both p<0.001). IMRT plans had significantly less heart and left lung radiation exposure compared with VMAT (all p<0.05). The 3DCRT plans with larger estimated CTV displacement had better target coverage but worse OARs sparing compared to those with smaller one. Conclusion: IMRT has dosimetrical advantages over the other two techniques in PMRMRT for left-sided breast cancer. Individually quantifying and minimizing CTV displacement can significantly improve dosage distribution. This work was supported by the Medical Scientific Research Foundation of Guangdong Procvince (A2014455 to Changchun Ma)

60 APPLIED LIFE SCIENCES↗

SU-E-J-71: Spatially Preserving Prior Knowledge-Based Treatment Planning

Purpose: Prior knowledge-based treatment planning is impeded by the use of a single dose volume histogram (DVH) curve. Critical spatial information is lost from collapsing the dose distribution into a histogram. Even similar patients possess geometric variations that becomes inaccessible in the form of a single DVH. We propose a simple prior knowledge-based planning scheme that extracts features from prior dose distribution while still preserving the spatial information. Methods: A prior patient plan is not used as a mere starting point for a new patient but rather stopping criteria are constructed. Each structure from the prior patient is partitioned into multiple shells. For instance, the PTV is partitioned into an inner, middle, and outer shell. Prior dose statistics are then extracted for each shell and translated into the appropriate Dmin and Dmax parameters for the new patient. Results: The partitioned dose information from a prior case has been applied onto 14 2-D prostate cases. Using prior case yielded final DVHs that was comparable to manual planning, even though the DVH for the prior case was different from the DVH for the 14 cases. Solely using a single DVH for the entire organ was also performed for comparison but showed a much poorer performance. Different ways of translating the prior dose statistics into parameters for the new patient was also tested. Conclusion: Prior knowledge-based treatment planning need to salvage the spatial information without transforming the patients on a voxel to voxel basis. An efficient balance between the anatomy and dose domain is gained through partitioning the organs into multiple shells. The use of prior knowledge not only serves as a starting point for a new case but the information extracted from the partitioned shells are also translated into stopping criteria for the optimization problem at hand.

60 APPLIED LIFE SCIENCES↗

SU-E-J-258: Prediction of Cervical Cancer Treatment Response Using Radiomics Features Based On F18-FDG Uptake in PET Images

Purpose: Radiomics have shown potential for predicting treatment outcomes in several body sites. This study investigated the correlation between PET Radiomics features and treatment response of cervical cancer outcomes. Methods: our dataset consisted of a cohort of 79 patients diagnosed with cervical cancer, FIGO stage IB-IVA, age range 25–86 years, (median age at diagnosis: 50 years) all treated between: 2009–14 with external beam radiation therapy to a dose range between: 45–50.4 Gy (median= 45 Gy), concurrent cisplatin chemotherapy and MRI-based brachytherapy to a dose of 20–30 Gy (median= 28 Gy). Metabolic Tumor Volume (MTV) in patient’s primary site was delineated on pretreatment PET/CT by two board certified Radiation Oncologists. The features extracted from each patient’s volume were: 26 Co-occurrence matrix (COM) Feature, 11 Run-Length Matrix (RLM), 11 Gray Level Size Zone Matrix (GLSZM) and 33 Intensity-based features (IBF). The treatment outcome was divided based on the last follow up status into three classes: No Evidence of Disease (NED), Alive with Disease (AWD) and Dead of Disease (DOD). The ability for the radiomics features to differentiate between the 3 treatments outcome categories were assessed by One-Way ANOVA test with p-value < 0.05 was to be statistically significant. The results from the analysis were compared with the ones obtained previously for standard Uptake Value (SUV). Results: Based on patients last clinical follow-up; 52 showed NED, 17 AWD and 10 DOD. Radiomics Features were able to classify the patients based on their treatment response. A parallel analysis was done for SUV measurements for comparison. Conclusion: Radiomics features were able to differentiate between the three different classes of treatment outcomes. However, most of the features were only able to differentiate between NED and DOD class. Also, The ability or radiomics features to differentiate types of response were more significant than SUV.

60 APPLIED LIFE SCIENCES↗

SU-F-T-312: Identifying Distinct Radiation Therapy Plan Classes Through Multi-Dimensional Analysis of Plan Complexity Metrics

Purpose: To determine whether body site-specific treatment plans form unique “plan class” clusters in a multi-dimensional analysis of plan complexity metrics such that a single beam quality correction determined for a representative plan could be universally applied within the “plan class”, thereby increasing the dosimetric accuracy of a detector’s response within a subset of similarly modulated nonstandard deliveries. Methods: We collected 95 clinical volumetric modulated arc therapy (VMAT) plans from four body sites (brain, lung, prostate, and spine). The lung data was further subdivided into SBRT and non-SBRT data for a total of five plan classes. For each control point in each plan, a variety of aperture-based complexity metrics were calculated and stored as unique characteristics of each patient plan. A multiple comparison of means analysis was performed such that every plan class was compared to every other plan class for every complexity metric in order to determine which groups could be considered different from one another. Statistical significance was assessed after correcting for multiple hypothesis testing. Results: Six out of a possible 10 pairwise plan class comparisons were uniquely distinguished based on at least nine out of 14 of the proposed metrics (Brain/Lung, Brain/SBRT lung, Lung/Prostate, Lung/SBRT Lung, Lung/Spine, Prostate/SBRT Lung). Eight out of 14 of the complexity metrics could distinguish at least six out of the possible 10 pairwise plan class comparisons. Conclusion: Aperture-based complexity metrics could prove to be useful tools to quantitatively describe a distinct class of treatment plans. Certain plan-averaged complexity metrics could be considered unique characteristics of a particular plan. A new approach to generating plan-class specific reference (pcsr) fields could be established through a targeted preservation of select complexity metrics or a clustering algorithm that identifies plans exhibiting similar modulation characteristics. Measurements and simulations will better elucidate potential plan-class specific dosimetry correction factors.

60 APPLIED LIFE SCIENCES↗

High Pressure Hydrogen Pressure Relief Devices: Accelerated Life Testing and Application Best Practices

Pressure relief devices (PRDs ) are used to protect high pressure systems from burst failure caused by overpressurization. Codes and standards require the use of PRDs for the safe design of many pressurized systems. These systems require high reliability due to the risks associated with a burst failure. Hydrogen service can increase the risk of PRD failure due to material property degradation caused by hydrogen attack. The National Renewable Energy Laboratory (NREL) has conducted an accelerated life test on a conventional spring loaded PRD. Based on previous failures in the field, the nozzles specific to these PRDs are of particular interest. A nozzle in a PRD is a small part that directs the flow of fluid toward the sealing surface to maintain the open state of the valve once the spring force is overcome. The nozzle in this specific PRD is subjected to the full tensile force of the fluid pressure. These nozzles are made from 440C material, which is a type of hardened steel that is commonly chosen for high pressure applications because of its high strength properties. In a hydrogen environment, however, 440C is considered a worst case material since hydrogen attack results in a loss of almost all ductility and thus 440C is prone to fatigue and material failure. Accordingly, 440C is not recommended for hydrogen service. Conducting an accelerated life test on a PRD with 440C material provides information on necessary and sufficient conditions required to produce crack initiation and failure. The accelerated life test also provides information on other PRD failure modes that are somewhat statistically random in nature.

33 ADVANCED PROPULSION SYSTEMS↗

A Non-hydrostatic Variable Resolution Atmospheric Model in ACME

The Accelerated Climate Modeling for Energy (ACME) Project is designed to perform coupled climate simulations at high resolution on current and next generation DOE leadership class supercomputers. Prior to this project, the ACME atmospheric model employed the primitive equations of motion, which constrained its maximum resolution and limited the physical phenomena that it could resolve. Our team removed this constraint by implementing a non-hydrostatic (NH) atmospheric model in the ACME Framework. Collaboration with SciDAC FASTMath institutes facilitated improvements to key technologies needed for the non-hydrostatic model. This model was tested in a variable resolution framework, which enables high resolution simulation regions at reasonable computational costs. The correct performance of the NH model was verified with standard dynamical-core tests, and by demonstrating that it reproduced expected climate statistics in the hydrostatic regime. The completed model was applied to evaluate the limitations of existing turbulent mountain stress and gravity wave drag parameterizations, in order to demonstrate the power of the new nonhydrostatic model to model new phenomena and enhance the quality of present day 1/4 degree simulations.

Hall, David Matthew↗

Modeling the Functional Forms of Grid Disturbances

This report introduces a functional form that may be used to quantitatively predict the impacts of new grid tools and changing system qualities on the likelihoods, durations, and depths of various grid disturbances. Each disturbance scenario is modeled to have three component stages—avoidance, reactance and recovery, which together parametrically estimate one disturbance’s impacts. The modeled scenario is then placed and replicated within an analysis period to represent the likelihood or frequency of the scenario and its consequent impacts. Whereas analysts have struggled to define and apply metrics for grid resilience, the functional form introduced by this report shares units of measurement with accepted grid-status measures (e.g., numbers of customers currently experiencing a service outage). Furthermore, the integrated and averaged functional form over an analysis period provides a meaningful normalized performance metric (e.g., customer outage minutes per year) that is ultimately independent of the duration of the period of. The approach may be applied similarly regardless of the severity or frequency of the disturbances that are being analyzed. Because metrics can be chosen to be identical in both the hypothetical future and the actual historical past, the historical past eventually becomes the test of the future predictions, at least in a statistical sense. The authors originally developed this approach to facilitate analysis of the effects of transactive energy (TE) systems effects on electric power grid resilience. TE systems invite energy suppliers and consumers to actively collaborate toward the discovery of, and their responses to, the locational value of energy. The findings from this process are often embodied as energy prices, the dynamics of which indicate the locational value of energy and can further represent important grid service needs. While some academic papers claim to quantify the value of a specific TE system design toward grid resilience, the answer, in general, has been elusive. Not only do multiple and conflicting definitions of resilience and reliability exist, but countless TE systems are being invented. We conclude the following: (1) The ideal analysis should harmonize rather than differentiate resilience and reliability. Therefore, this report uses the more general term disturbance whenever the overloaded terms resilience and reliability can be avoided. (2) The effectiveness of TE systems must be mapped to underlying qualities of a TE system, thereby avoiding presumptions that every TE design offers similar advantages. The authors seek to evaluate the parametric effects of TE system qualities (e.g., spatial granularity, granularity of time steps, length of future prediction horizon) on avoiding, reacting to, and recovering from grid disturbances. Furthermore, any advantages (or disadvantages) must be fairly compared with the many alternative tools, systems, and strategies that might offer comparable benefits.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Improving the Parameterization of Cloud and Rain Microphysics in E3SM using Novel Observationally-Constrained Bayesian Approach (Final Technical Report)

In this project, we sought to develop new cloud and rain microphysics frameworks within the Energy Exascale Earth System Model (E3SM). This work encompassed two primary avenues of research: 1) Further development of a Bayesian-based scheme called BOSS (Bayesian Observationally-constrained Statistical-physical Scheme) to represent cloud and rain microphysics, testing it in realistic high-resolution cloud models, and implementing it in E3SM; 2) Development of a methodology utilizing machine learning to enable computationally tractable use of tractable use of Markov chain Monte Carlo sampling for Bayesian parameter estimation in Earth system and cloud models. In this project, we adapted the BOSS microphysics scheme, originally formulated for rain-only, to include all liquid-phase microphysical processes for cloud and rain, in particular the processes that mediate between these two categories, for example the conversion from cloud to rain through collision and coalescence of drops. We constrained the scheme via comparison and testing against a detailed model that explicitly represents the evolution of cloud and rain particles, called a bin microphysics scheme.

54 ENVIRONMENTAL SCIENCES↗

Charge States and FIP Bias of the Solar Wind from Coronal Holes, Active Regions, and Quiet Sun

Connecting in situ measured solar-wind plasma properties with typical regions on the Sun can provide an effective constraint and test to various solar wind models. We examine the statistical characteristics of the solar wind with an origin in different types of source regions. We find that the speed distribution of coronal-hole (CH) wind is bimodal with the slow wind peaking at ∼400 km s{sup −1} and the fast at ∼600 km s{sup −1}. An anti-correlation between the solar wind speeds and the O{sup 7+}/O{sup 6+} ion ratio remains valid in all three types of solar wind as well during the three studied solar cycle activity phases, i.e., solar maximum, decline, and minimum. The N{sub Fe}/N{sub O} range and its average values all decrease with the increasing solar wind speed in different types of solar wind. The N{sub Fe}/N{sub O} range (0.06–0.40, first ionization potential (FIP) bias range 1–7) for active region wind is wider than for CH wind (0.06–0.20, FIP bias range 1–3), while the minimum value of N{sub Fe}/N{sub O} (∼ 0.06) does not change with the variation of speed, and it is similar for all source regions. The two-peak distribution of CH wind and the anti-correlation between the speed and O{sup 7+}/O{sup 6+} in all three types of solar wind can be explained qualitatively by both the wave-turbulence-driven and reconnection-loop-opening (RLO) models, whereas the distribution features of N{sub Fe}/N{sub O} in different source regions of solar wind can be explained more reasonably by the RLO models.

79 ASTRONOMY AND ASTROPHYSICS↗

Design features and results from fatigue reliability research machines.

The design, fabrication, development, operation, calibration and results from reversed bending combined with steady torque fatigue research machines are presented. Fifteen-centimeter long, notched, SAE 4340 steel specimens are subjected to various combinations of these stresses and cycled to failure. Failure occurs when the crack in the notch passes through the specimen automatically shutting down the test machine. These cycles-to-failure data are statistically analyzed to develop a probabilistic S-N diagram. These diagrams have many uses; a rotating component design example given in the literature shows that minimum size and weight for a specified number of cycles and reliability can be calculated using these diagrams.

Lalli, V. R.↗