Search NASA⌕ Search

SEARCH · Search NASA

Results for “test statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Simple and statistically sound recommendations for analysing physical theories

Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics, astrophysics and cosmology fall into one or both of these categories. These issues are often sidestepped with statistically unsound ad hoc methods, involving intersection of parameter intervals estimated by multiple experiments, and random or grid sampling of model parameters. Whilst these methods are easy to apply, they exhibit pathologies even in low-dimensional parameter spaces, and quickly become problematic to use and interpret in higher dimensions. In this article we give clear guidance for going beyond these procedures, suggesting where possible simple methods for performing statistically sound inference, and recommendations of readily-available software tools and standards that can assist in doing so. Our aim is to provide any physicists lacking comprehensive statistical training with recommendations for reaching correct scientific conclusions, with only a modest increase in analysis burden. Furthermore, our examples can be reproduced with the code publicly available at Zenodo.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Long-term Dynamical Stability in the Outer Solar System. I. The Regular and Chaotic Evolution of the 34 Largest Trans-Neptunian Objects

We carried out an extensive analysis of the stability of the outer solar system, making use of the frequency analysis technique over short-term integrations of nearly 100,000 test particles, as well as a statistical analysis of 200 1 Gyr long numerical simulations, which consider the mutual perturbations of the giant planets and the 34 largest trans-Neptunian objects (we have called all 34 objects “dwarf planets,” DPs, even if probably only the largest of them are true DPs). From the frequency analysis, we produced statistical diffusion maps for a wide region of the a–e phase-space plane; we also present the average diffusion time for orbits as a function of perihelion. We later turned our attention to the 34 DPs, making an individualized analysis for each of them and producing a first approximation of their future stability. From the 200 distinct realizations of the orbital evolution of the 34 DPs, we classified the sample into three categories, including 17 stable, 11 unstable, and 6 resonant objects; we also found that, statistically, two objects from the sample will leave the trans-Neptunian region within the next gigayear, most likely being ejected from the solar system, but with a nonnegligible probability of going inside the orbit of Neptune, either to collide with a giant planet or even falling to the inner solar system, where our simulations are no longer able to resolve their continuous evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

Ball-on-ring test validation for equibiaxial flexural strength testing of engineered ceramics

The validation of a ball-on-ring, equibiaxial flexural strength method to obtain the transverse rupture strength (TRS) of right cylindrical ceramic specimens was performed in this study. Validation of the test method was achieved using commercially available engineered high purity alumina disks and finite element (FE) model analysis. The validated fixture was then used to obtain the TRS and Weibull statistical analysis of MgO-partially stabilized zirconia (MSZ) and Y 2 O 3 -partially stabilized zirconia (YSZ) ceramic disks. TRS data for alumina, MSZ, and YSZ agreed with the TRS values reported in the literature. A statistically relevant number of samples (N > 30) for each material were tested to allow for a Weibull statistical analysis. Weibull parameters for these materials were within the expected values for engineered ceramics. The characteristic strength for alumina, MSZ, and YSZ were determined to be 289, 786, and 814 MPa, respectively. The Weibull modulus was determined between 10 and 25 for each material, which is typical of engineered ceramics. In addition, FE model results were in close agreement with experimental fracture values for the three ceramic materials tested in this study.

36 MATERIALS SCIENCE↗

Using the Monte Carlo Method to Evaluate the Reliability of Screening Multifamily Housing for Radon

When screening for radon in a multifamily housing complex using a fixed sample density (e.g., testing 1 in 10 (10%) or 1 in 4 units (25%)), the statistical confidence is dependent upon the assumed elevated radon frequency. For example, testing 25% of units in a complex estimated to have eight units with elevated radon levels will provide 90% confidence. However, if it is assumed that, in the same complex, there are only three units with elevated radon levels, the confidence drops to around 58% for the same sample density. Furthermore, in the previous example, if elevated radon levels are not found during the screening, all that can be stated is that the screening provides 90% confidence that there are no more than seven units in the complex with elevated radon levels. To more fully illustrate this uncertainty, ten separate multifamily housing radon data sets with 1 to 10 units with radon levels ≥4 pCi/L (Table 1) were selected for analysis using the Monte Carlo statistical method. Unlike other mathematically based statistical approaches, the Monte Carlo statistical method relies on repeated analysis of randomly selected data. from a 100% sampled complex at various sample densities. Success for each simulation is defined as finding at least one unit with elevated radon levels. In this statistical method, confidence in the overarching conclusion can be greatly enhanced by repeating the simulated screening hundreds or even thousands of times. For this study, each of the ten data sets was simulated 1,000 times. For each simulation, the data set was randomized three times before the fixed percentage of data was selected.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Emissions mitigation technology for advanced water-lean solvent-based CO 2 capture processes

This technical final report submitted to DOE/NETL presents all the research activities performed during the entirety of DE-FE0031660 project-Emissions Mitigation Technology for Advanced Water-Lean Solvent-Based CO 2 Capture Processes which spans from October 2018 through March 2022. RTI International has been conducting studies from fundamental and operational aspects to reduce the overall amine emissions from the advanced Water-Lean Solvent (WLS) systems, specifically RTI’s Non-Aqueous Solvent (NAS). This technical final report will highlight the key findings from project which align closely to the project objectives which are: Identify the contribution of vapor loss, entrainment, and aerosols to the overall emissions of water-lean systems; Determine the significance of CO 2 capture system operating parameters to the amine emissions; Develop an emissions model based on critical operating parameters; Evaluate the effectiveness of emissions mitigation devices to reduce the amine emissions to <1 ppm under flue coal-fired flue gas; and, Determine the contribution of the ECTs to the overall CO 2 capture cost. The following are the key findings based on numerous tests using both lab-scale setups and parametric testing performed at RTI’s Bench-scale Gas Absorption System (BsGAS). During the BP1, the aerosol generation system and monitoring equipment were installed at BsGAS to produce and determine the aerosol characteristics during the NAS CO 2 capture process. The aerosol produced by this setup produced aerosols with the peak diameter and concentration of 50 micron and 1.2E10 7 cm -3 , respectively. These particle sizes and concentrations are matched to those observed in the actual coal-fired power plant flue gases and expected to be found at the absorber inlet of the CO 2 capture system. Over 1,300 hours of parametric testing have been conducted to evaluate the impact of the aerosols and operating conditions during the CO 2 capture with NAS on the overall amine emissions in the treated flue gas. At the worse condition tested, the presence of the aerosols in the flue gas could increase the overall emissions by 10X compared to the baseline emissions from NAS’s vapor pressure. CO 2 capture rate was found to be a main factor impacting the overall emissions as well as aerosol size and concentrations in the absorber off-gas. The higher CO 2 capture rate, the higher amine emissions in the treated gas. The temperature difference between the temperature bulge seen in the absorber and the water wash temperature also impacts the particle growth where the larger the temperature difference, the more amine emissions from aerosols in the treated gas. The majority of the aerosols did not grow substantially in the system, and the particle concentrations remained nearly constant between the absorber inlet and wash outlet. Only a small portion of the particles were found to grow significantly. The high efficiency demister with mesh size of 5-10 micron can be installed to remove a portion of the aerosols from the gas stream leaving the water wash. Overall, these results from parametric testing have established the emission baseline and validate our assumption on the need of emission control technologies (ECT) in order to minimize the emissions from the baseline NAS CO 2 capture process. Over 2,000 of BsGAS operating hours was used to investigate a handful of process improvements which led to a selection of the vital few changes that effectively control the amine emissions. These process improvements are lime-coated-filters for absorber gas inlet, advanced demister at the top of the absorber, a second water wash with amine recovery unit were designed, installed, and tested at BsGAS at the end of BP1. The result showed that the NAS CO 2 capture process with these additional emission control devices could lower the amine emission in the treated gas to about 1 ppm using a simulated coal-fire flue gas stream. The main contributor in lowering the amine emission came from the second water wash with amine recovery unit where the amine concentration in the scrubbing water was kept below 2 wt% through a continuous amine removal via an adsorbent bed, resulting in a low amine vapor pressure. The adsorbent bed was regenerated via a direct steam regeneration and the recover amine was returned to the absorber to minimize wastewater and makeup amine. A flue gas generation system was designed and installed during the first half of BP2 to support the emission testing using a real coal-derived flue gas. The system is capable of generating both coal- and natural gas- derived flue gases with the composition of the gaseous species highly resemble to that of the power plant flue gases. The particulates detected in the coal-derived flue gas showed the mean diameter of 1 micron. The CO 2 capture operating was then proceed using the real coal-derived flue gas where the amine emission was controlled to be about 0-3 ppm for the total run time of about 200 hours. Similar testing was conducted with natural gas-derived flue gas and the result showed a highly amine emission of 30 ppm under the total run time of 200 hours. The Principal Component Analysis (PCA) and the Partial Least Squares Projection to Latent Structures (PLS) techniques were applied to the parametric testing data to derive a multivariate statistical model. The model was validated and trained with half of the data collected, and the predictive ability of the model was evaluated using the remaining half of the data. The resulting empirical model was capable of predicting the overall emissions from the NAS process without the ECTs with ±15% accuracy (average absolute deviation, AAD) in BP1. As more emission data were obtained under the real coal-flue gas in the BP2, the model incorporated these new set of data to reflect the final process configuration, operating parameters, and amine emission. This results in the updated empirical model predicting the amine emission from the NAS CO 2 capture process with 84% goodness-of-fit (R 2 ), 85% predictability (Q 2 ), and 15% AAD. The study evaluates the use of RTI’s Non-Aqueous Solvent technology for 90% CO 2 capture from a net 650 MWe pulverized coal power plant, downstream of the flue-gas desulfurization unit. The captured CO 2 has a purity of > 95% CO 2 , and is dried, compressed to 15.3 MPa (2,215 psia), ready for sequestration. The analysis uses Case B12B from the DOE Baseline study on Bituminous Coal, Revision 4 where the Cansolv CO 2 capture plant is replaced by the RTI CO 2 Capture plant. The CO 2 capture plant has been sized to capture >90% CO 2 from flue gas derived from a net 650 MWe supercritical pulverized coal power plant. The CO 2 capture plant is equipped with emission control technologies that limits the amine emissions to < 1 ppm. Two different cases were evaluated for the technoeconomic study. The key difference between the two cases is the regenerator pressure. In Case 1, the regenerator operates at 0.195 MPa (28.3 psia), whereas in Case 2, the regenerator pressure is 0.44 MPa (64 psia) thus removing the need for the first stage of compression of the eight-stage compression train. Results from the TEA are compared against the DOE reference cases for SCPC plant with and without CO 2 Capture (Case B12A and Case B12B of the DOE Baseline study, respectively). Case 2 with CO 2 regeneration at higher pressure results in the lower cost of CO 2 capture. The total capital cost of the capture process has been estimated using 2018 dollars in Aspen Process Economic Analyzer and was estimated to be $579 MM. The capture plant operation leads to a total parasitic power loss rate of 96 MWe, resulting in a decrease in pulverized coal power plant efficiency of 7.8% points. The resulting cost of electric power increases from 64.4 mills/kWh, for no capture, to 97.5 mills/kWh, with 90% capture, an increase of 51% in the COE. The cost of capturing 90% CO 2 was estimated to be $38.2/tonne-CO 2 , and meets the DOE target of $40/t-CO 2 . Emission control technologies (ECT) investigated in this project includes a second water wash with use of activated carbon beds for removal of amine from the wash water prior to recirculation in the water wash. These ECT allow operation of the CO 2 capture plant with < 1 ppm amine emissions with the treated flue gas and contributes to $2.4/t-CO 2 captured. Amine emissions derived from thermal and oxidative degradations were investigated under this project along with the emissions derived from aerosols for the NAS system. The thermally degraded of the lean NAS showed less than 4% decreased of the original total amine content in the NAS at 150 °C while the result obtained at 120 °C showed no drop in total amine content, suggesting that thermal degradation of the NAS is minimal. These results also suggested that the thermally degraded species are not likely formed and contributed to the emissions due to the low regeneration temperature of the NAS at 90-105 °C. The oxidative degradation, on the other hand, could become problematic as some of these oxidative degraded species were observed during the NAS-5 testing at National Carbon Capture Center (NCCC) and SINTEF in our previous project. The rapid screening of selected inhibitors suggested that oxidative degradation of NAS can be suppressed using thiol containing compounds in amounts of at least 1 mol%. The detailed mechanistic degradation pathway was conceived for a specific amine used in NAS formulation during BP2. he reduction of the nitrosamines caused by the NO x present in the flue gas was also examined. The study suggested that the thermo-chemical treatment of the NAS solvent would be a more effective and economically viable compared to removing NO x at the DCC.

01 COAL, LIGNITE, AND PEAT↗

169 Tm ( n , γ ) cross section and statistical decay properties from measurements at the DANCE facility

Background: Radiative neutron capture on thulium, which is a monoisotopic element, plays a role in different applications such as nuclear astrophysics or nuclear burning environments. Considerable discrepancies—reaching 20%—exist between evaluations in the unresolved-resonance region. Furthermore, experimental data on statistical 𝛾 decay in odd-odd rare-earth nuclei is scarce. There are still open questions about the systematics of the so-called scissors mode in the 𝑀⁢1 photon strength function, especially in odd-odd nuclei. Purpose: This work is focused on two main topics—deriving experimental 169 Tm ⁢(𝑛,𝛾) cross section and studying statistical 𝛾 decay of 170 Tm, in particular properties of the scissors mode. Methods: The capture experiments to obtain experimental cross section were performed at the Los Alamos Neutron Science Center using the time-of-flight technique and employing the Detector for Advanced Neutron Capture Experiments. Measured coincident 𝛾-ray spectra were also compared with statistical simulations using the dicebox code to test different models of level density and photon strength functions. Results: The capture cross section was determined from 1.8 eV to 0.97 MeV, the broadest neutron-energy range ever measured for this isotope. Several new resonances have been observed. The statistical 𝛾 decay of 170 Tm cannot be reproduced without a scissors mode resonance centered at ≈ 3.3MeV. Conclusions: The measured cross section in the unresolved-resonance region is generally lower than the latest evaluations. The derived 169 Tm 𝑠-process abundance is expected to increase by a factor of 1.26, while the changes of the abundances of elements heavier than 169 Tm are in the order of 0.2%. The scissors mode properties in 170 Tm are similar to those deduced in previous analyses of neighboring nuclei 168 Er and 166 Ho .

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Process-structure-property considerations for wire-based directed energy deposition of Ti-6Al-4V

Directed energy deposition (DED) is an attractive additive manufacturing (AM) process for large structural components. The rapid solidification and layer-by-layer process associated with DED results in non-ideal microstructures, such as large grains with strong crystallographic textures. These non-ideal microstructures can lead to severe anisotropy in the mechanical properties. Despite these challenges, DED has been identified as a potential solution for the manufacturing of near net shape Ti-6Al-4V preforms, replacing lost casting and forging capabilities. Two popular wire-based directed energy deposition (W-DED) processes were considered for the manufacturing of Ti-6Al-4V with assessments on their respective metallurgical and mechanical properties, as compared to a conventionally processed material. The two W-DED processes explored were wire arc additive manufacturing (WAAM) and electron beam additive manufacturing (EBAM). High throughput inspection and tensile testing procedures were utilized to generate statistically relevant data sets related to each process and sample orientation. The 2 AM technologies produced material with remarkably different microstructures and mechanical properties. Importantly, results revealed key differences in strength and ductility for the two disparate processes which were found to be related to differences in the metallurgical properties.

36 MATERIALS SCIENCE↗

Spatiotemporally dynamic implicit large eddy simulation using machine learning classifiers

In this article, we utilize machine learning to dynamically determine if a point on the computational grid requires implicit numerical dissipation for large eddy simulation (LES). The decision making process is learnt through a priori training on quantities derived from direct numerical simulation (DNS) data. In particular, we compute eddy-viscosities obtained through the coarse-graining of DNS quantities and utilize their projection onto a Gaussian distribution to categorize areas that may require dissipation. If our learning determines that closure is necessary, an upwinded scheme is utilized for computing the non-linear Jacobian. In contrast, if it is determined that closure is unnecessary, a symmetric and second-order accurate energy and enstrophy preserving Arakawa scheme is utilized instead. This results in a closure framework that precludes the specification of any model-form for the small scale contributions of turbulence but deploys an appropriate numerical dissipation from explicit closure driven hypotheses. Here, this methodology is deployed for the Kraichnan turbulence test-case and assessed through various statistical quantities such as angle-averaged kinetic energy spectra and vorticity structure functions. Our framework thus establishes a link between the use of explicit LES ideologies for closure and numerical dissipation-based modeling of turbulence leading to improved statistical fidelity of a posteriori simulations.

42 ENGINEERING↗

Contributions of vegetation heterogeneity within tower footprint to CO 2 flux estimations through graph neural network modeling

Net ecosystem exchange of CO 2 (Fc) measured directly by eddy covariance towers is based on various assumptions, including large, flat and homogenous land cover type. In reality, often a tower site is not large enough for flux measurements, and landscapes consist of patches of different land cover types within the flux footprint. In addition, some portions of fluxes are contributed by different cover types when a footprint exceeds the size of the target ecosystem. The contributions of non-dominant patches to Fc are often ignored. Here, in this study, we propose a novel integrated modeling framework that combines random forest (RF) and XGBoost with a residual correction module based on a deep graph convolutional network (DeeperGCN) to simulate Fc for seven flux measurement sites in southwest Michigan. High-resolution remote sensing vegetation indices, soil properties, meteorological variables, and footprint-weighted spatial features were used as model inputs at three spatial resolutions (10 m, 20 m, 30 m), and their importance in predicting Fc with DeeperGCN was assessed. We found that residual correction using DeeperGCN significantly improved prediction accuracy, with the R 2 increasing from 0.9098 to 0.9479 for RF and from 0.9235 to 0.9433 for XGBoost. At site level, the maximum improvement in R 2 reached 0.1617. Paired t-tests confirmed that these improvements were statistically significant (p < 0.05). Among all predictors, leaf area index and incoming shortwave radiation emerged as the dominant drivers of spatial residual variation, followed by precipitation, relative humidity, and selected vegetation indices. The 20 m resolution yielded the best balance between model performance and computational efficiency. In conclusion, our modeling framework effectively captures both spatial heterogeneity and nonlinear interactions, offering a robust solution for spatially explicit flux modeling in structurally diverse ecosystems beyond the study sites.

footprint model↗

Data-driven Mori–Zwanzig modeling of Lagrangian particle dynamics in turbulent flows

The dynamics of Lagrangian particles in turbulence play a crucial role in mixing, transport, and dispersion in complex flows. Their trajectories exhibit highly nontrivial statistical behavior, motivating the development of surrogate models that can reproduce these trajectories without incurring the high computational cost of direct numerical simulations of the full Eulerian field. This task is particularly challenging because reduced-order models typically lack access to the full set of interactions with the underlying turbulent field. Novel data-driven machine learning techniques can be powerful in capturing and reproducing complex statistics of the reduced-order/surrogate dynamics. In this work, we show how one can learn a surrogate dynamical system that is able to evolve a turbulent Lagrangian trajectory in a way that is point-wise accurate for short-time predictions (with respect to Kolmogorov time) and stable and statistically accurate at long times. This approach is based on the Mori–Zwanzig formalism, which prescribes a mathematical decomposition of the full dynamical system into resolved dynamics that depend on the current state and the past history of a reduced set of observables, and the unresolved orthogonal dynamics due to unresolved degrees of freedom of the initial state. We show how by training this reduced order model on a point-wise error metric on short time-prediction, we are able to correctly learn the dynamics of Lagrangian turbulence, such that also the long-time statistical behavior is stably recovered at test time. This opens up a range of applications, for example, for the control of active Lagrangian agents in turbulence.

97 MATHEMATICS AND COMPUTING↗

Analyzing the cosmic web environment in the vicinity of grand-design and flocculent spirals with local geometric index

We explore the environment of a combined set of 367 grand-design and 619 flocculent spiral galaxies. We introduce a novel estimator called the local geometric index to quantify the morphology of the local environment of these 986 spirals. The local geometric index allows us to classify the environment of galaxies into voids, sheets, filaments, and clusters. We find that grand-designs are mostly located in dense environments like clusters and filaments (∼ 78%), whereas the fraction of the flocculents lying in sparse environments like voids and sheets is significantly higher (> 10%) than that of the grand-designs. A p-value < 10 -3 from a Kolmogorov-Smirnov test indicates that our results are statistically significant at 99.9% confidence level. Further, we note that dense environments with large tidal flows are dominated by the grand-designs. On the other hand, low-density environments such as sheets and voids favor the growth of flocculents.

79 ASTRONOMY AND ASTROPHYSICS↗

Forecasting constraints on the mean free path of ionizing photons at z ≥ 5.4 from the Lyman-α forest flux autocorrelation function

ABSTRACT Fluctuations in Lyman-α (Ly α) forest transmission towards high-z quasars are partially sourced from spatial fluctuations in the ultraviolet background, the level of which are set by the mean free path of ionizing photons (λmfp). The autocorrelation function of Ly α forest flux characterizes the strength and scale of transmission fluctuations and, as we show, is thus sensitive to λmfp. Recent measurements at z ∼ 6 suggest a rapid evolution of λmfp at z > 5.0 which would leave a signature in the evolution of the autocorrelation function. For this forecast, we model mock Ly α forest data with properties similar to the XQR-30 extended data set at 5.4 ≤ z ≤ 6.0. At each z, we investigate 100 mock data sets and an ideal case where mock data matches model values of the autocorrelation function. For ideal data with λmfp = 9.0 cMpc at z = 6.0, we recover $\lambda _{\text{mfp}}=12^{+6}_{-3}$ cMpc. This precision is comparable to direct measurements of λmfp from the stacking of quasar spectra beyond the Lyman limit. Hypothetical high-resolution data leads to a $\sim 40~{{\ \rm per\ cent}}$ reduction in the error bars over all z. The distribution of mock values of the autocorrelation function in this work is highly non-Gaussian for high-z, which should caution work with other statistics of the high-z Ly α forest against making this assumption. We use a rigorous statistical method to pass an inference test, however future work on non-Gaussian methods will enable higher precision measurements.

Astronomy & Astrophysics↗

Dark energy survey year 3 results: likelihood-free, simulation-based w CDM inference with neural compression of weak-lensing map statistics

We present simulation-based cosmological wcold dark matter (wCDM) inference using dark energy survey year 3 weak-lensing maps, via neural data compression of weak-lensing map summary statistics: power spectra, peak counts, and direct map-level compression/inference with convolutional neural networks (CNN). Using simulation-based inference, also known as likelihood-free or implicit inference, we use forward-modelled mock data to estimate posterior probability distributions of unknown parameters. This approach allows all statistical assumptions and uncertainties to be propagated through the forward-modelled mock data; these include sky masks, non-Gaussian shape noise, shape measurement bias, source galaxy clustering, photometric redshift uncertainty, intrinsic galaxy alignments, non-Gaussian density fields, neutrinos, and non-linear summary statistics. We include a series of tests to validate our inference results. This paper also describes the Gower Street simulation suite: 791 full-sky pkdgrav3 dark matter simulations, with cosmological model parameters sampled with a mixed active-learning strategy, from which we construct over 3000 mock dark energy survey lensing data sets. For wCDM inference, for which we allow –1 < w < –$\frac{1}{3}$⁠, our most constraining result uses power spectra combined with map-level (CNN) inference. Using gravitational lensing data only, this map-level combination gives Ω m = 0.283$^{+0.020}_{–0.027}$⁠, S 8 = 0.804$^{+0.025}_{–0.017⁠}$, and w < –0.80 (with a 68 per cent credible interval); compared to the power spectrum inference, this is more than a factor of two improvement in dark energy parameter (Ω⁠ DE , w⁠) precision.

79 ASTRONOMY AND ASTROPHYSICS↗

XRD-PUAT (X-Ray Diffraction - Parameter Uncertainty Analysis Toolkit)

This XRD uncertainty toolkit was built to investigate uncertainty and local least squares topology over a specified parameter space on a single histogram in a gpx GSAS-II file. The parameter uncertainty can be investigated using either a frequentist F-test approach or a Bayesian Inference statistical inversion method on a weighted least squares or peak fit refinements.SAND Number: SAND2020-12227 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Moore, Alexander↗

LANL studies of ESD spark energy discharge through September 2019

Two concentric-sphere apparatuses were used to measure the energies deposited by electric sparks through air to calibrated loads. Both sets of spheres had clean, uninsulated metal surfaces. The 127-mm diameter pair of spheres had a gap of 10 mm and a capacitance of 52 pF. The maximum energy stored on these spheres was 12 mJ and the maximum energy delivered to the 50-mΩ load was 11 µJ, with or without inductance. This load energy amounted to 0.09% of the available input energy; the remainder of the input energy was expended in forming the spark. The second set of spheres was 330 mm in diameter with a gap of 14 mm and a capacitance of 240 pF. The maximum energy stored on these spheres was 71 mJ and the maximum energy delivered to the 50-mΩ load was 150 µJ without added inductance. This load energy was 0.27% of the input energy; again, the remainder of the input energy was expended in forming the spark. The inclusion of 250 nH and 500 nH inductances in the discharge path of the smaller spheres caused the current discharges to resonate, but had little effect on the maximum energies deposited in the loads. At the time of writing, inductances had not yet been added to the larger spheres. The magnitudes of the observed spark discharges were stochastic, so more than 1200 tests were required to develop the statistical bounds of the spark behavior, i.e., to estimate the worst case (highest likely) energy depositions in the loads. The action integrals of the current discharges $∫ i^2dt$ were found to be approximately independent of the load resistances for loads of less than ~1 Ω. Hence the energy deposition scaled with resistance as 207 µJ/Ω and 2.93 mJ/Ω for the two apparatuses.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Comparative Assessment of Data-driven Process Models in Health Information Technology

Process mining for conformance analysis consists of comparing a reference process model against a data-driven process model generated via log files from information technology systems. However, in the absence of a complete reference process model, we found no suggested approaches in the literature to address the need for evaluating process conformance among different healthcare facilities to assess standardization of care. Our goal is to find similarities and dissimilarities in data-driven process models among US Veterans Health Administration (VHA) facilities that can be indicative of patient safety issues. Our hypothesis was that the analysis would not produce statistically significant differences in outcome. We present a unique implementation of conformance analysis in process mining that consists of combining process mining, process mapping and statistical metrics. We illustrate our approach by applying it to the analysis of two clinical radiology order process models generated from healthcare data provided by two similar facilities in the VHA. The comparative assessment showed that about 70% of the orders completed successfully and 30% were not completed due to policy and duplications. Our analysis found a good statistical correlation between both facilities, as the Spearman’s correlation coefficient between facilities for the frequency of cases per total hours was 0.87879, for the frequency of cases by state transition was 0.79702 and for the throughput time per state transition was 0.63582. Additional statistical analyses using the Mann-Whitney U test and the root mean square error both produced values that were not significant. The foregoing approach validated our hypothesis by demonstrating a good statistical correlation of data describing the flow of clinical radiology orders absent a credible reference model. Finding good agreement between both facilities was important in confirming that the clinical orders flow in a similar manner, suggesting standardization of care.

97 MATHEMATICS AND COMPUTING↗

Predictive Indicators of the Performance of Large Language Models

In several mission contexts, it is desirable to estimate the performance of large language models (LLMs) on tasks that we cannot run directly. In light of published “scaling laws” our hypothesis is that some tasks should be consistently more challenging than others based on characteristics of the task. The goal of this project was to begin quantifying how much information about LLM performance can be gained from the features of a model and a task. Two of our statistical models struggled to converge. Pass/fail test results may provide limited information for inference beyond model quality and task difficulty, but we see no evidence at this time for significant feature interaction effect sizes, arguing for simple models. Future work extending the models to capitalize on perplexity of ground truth answers is suggested. This project also introduces “Depth of Knowledge Variant Testing” as a strategy for more finely assessing language models on open domain question and answer tasks. We developed sets of questions that ask a language model to produce similar information while demonstrating increasing depth of knowledge, and also relabeled existing Q&A test questions with their depth of knowledge. Our results suggest further consideration of Bloom’s taxonomy and further refinement of prompts to properly elicit information at varying depths. In the course of this work, we set up a basic infrastructure for standardizing tasks and testing many language models on these tasks. In addition to testing the predictive quality of model features and performance across test suites, with this project we have introduced two new task features to contextualize each test question: the Dewey Classification main category of information covered, and the Bloom’s taxonomy level that corresponds to the depth of knowledge probed by the question. Splits across these and other features produced over five hundred task subtypes with distinct feature vectors, which we tested on half a dozen models.

97 MATHEMATICS AND COMPUTING↗

Advanced Laboratory and Field Arrays: Debris Modeling, Detection,& Mitigation (Task 1)

The statement of project objectives for this task was: develop tools, methods and models to assess, and mitigate the risk of damage to MHK infrastructure from woody debris. Develop the capability to detect woody debris using sonar and/or physical methods for purposes of characterizing debris statistics in river (at UAF’s Tanana River Test Site) and near-shore wave (at Yakutat, AK) environments and to activate debris mitigation measures. Develop debris impact risk maps and tables using statistics on debris size, geometry, type, prevalence, mobility and location. Improve and apply the COUPi discrete element method (DEM) to develop models of debris movement and impact on MHK infrastructure to evaluate risk of damage, and interference, to operations from debris. The proposed final deliverable for the task was a set of tools or techniques for providing estimates of the probability of debris impact, and resulting impact forces, on MHK infrastructure as a function of debris size, type, wave regime, and current velocity. Such estimates are required to assess damage risks to operational MHK infrastructure.

13 HYDRO ENERGY↗