Search NASA⌕ Search

SEARCH · Search NASA

Results for “missing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Network Scale Ubiquitous Volume Estimation Using Tree-Based Ensemble Learning Methods

Currently real-time, ubiquitous volume data for roadway networks remains the key missing dimension in traffic operations. Most volume data are average annual daily traffic (AADT) measures derived from the Highway Performance Monitoring System (HPMS). Although methods to factor the AADT to hourly averages for typical day of week exist, actual volume data is limited to a sparse collection of locations in which volumes are continuously recorded. This paper explores the use of state-of-art machine learning techniques to estimate accurate real-time volume measures that span the highway network providing ubiquitous coverage in space, and point-in-time measures for a specific date and time. Three tree-based ensemble learning models, random forest (RF), gradient boost machine (GBM), and extreme gradient boost (XGBoost), were tested for volume estimation by learning from combined dataset of commercial probe data provided by TomTom, the FHWA's Travel Monitoring Analysis System (TMAS) data, and other infrastructure attributes such as number of lanes, speed limit, and weather. The methods were tested on major corridors and freeways in the metropolitan area of Denver. All three machine learning methods were able to provide hourly volume estimates 24 hours a day, 7 days a week, and 365 days a year with around 18% mean absolute error to true volume and about 5% of error with respect to roadway capacity. The low error measures allow the potential application by transportation agencies.

33 ADVANCED PROPULSION SYSTEMS↗

Network-Scale Ubiquitous Volume Estimation Using Tree-Based Ensemble Learning Methods

Currently ubiquitous volume data for roadway networks remains the key missing dimension in traffic operations. Most volume data are average annual daily traffic (AADT) measures derived from the Highway Performance Monitoring System (HPMS). Although methods to factor the AADT to hourly averages for typical day of week exist, actual volume data is limited to a sparse collection of locations in which volumes are continuously recorded. This paper/poster explores the use of state-of-art machine learning techniques to estimate accurate volume measures that span the highway network providing ubiquitous coverage in space, and point-in-time measures for a specific date and time. Three tree-based ensemble learning models, random forest (RF), gradient boost machine (GBM), and extreme gradient boost (XGBoost), were tested for volume estimation by learning from combined dataset of commercial probe data provided by TomTom, the FHWA's Travel Monitoring Analysis System (TMAS) data, and other infrastructure attributes such as number of lanes, speed limit, and weather. The methods were tested on major corridors and freeways in the metropolitan area of Denver. All three machine learning methods were able to provide hourly volume estimates 24 hours a day, 7 days a week, and 365 days a year with around 18% mean absolute error to true volume and about 5% of error with respect to roadway capacity. The low error measures allow the potential application by transportation agencies.

33 ADVANCED PROPULSION SYSTEMS↗

Search for supersymmetry in final states with jets, missing transverse momentum and one isolated lepton in s = 7 TeV pp collisions using 1 f b − 1 of ATLAS data

CERN-LHC. Study of final states containing jets, missing transverse momentum and one isolated electron or muon in proton-proton collisions at a centre-of-mass energy of 7 TeV. The data sample used, with an integrated lumninosity of 1.04 fb-1 was collected in the first half of 2011. The analysis uses four distinct signal regions with either a minimum of 3 or 4 jets and variations on the missing transverse momentum cuts designed to optimize searches for various SUSY models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Software-Based Challenges of Developing the Future Distribution Grid

The software that the utility industry currently uses may be insufficient to analyze the distribution grid as it rapidly modernizes to include active resources such as distributed generation, switch and voltage control, automation, and increasingly complex loads. Although planners and operators have traditionally viewed the distribution grid as a passive load, utilities and consultants increasingly need enhanced analysis that incorporates active distribution grid loads in order to ensure grid reliability. Numerous commercial and open-source tools are available for analyzing distribution grid systems. These tools vary in complexity from providing basic load-flow and capacity analysis under steady-state conditions to time-series analysis and even geographical representations of dynamic and transient events. The need for each type of analysis is not well understood in the industry, nor are the reasons that distribution analysis requires different techniques and tools both from those now available and from those used for transmission analysis. In addition, there is limited understanding of basic capability of the tools and how they should be practically applied to the evolving distribution system. The study reviews the features and state of the art capability of current tools, including usability and visualization, basic analysis functionality, advanced analysis including inverters, and renewable generation and load modeling. We also discuss the need for each type of distribution grid system analysis. In addition to reviewing basic functionality current models, we discuss dynamics and transient simulation in detail and draw conclusions about existing software?s ability to address the needs of the future distribution grid as well as the barriers to modernization of the distribution grid that are posed by the current state of software and model development. Among our conclusions are that accuracy, data transfer, and data processing abilities are key to future distribution grid modeling, and measured data sources are a key missing element . Modeling tools need to be calibrated based on measured grid data to validate their output in varied conditions such as high renewables penetration and rapidly changing topology. In addition, establishing a standardized data modeling format would enable users to transfer data among tools to take advantage of different analysis features. ?

99 GENERAL AND MISCELLANEOUS↗

The MCDB System for Management and Analysis of Petabyte-Scale Uncertain Data

Analysts working with very large data sets often use statistical models to “guess” at unknown, inaccurate, or missing information associated with the data. For example, a distant object viewed through an optical lens will have its position slightly shifted by imperfections in the lens. Thus, rather than considering the object’s observed position to be absolutely correct, it makes sense to take into account the lens’s imperfections to obtain a probabilistic guess as to the object’s true position. For another example, it might be important to associate some sort of error distribution with each of the individual sensors in an array of magnetometers. This error distribution may be complex and include spatially-driven covariances, because errors in nearby sensors are likely to be correlated (caused, for example, by the presence of some nearby, fixed metal object). This project is concerned with the design and implementation of a prototype data management system called the Monte Carlo Database System, or MCDB for short. MCDB allows an expert-level analyst or statistician to attach arbitrary stochastic models to very large data sets in order to “guess” the values for unknown or inaccurate data, such as the actual position of the observed object in the lens example above. When the resulting data set is analyzed, the underlying stochastic models are used to generate hundreds or thousands of possible data set instances, and each of those possible instances is analyzed separately by MCDB. Thus, MCDB does not just give a single answer to the analysis, but it actually gives an empirical distribution of query results that embody the underlying uncertainty, and can in turn be analyzed using standard statistical techniques. The stochastic models in MCDB are implemented as user-defined, external C++ libraries called Variable Generation functions (VG functions for short). Because the VG function interface is exceedingly general, it allows MCDB to be used in a very wide variety of application domains, in conjunction with virtually any stochastic model. Ultimately, we ended up calling the system that we developed over the course of the project SimSQL, to denote the fact that it allowed for stochastic simulation of data. The software developed during the lifetime of the project is available for download from the SimSQL project website: http://cmj4.web.rice.edu/SimSQL/SimSQL.html.

42 ENGINEERING↗

Merged Aerosol Value-Added Product Report

The Merged Aerosol Value-Added Product (VAP) simplifies scientists’ use of Atmospheric Radiation Measurement (ARM) User Facility aerosol data by performing several tedious, time-consuming tasks for the users. First, the VAP identifies the best data available when multiple datastreams exist for a single geophysical quantity so that ARM users do not have to research this for themselves. Second, the VAP consolidates multiple ARM aerosol datastreams into a single file for ARM data users so that they do not have to download, open, and read multiple files for their analysis. Next, the VAP transforms all measurements onto a common one-hour timestamp. The one-hour resolution matches the time resolution of the slowest instrument. Instruments with faster sampling rates than one measurement per hour are averaged over the time interval. Finally, the VAP reads the QA/QC variables and marks data with known issues as missing, so that users do not have to spend excessive time cleaning data. This includes incorporating Data Quality Reports (DQRs) that exist at the time when the VAP data is generated. DQRs are reports filed by instrument mentors or data users that indicate a problem with the output data of individual instruments.

54 ENVIRONMENTAL SCIENCES↗

WE-EF-BRA-11: Precision Partial-Tumor Irradiation of Dorsal Rodent Mammary Tumors

Purpose: To introduce a pre-clinical treatment technique on a micro-irradiator to treat specific volumes of dorsal mammary tumors in BALB/c mice while sparing lungs and spine. This technique facilitates pre-clinical investigation of tumor response to sub-optimal radiation treatments in which a portion of the tumor is unirradiated, known as a “marginal miss”. In-vitro data suggests that partial tumor radiations trigger a more aggressive phenotype in non-irradiated, regional tumor cells via bystander effects. As the lung tissue is spared, the impact of marginal miss on the development of pulmonary metastasis may be assessed. Methods: End to end test was performed on three BALB/c mice as proof of concept for larger studies. 1Gy was delivered on the micro-irradiator employing previously unexplored lateral parallel-opposed diamond and/or triangle-shaped beams. The margins of the treatment beam were defined using a combination of tumor palpation, barium fiducial markers, and real-time fluoroscopic images. The dose distribution was independently verified with kilovoltage beam Monte Carlo dose calculations with 7% statistical uncertainty and double exposure images. As a final step, the technique was used in a larger pre-clinical study (15Gy, 36 BALB/c mice) and lung metastasis in response to tumor irradiation of 100%, 50% and 0% was quantified. Results: For the Monte-Carlo dose calculations, the dose volume histograms established a maximum dose within the un-irradiated and radiated portions of the mammary tumor of 0.3Gy and 1.5Gy respectively, with a sharp gradient at the boundary. 100% of the lung volume received less than 0.5Gy. This technique proved suitable for a pre-clinical marginal miss study with 50% more lung metastases in partially-radiated mouse models compared to completely. Conclusion: We have developed a novel treatment technique for partial or full irradiation of dorsal mammary tumors incorporating lung sparing.The technique will be useful for exploring the phenomena of aggressive tumor phenotype that may arise from miss-irradiation.

60 APPLIED LIFE SCIENCES↗

Supersymmetry in Light of 1/fb of LHC Data

We update previous frequentist analyses of the CMSSM and NUHM1 parameter spaces to include the public results of searches for supersymmetric signals using ~1 /fb of LHC data recorded by ATLAS and CMS and ~0.3/fb of data recorded by LHCb in addition to electroweak precision and B-physics observables. We also include the constraints imposed by the cosmological dark matter density and the XENON100 search for spin-independent dark matter scattering. The LHC data set includes ATLAS and CMS searches for jets + missing ET events and for the heavier MSSM Higgs bosons, and the upper limits on B_s to mu^+ mu^- from LHCb and CMS. The absences of jets + missing ET signals in the LHC data favour heavier mass spectra than in our previous analyses of the CMSSM and NUHM1, which may be reconciled with (g-2)_mu if tan beta ~ 40, a possibility that is however under pressure from heavy Higgs searches and the upper limits on B_s to mu^+ mu^-. As a result, the p-value for the CMSSM fit is reduced to ~ 15 (38)%, and that for the NUHM1 to ~ 16 (38)%, to be compared with ~ 9 (49)% for the Standard Model limit of the CMSSM for the same set of observables (dropping (g-2)_mu), ignoring the dark matter relic density in both cases. We discuss the sensitivities of the fits to the (g-2)_mu and b to s gamma constraints, contrasting fits with and without the (g-2)_mu constraint, and combining the theoretical and experimental errors for b to s gamma linearly or in quadrature. We present predictions for m_gluino, B_s to mu^+ mu^-, M_h and M_A, and update predictions for spin-independent dark matter scattering, stressing again the importance of taking into account the uncertainty in the pi-nucleon sigma term, Sigma_{pi N}. Finally, we present predictions based on our fits for the likely thresholds for sparticle pair production in e^+e^- collisions in the CMSSM and NUHM1.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The Missing Correlation Between the Potential Rate Impacts of Rooftop Solar and the Timing of State Net Metering Policy Revisions

Data supporting the article “The Missing Correlation Between the Potential Rate Impacts of Rooftop Solar and the Timing of State Net Metering Policy Revisions” (https://www.nlr.gov/docs/fy25osti/93543.pdf). Residential solar photovoltaic (PV) output in most states is credited at the retail electricity rate, a policy commonly known as net metering. Twelve states have replaced net metering with alternative rate structures that reduce PV adopter bill savings. Proponents of these revisions argue that net metering increases the electricity rates of customers without PV. Here, we analyze the degree to which the timelines of net metering revisions have correlated with potential electricity rate impacts. We estimate that potential rate impacts at the end of 2023 were less than 1% of typical customer bills in 37 of 44 states that have offered net metering. There are no statistically significant differences in average or median estimated rate impacts between states that have and have not revised net metering. Nine of the states that had revised net metering did so when estimated impacts were less than 1% of typical customer bills. Many states have retained net metering into higher PV deployment levels with increased risk of potential rate impacts. Only two states-California and Hawaii-retained net metering beyond estimated rate impacts of 5%, and both have revised net metering. These findings do not suggest a clear, consistent link between net metering revision timelines and potential rate impacts. The timing and nature of net metering revisions are ultimately policy decisions based on state-level priorities and considerations.

14 SOLAR ENERGY↗

RELAP5-3D Modeling of High Temperature Test Facility (HTTF) Test PG-26

The High Temperature Test Facility (HTTF) at Oregon State University (OSU) is a scaled integral effects experiment designed to investigate transient behavior in high-temperature gas-cooled nuclear reactors with prismatic fuel and reflector blocks. Several tests have been completed, and more are still planned to at the HTTF, including depressurized conduction cooldown (DCC) and pressurized conduction cooldown (PCC) transients. This report analyses test PG-26, a progression of the Double Ended Inlet-Outlet Crossover Duct Break transient that is referred to as a DCC. PG-26 has been performed at the HTTF between May 30 and June 30, 2019. Core initial conditions (i.e., before the DCC started) have been met using low power (<100 kW) and two of ten available electric heaters. The DCC transient was initiated during the 50 th hour of the test. The break valves were opened, and hot helium from the core and cold helium from the reactor cavity simulation tank (RCST) started mixing. The gases flowed in a countercurrent fashion, where the top half of the hot duct contained hot helium that flowed in one direction and cold helium that flowed in the other direction in the bottom half of the duct. After the pressure and density reached equilibrium, the event entered a diffusion mode. The onset of a reverse natural circulation was not observed during the DCC period of the test. Version 4.4.2ie of the RELAP5-3D computer code has been used to model the HTTF PG-26 test, and results have been compared to available high-quality measured data. The model used in this study is the quality-controlled HTTF RELAP5-3D model (HTTF base 2018-04-19 QA), originally developed by P. Bayless. The report includes RELAP5-3D results of the “base calculations” as well as some sensitivities to important uncertain model inputs, such as primary helium mass flow rate, core ceramic thermal properties, as well as heat evacuation and loop friction models. Using the base RELAP5-3D model predicts a countercurrent helium flow in the hot duct observed at the beginning of the DCC, but instead of going into a molecular diffusion mode, the model predicts the onset of natural convection. Increasing friction in the core and hot duct prevents the natural convection from happening in some of the simulations. Although some temperatures are well predicted (and even overpredicted), the general tendency is to underpredict the ceramic and helium temperatures and heat removal rates during the DCC, resulting in many of the assessment findings being in minimal or insufficient agreement with the data. It is worth noting that the described discrepancies between measured data and RELAP5-3D predictions are not RELAP5-3D code limitations. More so, they reflect limitations in boundary condition and thermal property knowledge. While the RELAP5-3D calculations of the test provide some insights into what happens during the transient, and point to missing or potentially uncertain data to which the experimenters can direct their attention, the principal conclusion is that the PG-26 test data are insufficient for a system code assessment.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Enhancing Worker Safety During Off-Site Construction of Energy-Efficient, Low-Carbon Exterior Envelope

The construction industry is not doing enough to embrace off-site modular construction. It is a missed opportunity for optimized energy efficiency because prefabricated exterior wall envelopes are lower in cost and faster and easier to install. Factory off-site construction offers improved safety for construction workers because work is done in a controlled environment, but lack of intent, understanding, and data is also a missed opportunity for enhancing worker safety. This research looks specifically at the prefabricated wall exterior envelope in the context of safety. The research question is "off-site factories build with ease of energy efficiency and lowered carbon emissions, but is the process safer?" This research was funded by NREL Student Training in Applied Research (STAR) program, University Partnerships Program, and Wells Fargo Bank. Key finding is that modular and prefabricated construction are perceived to be safer, but the accident rates are much higher than in the general construction and manufacturing industries. Proposed solutions to decrease accidents in off-site prefabricated construction includes safety training for workers, provide movable kiosks with PPE at workstations, ensure tools are well-maintained and place safety posters in visible locations. Future work includes improving worker safety to increase worker productivity, perform pilot demonstration, work with factory designers for new modular layout for worker safety, i.e., easy access to PPE kiosks, and work closely with OSHA so that they take notice of this safety niche.

drywall↗

Molecular Assemblies, Genes and Genomics Integrated Efficiently (MAGGIE)

Final report on MAGGIE. We set ambitious goals to model the functions of individual organisms and their community from molecular to systems scale. These scientific goals are driving the development of sophisticated algorithms to analyze large amounts of experimental measurements made using high throughput technologies to explain and predict how the environment influences biological function at multiple scales and how the microbial systems in turn modify the environment. By experimentally evaluating predictions made using these models we will test the degree to which our quantitative multiscale understanding wilt help to rationally steer individual microbes and their communities towards specific tasks. Towards this end we have made substantial progress towards understanding evolution of gene families, transcriptional structures, detailed structures of keystone molecular assemblies (proteins and complexes), protein interactions, biological networks, microbial interactions, and community structure. Using comparative analysis we have tracked the evolutionary history of gene functions to understand how novel functions evolve. One level up, we have used proteomics data, high-resolution genome tiling microarrays, and 5' RNA sequencing to revise genome annotations, discover new genes including ncRNAs, and map dynamically changing operon structures of five model organisms: For Desulfovibrio vulgaris Hildenborough, Pyrococcus furiosis, Sulfolobus solfataricus, Methanococcus maripaludis and Haiobacterium salinarum NROL We have developed machine learning algorithms to accurately identify protein interactions at a near-zero false positive rate from noisy data generated using tagfess complex purification, TAP purification, and analysis of membrane complexes. Combining other genome-scale datasets produced by ENIGMA (in particular, microarray data) and available from literature we have been able to achieve a true positive rate as high as 65% at almost zero false positives when applied to the manually curated training set. Applying this method to the data representing around a quarter of the fraction space for water soluble proteins in D. vulgaris, we obtained 854 reliable pair wise interactions. Further, we have developed algorithms to analyze and assign significance to protein interaction data from bait pull-down experiments and integrate these data with other systems biology data through associative biclustering in a parallel computing environment. We will 'fill-in' missing information in these interaction data using a 'Transitive Closure' algorithm and subsequently use 'Between Commonality Decomposition' algorithm to discover complexes within these large graphs of protein interactions. To characterize the metabolic activities of proteins and their complexes we are developing algorithms to deconvolute pure mass spectra, estimate chemical formula for m/z values, and fit isotopic fine structure to metabolomics data. We have discovered that in comparison to isotopic pattern fitting methods restricting the chemical formula by these two dimensions actually facilitates unique solutions for chemical formula generators. To understand how microbial functions are regulated we have developed complementary algorithms for reconstructing gene regulatory networks (GRNs). Whereas the network inference algorithms cMonkey and Inferelator developed enable de novo reconstruction of predictive models for GRNs from diverse systems biology data, the RegPrecise and RegPredict framework developed uses evolutionary comparisons of genomes from closely related organisms to reconstruct conserved regulons. We have integrated the two complementary algorithms to rapidly generate comprehensive models for gene regulation of understudied organisms. Our preliminary analyses of these reconstructed GRNs have revealed novel regulatory mechanisms and cis-regulatory motifs, as well asothers that are conserved across species. Finally, we are supporting scientific efforts in ENIGMA with data management solutions and by integrating all of the algorithms, software and data into a Knowledgebase. For instance, we have developed the RegPrecise database (http://regprecise.lbl.gov) which represents manually curated sets of regulons laying the basis for automatic annotation of regulatory interactions in closely related species. We are also in the midst of scaling up MicrobesOnline to handle the growing volume of sequence and functional genomics data. Over the last year our efforts have been focused on providing support for additional genomic and functional genomic data types. Similarly, we have developed several visualization tools to help with the exploration of complex systems biology datasets. A case in point is the Gaggle Genome Browser (GGB), which was enhanced with visualizations for plotting peptide detections and protein-DNA binding alongside transcriptome structure, plus the ability to interactively filter by signal intensity or p-value.

54 ENVIRONMENTAL SCIENCES↗

Maximum likelihood method to correct for missed levels based on the {Delta}{sub 3}(L) statistic

The {Delta}{sub 3}(L) statistic of random matrix theory is defined as the average of a set of random numbers {l_brace}{delta}{r_brace}, derived from a spectrum. The distribution p({delta}) of these random numbers is used as the basis of a maximum likelihood method to gauge the fraction x of levels missed in an experimental spectrum. The method is tested on an ensemble of depleted spectra from the Gaussian orthogonal ensemble (GOE) and accurately returned the correct fraction of missed levels. Neutron resonance data and acoustic spectra of an aluminum block were analyzed. All results were compared with an analysis based on an established expression for {Delta}{sub 3}(L) for a depleted GOE spectrum. The effects of intruder levels are examined and seen to be very similar to those of missed levels. Shell model spectra were seen to give the same p({delta}) as the GOE.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Low-rank Tensor Completion for PMU Data Recovery

This paper proposes a tensor completion method for the recovery of missing phasor measurement unit (PMU) measurements. Tensor completion as the general case of matrix completion has attracted increasing attention in recent years. The imputation accuracy for the existing matrix completion methods may be significantly reduced when there are consecutive data losses across multiple data channels. To tackle this issue, we explore the multi-way characteristics of PMU measurements by using a tensor model. We leverage the low-rank property of the PMU measurements and formulate the missing PMU data recovery problem as a low-rank tensor completion problem. An efficient algorithm based on alternating direction method of multipliers (ADMM) is developed to solve the tensor completion problem. The experiments using the real PMU dataset show that the proposed method exhibits better imputation accuracy compared with the conventional data recovery methods.

Ghasemkhani, Amir↗

A Chandra-HETG view of MCG +8-11-11

We present a spectral analysis of the 118 ks Chandra High Energy Transmission Gratings (HETG) observation of the X-ray bright Seyfert 1.5 galaxy MCG +8-11-11, in conjunction with 100 ks of archival Suzaku data, aimed at investigating the signatures of warm absorption and Compton reflection reported from previous Suzaku and XMM-Newton studies of the source. Contrary to previous results, we find that warm absorption is not required by the data. Instead, we report upper limits on absorption lines that are below previous (marginal) detections. Fe Kα line emission is clearly detected and is likely resolved with σ ∼ 0.02 keV with the HETG data. We applied self-consistent, broadband spectral-fitting models to the Chandra and Suzaku data to investigate this and other signatures of distant absorption and reflection. Utilizing in particular the MYTorus model, we find that the data are consistent with reprocessing by a distant, neutral torus that is marginally Compton-thick ( N {sub H} ∼10{sup 24}cm{sup –2}) and out of the line of sight. However, we do not find compelling evidence of a relativistically broadened Fe K emission line, which is often expected from type 1 active galactic nuclei. This is consistent with some, although not all, previous studies of MCG +8-11-11. A well-measured edge is identified by the HETG near 0.5 keV, indicating neutral absorption in the line of sight that is consistent with galactic absorption; however, the absorption may be partially intrinsic to the source. The HETG data are consistent with the presence of a soft excess, a feature that may be missed by considering the Suzaku data alone.

79 ASTRONOMY AND ASTROPHYSICS↗

Atomistic Calculations of the Effect of Minor Actinides on Thermodynamic and Kinetic Properties of UO 2±x

The team will examine how the incorporation of actinide species important for mixed oxide (MOX) and other advanced fuel designs impacts thermodynamic quantities of the host UO 2 nuclear fuel and how Pu, Np, Cm and Am influence oxygen mobility. In many cases, the experimental data is either insufficient or missing. For example, in the case of pure NpO 2 , there is essentially no experimental data on the hyperstoichiometric form it is not even known if hyperstoichiometry NpO 2 ±x is stable. The team will employ atomistic modeling tools to calculate these quantities

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

In-Situ Inference: Bringing Advanced Data Science Into Exascale Simulations

As simulations generate ever-increasing amounts of data, there are correspondingly richer opportunities for analysis and scientific discovery - discoveries that will be missed if most of the data must be discarded before it is analyzed. Because future exascale architectures will be increasingly storage-limited, it will not be possible to save the vast majority of simulation data for later analysis, requiring analysis to occur “in-situ” within the simulation. However, existing in-situ data analysis frameworks provide little or no support for one of the most sophisticated forms of data science: probabilistic statistical modeling or uncertainty quantification (UQ), and the accompanying challenge of inference - fitting those statistical models to massive simulation output. Our goal is to develop the fundamental statistical algorithms and computer science needed to perform statistical inference in-situ (in HPC simulations) to the full stream of data those simulations generate.

97 MATHEMATICS AND COMPUTING↗