Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98

Towards a CAN IDS Based on a Neural Network Data Field Predictor

Modern vehicles contain a few controller area networks (CANs), which allow scores of on-board electronic control units (ECUs) to communicate messages critical to vehicle functions and driver safety. CAN provides a lightweight and reliable broadcast protocol but is bereft of security features. As evidenced by many recent research works, CAN exploits are possible both remotely and with direct access, fueling a growing CAN intrusion detection system (IDS) body of research. A challenge for pioneering vehicle-agnostic IDSs is that passenger vehicles' CAN message encodings are proprietary, defined and held secret by original equipment manufacturers (OEMs). Targeting detection of next-generation attacks, in which messages are sent from the expected ECU at the expected time but with malicious content, researchers are now seeking to leverage "CAN data models'', which predict future CAN messages and use prediction error to identify anomalous, hopefully malicious CAN messages. Yet, current works model CAN signals post-translation, i.e., after applying OEM-donated or reverse-engineered translations from raw data. We present initial IDS results testing deep neural networks used to predict CAN data at the bit level, targeting IDS capabilities that avoiding reverse engineering proprietary encodings. Our results suggest the method is promising for data with signals exhibiting dependence on previous or concurrent inputs.

Pawelec, Krzysztof↗

Advanced Computational Framework for Environmental Management ZEM, Version 1.x

Typically environmental management problems require analysis of large and complex data sets originating from concurrent data streams with different data collection frequencies and pedigree. These big data sets require on-the-fly integration into a series of models with different complexity for various types of model analyses where the data are applied as soft and hard model constraints. This is needed to provide fast iterative model analyses based on the latest available data to guide decision-making. Furthermore, the data and model are associated with uncertainties. The uncertainties are probabilistic (e.g. measurement errors) and non-probabilistic (unknowns, e.g. alternative conceptual models characterizing site conditions). To address all of these issues, we have developed an integrated framework for real-time data and model analyses for environmental decision-making called ZEM. The framework allows for seamless and on-the-fly integration of data and modeling results for robust and scientifically-defensible decision-making applying advanced decision analyses tools such as Bayesian- Information-Gap Decision Theory (BIG-DT). The framework also includes advanced methods for optimization that are capable of dealing with a large number of unknown model parameters, and surrogate (reduced order) modeling capabilities based on support vector regression techniques. The framework is coded in Julia, a state-of-the-art high-performance programing language (http://julialang.org). The ZEM framework is open-source and can be applied to any environmental management site. The framework will be open-source and released under GPL V3 license.

Vesselinov, VelimirV.↗

Network design for quantifying urban CO<sub>2</sub> emissions: assessing trade-offs between precision and network density

The majority of anthropogenic CO 2 emissions are attributable to urban areas. While the emissions from urban electricity generation often occur in locations remote from consumption, many of the other emissions occur within the city limits. Evaluating the effectiveness of strategies for controlling these emissions depends on our ability to observe urban CO 2 emissions and attribute them to specific activities. Cost-effective strategies for doing so have yet to be described. Here we characterize the ability of a prototype measurement network, modeled after the Berkeley Atmospheric CO 2 Observation Network (BEACO 2 N) in California's Bay Area, in combination with an inverse model based on the coupled Weather Research and Forecasting/Stochastic Time-Inverted Lagrangian Transport (WRF-STILT) to improve our understanding of urban emissions. The pseudo-measurement network includes 34 sites at roughly 2 km spacing covering an area of roughly 400 km 2 . The model uses an hourly 1 × 1 km 2 emission inventory and 1 × 1 km 2 meteorological calculations. We perform an ensemble of Bayesian atmospheric inversions to sample the combined effects of uncertainties of the pseudo-measurements and the model. We vary the estimates of the combined uncertainty of the pseudo-observations and model over a range of 20 to 0.005 ppm and vary the number of sites from 1 to 34. We use these inversions to develop statistical models that estimate the efficacy of the combined model–observing system in reducing uncertainty in CO 2 emissions. We examine uncertainty in estimated CO 2 fluxes on the urban scale, as well as for sources embedded within the city such as a line source (e.g., a highway) or a point source (e.g., emissions from the stacks of small industrial facilities). Using our inversion framework, we find that a dense network with moderate precision is the preferred setup for estimating area, line, and point sources from a combined uncertainty and cost perspective. The dense network considered here (modeled after the BEACO 2 N network with an assumed mismatch error of 1 ppm at an hourly temporal resolution) could estimate weekly CO 2 emissions from an urban region with less than 5 % error, given our characterization of the combined observation and model uncertainty.

54 ENVIRONMENTAL SCIENCES↗

ZEM: Integrated Framework for Real-Time Data and Model Analyses for Robust Environmental Management Decision Making - 16438

Typically environmental management (EM) problems require analysis of large and complex data sets originating from concurrent data streams with different data collection frequencies and pedigree. These big data sets require on-the-fly analysis, assimilation and integration into a series of models with different complexity for various types of model-based analyses. This is needed to provide fast iterative model analyses based on the latest available data to guide decision-making. Furthermore, the data and model are associated with uncertainties. The uncertainties are probabilistic (e.g. measurement errors) and non-probabilistic (unknowns, e.g. alternative conceptual models characterizing site conditions). To address all of these issues, we have developed an integrated framework for real-time data and model analyses for environmental decision-making called ZEM. The framework allows for seamless and on-the-fly integration of data and modeling results for robust and scientifically-defensible decision-making applying advanced decision analyses tools such as Bayesian-Information-Gap Decision Theory (BIG-DT). The framework also includes advanced methods for optimization that are capable of dealing with a large number of unknown model parameters, and surrogate (reduced order) modeling capabilities based on support vector regression techniques. The framework is predominantly coded in Julia, a state-of-the-art high-performance programing language (http://julialang.org) and incorporates the MADS computational tools (Model Analysis and Decision Support; http://mads.lanl.gov). We demonstrate the application of ZEM for data and model analyses at the LANL Chromium site. The ZEM framework will be released as open-source code and can be applied to any environmental management site. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Validation of sea ice models using an uncertainty-based distance metric for multiple model variables: NEW METRIC FOR SEA ICE MODEL VALIDATION

Here, we implement a variance-based distance metric (D n ) to objectively assess skill of sea ice models when multiple output variables or uncertainties in both model predictions and observations need to be considered. The metric compares observations and model data pairs on common spatial and temporal grids improving upon highly aggregated metrics (e.g., total sea ice extent or volume) by capturing the spatial character of model skill. The D n metric is a gamma-distributed statistic that is more general than the χ 2 statistic commonly used to assess model fit, which requires the assumption that the model is unbiased and can only incorporate observational error in the analysis. The D n statistic does not assume that the model is unbiased, and allows the incorporation of multiple observational data sets for the same variable and simultaneously for different variables, along with different types of variances that can characterize uncertainties in both observations and the model. This approach represents a step to establish a systematic framework for probabilistic validation of sea ice models. The methodology is also useful for model tuning by using the D n metric as a cost function and incorporating model parametric uncertainty as part of a scheme to optimize model functionality. We apply this approach to evaluate different configurations of the standalone Los Alamos sea ice model (CICE) encompassing the parametric uncertainty in the model, and to find new sets of model configurations that produce better agreement than previous configurations between model and observational estimates of sea ice concentration and thickness.

58 GEOSCIENCES↗

Hydro-frac monitoring using ground time-domain electromagnetics: Hydro-frac monitoring using ground time-domain EM

& Engineers. As motivation for considering new electromagnetic techniques for hydraulic fracture monitoring, we develop a simple financial model for the net present value offered by geophysical characterization to reduce the error in stimulated reservoir volume calculations. Additionally, this model shows that even a 5% improvement in stimulated reservoir volume for a 1 billion barrel (bbl) field results in over 1 billion U.S. dollars (US$) in net present value over 24 years for US$100/bbl. oil and US$0.5 billion for US$50/bbl. oil. The application of conductivity upscaling, often used in electromagnetic modeling to reduce mesh size and thus simulation runtimes, is shown to be inaccurate for the high electrical contrasts needed to represent steel-cased wells in the earth. Fine-scale finite-difference modeling with 12.22-mm cells to capture the steel casing and fractures shows that the steel casing provides a direct current pathway to a created fracture that significantly enhances the response compared with neglecting the steel casing. We consider conductively enhanced proppant, such as coke-breeze-coated sand, and a highly saline brine solution to produce electrically conductive fractures. For a relatively small frac job at a depth of 3 km, involving 5,000 bbl. of slurry and a source midpoint to receiver separation of 50 m, the models show that the conductively enhanced proppant produces a 15% increase in the electric field strength (in-line with the transmitter) in a 10-Ωm background. In a 100-Ωm background, the response due to the proppant increases to 213%. Replacing the conductive proppant by brine with a concentration of 100,000-ppm NaCl, the field strength is increased by 23% in the 100-Ωm background and by 2.3% in the 10-Ωm background. Finally, all but the 100,000-ppm NaCl brine in a 10-Ωm background produce calculated fracture-induced electric field increases that are significantly above 2%, a value that has been demonstrated to be observable in field measurements. © 2015 European Association of Geoscientists

58 GEOSCIENCES↗

Prediction of DVH parameter changes due to setup errors for breast cancer treatment based on 2D portal dosimetry

Electronic portal imaging devices (EPIDs) are increasingly used for portal dosimetry applications. In our department, EPIDs are clinically used for two-dimensional (2D) transit dosimetry. Predicted and measured portal dose images are compared to detect dose delivery errors caused for instance by setup errors or organ motion. The aim of this work is to develop a model to predict dose-volume histogram (DVH) changes due to setup errors during breast cancer treatment using 2D transit dosimetry. First, correlations between DVH parameter changes and 2D gamma parameters are investigated for different simulated setup errors, which are described by a binomial logistic regression model. The model calculates the probability that a DVH parameter changes more than a specific tolerance level and uses several gamma evaluation parameters for the planning target volume (PTV) projection in the EPID plane as input. Second, the predictive model is applied to clinically measured portal images. Predicted DVH parameter changes are compared to calculated DVH parameter changes using the measured setup error resulting from a dosimetric registration procedure. Statistical accuracy is investigated by using receiver operating characteristic (ROC) curves and values for the area under the curve (AUC), sensitivity, specificity, positive and negative predictive values. Changes in the mean PTV dose larger than 5%, and changes in V{sub 90} and V{sub 95} larger than 10% are accurately predicted based on a set of 2D gamma parameters. Most pronounced changes in the three DVH parameters are found for setup errors in the lateral-medial direction. AUC, sensitivity, specificity, and negative predictive values were between 85% and 100% while the positive predictive values were lower but still higher than 54%. Clinical predictive value is decreased due to the occurrence of patient rotations or breast deformations during treatment, but the overall reliability of the predictive model remains high. Based on our predictive model, 2D transit dosimetry measurements can now directly be translated in clinically more relevant DVH parameter changes for the PTV during conventional breast treatment. In this way, the possibility to design decision protocols based on extracted DVH changes is created instead of undertaking elaborate actions such as repeated treatment planning or 3D dose reconstruction for a large group of patients.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A crystal plasticity model with an atomistically informed description of grain boundary sliding for improved predictions of deformation fields

Crystal plasticity (CP) is a powerful meso-scale technique for deformation modeling in polycrystalline materials. Crystal plasticity models typically do not include an explicit description of grain boundary (GB) sliding, which could lead to inaccurate predictions of strain distributions, especially in the vicinity of GBs. In the present study, a CP model is developed that includes GB sliding as an additional deformation mechanism and models the interaction between slip and GB sliding. Atomistic simulations are used to formulate the constitutive model for GB sliding and its interaction with incident slip. The deformation fields and structure of the GBs are obtained directly from experimental characterization and are faithfully reproduced as bicrystal systems for molecular dynamics simulations. The GBs are modeled as random-type (non-coincidence, asymmetrical) boundaries as observed from experimental data. The underlying atomistic-scale mechanism for pure sliding of random GBs was found to be analogous to fluid-flow. The interaction between incident slip and a sliding GB caused local increases in stress concentration, which further led to a momentary increase in the local sliding rate. The displacement profiles at the sliding GBs computed from the CP model with sliding accommodation are 38% more accurate than the baseline CP model as quantified by the mean squared error between the simulations and experiment. Here these results help improve the sophistication and accuracy of deformation modeling by including physics-based descriptions for GB sliding and its interaction with slip, eventually leading to more reliable predictions of micromechanical quantities.

36 MATERIALS SCIENCE↗

Addressing Angular Single-Event Effects in the Estimation of On-Orbit Error Rates

Our study describes complications introduced by angular direct ionization events on space error rate predictions. In particular, prevalence of multiple-cell upsets and a breakdown in the application of effective linear energy transfer in modern-scale devices can skew error rates approximated from currently available estimation models. Moreover, this paper highlights the importance of angular testing and proposes a methodology to extend existing error estimation tools to properly consider angular strikes in modern-scale devices. Finally, these techniques are illustrated with test data provided from a modern 28 nm SRAM-based device.

42 ENGINEERING↗

Validating a Dynamic PWR Safety and Security Model?

Nuclear power plants (NPPs) are assessed for safety and security using separate models that cannot capture how an attacker's decisions and a plant's response unfold together in real time, leaving regulators and operators without a complete picture of true plant vulnerability. Traditional probabilistic risk assessment (PRA) methods treat adversarial events as fixed initiators with predetermined outcomes, and are structurally incapable of representing the time-dependent interplay between physical security events, safety system response, and operator mitigative actions. At Idaho National Laboratory (INL), I contributed to the development and validation of Modeling and Analysis for Safety and Security using the Dynamic EMRALD Framework (MASS-DEF). Where static PRA relies on event-tree logic that cannot evolve mid-scenario, MASS-DEF couples a time-dependent dynamic PRA tool EMRALD (Event Modeling Risk Assessment using Linked Diagrams) with attack simulation software, allowing attacker behavior, plant system states, and operator actions to interact across time. My work focused on validating a general Pressurized Water Reactor (PWR) model. I traced model logic against PWR plant to identified errors in logic and confirm accuracy. I then built and tested attack scenarios against a general PWR model to verify that the model produced expected outcomes across all logical pathways. I also contributed a section to a related technical paper applying the same EMRALD platform to radiation dose modeling. Results show that MASS-DEF can quantitatively demonstrate that many plants exceed their regulatory security thresholds. This demonstrated margin provides a technically defensible basis for reducing the number of guards without compromising regulatory compliance. Physical security costs represent roughly 10% of annual operating budgets, making such reductions directly meaningful to INL's mission of sustaining existing commercial NPPs. This internship strengthened my understanding of nuclear systems, probabilistic modeling, and technical writing, and has solidified my pursuit of a career at a national laboratory.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗

Design of set-point weighting PI{sup λ} + D{sup μ} controller for vertical magnetic flux controller in Damavand tokamak

In this paper, a simple method is presented for tuning weighted PI{sup λ} + D{sup μ} controller parameters based on the pole placement controller of pseudo-second-order fractional systems. One of the advantages of this controller is capability of reducing the disturbance effects and improving response to input, simultaneously. In the following sections, the performance of this controller is evaluated experimentally to control the vertical magnetic flux in Damavand tokamak. For this work, at first a fractional order model is identified using output-error technique in time domain. For various practical experiments, having desired time responses for magnetic flux in Damavand tokamak, is vital. To approach this, at first the desired closed loop reference models are obtained based on generalized characteristic ratio assignment method in fractional order systems. After that, for the identified model, a set-point weighting PI{sup λ} + D{sup μ} controller is designed and simulated. Finally, this controller is implemented on digital signal processor control system of the plant to fast/slow control of magnetic flux. The practical results show appropriate performance of this controller.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Numerical Uncertainties vs. Model Uncertainties in Two-phase Flow Simulations

In recent years, verification, validation and uncertainty quantification (VVUQ) have become a common practice in thermal-hydraulics analysis. In general, these activities deal with propagations of uncertainties in computer code simulations, e.g., through system analysis codes. However, most existing such activities in thermal-hydraulics analysis have been primarily focused on model uncertainties, while numerical uncertainties were largely overlooked. Numerical uncertainties (or numerical errors) can appear in many different forms, e.g., round-off error, statistical sampling error, and discretization error. As pointed out by Oberkampf and Roy, discretization error is usually the largest however the most difficult type of error to estimate reliably. In thermal-hydraulics analysis, especially two-phase flow simulations commonly encountered in reactor safety analysis, the lack of consideration on discretization error is mainly due to the difficulty in estimating them. Accurate estimations on discretization error require continuous mesh refinement and/or implementation of high-order numerical schemes in system analysis code, both of which are unfortunately difficult to achieve for existing codes. At first, it should be emphasized that mesh refinement (or mesh sensitivity study) is a well-understood concept in the thermal-hydraulics field. However, it is not commonly practiced for many reasons, e.g., lack of understanding on numerical errors by code users, consideration on computational cost, deteriorated numerical stability performance with refined meshes, and etc. Secondly, high-order (e.g., second-order) numerical schemes are simply unavailable in almost any existing system analysis code. Implementation of high-order numerical schemes in these codes is difficult, if not impossible, given the complexity of these codes. On the other hand, people tend to argue that numerical uncertainties (or discretization error as we have emphasized) are not as important as the commonly large uncertainties in two-phase flow models, e.g., closure correlations. As a result, nodalization is sometimes played unintentionally, or maybe intentionally, to match experimental data, which is referred as 'user effects' or 'compensating errors' in thermal-hydraulics community. Such a practice is highly criticized by Levy. In this work, we will at first build a computer code that incorporates both first-order and second-order numerical methods to solve the two-phase flow problems. The first-order method resembles the one used in many existing system analysis codes; and the second-order method works as the reference to estimate numerical errors. Numerical verifications on spatial discretization schemes will be presented in the form of mesh convergence study. It will also be demonstrated that, in practical scenarios, discretization errors can be as large as, or even larger than, model uncertainties via case studies.

42 ENGINEERING↗

Nonlinear modelling of polymer electrolyte membrane fuel cell stack using nonlinear cancellation technique

Fuel cells are promising new energy conversion devices that are friendly to the environment. A set of control systems are required in order to operate a fuel cell based power plant system optimally. For the purpose of control system design, an accurate fuel cell stack model in describing the dynamics of the real system is needed. Currently, linear model are widely used for fuel cell stack control purposes, but it has limitations in narrow operation range. While nonlinear models lead to nonlinear control implemnetation whos more complex and hard computing. In this research, nonlinear cancellation technique will be used to transform a nonlinear model into a linear form while maintaining the nonlinear characteristics. The transformation is done by replacing the input of the original model by a certain virtual input that has nonlinear relationship with the original input. Then the equality of the two models is tested by running a series of simulation. Input variation of H2, O2 and H2O as well as disturbance input I (current load) are studied by simulation. The error of comparison between the proposed model and the original nonlinear model are less than 1 %. Thus we can conclude that nonlinear cancellation technique can be used to represent fuel cell nonlinear model in a simple linear form while maintaining the nonlinear characteristics and therefore retain the wide operation range.

30 DIRECT ENERGY CONVERSION↗

Verification of MCNP Critical Benchmark Model of U233-COMP-THERM-004

Los Alamos National Laboratory (LANL) has been working on creating a new centralized repository for MCNP models of critical benchmark experiments. The initial model of U233-COMP-THERM-004 was derived from the Whisper Suite provided with MCNP6.2, and was compared against the ICSBEP handbook chapter for the benchmark. Many notable errors were found in the initial model and were revised accordingly. Comparing the computational model of the old and new models confirmed that any Whisper results that relied upon the old model are still valid.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

RADII OF RAPIDLY ROTATING STARS, WITH APPLICATION TO TRANSITING-PLANET HOSTS

The currently favored method for estimating radii and other parameters of transiting-planet host stars is to match theoretical models to observations of the stellar mean density rho{sub *}, the effective temperature T{sub eff}, and the composition parameter [Z]. This explicitly model-dependent approach is based on readily available observations, and results in small formal errors. Its performance will be central to the reliability of results from ground-based transit surveys such as TrES, HAT, and SuperWASP, as well as to the space-borne missions MOST, CoRoT, and Kepler. Here, I use two calibration samples of stars (eclipsing binaries (EBs) and stars for which asteroseismic analyses are available) having well-determined masses and radii to estimate the accuracy and systematic errors inherent in the rho{sub *} method. When matching to the Yonsei-Yale stellar evolution models, I find the most important systematic error results from selection bias favoring rapidly rotating (hence probably magnetically active) stars among the EB sample. If unaccounted for, this bias leads to a mass-dependent underestimate of stellar radii by as much as 4% for stars of 0.4 M{sub sun}, decreasing to zero for masses above about 1.4 M{sub sun}. Relative errors in estimated stellar masses are three times larger than those in radii. The asteroseismic sample suggests (albeit with significant uncertainty) that systematic errors are small for slowly rotating, inactive stars. Systematic errors arising from failings of the Yonsei-Yale models of inactive stars probably exist, but are difficult to assess because of the small number of well-characterized comparison stars having low mass and slow rotation. Poor information about [Z] is an important source of random error, and may be a minor source of systematic error as well. With suitable corrections for rotation, it is likely that systematic errors in the rho{sub *} method can be comparable to or smaller than the random errors, yielding radii that are accurate to about 2% for most stars.

79 ASTRONOMY AND ASTROPHYSICS↗

Elastic functional principal component regression

We study regression using functional predictors in situations where these functions contains both phase and amplitude variability. In other words, the functions are misaligned due to errors in time measurements, and these errors can significantly degrade both model estimation and prediction performance. The current techniques either ignore the phase variability, or handle it via preprocessing, that is, use an off–the–shelf technique for functional alignment and phase removal. We develop a functional principal component regression model which has a comprehensive approach in handling phase and amplitude variability. The model utilizes a mathematical representation of the data known as the square–root slope function. These functions preserve the L 2 norm under warping and are ideally suited for simultaneous estimation of regression and warping parameters. Furthermore, using both simulated and real–world data sets, we demonstrate our approach and evaluate its prediction performance relative to current models. In addition, we propose an extension to functional logistic and multinomial logistic regression.

97 MATHEMATICS AND COMPUTING↗

Using Explainable Artificial Intelligence to Predict Perovskite Solar Cell Electrical Metastability from Operando Photoluminescence Images in Accelerated Stress Testing

Metal halide perovskite (MHP) solar cells exhibit a metastable response to bias governed by coupled ionic–electronic processes, complicating the conventional reciprocity relation between luminescence intensity and device open-circuit voltage (V oc ). This limits the use of luminescence as a diagnostic for device screening or accelerated stress testing, motivating new approaches that can interpret photoluminescence (PL) signals under nonequilibrium conditions. From the artificial intelligence perspective, we develop an explainable deep learning framework that integrates convolutional neural networks (CNN), long short-term memory (LSTM) layers, and an attention mechanism to learn spatiotemporal features from operando photoluminescence PL image sequences. The model achieves a mean absolute error of ±0.027 V in predicting open-circuit voltage transients and reduces extreme-tail errors by up to 78% compared to physics-based reciprocity calculations. Gradient-weighted Class Activation Mapping (Grad-CAM) provides interpretability by highlighting physically meaningful regions such as electrode edges and emergent defect features. From the engineering application perspective, this framework enables accurate, contactless prediction of device V oc and identification of degradation-relevant features during accelerated aging of perovskite solar cells. This approach demonstrates how explainable AI can enhance operando diagnostics and reliability analysis in photovoltaic devices under nonequilibrium conditions.

14 SOLAR ENERGY↗

Security of quantum position-verification limits Hamiltonian simulation via holography

We investigate the link between quantum position-verification (QPV) and holography established in [1] using holographic quantum error correcting codes as toy models. By inserting the “temporal” scaling of the AdS metric by hand via the bulk Hamiltonian interaction strength, we recover a toy model with consistent causality structure. This leads to an interesting implication between two topics in quantum information: if position-based verification is secure against attacks with small entanglement then there are new fundamental lower bounds for resources required for one Hamiltonian to simulate another.

AdS-CFT Correspondence↗