High accuracy coronagraph flight WFC model for WFIRST-CGI raw contrast sensitivity analysis
UNKNOWN
Poberezhskiy, Ilya↗
SEARCH · Search NASA
Results for “model accuracy”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Evaluating the impact of urban morphology configurations on the accuracy of urban canopy model temperature simulations with MODIS
Explore the source record for details and available documents.
Andrew J. Monaghan↗
Physics-informed hybrid modeling methodology for building infiltration
Infiltration is responsible for one-third to one-half of the space conditioning load of a typical residential home, but the modeling of infiltration for building energy modeling is either represented by over-simplified equations or dependent on over-generalized rules of thumb. Here, this paper develops a physics-informed data-driven methodology for modeling infiltration using building-specific empirical measurements. The developed hybrid methodology combines machine-learning categorization and grey-box sub-modeling to improve the accuracy and generalization of commonly used grey-box infiltration models. The developed methodology excels at predicting infiltration by improving the ability to predict infiltration under unseen environmental conditions using machine learning algorithms with physical significance. In a case study conducted using the iUnit, a modular studio apartment experimental test facility located at the National Renewable Energy Laboratory, we use empirical airtightness measurements to fit an infiltration model using the developed methodology. We find that the developed methodology can improve the overall model accuracy by 43% and improve extrapolation by 38%, compared with the model based on the common grey-box infiltration equation. We also notice that the selected features can improve the performance of a pure machine-learning model, indicating that our methodology identifies the features with the most physical significance to infiltration modeling.
97 MATHEMATICS AND COMPUTING↗
An open-source framework for balancing computational speed and fidelity in production cost models
Studies of bulk power system operations need to incorporate uncertainty and sensitivity analyses, especially around exposure to weather and climate variability and extremes, but this remains a computational modeling challenge. Commercial production cost models (PCMs) have shorter runtimes, but also important limitations (opacity, license restrictions) that do not fully support stochastic simulation. Open-source PCMs represent a potential solution. They allow for multiple, simultaneous runs in high-performance computing environments and offer flexibility in model parameterization. Yet, developers must balance computational speed (i.e. runtime) with model fidelity (i.e. accuracy). In this paper, we present Grid Operations (GO), a framework for instantiating open-source, scale-adaptive PCMs. GO allows users to search across parameter spaces to identify model versions that appropriately balance computational speed and fidelity based on experimental needs and resource limits. Results provide generalizable insights on how to navigate the fidelity and computational speed tradeoff through parameter selection. We show that models with coarser network topologies can accurately mimic market operations, sometimes better than higher-resolution models. It is thus possible to conduct large simulation experiments that characterize operational risks related to climate and weather extremes while maintaining sufficient model accuracy.
42 ENGINEERING↗
Comparison of plug flow and multi-node stratified tank modeling approaches regarding computational efficiency and accuracy
Residential water heaters contain water stratified by temperature-driven density differences. This implies that a water tank can reach a state in which the top and bottom sections have different temperatures, unless mixing happens. A high degree of thermal stratification can improve the efficiency of some water heaters, by saving the amount of energy required for the heat-up process. Studies of stratification became popular in the 1970s and it remains an active research topic today. The research has led to the development of different models and techniques to better predict and define a stratified tanks behavior. By comparing these models and techniques used previously to describe thermal stratification, the phenomenon could be better understood, exploited, and used to increase efficiency and thermal energy capacity in modern water tanks. From the existing models, we found the one-dimensional standard plug-flow and a multi node model to be appropriate for analyzing the processes of the heat up and cool-down in a water tank. These two models are based on energy balances. This work involved comparing the accuracy and computational effort needed to implement these models. To assess accuracy, we compared both types of existing models to experimental data (also collected in this work) which included a heat up process using an external heat pump. This external process included a layering process that has an eddy diffusivity at five times the rate of thermal diffusion. For this project, we implemented the models in MATLAB, the multi-paradigm numerical computing environment. We quantified model accuracy using the root mean squared error between modeled data and experimental data for six measured tank temperatures. Comparing the accuracy and the computational time taken to run the simulation provides a method to contrast the performance of each model and a way to rate it. The multi node model was run using from 6 to 96 spatial nodes; the plug flow model was run using 1 to 0.001 º C temperature bin sizes. Additionally, timesteps were varied from 4 to 236 s. The results quantify the tradeoff between accuracy and computational time, providing guidance for simulations to intelligently select the best model type and simulation parameters. This research can be used to validate the pre-existing models and possibly improve the modern water tank.
Bulnes, Fernando Karg↗
Improving the accuracy of freight mode choice models: A case study using the 2017 CFS PUF data set and ensemble learning techniques
Here, the US Census Bureau has collected two rounds of experimental data from the Commodity Flow Survey, providing shipment-level characteristics of nationwide commodity movements, published in 2012 (i.e., Public Use Microdata) and in 2017 (i.e., Public Use File). With this information, data-driven methods have become increasingly valuable for understanding detailed patterns in freight logistics. In this study, we used the 2017 Commodity Flow Survey Public Use File data set to explore building a high-performance freight mode choice model, considering three main improvements: (1) constructing local models for each separate commodity/industry category; (2) extracting useful geographical features, particularly the derived distance of each freight mode between origin/destination zones; and (3) applying additional ensemble learning methods such as stacking or voting to combine results from local and unified models for improved performance. The proposed method achieved over 92% accuracy without incorporating external information, an over 19% increase compared to directly fitting Random Forests models over 10,000 samples. Furthermore, SHAP (Shapely Additive Explanations) values were computed to explain the outputs and major patterns obtained from the proposed model. The model framework could enhance the performance and interpretability of existing freight mode choice models.
42 ENGINEERING↗
A hierarchical gray-box dynamic modeling methodology for direct-expansion cooling systems to support control stability analysis; Méthodologie de modélisation dynamique hiérarchique de type boîte grise pour les systèmes de refroidissement à détente directe afin de soutenir l'analyse de stabilité de la commande
In this paper, a gray-box dynamic modeling approach for direct-expansion cooling systems is presented. The overall approach incorporates a multi-stage training procedure that consists of 1) identification of component sub-models from quasi-steady-state performance data, 2) system model integration with estimation of refrigerant charge and 3) fine tuning of thermal capacitances of the evaporator and condenser to capture the system dynamic responses. Compared to traditional physics-based models, the proposed modeling approach has advantages including reduced engineering efforts in the model development phase, improved computational efficiency and enhanced prediction accuracy. The modeling method was validated using a 3-ton variable-speed heat pump and proved to be capable of accurately predicting the system transient behaviors over a wide range of operating conditions. The established dynamic model was then applied for control stability analysis, with a specific goal of determining a proper control execution time step. The case study results showed that the stable control execution time step could change significantly, from 3 sec to 19 sec, as the operating conditions and control settings vary, and a proper selection of the execution time step is critical to ensure stable and reliable operations.
42 ENGINEERING↗
Shielded-Twisted-Pair Cable Model for Chafe Fault Detection via Time-Domain Reflectometry
This report details the development, verification, and validation of an innovative physics-based model of electrical signal propagation through shielded-twisted-pair cable, which is commonly found on aircraft and offers an ideal proving ground for detection of small holes in a shield well before catastrophic damage occurs. The accuracy of this model is verified through numerical electromagnetic simulations using a commercially available software tool. The model is shown to be representative of more realistic (analytically intractable) cable configurations as well. A probabilistic framework is developed for validating the model accuracy with reflectometry data obtained from real aircraft-grade cables chafed in the laboratory.
Schuet, Stefan R.↗
Assessing Inverter-Based Resources Modeling Gaps in Commonly Used Short-Circuit Programs
Future bulk power systems are expected to operate with a high penetration of inverter-based resources (IBR). This is anticipated to fundamentally change the system’s short-circuit behaviors and demand a change in existing transmission line protection settings or schemes. Phasor-domain short circuit programs (e.g., ASPEN, CAPE, and CYME) remain the mainstream tools for developing protection settings. However, the system protection community has shared concerns about the accuracy of IBR models in short-circuit programs. This report compares the performance of existing generic IBR models in short-circuit programs with detailed electro-magnetic transient (EMT) models provided by several different IBR manufacturers in PSCAD, to quantify the short-circuit program’s IBR model accuracy, assess their ability to replicate individual IBR controls such as negative sequence current injections, and identify specific gaps in the existing generic phasor-domain IBR models that are currently available.
42 ENGINEERING↗
Challenges in Rotor Aerodynamic Modeling for Non-Uniform Inflow Conditions
Within an international collaboration framework, the accuracy of rotor aerodynamic models used for design load calculations of wind turbines is being assessed. Where the use of high-fidelity computation fluid dynamics (CFD) and mid-fidelity free-vortex wake (FVW) models has become commonplace within the wind energy community, these still fail to meet the requirements in terms of execution time and computational cost needed for design load calculations. The fast but engineering fidelity blade-element/momentum (BEM) method can therefore still be considered the industry workhorse for design load simulations. At the same time, upscaling of wind turbine rotors makes inflow non-uniformities (e.g. shear, veer, turbulence) more important. The objective of this work is to assess model accuracy in non-uniform inflow conditions, which violate several BEM assumptions. Thereto a comparison in turbulent inflow has been executed including a wide variety of codes, focusing on the DanAero field measurements, where a 2.3-MW turbine was equipped with, among other sensors, a pressure measurement apparatus. The results indicate that, although average load patterns are in good agreement, this does not hold for the unsteady loads that drive fatigue damage and aero-elastic stability. A simplified comparison round in vertical shear was initiated to investigate the observed differences in a more controlled manner. A consistent offset in load amplitude was observed between CFD and free-vortex codes on the one hand and BEM-type codes on the other hand. To shed more light on the observations, dedicated efforts are ongoing to pinpoint the cause for these differences, in the end leading to guidelines for an improved BEM implementation.
17 WIND ENERGY↗
Correlation of ground tests and analyses of a dynamically scaled Space Station model configuration
Verification of analytical models through correlation with ground test results of a complex space truss structure is demonstrated. A multi-component, dynamically scaled space station model configuration is the focus structure for this work. Previously established test/analysis correlation procedures are used to develop improved component analytical models. Integrated system analytical models, consisting of updated component analytical models, are compared with modal test results to establish the accuracy of system-level dynamic predictions. Design sensitivity model updating methods are shown to be effective for providing improved component analytical models. Also, the effects of component model accuracy and interface modeling fidelity on the accuracy of integrated model predictions is examined.
Javeed, Mehzad↗
Correlation of ground tests and analyses of a dynamically scaled space station model configuration
Verification of analytical models through correlation with ground test results of a complex space truss structure is demonstrated. A multi-component, dynamically scaled space station model configuration is the focus structure for this work. Previously established test/analysis correlation procedures are used to develop improved component analytical models. Integrated system analytical models, consisting of updated component analytical models, are compared with modal test results to establish the accuracy of system-level dynamic predictions. Design sensitivity model updating methods are shown to be effective for providing improved component analytical models. Also, the effects of component model accuracy and interface modeling fidelity on the accuracy of integrated model predictions is examined.
Javeed, Mehzad↗
Atmospheric ice nucleating particle measurements and parameterization representative for Indian region
Not Available
Anil Kumar, V.↗
NNREPAIR: Constraint-based Repair of Neural Network Classifiers
We present NNREPAIR, a constraint-based technique for repairing neural network classifiers by i) fixing the logic of the network at an intermediate layer, and ii) fixing the decision conditions of the network at the last layer. NNREPAIR first uses fault localization to find potentially faulty network parameters (specifically weights) and then performs repair using constraint solving to apply small modifications to remedy the defects. We present novel strategies to enable precise yet efficient repair such as inferring correctness specifications to act as oracles for intermediate layer repair, and generation of experts wrt each class. We demonstrate the technique in the context of three different scenarios: (1) Improving the over all accuracy of a model, (2) Fixing security vulnerabilities caused by poisoning of training data and (3) Improving the robustness of the network against adversarial attacks. Our evaluation on MNIST and CIFAR-10 models shows that NNREPAIR can improve the accuracy by 45.56% on poisoned data and 11.11% on adversarial data. NNREPAIR also provides improvement, albeit modest, in the overall accuracy of models, without requiring new data or re-training.
Repair↗
Machine-Learning-based Algorithms for Automated Image Segmentation Techniques of Transmission X-ray Microscopy (TXM)
Four state-of-the-art Deep Learning-based Convolutional Neural Networks (DCNN) were applied to automate the semantic segmentation of a 3D Transmission x-ray Microscopy (TXM) nanotomography image data. The standard U-Net architecture as baseline along with UNet++, PSPNet, and DeepLab v3+ networks were trained to segment the microstructural features of an AA7075 micropillar. A workflow was established to evaluate and compare the DCNN prediction dataset with the manually segmented features using the Intersection of Union (IoU) scores, time of training, confusion matrix, and visual assessment. Comparing all model segmentation accuracy metrics, it was found that using pre-trained models as a backbone along with appropriate training encoder-decoder architecture of the Unet++ can robustly handle large volumes of x-ray radiographic images in a reasonable amount of time. This opens a new window for handling accurate and efficient image segmentation of in situ time-dependent 4D x-ray microscopy experimental datasets.
36 MATERIALS SCIENCE↗
Discovery of widespread transcription initiation at microsatellites predictable by sequence-based deep neural network
Using the Cap Analysis of Gene Expression (CAGE) technology, the FANTOM5 consortium provided one of the most comprehensive maps of transcription start sites (TSSs) in several species. Strikingly, ~72% of them could not be assigned to a specific gene and initiate at unconventional regions, outside promoters or enhancers. Here, we probe these unassigned TSSs and show that, in all species studied, a significant fraction of CAGE peaks initiate at microsatellites, also called short tandem repeats (STRs). To confirm this transcription, we develop Cap Trap RNA-seq, a technology which combines cap trapping and long read MinION sequencing. We train sequence-based deep learning models able to predict CAGE signal at STRs with high accuracy. These models unveil the importance of STR surrounding sequences not only to distinguish STR classes, but also to predict the level of transcription initiation. Importantly, genetic variants linked to human diseases are preferentially found at STRs with high transcription initiation level, supporting the biological and clinical relevance of transcription initiation at STRs. Together, our results extend the repertoire of non-coding transcription associated with DNA tandem repeats and complexify STR polymorphism.
59 BASIC BIOLOGICAL SCIENCES↗
Solvent-mediated contaminant removal from plastic waste using thermodynamic modeling
Plastics recycling is hindered by the compositional complexity of plastic waste, which can include numerous polymer components as well as low concentrations of additives and non-intentionally added substances. These latter small-molecule species, which we collectively refer to as contaminants, can harm human health and will build up in recycled plastic causing environmental and downstream processing challenges if not removed. In this work, we present molecular modeling approaches using the COnductor-like Screening MOdel for Real Solvents (COSMO-RS) to guide the selection of solvents that are capable of removing targeted contaminants from plastic waste. By considering the thermodynamic partitioning of contaminant species between a solvent phase and polymer phase, we identify guidelines for solvent selection to promote either the low-temperature extraction of contaminants from plastic waste or the removal of contaminants as part of a dissolution-based plastics recycling process. We present four case studies to illustrate the application of the computational approach to the removal of brominated flame retardants, phthalates, and selected perfluoroalkyl substances, and compare to both literature and newly collected experimental data to illustrate model prediction accuracy. Furthermore, the case studies highlight the capability of the modeling approach to help design recycling processes that explicitly account for contaminant removal, thereby increasing product purity during dissolution-based recycling or facilitating chemical recycling of contaminant-free plastics.
Zhou, Panzheng [University of, Wisconsin, Madison,↗
Validation Metrics for Fixed Effects and Mixed-Effects Calibration
The modern scientific process often involves the development of a predictive computational model. To improve its accuracy, a computational model can be calibrated to a set of experimental data. A variety of validation metrics can be used to quantify this process. Some of these metrics have direct physical interpretations and a history of use, while others, especially those for probabilistic data, are more difficult to interpret. In this work, a variety of validation metrics are used to quantify the accuracy of different calibration methods. Frequentist and Bayesian perspectives are used with both fixed effects and mixed-effects statistical models. Through a quantitative comparison of the resulting distributions, the most accurate calibration method can be selected. Two examples are included which compare the results of various validation metrics for different calibration methods. It is quantitatively shown that, in the presence of significant laboratory biases, a fixed effects calibration is significantly less accurate than a mixed-effects calibration. This is because the mixed-effects statistical model better characterizes the underlying parameter distributions than the fixed effects model. The results suggest that validation metrics can be used to select the most accurate calibration model for a particular empirical model with corresponding experimental data.
97 MATHEMATICS AND COMPUTING↗