SEARCH · Search NASA
Results for “Validation Methods”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Multi-Commodity Traffic Signal Control and Routing With Connected Vehicles
We report a real-time traffic management policy that integrates traffic signal control and multi-commodity routing of connected vehicles in networks with multiple destinations is developed. The proposed policy is based on a multi-commodity formulation of the store-and-forward model and assumes all vehicles are able to exchange information with the infrastructure. Vehicles share information about their current location and final destination. Based on this information, the strategy determines both optimized signal timings at every intersection and vehicle-specific routing information at every link of the network. The control actions, i.e., signal times and routing information, are updated at every cycle and delivered by a finite horizon optimal control problem cast into a rolling horizon framework. The underlying optimization problem is convex, and thus the method is suitable for real-time operation in large networks. The method is validated via a micro-simulation study in networks with up to twenty intersections and, in all simulations, outperforms a real-time traffic-responsive signal control strategy that is based on a single-commodity store-and-forward model. The scalable computation effort for increasing network sizes and prediction horizon confirms the computational efficiency of the method.
Optical tweezer measurements of asymptotic nonlinearities in complex fluids
This article presents micro-medium-amplitude oscillatory shear (μMAOS), a method to measure the frequency-dependent micromechanical properties of soft materials in the asymptotically nonlinear regime using optical tweezers. For this work, we have developed a theoretical framework to extract these nonlinear mechanical properties of the material from experimental measurements and also proposed a physical interpretation of the third-order nonlinearities measured in single-tone oscillatory tests. We validate the method using a well-characterized surfactant solution of wormlike micelles, and subsequently employ this technique to demonstrate that the cytoplasm of a living cell undergoes strain softening and shear thinning when locally subjected to weakly nonlinear oscillatory deformations.
Estimation of process steady state with autoregressive models and Bayesian inference
To improve efficiency, separations engineers will typically design process circuits containing recirculating streams, which mix one or more of the process outputs with the feed material. Doing so can improve efficiency, but will cause a delay in the system reaching steady state conditions until the recirculating load mass flows stabilize. In testing separation circuits, engineers will often test a variety of factors and complete an analysis from sample results. Knowledge of if a process is at steady state, as well as the steady state conditions of a process, is essential for a valid techno-economic analysis. However, the definition of process steady state is often poorly defined, or does not include uncertainty quantification. If the performance of a process operating under two different sets of conditions are compared, an engineer who does not test for steady state or quantify steady state conditions risks producing a faulty analysis. In this work, a Bayesian statistical method for testing if all streams are at steady state is further motivated and then derived. Then after testing for steady state, the same model is used with a prior distribution that enforces a steady state assumption to estimate steady state conditions. Further, these methods were validated in a solvent extraction pilot plant where steady state conditions for all outflows were inferred with uncertainty quantification. Analysis is completed with functions available to the reader as part of the BayesMassBal (V 1.1.0) software package written in R.
Accessing tens-to-hundreds femtoseconds nuclear state lifetimes with low-energy binary heavy-ion reactions
A novel Monte Carlo technique has been developed to determine lifetimes of excited states in the tens-to-hundreds femtoseconds range in products of low-energy heavy-ion binary reactions, with complex velocity distributions. The method is based on a detailed study of Doppler-broadened γ-ray lineshapes. Its relevance is demonstrated in connection with the 18 O(7.0MeV/u)+ 181 Ta experiment, performed at GANIL with the AGATA+VAMOS+PARIS setup, to study neutron-rich O, C, N, ... nuclei. Excited states in 17 O and 19 O, with known lifetimes, are used to validate the method over the ~20-400fs lifetime-sensitivity range. Emphasis is given to the unprecedented position resolution provided by γ-tracking arrays, which turns out to be essential for reaching the required accuracy in Doppler-shift correction. The technique is anticipated to be an important tool for lifetime investigations in exotic neutron-rich nuclei, produced with intense ISOL-type beams.
Predicting metal-binding proteins and structures through integration of evolutionary-scale and physics-based modeling
Metals are essential elements in all living organisms, binding to approximately 50% of proteins. They serve to stabilize proteins, catalyze reactions, regulate activities, and fulfill various physiological and pathological functions. While there have been many advancements in determining the structures of protein-metal complexes, numerous metal-binding proteins still need to be identified through computational methods and validated through experiments. Here, to address this need, we have developed the ESMBind workflow, which combines evolutionary scale modeling (ESM) for metal-binding prediction and physics-based protein-metal modeling. Our approach utilizes the ESM-2 and ESM-IF models to predict metal-binding probability at the residue level. In addition, we have designed a metal-placement method and energy minimization technique to generate detailed 3D structures of protein-metal complexes. Our workflow outperforms other models in terms of residue and 3D-level predictions. To demonstrate its effectiveness, we applied the workflow to 142 uncharacterized fungal pathogen proteins and predicted metal-binding proteins involved in fungal infection and virulence.
A hybrid calibration approach to Hertz-type contact parameters for discrete element models
This study aims at providing a hybrid calibration framework to estimate Hertz-type contact parameters (particle-scale shear modulus and Poisson ratio) for both two-dimensional and three-dimensional discrete element modelling (DEM). On the basis of statistically isotropic granular packings, a set of analytical formulae between macroscopic material parameters (Young modulus and Poisson ratio) and particle-scale Hertz-type contact parameters for granular systems are derived under small-strain isotropic stress conditions. However, the derived analytical solutions are only estimated values for general models. By viewing each DEM modelling as an implicit mathematical function taking the particle-level parameters as independent variables and employing the derived analytical solutions as the initial input parameters, an automatic iterative scheme is proposed to obtain the calibrated parameters with higher accuracies. Considering highly nonlinear features and discontinuities of the macro-micro relationship in Hertz-based discrete element models, the adaptive moment estimation algorithm is adopted in this study because of its capacity of dealing with noise gradients of cost functions. Here, the proposed method is validated with several numerical cases including randomly distributed monodisperse and polydisperse packings. Noticeable improvements in terms of calibration efficiency and accuracy have been made.
Boosting Noise2Inverse via enhanced model selection for denoising computed tomography data
Synchrotron-based x-ray tomographic imaging enables the examination of the internal structure of materials at high spatial and temporal resolution. Experimental constraints can impose dose and time limits on the measurements, introducing a higher level of noise and artifacts in the reconstructed images. Deep learning has emerged as a powerful tool to remove noise from reconstructed images. Recently, the Noise2Inverse method was designed specifically for denoising reconstructed images without requiring paired noisy and clean images. This method creates multiple statistically independent reconstructions used to pair the data in which training involves transforming one reconstruction into the other, and vice versa. Originally designed to be used after a fixed number of epochs, we see in practice that this approach may not produce the optimal model and may unnecessarily waste computational resources. Therefore, we propose an alternative method of identifying the best model during training that aligns with the Noise2Inverse method. During validation, we compare the model output of the multiple reconstructions among each other. We hypothesize that the best model is the one that produces images with the highest similarity, implying a convergence in the predicted material properties and absorption values. To compare model outputs, we consider the absolute error, square error, structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), and cosine similarity. We evaluate our method on two simulated tomography datasets and two, real-world, low-contrast, high-energy x-ray tomography datasets. We show our approach is more effective at determining the best model, up to an increase of 12.50% and 12.53% in SSIM and PSNR, respectively, while only requiring a fifth of the training time compared to the original approach.
Tackling the curse of dimensionality in fractional and tempered fractional PDEs with physics-informed neural networks
Fractional and tempered fractional partial differential equations (PDEs) are effective models of long-range interactions, anomalous diffusion, and non-local effects. Traditional numerical methods for these problems are mesh-based, thus struggling with the curse of dimensionality (CoD). Physics-informed neural networks (PINNs) offer a promising solution due to their universal approximation, generalization ability, and mesh-free training. In principle, Monte Carlo fractional PINN (MC-fPINN) estimates fractional derivatives using Monte Carlo methods and thus could lift CoD. However, this may cause significant variance and errors, hence affecting convergence; in addition, MC-fPINN is sensitive to hyperparameters. In general, numerical methods and specifically PINNs for tempered fractional PDEs are under-developed. Herein, we extend MC-fPINN to tempered fractional PDEs to address these issues, resulting in the Monte Carlo tempered fractional PINN (MC-tfPINN). To reduce possible high variance and errors from Monte Carlo sampling, we replace the one-dimensional (1D) Monte Carlo with 1D Gaussian quadrature, applicable to both MC-fPINN and MC-tfPINN. We validate our methods on various forward and inverse problems of fractional and tempered fractional PDEs, scaling up to 100,000 dimensions. Our improved MC-fPINN/MC-tfPINN using quadrature consistently outperforms the original versions in accuracy and convergence speed in very high dimensions.
Lost and Found Opportunities Around the Chlorine Worth Study
Los Alamos National Laboratory performed a series of critical experiments in 2021 to examine the worth of chlorine in plutonium-fueled systems. This series of experiments has been dubbed the “Chlorine Worth Study,” and the evaluation of the experiments was presented to the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Technical Review Group in April, 2023. The primary purpose of these experiments was to enable validation of aqueous solutions crediting neutron absorption in 35 Cl. An external, independent view of the events leading up to the design and execution of these experiments indicates a missed opportunity to leverage sensitivity/uncertainty (S/U) analysis to assert validation without the experiments by taking an additional margin for the lack of direct validation of chlorine. On the other hand, the execution of these experiments also presents a rare opportunity to examine the efficacy of the S/U approach and extract useful information about the evaluated chlorine covariance data. TSUNAMI-1D models of representative application solutions were created and used to generate sensitivity data. Varying plutonium and chlorine concentrations were considered to examine the impact of these differences on the chlorine sensitivities and uncertainties. The data-induced uncertainty in k eff resulting from chlorine was calculated directly from uncertainty information calculated in the TSUNAMI-1D sequence. In all cases, this uncertainty was less than 0.1 %Δk. This result could potentially be used to justify a reactivity margin to account for the validation gap related to chlorine in the validation set. On the other hand, given that the experiments were performed, the community should endeavor to extract as much value from them and their results as possible. The results can be used to examine the actual bias associated with chlorine in these systems once the evaluations have been released. These data can be compared with the data-induced uncertainty margin discussed above to test the sufficiency of the validation gap penalty. This result will provide an indication of the performance of the chlorine covariance data specifically and the S/U validation approach generally. More advanced S/U techniques may also be employed to determine reactivity sensitivities associated with the chlorine in the experiments, potentially generating a more robust test of the chlorine covariance data.
Physics-Based Machine Learning Methods for U-235 Forensics Signatures
Signatures of low-intensity U-235 sources have been recently studied by utilizing a variety of machine learning (ML) classifiers using features derived from gamma spectral measurements collectedunder structured campaigns. Several ML classifiers, such as ensemble of tress and classification trees, revealed misleadingly-optimistic training error due to over-fitting, and furthermore,their performance is not directly relatable to the physical properties due to their data-driven, opaque designs. We present a regression-based ML method that first estimates the inverse distanceto the source and then utilizes a threshold to infer its presence, by representing the background as a source located at an infinite distance. For the inverse distance estimation, we study the ensembleof trees and Gaussian process regression methods, and a hyper parameter auto-tuning and selection method that employs five regression estimators. These methods avoid the over-fittingobserved in several ML classifiers, while providing the classification error nearly comparable to them based on independent test data. Their error is directly related to estimates of the inversephysical distance to source, and the precision of error determines the seperability property that determines the false alarm and missed detection rates. The property of monotonic decrease of thesource strength with increasing detector distance combined with Poisson distribution of measurements is utilized to analytically validate these methods by deriving the generalization equations ofunderlying regression methods.
Physics-Based Machine Learning Methods for U-235 Forensics Signatures
Signatures of low-intensity U-235 sources have been recently studied by utilizing a variety of machine learning (ML) classifiers using features derived from gamma spectral measurements collected under structured campaigns. Several ML classifiers, such as ensemble of tress and classification trees, revealed misleadingly-optimistic training error due to over-fitting, and furthermore, their performance is not directly relatable to the physical properties due to their data-driven, opaque designs. We present a regression-based ML method that first estimates the inverse distance to the source and then utilizes a threshold to infer its presence, by representing the background as a source located at an infinite distance. For the inverse distance estimation, we study the ensemble of trees and Gaussian process regression methods, and a hyper parameter auto-tuning and selection method that employs five regression estimators. These methods avoid the over-fitting observed in several ML classifiers, while providing the classification error nearly comparable to them based on independent test data. Their error is directly related to estimates of the inverse physical distance to source, and the precision of error determines the seperability property that determines the false alarm and missed detection rates. The property of monotonic decrease of the source strength with increasing detector distance combined with Poisson distribution of measurements is utilized to analytically validate these methods by deriving the generalization equations of underlying regression methods.
Characterizing post-fire delayed tree mortality with remote sensing: sizing up the elephant in the room
Abstract Background Despite recent advances in understanding the drivers of tree-level delayed mortality, we lack a method for mapping delayed mortality at landscape and regional scales. Consequently, the extent, magnitude, and effects of delayed mortality on post-fire landscape patterns of burn severity are unknown. We introduce a remote sensing approach for mapping delayed mortality based on post-fire decline in the normalized burn ratio (NBR). NBR decline is defined as the change in NBR between the first post-fire measurement and the minimum NBR value up to 5 years post-fire for each pixel. We validate the method with high-resolution aerial photography from six wildfires in California, Oregon, and Washington, USA, and then compare the extent, magnitude, and effects of delayed mortality on landscape patterns of burn severity among fires and forest types. Results NBR decline was significantly correlated with post-fire canopy mortality (r 2 = 0.50) and predicted the presence of delayed mortality with 83% accuracy based on a threshold of 105 NBR decline. Plots with NBR decline greater than 105 were 23 times more likely to experience delayed mortality than those below the threshold (p < 0.001). Delayed mortality occurred across 6–38% of fire perimeters not affected by stand-replacing fire, generally affecting more areas in cold (22–41%) and wet (30%) forest types than in dry (1.7–19%) types. The total area initially mapped as unburned/very low-severity declined an average of 38.1% and generally persisted in smaller, more fragmented patches when considering delayed mortality. The total area initially mapped as high-severity increased an average of 16.2% and shifted towards larger, more contiguous patches. Conclusions Differences between 1- and 5-year post-fire burn severity maps depict dynamic post-fire mosaics resulting from delayed mortality, with variability among fires reflecting a range of potential drivers. We demonstrate that tree-level delayed mortality scales up to alter higher-level landscape patterns of burn severity with important implications for forest resilience and a range of fire-driven ecological outcomes. Our method can complement existing tree-level studies on drivers of delayed mortality, refine mapping of fire refugia, inform estimates of habitat and carbon losses, and provide a more comprehensive assessment of landscape and regional scale fire effects and trends.
First-Principles Modeling of the Repassivation of Corrosion Resistant Alloys: Part II. Surface Adsorption Isotherms for Alloys and the Chloride Susceptibility Index
Quantitatively predicting the corrosion resistance of alloys is vital to the design and application of the next generation of superior corrosion resistant alloys (CRAs). Here, the Chloride Susceptibility Index (CSI), a scientifically based quantitative descriptor for repassivation tendency of CRAs, is proposed as a metric constructed through combining atomistically resolved information regarding adsorption and alloy surface composition with environmental conditions such as applied potential, temperature, pH, and Cl – concentration. Using this method, the response of CRAs to relevant environments can be predicted. CSI is determined by: (1) estimation of thermoequilibrium surface coverages of O and Cl by a Langmuir isotherm model using adsorption energies of different species (O, Cl, OH, H 2 O) obtained from DFT. (2) determination of CSI by integrating Cl surface coverage over a realistic window of applied potentials, thereby incorporating the effect of Cl surface coverage and electrochemical environment simultaneously. A series of Ni-Cr-X alloys was used as an example to develop and validate the method through studying the effect of different alloy solutes X on chloride resistance. Here, the trends and relations predicted by CSI are in qualitative agreements with experimental observations. Moreover, a quantitative correlation is found between CSI and the repassivation potential.
Overcoming time and complexity limitations in molecular dynamics investigations of equilibrium melting
Abstract A hybrid Monte-Carlo molecular-dynamics method for determining solidus and liquidus compositions in multicomponent systems is presented that overcomes both the time limitations in conventional molecular dynamics that prevent the evolution of distinct solid and liquid compositions via diffusion and the complexity challenge that prevents use of thermodynamic assessment in systems of many components. This hybrid method is validated in the Cu–Ni system against an independent assessment of solidus and liquidus compositions based on the regular solution model. Strategies for efficient mapping of different phase diagrams, based on the thermodynamic parameter T 0 , the temperature at which two phases of the composition X 0 have equal free energies, are presented and then demonstrated for the copper-nickel fully miscible system and the gold–silicon eutectic system. A calculation of the solidus and liquidus sampled during the equilibrium melting of equiatomic CrMnFeCoNi is performed, indicating that this method has potential to be extended to the study of many component alloys.
Development of a Practical Secondary Control for Hardware Microgrids
Practical, vendor-agnostic interoperability guidelines for the secondary control architecture of microgrids (MGs) with multiple grid-forming (GFM) inverter-based resources (IBRs) have not yet been developed. Therefore, this paper proposes a generic and vendor-agnostic secondary control architecture that operates with all GFM IBRs and synchronous generators. This secondary control does not require the use of additional measurement devices in the MG and utilizes the inherent communication systems of the GFM units, such as Modbus TCP/IP. The practical challenges of Modbus registers, such as packet loss and quantization error, and their detrimental impacts on secondary control actions are investigated. The proposed three-stage modification for any secondary control architecture to mitigate these impacts includes: 1) averaging the data read, 2) situational event-triggering of the controller, and 3) finite iteration of the controlling action. The proposed method is validated using a 3-..phi.., 480 V, 60 Hz, 500 kVA laboratory hardware microgrid with commercial two GFM IBRs and one diesel generator. The experimental results corroborates the fact the proposed modification in the secondary control architecture is advantageous for practical usage under erroneous measurements.
Chelation ion chromatography as an automated, and cost-effective analytical technique for REE determination: method development and applications
Rare earth elements (REEs), as critical minerals, have important uses in modern energy and technologies, yet are vulnerable to potential supply chain disruptions. To establish domestic REE supply chain, efficient REE detection methods for resource characterization and mineral processing will be needed to accelerate innovations for domestic REE recovery. This study developed a rapid, novel, and cost-effective for REE detection method using ion chromatography (IC) for aqueous samples. Various REE-targeted eluent gradients and post-column agent compositions were tested on the chelation ion chromatography (CIC) with UV-vis detector for optimal separation and quantification of REEs within approximately 20 min. The single-channel pump to deliver the post-column solution to UV-vis detector was replaced with a 4-channel gradient pump, to increase operation and maintenance efficiencies. After method optimization, resulting calibration curves for more than ten REEs achieved high coefficients of determination (R2>0.999) and low relatively standard deviations (below 3.24%), demonstrating sub-ppm level detection limits (0.0897 to 0.1149 mg/L). The reliability of the CIC method was validated through comparison with inductively coupled plasma mass spectrometry (ICP-MS), showing strong agreement in REE recovery from certified standards. The impact of metal ions and salts on REE recovery using CIC was also systematically investigated. CIC consistently exhibited reliable performance in the presence of salt solutions such as NaCl and Na₂SO₄ (up to 10,000 mg/L). Our study also found the presence of high concentrations of Al ions (at 10,000 mg/L) significantly influenced REE determination, and elevated concentrations of Ca ions affected the recovery of specific REEs, including La, Ce, and Pr. The CIC method was further tested on REE-containing eluents from solvent extraction tests out of fly ash leachates. REE detection from these real processing fluids were reported to achieve 90% to 100% recovery rate from our IC method, compared to ICP-MS results. This study underscores the potential of CIC as a reliable and efficient alternative for REE determination in complex matrices. It also highlights the importance of minimizing select interfering metal ions in solutions to ensure accurate results. The REE CIC method presents a promising, low-maintenance, salt-tolerant, and cost-effective alternative to traditional analytical methods for REE analysis.