Gray-box approach to fault diagnosis of dynamical systems
Model-based fault diagnosis has become an important approach for diagnosis of dynamical systems.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Model-based fault diagnosis has become an important approach for diagnosis of dynamical systems.
Low-rank compression has been shown as an effective tool to reduce parameter counts of convolutional and vision transformer architectures; however, low-rank training often reduces model robustness to adversarial perturbations. In this work, we explore the effects of low-rank training on black-box attacks, where attacked images are generated without knowledge of the low-rank parameters. We find that low-rank training is not sufficient as a black-box defense and can sometimes produce worse than expected as compared to baseline models. Influencing the spectrum of the low-rank models during training, which is known to increase model robustness against white-box attacks, improves black-box performance as well.
An order (n) algorithm is developed for use in the industry-standard DISCOS (Dynamics Interaction Simulation of Controls and Structures) program for flexible multibody system dynamics simulation. This version should be more computationally efficient than conventional DISCOS for problems where a large number of bodies are involved. Program-dependent changes to DISCOS are described for reducing the number of bodies required to model gear reduction and nonlinear stiffness as internal effects. The gear reduction modification can be extended to general applications, such as gear box, rack and pinion, lever joint, and screw rotation models. Upgrading DISCOS for future use include the addition of robotics capabilities such as event-driven topology changes, surface sliding, pick-and-place, and multiarm hand-off.
Abstract This study addressed the cognitive impacts of providing correct and incorrect machine learning (ML) outputs in support of an object detection task. The study consisted of five experiments that manipulated the accuracy and importance of mock ML outputs. In each of the experiments, participants were given the T and L task with T-shaped targets and L-shaped distractors. They were tasked with categorizing each image as target present or target absent. In Experiment 1, they performed this task without the aid of ML outputs. In Experiments 2–5, they were shown images with bounding boxes, representing the output of an ML model. The outputs could be correct (hits and correct rejections), or they could be erroneous (false alarms and misses). Experiment 2 manipulated the overall accuracy of these mock ML outputs. Experiment 3 manipulated the proportion of different types of errors. Experiments 4 and 5 manipulated the importance of specific types of stimuli or model errors, as well as the framing of the task in terms of human or model performance. These experiments showed that model misses were consistently harder for participants to detect than model false alarms. In general, as the model’s performance increased, human performance increased as well, but in many cases the participants were more likely to overlook model errors when the model had high accuracy overall. Warning participants to be on the lookout for specific types of model errors had very little impact on their performance. Overall, our results emphasize the importance of considering human cognition when determining what level of model performance and types of model errors are acceptable for a given task.
We synthesized 177 unoccupied aerial system flights and 77 airborne flights across the Arctic and created a multi-resolution benchmark data of low-to-tall shrub fractional cover leveraging Structure-from-Motion and Light Detection and Ranging. The resulting dataset covered a total of 1899 km2 across Alaska, Western Canada, Sweden, and Siberian Arctic, including key sites from the Oro Arctic to the High Arctic. The dataset is organized into 6 primary data collection directories (“Abisko,” “AWI,” “ERE,” “Fairbanks,” “NGEE,” “Toolik”), each containing site and flight subdirectories. Flight directories include shrub cover rasters (*.tifs) at 1 m, 5 m, and 30 m resolution, the canopy height model at 1 m resolution (*.tifs), and a bounding box *.kml file. For the AWI, Abisko, NGEE, and Fairbanks collections, we also include the GCC raster at 1 m resolution (*.tif). Files are organized by Collection > Site > Flight Name > Data Files. Flight rasters are in the local UTM zone and the .kml files are in the geographic coordinate system EPSG 4326. We also include a .csv file that details the source datasets for every flight. The Next-Generation Ecosystem Experiments in the Arctic (NGEE Arctic) project is a research effort to reduce uncertainty in the Department of Energy’s Energy Exascale Earth System Model (E3SM) by developing a predictive understanding of Arctic tundra ecosystems underlain by permafrost and to quantify feedbacks from the Arctic tundra to the Earth system. NGEE Arctic is supported by the Department of Energy's Office of Biological and Environmental Research. Over Phases 1–3, observations made by the NGEE Arctic team across a gradient of permafrost landscapes in Arctic Alaska improved the representation of tundra processes in the land surface component of E3SM (the E3SM Land Model, ELM). Model improvements emphasized unique aspects of permafrost environments and explored reductions in model complexity while retaining predictive power. The Arctic-informed ELM developed by NGEE Arctic has been used to make novel predictions on processes ranging from permafrost thaw to soil biogeochemical cycling to Earth system feedbacks associated with the unique characteristics of tundra plants. In Phase 4, the NGEE Arctic team is evaluating our new predictive understanding under novel conditions across the Arctic domain. In collaboration with partners at long-term pan-Arctic research sites we are examining whether an Arctic-informed ELM can faithfully simulate interactions among surface and subsurface processes at site, regional, and pan-Arctic scales. In turn, we are using variety of tools to dynamically extend and evaluate ELM inference, with an emphasis on data synthesis and pan-Arctic model evaluation, reintegration of code with an evolving E3SM, scaling across heterogeneous Arctic landscapes, and the appropriate representation of the impacts of increasingly frequent Arctic disturbances.
In recent years, deep generative models have been successfully applied to various molecular design tasks, particularly in the life and materials sciences. One critical challenge for pre-trained generative molecular design (GMD) models is to fine-tune them to be better suited for downstream design tasks that aim at optimizing specific molecular properties. However, redesigning and training an existing effective generative model from scratch for each new design task are impractical. Furthermore, the black-box nature of typical downstream tasks that involve property prediction makes it nontrivial to optimize the generative model in a task-specific manner. In this work, we propose an uncertainty-guided fine-tuning strategy that can effectively enhance a pre-trained variational autoencoder (VAE) for GMD through performance feedback in an active learning setting. The strategy begins by quantifying the model uncertainty of the generative model using an efficient active subspace-based UQ (uncertainty quantification) scheme. Next, the decoder diversity within the characterized model uncertainty class is explored to expand the viable space of molecular generation. The low-dimensionality of the active subspace makes this exploration tractable using a black-box optimization scheme, which in turn enables us to identify and leverage a diverse set of high-performing models to generate enhanced molecules. Empirical results across six target molecular properties using multiple VAE-based generative models demonstrate that our uncertainty-guided fine-tuning strategy consistently leads to improved models that outperform the original pre-trained models.
Long short-term memory (LSTM) networks have demonstrated successful applications in accurately and efficiently predicting reservoir releases from hydrometeorological drivers including reservoir storage, inflow, precipitation, and temperature. However, due to its black-box nature and lack of process-based implementation, we are unsure whether LSTM makes good predictions for the right reasons. In this work, we use an explainable machine learning (ML) method, called SHapley Additive exPlanations (SHAP), to evaluate the variable importance and variable-wise temporal importance in the LSTM model prediction. In application to 30 reservoirs over the Upper Colorado River Basin, United States, we show that LSTM can accurately predict the reservoir releases with NSE ≥ 0.69 for all the considered reservoirs despite of their diverse storage sizes, functionality, elevations, etc. Additionally, SHAP indicates that storage and inflow are more influential than precipitation and temperature. Moreover, the storage and inflow show a relatively long-term influence on the release up to 7 days and this influence decreases as the lag time increases for most reservoirs. These findings from SHAP are consistent with our physical understanding. However, in a few reservoirs, SHAP gives some temporal importances that are difficult to interpret from a hydrological point of view, probably because of its ignorance of the variable interactions. SHAP is a useful tool for black-box ML model explanations, but the hydrological processes inferred from its results should be interpreted cautiously. More investigations of SHAP and its applications in hydrological modeling is needed and will be pursued in our future study.
Coupled fluid-material response analyses of arc-jet wedge ablation tests conducted in a NASA Ames arc-jet facility are considered. These tests were conducted using blunt wedge models placed in a free jet downstream of the 6-inch diameter conical nozzle in the Ames 60-MW Interaction Heating Facility. The fluid analysis includes computational Navier-Stokes simulations of the nonequilibrium flowfield in the facility nozzle and test box as well as the flowfield over the models. The material response analysis includes simulation of two-dimensional surface ablation and internal heat conduction, thermal decomposition, and pyrolysis gas flow. For ablating test articles undergoing shape change, the material response and fluid analyses are coupled in order to calculate the time dependent surface heating and pressure distributions that result from shape change. The ablating material used in these arc-jet tests was Phenolic Impregnated Carbon Ablator. Effects of the test article shape change on fluid and material response simulations are demonstrated, and computational predictions of surface recession, shape change, and in-depth temperatures are compared with the experimental measurements.
It is increasingly popular to use Computational Fluid Dynamics (CFD) models to study floating structures subjected to ocean waves, especially when it comes to applications of floating offshore wind turbines and Wave Energy Converters (WECs). Mooring dynamics are currently lacking in most of these applications. This paper presents a coupled simulation study of moored floating body motion by coupling two open-source libraries: a finite volume CFD toolbox, OpenFOAM, and a lumped-mass mooring model, MoorDyn. The instantaneous floating body position and velocity are passed from the body motion solver in the CFD model to the mooring model to calculate the fairlead kinematics. The mooring reaction forces, which are calculated by MoorDyn after updating the mooring system states, are then returned to the body motion solver to update the floating body motion. Both mesh deformation and overset mesh methods are used as the mesh motion solver in the CFD model to account for the floating body motion. The coupled model was validated against experimental measurements for a floating box moored with four catenary lines under the action of regular waves, which came from a preliminary test campaign for WECs. Apart from the lumped-mass mooring model, the present work also coupled a quasi-static mooring model and a finite element model with the floating body motion solver in OpenFOAM. The mooring line tensions predicted by these models were compared. The coupled model equipped with three mooring line codes may be further used to carry out survivability studies of FOWTs and WECs subject to severe sea states.
The LINPACK benchmark reports the performance of a computer for solving a system of linear equations with dense random matrices. Although this task was not designed with a real application directly in mind, the LINPACK benchmark has been used to define the list of TOP500 supercomputers since the debut of the list in 1993. We propose that a similar benchmark, called the quantum LINPACK benchmark, could be used to measure the whole machine performance of quantum computers. The success of the quantum LINPACK benchmark should be viewed as the minimal requirement for a quantum computer to perform a useful task of solving linear algebra problems, such as linear systems of equations. We propose an input model called the Random Circuit Block-Encoded Matrix (RACBEM), which is a proper generalization of a dense random matrix in the quantum setting. The RACBEM model is efficient to be implemented on a quantum computer and can be designed to optimally adapt to any given quantum architecture, with relying on a black-box quantum compiler. Besides solving linear systems, the RACBEM model can be used to perform a variety of linear algebra tasks relevant to many physical applications, such as computing spectral measures, time series generated by a Hamiltonian simulation, and thermal averages of the energy. We implement these linear algebra operations on IBM Q quantum devices as well as quantum virtual machines, and demonstrate their performance in solving scientific computing problems.
Knowing little about how porosity and permeability are distributed at depth, we commonly develop models of groundwater by treating the subsurface as a homogeneous black box even though porosity and permeability vary with depth. One reason for this depth variation is that infiltrating meteoric water reacts with minerals to affect porosity in localized zones called reaction fronts. We are beginning to learn to map and model these fronts beneath headwater catchments and show how they are distributed. The subsurface landscapes defined by these fronts lie subparallel to the earth-air interface but with lower relief. They can be situated above, below, or at the water table. These subsurface landscapes of reaction are important because porosity developed from weathering can control subsurface water storage. In addition, porosity often changes at the weathering fronts, and when this affects permeability significantly, the front can act like a valve that re-orients water flowing through the subsurface. We explore controls on the positions of reaction fronts under headwater landscapes by accounting for the timescales of erosion, chemical equilibration, and solute transport. One strong control on the landscape of subsurface reaction is the land surface geometry, which is in turn a function of the erosion rate. In addition, the reaction fronts, like the water table, are strongly affected by the lithology and water infiltration rate. We hypothesize that relationships among the land surface, reaction fronts, and the water table are controlled by feedbacks that can push landscapes toward an “ideal hill”. In this steady state, reaction-front valves partition water volumes into shallow and deep flowpaths. Furthermore, these flows dissolve low- and high-solubility minerals, respectively, allowing their reaction fronts to advance at the erosion rate. This conceptualization could inform better models of subsurface porosity and permeability, replacing the black box.
Back sheet failure has resulted in power loss and large-scale recall of photovoltaic modules, resulting in billions of dollars in lost revenue. The light exposure on the backside of a photovoltaic module comes primarily from reflected light which alters the distribution of natural sunlight. Because of this, modelling the backside exposure and duplicating the exposure is much more difficult than modeling the frontside exposure. This project aims to study how various back sheets and junction box materials degrade under different conditions and to develop Python code to help model and predict degradation. The stress factors for back-sheet degradation must be quantified to extrapolate accelerated stress tests to the field. Test samples were placed in the A3, A4, and A5 conditions, as defined in IEC 62788-7-2, to assess the temperature and humidity dependence of ultraviolet (UV) induced degradation. We are utilizing a custom chamber with exposure from 0.5 UV-suns to 5 UV-suns to understand the dependence of degradation on light intensity. A group of samples put in the A3 condition had glass filters with 50% UV cut-offs of 320 nm, 335 nm, and 360 nm to assess the wavelength dependence of UV degradation. All this data is necessary to assess the impact of non-standard UV light exposure. The material evaluation tests include gloss measurements, attenuated total internal reflectance Fourier transform infrared spectroscopy (ATR-FTIR), UV-visible reflectance/transmittance utilizing a Cary Ci7000 spectrophotometer, and a nano-indenter for surface hardness and modulus measurements. Alongside the experimental work, there is a computational effort using raytracing and Python open-source tools in PVDeg , PVLib, and Bifacial_Radiance. This code will create specific exposure scenarios and enable the evaluation of chamber degradation relative to field degradation. Equation 1 is a strawman equation used to model degradation on the backside of a PV module. We will create simplified code, based on the results of ray-tracing calculations, which uses a view factor approach to provide fast calculations for the most common exposure scenarios.
Aims Understanding the influence of different forms of phosphorus (P) over the different root traits and how those traits are related to increasing the efficiency of nutrient acquisition strategies. Methods Investigation of switchgrass (Panicum virgatum L.) root morphology responses to inorganic P (Pi) soluble (Potassium-P), insoluble (Aluminum-P), and organic P (Po) (Inositol Hexa-Phosphate, IHex-P) in rhizoboxes. Roots were traced over the root box and scanned using WinRhizoTM. The CRootbox model was employed to simulate root growth. Results Significant plasticity observed under IHex-P treatment, with a 46% increase in root branching, leading to a 74% rise in total root length and a 65% increase in root surface area compared to inorganic P forms. IHex-P resulted in a 73% higher root biomass than Aluminum-P and a 26% increase compared to Potassium-P. Most of the differences were attributed to the elongation of root branches. Conclusions Here, the study emphasizes the dynamic nature of switchgrass root architecture and morphology in response to varying P forms in the soil. The absence of Pi in the soil triggered increased plasticity in root traits, facilitating root access to Po and uptake of P. These findings offer valuable insights into the adaptive mechanisms of perennial plants, with significant implications for optimizing nutrient acquisition strategies in both agricultural and natural ecosystems.
Remote quantification of Pu(VI) (0–5 mol%) co-crystallized with U in uranyl nitrate hexahydrate (UNH) crystals was achieved in a glove box using reflectance spectroscopy coupled with chemometric modeling. Reflectance spectra were also acquired for Pu(IV) and Np(VI) (0–5 mol%) crystallized with UNH; revealing spectral features consistent with their solution-phase analogs. Principal component analysis revealed Pu(IV/VI) and Np(VI) concentrations as the primary source of variation in the data, informing the development of a supervised partial least squares regression model for Pu(VI). The resulting calibration demonstrated robust performance, with replicate root mean square errors near 10% and quantifiable limits near 0.2 mol% Pu(VI) relative to U. The Pu(VI) remained stable in the crystalline UNH matrix for at least one week with minimal reduction to Pu(IV). Notably, Pu(VI) and Np(VI) incorporation in UNH quenched U(VI) fluorescence while Pu(IV) did not. This study presents a noninvasive, spectroscopic approach for solid-state Pu quantification, with direct implications for material accountability and nuclear nonproliferation monitoring.
The Resolve instrument onboard the X-Ray Imaging and Spectroscopy Mission (XRISM) consists of an array of 6 × 6 silicon-thermistor microcalorimeters cooled down to 50 mK and a high-throughput X-ray mirror assembly (XMA) with a focal length of 5.6 m. XRISM is a recovery mission of ASTRO-H/Hitomi, and the Resolve instrument is a rebuild of the ASTRO-H Soft X-ray spectrometer (SXS) and the Soft X-ray Telescope (SXT) that achieved energy resolution of ∼ 5 eV FWHM on orbit, with several important changes based on lessons learned from ASTRO-H. The flight models of the Dewar and the electronics boxes were fabricated, and the instrument test and calibration were conducted in 2021. By tuning the cryocooler frequencies, energy resolution better than 4.9 eV FWHM at 6 keV was demonstrated for all 36 pixels and high-resolution grade events, as well as energy-scale accuracy better than 2 eV up to 30 keV. The immunity of the detectors to microvibration, electrical conduction, and radiation was evaluated. The instrument was delivered to the spacecraft system in April 2022. The XMA was tested and calibrated separately. Its angular resolution is 1.27′, and the effective area of the mirror itself is 570 cm 2 at 1 keV and 424 cm 2 at 6 keV. We report the design and the major changes from the ASTRO-H SXS, the integration, and the results of the instrument test.
Multi-Token Reliability Estimation (MTRE) is a lightweight, white-box hallucination detector for vision-language models. Instead of using only the first output token, MTRE aggregates logits from the first ~10 tokens and feeds them to a small attention-based reliability head; per-token scores are combined via a sequential log-likelihood-ratio test with early-stopping, and an MTRE-t variant calibrates thresholds via cross-fitting. MTRE reports average gains of +9.4% Accuracy and +14.8% AUROC over common baselines across MAD-Bench, MM-SafetyBench, MathVista, and arithmetic/counting tasks, while adding ~4.3M params and ~1% inference overhead (~26 MB VRAM, ~0.94 ms per detection). Key limitation: requires access to early token logits and is evaluated on a handful of open-source 7B VLMs.
Measurements of the composition of the cosmic rays at high energies, and of the energy spectra of the individual components provide the basis for the understanding of the sources, of the acceleration mechanism, and of the galactic containment of these particles. A brief review of the presently available information and a recent measurement performed on the Space Shuttle to substantially extend the range of energies in which the elemental composition is known are described. Results, and recent data on the electron component of cosmic rays are discussed and summarized. The body of data now available contains several features that are difficult to explain within current models of galactic shock acceleration and 'leakly box' containment. The need for further measurements is emphasized and possible opportunities for future work are briefly discussed.
The objective is to present results from investigating the integrated use of five computer programs: ANALYZE, ASTROS, NASTRAN, OPTSTAT, and VAASEL for analysis and optimization of a given structure. The structure designated for study purposes was the F-15E vertical tail. The concept of integrated use is limited to the capability of using a NASTRAN structural model to run each of the other specified programs. This was actually accomplished in practice by converting a NASTRAN model of the designated structure into an appropriate analysis model. For optimization purposes, the torque-box of the F-15E vertical tail was used.