Search NASA⌕ Search

SEARCH · Search NASA

Results for “confidence measures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Terra-Populus v0.1: A Python Library for LandScan High-Definition Population Analysis and Modeling

The terra-populus library is designed for use by the LandScan HD technical team, offering a streamlined set of tools for generating and updating LandScan HD datasets from foundational building-level data, referred to as 'molecules,' provided by the building-level attribution team. This document serves as the primary technical documentation for terra-populus. Version 0.1 of the library includes the core modeling components necessary for LandScan HD production. It enables the generation of the LandScan HD Baseline dataset as well as corresponding confidence measures for the occupancy rates used. Parameters have been included for incorporating damaged building indicators and changes in population, to faciliate the creation of rapid updates for LandScan HD. Future iterations of terra-populus will introduce tools for creating a confidence index, and quantifying and propagating uncertainty, facilitating the creation of probabilistic LandScan HD outputs. This report provides an overview of the tools available in the library and the corresponding code implementations. One of the key advancements implemented in terra-populus is a redefinition of the atomic modeling unit for LandScan HD. Traditionally, the LandScan HD vector analytical framework has generated population estimates at the building sub-component (molecule) level. However, terra-populus adopts a building-level modeling approach. This shift is an operational decision aimed at aligning LandScan HD outputs with confidence measures, which are computed and validated at the building level (confidence measures are not included in this version of terra-populus, aside from those associated with the occupancy rates). Additional advancements to the LandScan HD modeling, as implemented by terra-populus, include a minimum population value parameter and an auto assignment of building floor counts. The population minimum value was implemented to prevent buildings and subsequent LandScan HD pixels that contained small values that may not rasterize in production. An 'auto' value has been included as a method for dealing with buildings lacking floor count information, where it is the average floor count of all other buildings with a residential building use type tag. The logic behind this is to remain consistent with the current logic employed for dealing with building use type null instances, where a null use type is defaulted to residential since it is the most common building type. The auto logic is intended to apply the most common building floor count of the most common type of buildings. The tools provided in terra-populus represent a significant step forward in improving the efficiency, reproducibility, and transparency of the LandScan HD modeling process. As the library evolves, it will continue to serve as a foundational resource for high-resolution population modeling.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Towards Measurement of Confidence in Safety Cases

Arguments in safety cases are predominantly qualitative. This is partly attributed to the lack of sufficient design and operational data necessary to measure the achievement of high-dependability targets, particularly for safety-critical functions implemented in software. The subjective nature of many forms of evidence, such as expert judgment and process maturity, also contributes to the overwhelming dependence on qualitative arguments. However, where data for quantitative measurements is systematically collected, quantitative arguments provide far more benefits over qualitative arguments, in assessing confidence in the safety case. In this paper, we propose a basis for developing and evaluating integrated qualitative and quantitative safety arguments based on the Goal Structuring Notation (GSN) and Bayesian Networks (BN). The approach we propose identifies structures within GSN-based arguments where uncertainties can be quantified. BN are then used to provide a means to reason about confidence in a probabilistic way. We illustrate our approach using a fragment of a safety case for an unmanned aerial system and conclude with some preliminary observations

Denney, Ewen↗

A decay database of coincident γ–γ and γ–X -ray branching ratios for in-field spectroscopy applications

Current fieldable spectroscopy techniques often use single detector systems heavily impacted by interferences from intense background radiation fields. These effects result in low-confidence measurements that can lead to misinterpretation of the collected spectrum. To help improve interpretation of the fission products and short-lived radionuclides produced in a composite sample, a coincidence-database is being developed in support of a robust portable and X-ray coincidence detector system concurrently under development at the Pacific Northwest National Laboratory for in-field deployment. Hitherto, no database exists containing coincident γ–γ and γ–X-ray branching-ratio intensities on an absolute scale that will greatly enhance isotopic identification for in-field applications. As part of this project, software has been developed to parse all radioactive-decay data sets from the Evaluated Nuclear Structure Data File (ENSDF) archive to enable translation into a more useful JavaScript Object Notation (JSON) formats that more readily supports query-based data manipulation. The coincident database described in this work is the first of its kind and contains coincidence γ–γ and γ–X-ray intensities and their corresponding uncertainties, together with auxiliary metadata associated with each decay data set. The new JSON format provides a convenient and portable means of data storage that can be imported into analysis frameworks with relatively low overhead allowing for meaningful comparison with measured data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Real-Time Stability and Control Derivative Extraction From F-15 Flight Data

A real-time, frequency-domain, equation-error parameter identification (PID) technique was used to estimate stability and control derivatives from flight data. This technique is being studied to support adaptive control system concepts currently being developed by NASA (National Aeronautics and Space Administration), academia, and industry. This report describes the basic real-time algorithm used for this study and implementation issues for onboard usage as part of an indirect-adaptive control system. A confidence measures system for automated evaluation of PID results is discussed. Results calculated using flight data from a modified F-15 aircraft are presented. Test maneuvers included pilot input doublets and automated inputs at several flight conditions. Estimated derivatives are compared to aerodynamic model predictions. Data indicate that the real-time PID used for this study performs well enough to be used for onboard parameter estimation. For suitable test inputs, the parameter estimates converged rapidly to sufficient levels of accuracy. The devised confidence measures used were moderately successful.

Smith, Mark S.↗

CCN data from TAMU TRACER campaign in the Houston TX region from July to September 2022

During TRACER, the Texas A&M Rapid Onsite Atmospheric Measurements Van (ROAM-V) was deployed to capture airmasses behind (maritime) and ahead (continental) of the passage of the sea-breeze front through Houston. On select sampling days, ROAM-V sampled in the morning/mid-day on the coast and then transited to a second inland site for the afternoon/evening. The suite of instruments deployed on ROAM-V included a Condensation Particle Counter (CPC; GRIMM Model 5.403 CPC), Scanning Mobility Particle Sizer (SMPS; TSI 3750 detector, TSI 3082 classifier, TSI 3088 neutralizer, TSI 3081A Differential Mobility Analyzer), Cloud Condensation Nuclei counter (Droplet Measurement Technologies CCN Counter), micro pulse lidar (Droplet Measurement Technologies Micro Pulse LiDAR (miniMPL)), and a Davis Rotating Uniform size-cut Monitor (DRUM; DRUMAir 4-DRUM). Before sampling at each location, the latitude and longitude were recorded using the GPS on the phone application “My Altitude”. Onboard the ROAM-V, aerosol samples are drawn through a shared isokinetic inlet at a flow rate ranging from 3.5 to 7.0 LPM. A portion of this flow is directed through a cyclone impactor (Brechtel, Inc. Model SCC 0.732) and 0.5 LPM is directed to the CCN. To calculate particle losses, we used a two-step method. First, the measured SMPS size distributions were used to calculate particle loss through the inlet during sampling. Second, the corrected SMPS data was used to calculate the average of the total losses per scan down the CCN line. Then, the correction was applied to the CCN data. This calculation was done separately for each deployment location due to changes in the measured size distributions between locations. Particle loss from diffusion (based on Kesten, 1991 and Gormley, 1949), inertial impaction in 90-degree bends (based on Aerosol Measurement, 2011 and Crane, 1977), and cyclone impactor efficiency (based on Dirgo, 1985) were included in the loss calculation. When the SMPS was not sampling at a location (in the case of an instrument malfunction or operator error), the reported CPC data was corrected with an average of the total losses for the entire campaign at the specified deployment location (e.g., if we needed to correct Galveston data, then the average of all calculated losses at Galveston was taken). These flatline corrections were used for all data on 22/07/13, 22/07/20, 22/07/22, and the data from Galveston on 22/08/09. The supersaturation uncertainty is estimated conservatively at +/- 0.03%, where variation in the inlet temperature, pressure, and calibration technique prevents a more accurate measurement. Confidence in the reported supersaturation measurements is based on a pre-campaign calibration (following the methods from our previous work and Deng, 2014 based on Rose, 2008) in addition to inter-comparisons with the DOE for two days (22/08/18 and 22/09/01) where TAMU was co-located with AMF1. The inter-comparisons show good agreement between our instrument and the DOEs instrument on both days at all supersaturations. After the last inter-comparison on 22/09/01, there was no indication of a malfunction by our instrument through the rest of the campaign. Unfortunately, the instrument was dropped during demobilization. A post-campaign calibration was conducted, which showed a substantial departure from the pre-campaign calibration. The drop may have damaged the instrument’s ability to produce the desired supersaturations. Therefore, we do consider the data after 22/09/01 to be correct, but it should be used with caution. The CCN counter sampled for 3 minutes at each supersaturation setpoint (0.2, 0.4, 0.6, 0.8, 1.0, and 1.2%). At the end of a cycle, the instrument was set to 0.01% supersaturation for 5 minutes. The data is comprised of the last 60 seconds of each supersaturation set point (0.2, 0.4, 0.6, 0.8, 1.0, and 1.2%) to ensure the instrument stabilized and was able to reach thermal equilibrium. We removed the data during the periods where there were operational difficulties, setup, or maintenance. This data was collected for ARM Field Campaign AFC07055 and supported by DOE ASR grant DE-SC0021047. For any further questions, please feel free to contact the instrument PI, Sarah D. Brooks, sbrooks@tamu.edu. Rose et. al. Calibration and Measurement Uncertainties of a Continuous-Flow Cloud Condensation Nuclei Counter (DMT-CCNC): CCN Activation of Ammonium Sulfate and Sodium Chloride Aerosol Particles in Theory and Experiment. Atmos. Chem. Phys., 8, 1153-1179, 2008. Deng et. al. Using Raman Microspectroscopy to Determine Chemical Composition and Mixing State of Airborne Marine Aerosols over the Pacific Ocean. Aerosol Science and Technology, Vol 48, Issue 2, 2014. Kesten et. al. Calibration of a TSI Model 3025 Ultrafine Condensation Particle Counter. Aerosol Science and Technology, 15:2, 107-111, 1991. Gormley et. al. Diffusion from a Stream Flowing through a Cylindrical Tube. Proceedings of the Royal Irish Academy, Vol 52, 163-169, 1948. Aerosol Measurement: Principles, Techniques, and Applications, Third Edition. John Wiley & Sons, Inc, 2011. Crane et. al. Inertial Deposition of Particles in a Bent Pipe. Journal of Aerosol Science, Vol 8, 161-170, 1977. Dirgo et. al. Cyclone Collection Efficiency: Comparison of Experimental Results with Theoretical Predictions. Aerosol Science and Technology, 4:4, 401-415, 1985.

54 ENVIRONMENTAL SCIENCES↗

Sensor placement for diagnosability in space-borne systems - A model-based reasoning approach

This paper presents an approach to evaluating sensor placements on the basis of how well they are able to discriminate between a given fault and normal operating modes and/or other fault modes. In this approach, a model of the system in both normal operations and fault modes is used to evaluate possible sensor placements upon the basis of three criteria. Discriminability measures how much of a divergence in expected sensor readings the two system modes can be expected to produce. Accuracy measures confidence in the particular model predictions. Timeliness measures how long after the fault occurrence the expected divergence will take place. These three metrics then can be used to form a recommendation for a sensor placement. This paper describes how these measures can be computed and illustrated these methods with a brief example.

Chien, Steve↗

Observations of Mantle Seismic Anisotropy Using Array Techniques: Shear-Wave Splitting of Beamformed SmKS Phases

Shear-wave splitting measurements are commonly used to resolve seismic anisotropy in both the upper and lowermost mantle. Typically, such techniques are applied to SmKS phases that have reflected (m-1) times off the underside of the core-mantle boundary before being recorded. Practical constraints for shear-wave splitting studies include the limited number of suitable phases as well as the large fraction of available data discarded because of poor signal-to-noise ratios (SNRs) or large measurement uncertainties. Array techniques such as beamforming are commonly used in observational seismology to enhance SNRs, but have not been applied before to improve SmKS signal strength and coherency for shear wave splitting studies. Here, we investigate how a beamforming methodology, based on slowness and backazimuth vespagrams to determine the most coherent incoming wave direction, can improve shear-wave splitting measurement confidence intervals. Through the analysis of real and synthetic seismograms, we show that (a) the splitting measurements obtained from the beamformed seismograms (beams) reflect an average of the single-station splitting parameters that contribute to the beam; (b) the beams have (on average) more than twice as large SNRs than the single-station seismograms that contribute to the beam; (c) the increased SNRs allow the reliable measurement of shear wave splitting parameters from beams down to average single-station SNRs of 1.3. Beamforming may thus be helpful to more reliably measure splitting due to upper mantle anisotropy. Moreover, here we show that beamforming holds potential to greatly improve detection of lowermost mantle anisotropy by demonstrating differential SKS–SKKS splitting analysis using beamformed USArray data.

54 ENVIRONMENTAL SCIENCES↗

Launch commit criteria performance trending analysis

Summarized results and recommendations are presented for a prototype performance-trending study sponsored by the Marshall Space Flight Center (MSFC) with NASA Headquarters support. The acquirement of this recognition capability is statistically addressed through the expansion of an arbitrary probability density function (PDF) of the Gram-Charlier series type. This PDF is utilized to assess the relative deviation of any future measurement confidence bounds for launch commit criteria. As a result, the probabilistic assessment of time-varying measurement fluctuation stability can be identified in terms of these historical measurement profiles.

Hart, G. F.↗

A comprehensive spectral assay library to quantify the Halobacterium salinarum NRC-1 proteome by DIA/SWATH-MS

Data-Independent Acquisition (DIA) is a mass spectrometry-based method to reliably identify and reproducibly quantify large fractions of a target proteome. The peptide-centric data analysis strategy employed in DIA requires a priori generated spectral assay libraries. Such assay libraries allow to extract quantitative data in a targeted approach and have been generated for human, mouse, zebrafish, E. coli and few other organisms. However, a spectral assay library for the extreme halophilic archaeon Halobacterium salinarum NRC-1, a model organism that contributed to several notable discoveries, is not publicly available yet. Here, we report a comprehensive spectral assay library to measure 2,563 of 2,646 annotated H. salinarum NRC-1 proteins. We demonstrate the utility of this library by measuring global protein abundances over time under standard growth conditions. The H. salinarum NRC-1 library includes 21,074 distinct peptides representing 97% of the predicted proteome and provides a new, valuable resource to confidently measure and quantify any protein of this archaeon. Data and spectral assay libraries are available via ProteomeXchange (PXD042770, PXD042774) and SWATHAtlas (SAL00312-SAL00319).

59 BASIC BIOLOGICAL SCIENCES↗

Safe Operations at Roadway Junctions: Intelligent Roadway Infrastructure as Functional Interlocking

Automated vehicle (AV) technology is quickly maturing, and the corresponding infrastructure systems that evaluate traffic and communicate to vehicles requires sophisticated sensing and perception technologies, referred to as intelligent roadway infrastructure (IRI), to complement emerging AV capabilities. IRI provides signals to vehicles, indicating right-of-way for vehicles and communicating to approaching AVs that no other vehicle is failing to yield. This capability, denoted as safety-affirmative signaling, provides a green light or a green arrow as appropriate and affirms through communication links to connected vehicles when it is safe to proceed. About 36% of collisions occur at intersections, with most occurring upon left turns (22.2%) or crossing over (12.6%), and only a small percentage (1.2%) while turning right at an intersection. Of all intersection crashes about half (52.5%) of those vehicles were traveling through a signalized intersection 2. Safety-affirmative signaling would guarantee safety of AV fleet vehicles, by providing the interlocking principle, a term from automated train control that only allows progression through a railway intersection after affirming no opportunity for a crash exists. IRI through safety-affirmative signaling would bring performance and safety to complex roadway intersections where AV transit fleet service is most needed, as well as safety benefits to traditional, non-automated vehicles and vulnerable road users. The implementation of IRI has functional, programmatic, and technical challenges. Research work performed at the National Renewable Energy Laboratory (NREL) in an integrative approach encapsulating these themes, and termed infrastructure perception and control (IPC) is motivated by improved performance (travel time), improved safety (reduced collisions), and improved energy efficiency (less fuel burned and minimized production of greenhouse gases). IPC is intended not only for roadway and intersection applications but also in extension to inform complementary buildings and grid systems to enable better co-management, as vehicles and their charging needs become increasingly integrated into the built environment. The NREL IPC project presents an open-source framework, architecture, and supporting technology to implement IRI, addressing critical issues such as fusion of data, reliability, standardization of data interfaces, and confidence of detection. The framework is informed by previous experience in U.S. Department of Defense research technology, specifically in the use of radar to detect, identify, and track aerial threats. These principles combined with multi-sensor fusion provides for a complete digital twin with known and measurable confidence and accuracy from which safety-affirmative signaling can be developed and deployed.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗

Fast frequency acquisition via adaptive least squares algorithm

A new least squares algorithm is proposed and investigated for fast frequency and phase acquisition of sinusoids in the presence of noise. This algorithm is a special case of more general, adaptive parameter-estimation techniques. The advantages of the algorithms are their conceptual simplicity, flexibility and applicability to general situations. For example, the frequency to be acquired can be time varying, and the noise can be nonGaussian, nonstationary and colored. As the proposed algorithm can be made recursive in the number of observations, it is not necessary to have a priori knowledge of the received signal-to-noise ratio or to specify the measurement time. This would be required for batch processing techniques, such as the fast Fourier transform (FFT). The proposed algorithm improves the frequency estimate on a recursive basis as more and more observations are obtained. When the algorithm is applied in real time, it has the extra advantage that the observations need not be stored. The algorithm also yields a real time confidence measure as to the accuracy of the estimator.

Kumar, R.↗

Fast frequency acquisition via adaptive least squares algorithm

A new least squares algorithm is proposed and investigated for fast frequency and phase acquisition of sinusoids in the presence of noise. This algorithm is a special case of more general, adaptive parameter-estimation techniques. The advantages of the algorithms are their conceptual simplicity, flexibility and applicability to general situations. For example, the frequency to be acquired can be time varying, and the noise can be non-Gaussian, nonstationary and colored. As the proposed algorithm can be made recursive in the number of observations, it is not necessary to have a priori knowledge of the received signal-to-noise ratio or to specify the measurement time. This would be required for batch processing techniques, such as the fast Fourier transform (FFT). The proposed algorithm improves the frequency estimate on a recursive basis as more and more observations are obtained. When the algorithm is applied in real time, it has the extra advantage that the observations need not be stored. The algorithm also yields a real time confidence measure as to the accuracy of the estimator.

Kumar, Rajendra↗

An intercomparison of instrumentation for tropospheric measurements of dimethyl sulfide: Aircraft results for concentrations at the parts-per-trillion level

This paper reports results from NASA's Chemical Instrumentation and Test Evaluation (CITE 3) during which airborne measurements of dimethyl sulfide (DMS) from six instruments were intercompared. Represented by the six instruments are three fundamentally different detection principles (flame photometric, mass spectrometric, and electron capture after fluorination); three collection/preconcentration methods (cryogenic, gold wool absorption, and polymer absorbent); and three types of oxidant scrubbers (solid phase alkaline, aqueous reactor, and cotton). The measurements were made over the Atlantic Ocean in August/September 1989 during flights from NASA's Wallops Flight Center, Virginia, and Natal, Brazil. The majority of the intercomparisons are at DMS mixing ratios less than 50 pptv. Results show that instrument agreement is of the order of a few pptv for mixing ratios less than 50 pptv and to within about 15% above 50 pptv. Statistically significant (95% confidence) measurement biases were noted among some of the techniques. However, in all cases, any bias is small and within the accuracy of the measurements and prepared DMS standards. Thus, we conclude that the techniques intercompared during CITE 3 provide equally valid measurements of DMS in the range of a few pptv to 100 pptv (upper range of the intercomparisons).

Gregory, Gerald L.↗

Estimation of Stability and Control Derivatives of an F-15

A technique for real-time estimation of stability and control derivatives (derivatives of moment coefficients with respect to control-surface deflection angles) was used to support a flight demonstration of a concept of an indirect-adaptive intelligent flight control system (IFCS). Traditionally, parameter identification, including estimation of stability and control derivatives, is done post-flight. However, for the indirect-adaptive IFCS concept, parameter identification is required during flight so that the system can modify control laws for a damaged aircraft. The flight demonstration was carried out on a highly modified F-15 airplane (see Figure 1). The main objective was to estimate the stability and control derivatives of the airplane in nearly real time. A secondary goal was to develop a system to automatically assess the quality of the results, so as to be able to tell a learning neural network which data to use. Parameter estimation was performed by use of Fourier-transform regression (FTR) a technique developed at NASA Langley Research Center. FTR is an equation- error technique that operates in the frequency domain. Data are put into the frequency domain by use of a recursive Fourier transform for a discrete frequency set. This calculation simplifies many subsequent calculations, removes biases, and automatically filters out data beyond the chosen frequency range. FTR as applied here was tailored to work with pilot inputs, which produce correlated surface positions that prevent accurate parameter estimates, by replacing half the derivatives with predicted values. FTR was also set up to work only on a recent window of data, to accommodate changes in flight condition. A system of confidence measures was developed to identify quality-parameter estimates that a learning neural network could use. This system judged the estimates primarily on the basis of their estimated variances and of the level of aircraft response. The resulting FTR system was implemented in the Simulink software system and auto-coded in the C programming language for use on the Airborne Research Test System (ARTS II) computer installed in the F-15 airplane. The Simulink model was also used in a control room that utilizes the Ring Buffered Network Bus hardware and software, making it possible to evaluate test points during flights. In-flight parameter estimation was done for piloted and automated maneuvers, primarily at three test conditions. Figure 2 shows results for pitching moment due to symmetric stabilator actuations for a series of three pitch doublet maneuvers (in a doublet maneuver, a command to change attitude in a given direction by a given amount is followed immediately by a command to change attitude in the opposite direction by the same amount). A time window of 5 seconds was used. The portions of the curves shown in red are those that passed the confidence tests. The technique showed good convergence for most derivatives for both kinds of maneuvers - typically within a few seconds. The confidence tests were marginally successful, and it would be necessary to refine them for use in an IFCS.

Smith, Mark↗

Long-baseline quantum sensor network as dark matter haloscope

Ultralight dark photons constitute a well-motivated candidate for dark matter. A coherent electromagnetic wave is expected to be induced by dark photons when coupled with Standard-Model photons through kinetic mixing mechanism, and should be spatially correlated within the de Broglie wavelength of dark photons. Here we report the first search for correlated dark-photon signals using a long-baseline network of 15 atomic magnetometers, which are situated in two separated meter-scale shield rooms with a distance of about 1700 km. Both the network’s multiple sensors and the shields large size significantly enhance the expected dark-photon electromagnetic signals, and long-baseline measurements confidently reduce many local noise sources. Using this network, we constrain the kinetic mixing coefficient of dark photon dark matter over the mass range 4.1 feV-2.1 peV, which represents the most stringent constraints derived from any terrestrial experiments operating over the aforementioned mass range. Our prospect indicates that future data releases may go beyond the astrophysical constraints from the cosmic microwave background and the plasma heating.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DESI 2024 II: sample definitions, characteristics, and two-point clustering statistics

We present the samples of galaxies and quasars used for DESI 2024 cosmological analyses, drawn from the DESI Data Release 1 (DR1). We describe the construction of largescale structure (LSS) catalogs from these samples, which include matched sets of synthetic reference ‘randoms’ and weights that account for variations in the observed density of the samples due to experimental design and varying instrument performance. We detail how we correct for variations in observational completeness, the input ‘target’ densities due to imaging systematics, and the ability to confidently measure redshifts from DESI spectra. We then summarize how remaining uncertainties in the corrections can be translated to systematic uncertainties for particular analyses. We describe the weights added to maximize the signalto-noise of DESI DR1 2-point clustering measurements. We detail measurement pipelines applied to the LSS catalogs that obtain 2-point clustering measurements in configuration and Fourier space. The resulting 2-point measurements depend on window functions and normalization constraints particular to each sample, and we present the corrections required to match models to the data. We compare the configuration- and Fourier-space 2-point clustering of the data samples to that recovered from simulations of DESI DR1 and find they are, generally, in statistical agreement to within 2% in the inferred real-space over-density field. The LSS catalogs, 2-point measurements, and their covariance matrices will be released publicly with DESI DR1.

79 ASTRONOMY AND ASTROPHYSICS↗

Deep learning Hamiltonians from disordered image data in quantum materials

The capabilities of image probe experiments are rapidly expanding, providing new information about quantum materials on unprecedented length- and timescales. Many such materials feature inhomogeneous electronic properties with intricate pattern formation on the observable surface. This rich spatial structure contains information about interactions, dimensionality, and disorder—a spatial encoding of the Hamiltonian driving the pattern formation. Image recognition techniques from machine learning are an excellent tool for interpreting information encoded in the spatial relationships in such images. Here, we develop a deep learning framework for using the rich information available in these spatial correlations in order to discover the underlying Hamiltonian driving the patterns. We first vet the method on a known case, scanning near-field optical microscopy on a thin film of V⁢O 2 . We then apply our trained convolutional neural network architecture to new optical microscope images of a different V⁢O 2 film as it goes through the metal-insulator transition. We find that a two-dimensional Hamiltonian with both interactions and random field disorder is required to explain the intricate, fractal intertwining of metal and insulator domains during the transition. This detailed knowledge about the underlying Hamiltonian paves the way for using the model to control the pattern formation via, e.g., tailored hysteresis protocols. Finally, we also introduce a distribution-based confidence measure on the results of a multilabel classifier, which does not rely on adversarial training. In addition, we propose a machine-learning-based criterion for diagnosing a physical system's proximity to criticality.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Development and implementation of high-throughput proteomic and metabolomics assays by using advanced chromatographic and mass spectrometric systems (CRADA Final Report)

The mission of this CRADA with Agilent was to couple powerful MS platforms (QQQ, IM-QTOFMS) with Agilent’s novel Ultra-High-Performance Liquid Chromatography (UHPLC) fast metabolomic workflows and perform ABF Machine Learning (ML) to generated datasets. Agilent transferred UHPLC methods to PNNL and LBNL and methods were implemented and demonstrated in both labs, achieving total acquisition times of < 10 min. Metabolites analyzed using Agilent’s shared methods included metabolites from central carbon metabolism, common across hosts, and metabolites unique to engineered strains. Standards were acquired in an UHPLC-Drift Tube Ion Mobility Mass Spectrometer (DTIMS) system for the first time within the context of ABF and methods were optimized based on Agilent’s protocols. Samples from ABF hosts Pseudomonas putida, Aspergillus pseudoterreus, Aspergillus niger and Rhodosporidium toruloides were analyzed using the UHPLC-DTIMS platform for a total of 276 runs. A data analysis workflow compatible with the Experimental Data Depot (EDD) and completely shareable was developed for the acquired UHPLC-DTIMS data. Samples were analyzed using a Data Independent Acquisition Approach (DIA), which for most of the standards provided more transitions therefore increasing detection confidence. Using the data acquired by PNNL, LBNL, and Agilent’s specifications from previous ML projects, SNL applied an ensemble ML strategy to pick the best performing model for automated LC-method selection. Finally, with the contribution of the participant labs and Agilent, SNL developed an Automated Method Selection (AMS) software tool to predict the best liquid chromatography method for analysis of any new molecules of interest. Samples with novel pathways and new metabolite targets of interest are generated at a high pace in the ABF. Overall, the project advanced rapid metabolomics by combining liquid chromatography, ion mobility spectrometry, and data-independent mass spectrometry with machine learning. This multidimensional approach uses retention time, collision cross-section, precursor mass, and fragment-ion information to distinguish chemically similar metabolites that can be difficult to resolve using conventional liquid- or gas-chromatography methods. The resulting workflow also provided automated metabolite-identification error estimates, addressing a recognized need for statistical confidence measures in metabolomics.

Petzold, Christopher [Lawrence Berkeley National L↗