SEARCH · Search NASA

Results for “Image processing algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

All sources NASA NTRS DOE OSTI

NASA NTRS2013

Functional Near-Infrared Spectroscopy Signals Measure Neuronal Activity in the Cortex

Functional near infrared spectroscopy (fNIRS) is an emerging optical neuroimaging technology that indirectly measures neuronal activity in the cortex via neurovascular coupling. It quantifies hemoglobin concentration ([Hb]) and thus measures the same hemodynamic response as functional magnetic resonance imaging (fMRI), but is portable, non-confining, relatively inexpensive, and is appropriate for long-duration monitoring and use at the bedside. Like fMRI, it is noninvasive and safe for repeated measurements. Patterns of [Hb] changes are used to classify cognitive state. Thus, fNIRS technology offers much potential for application in operational contexts. For instance, the use of fNIRS to detect the mental state of commercial aircraft operators in near real time could allow intelligent flight decks of the future to optimally support human performance in the interest of safety by responding to hazardous mental states of the operator. However, many opportunities remain for improving robustness and reliability. It is desirable to reduce the impact of motion and poor optical coupling of probes to the skin. Such artifacts degrade signal quality and thus cognitive state classification accuracy. Field application calls for further development of algorithms and filters for the automation of bad channel detection and dynamic artifact removal. This work introduces a novel adaptive filter method for automated real-time fNIRS signal quality detection and improvement. The output signal (after filtering) will have had contributions from motion and poor coupling reduced or removed, thus leaving a signal more indicative of changes due to hemodynamic brain activations of interest. Cognitive state classifications based on these signals reflect brain activity more reliably. The filter has been tested successfully with both synthetic and real human subject data, and requires no auxiliary measurement. This method could be implemented as a real-time filtering option or bad channel rejection feature of software used with frequency domain fNIRS instruments for signal acquisition and processing. Use of this method could improve the reliability of any operational or real-world application of fNIRS in which motion is an inherent part of the functional task of interest. Other optical diagnostic techniques (e.g., for NIR medical diagnosis) also may benefit from the reduction of probe motion artifact during any use in which motion avoidance would be impractical or limit usability.

Harrivel, Angela↗

NASA NTRS2013

Functional Near-Infrared Spectroscopy Signals Measure Neuronal Activity in the Cortex

Harrivel, Angela↗

DOE OSTI2022

Inverse Method for Noninvasive Material Discrimination with Multienergy X-Ray Radiography

Active x-ray inspections have great potential for noninvasive detection of illicit materials. Dual-energy x-ray radiography, in particular, has been used to determine material composition by utilizing the energy-dependence of the x-ray attenuation coefficients. However, current implementations of this method are limited in their ability to determine the material composition of composite objects. Here, in this paper, we present an inverse algorithm that uses multienergy x-ray radiography data to noninvasively reconstruct the contents of a container. A critical feature of the current contribution is that material identification can be performed using conventional detectors and x-ray spectra with different endpoint energies produced by varying nothing more than the tube voltage. Adaptive regularization is used to increase the accuracy of material estimations from multienergy data sets. The utility of these methods is demonstrated with experimentally acquired radiographs obtained using a tunable x-ray source that produces spectra with endpoint energies of 100–450 keV. The object inspected is a scale model of a nuclear materials storage container composed of three-dimensional printed plastic and stainless-steel spheres inside a thin-walled steel container. Reconstructions of the steel sphere thicknesses are within a root-mean-square error of 0.37 cm.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

FY21 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

The development of algorithms for machine learning and data analysis for the 3013 Surveillance Program is a collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). For corrosion detection, Laser Confocal Microscope (LCM) or Wide Area 3D Measurement System (WAMS) data is extracted from large binary files, with software written to convert the data to physical attributes (e.g., height, color and grayscale values; all as functions of a location in a plane projection). A user-friendly Matlab Graphical User Interface (GUI) that reads data from either LCM or WAMS files was developed to integrate input data with software developed for processing and evaluation. The GUI can selectively download binary data, interrogate data attributes, label data, flag significant features, execute Machine Learning (ML) algorithms, output parameters for trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. Features can be called out by user-specified thresholds, manual labeling or machine learning algorithms when they have been completed. The ability to rapidly label data is important because of the volume of data required for training machine learning algorithms. The GUI has the flexibility to allow addition of improved ML algorithms, methods for data visualization, and statistical computations. Statistical analyses via the GUI include areas of pits within a defined range of pit depths, correlations between Red-Green-Blue (RGB) or grayscale intensity and relative surface height, covariances between values associated with features, and feature histograms. The development of supervised machine learning algorithms, however, has been hindered by a lack of training data. The machine learning algorithms for crack identification are being refined but require improvements to the true positive rate for crack detection. This shortcoming is an artifact of the limited training data currently available, perhaps more so than the structure of the neural networks. At present, the best results are had from a consensus over an ensemble of randomly generated Deep Neural Network (DNN) or Convolutional Neural Network (CNN) algorithms. Although the consensus accuracy method has yielded optimum true positive and true negative rates in excess of 80%, additional validation testing is necessary. In addition to the suite of LCM data that was initially used, and which represents the majority of the work presented in this report, WAMS image data was also reviewed at a preliminary level. The review included a comparison between image resolution and dynamic range for each method. WAMS (ZON file) image data was found to have a pixel pitch of 3.69μm compared to 1 μm for the LCM (vk4 file) data, which implies a lower resolution for the WAMS images. Conversely, the ratio of dynamic range of the WAMS data to the LCM data was approximately 41:20 for height data, suggesting that information from WAMS should more accurately determine the depth of pits. At present, the significance of the greater dynamic range of the WAMS data relative to the LCM data has not yet been evaluated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

NASA NTRS2010

Utilizing Earth Observations for Societal Issues

Over the last four decades a tremendous progress has been made in the Earth science space-based remote sensing observations, technologies and algorithms. Such advancements have improved the predictability by providing lead-time and accuracy of forecast in weather, climate, natural hazards, and natural resources. It has further reduced or bounded the overall uncertainties by partially improving our understanding of planet Earth as an integrated system that is governed by non-linear and chaotic behavior. Many countries such as the US, European Community, Japan, China, Russia, India has and others have invested billions of dollars in developing and launching space-based assets in the low earth (LEO) and geostationary (GEO) orbits. However, the wealth of this scientific knowledge that has potential of extracting monumental socio-economic benefits from such large investments have been slow in reaching the public and decision makers. For instance, there are a number of areas such as water resources and availability, energy forecasting, aviation safety, agricultural competitiveness, disaster management, air quality and public health, which can directly take advantage. Nevertheless, we all live in a global economy that depends on access to the best available Earth Science information for all inhabitants of this planet. This presentation discusses a process to transition Earth science data and products for societal needs including NASA's experience in achieving such objectives. It is important to mention that there are many challenges and issues that pertain to a number of areas such as: (1) difficulties in making a speedy transition of data and information from observations and models to relevant Decision Support Systems (DSS) or tools, (2) data and models inter-operability issues, (3) limitations of spatial, spectral and temporal resolution, (4) communication limitations as dictated by the availability of image processing and data compression techniques. Additionally, the most critical element amongst all is the organizational and management boundaries that must be resolved at local, state, national and international levels to implement and realize free flow of such vital information.

Habib, Shahid↗

NASA NTRS1992

Tests of a simple data merging algorithm for the GONG project

The GONG (Global Oscillation Network Group) project proposes to reduce the impact of diurnal variations on helioseismic measurements by making long-term observations of solar images from six sites placed around the globe. The sun will be observed nearly constantly for three years, resulting in the acquisition of l+ terabyte of image data. To use the solar network to maximum advantage, the images from the sites must be combined into a single time series to determine mode frequencies, amplitudes, and line widths. Initial versions of combined, i.e., merged, time series were made using a simple weighted average of data from different sites taken simultaneously. In order to accurately assess the impact of the data merge on the helioseismic measurements, a set of artificial solar disk images was made using a standard solar model and containing a well known set of oscillation modes and frequencies. This undegraded data set and data products computed from it were used to judge the relative merits of various data merging schemes. The artificial solar disk images were subjected to various instrumental and atmospheric degradations, dependent on site and time, in order to create a set of images simulating those likely to be taken at the site. The degraded artificial solar disk images for the six observing sites were combined in various ways to form merged time series of images and mode coefficients. Various forms of a weighted average were used, including an equally-weighted average, an average with weights dependent upon air mass and averages with weights dependent on various quality assurance parameters. Both the undegraded solar disk image time series and several time series made up of various combinations of the degraded solar disk images from the six sites were subjected to standard helioseismic measurement processing. This processing consisted of coordinate remapping, detrending, spherical harmonic transformation, computation of power series for the oscillation mode coefficients, and mode frequency identification. Visual and statistical evaluation of the merged data sets themselves and differences between the merged and undegraded data set shows good agreement between the two data sets. Some slight differences in image scale and registration appear between the undegraded data set and the various merged data sets. In the set of power series made from the mode coefficients of the merged data sets, some power leakage is observed into the background and into slightly lower l-value modes, especially at higher l-value mode frequencies. The results of the comparison of time series and mode oscillation frequencies of the undegraded data with those of the data merged using weighted averages indicate that, at least for p-mode solar oscillations, a weighted average of either the detrended remapped images or the mode coefficients gives good determination of the mode frequencies and adequate-to-good determination of the amplitudes and widths of the mode frequency lines. This conclusion is most advantageous to the analysis of the massive amounts of data to be received by the GONG network.

Williams, W. E.↗

NASA NTRS2021

LiDAR-Based Map Relative Localization Performance Analysis for Landing on Europa

This paper presents preliminary simulations andanalyses done to assess the feasibility of performing Map RelativeLocalization (MRL) with the Europa Lander LiDAR beingdeveloped for the Europa Lander Pre-Phase A concept. MapRelative Localization is the process of determining the horizontalposition of a lander with respect to an onboard, a-priori map,by comparing the map to sensor observations of the terrain duringdeorbit, descent, and landing (DDL). Although kilometerscaleposition knowledge is commonly available during DDL,landing in hazard-rich environments requires position errors of100 m or less. Prior knowledge in the case of Europa Landerwill be visual and topographic maps collected by the upcomingEuropa Clipper mission. The Mars 2020 Lander Vision System(LVS) uses images from a camera to localize with respect tovisual maps. This technology, as well as a 3D imaging LiDAR indevelopment for hazard detection, is currently baselined for theEuropa Lander Pre-Phase A concept. This paper investigatesthe potential use of the hazard detection LiDAR to performMRL with respect to a 3D digital elevation model (DEM)provided by the Europa Clipper mission, as an alternative orbackup solution to passive optical MRL. Compared to passiveoptical MRL, one advantage of LiDAR-based localization isthat it is insensitive to lighting conditions, potentially relaxingrequirements on synchronizing map acquisition and landingtime of day. To analyze LiDAR based MRL performance,six representative terrains are synthetically up-sampled fromGalileo-derived maps of Europa to a resolution of 0.5 m/pxand covering an area of 4 km by 4 km. These maps are usedas ground-truth to generate simulated noisy a-priori onboardtopographic maps expected from Europa Clipper as well assimulated LiDAR DEMs generated at an altitude of 5 km duringEuropa Lander DDL. The simulated LiDAR DEM is matchedagainst the simulated map via 2D normalized cross-correlation,exploiting the accurately known spacecraft attitude to avoidthe need for more computationally intensive algorithms such asIterative Closest Point (ICP). Two sources of measurement errorare identified for analysis: 1) additive Gaussian noise in therange measurements from the Europa Lander LiDAR and theEuropa Clipper derived maps and 2) errors in the LiDAR DEMinduced by errors in the Europa Lander state estimate which isused to de-warp the LiDAR scan data into a DEM format. Weassess the effect of each of these types of errors independently onmatching performance as well as the overall performance whenall types of error are introduced. Additionally, we present theresult of a sensitivity study to terrain frequency content.

Trawny, Nikolas↗

NASA NTRS2008

NASA Tech Briefs, November 2008

Topics covered include: Digital Phase Meter for a Laser Heterodyne Interferometer; Vision System Measures Motions of Robot and External Objects; Advanced Precipitation Radar Antenna to Measure Rainfall From Space; Wide-Band Radar for Measuring Thickness of Sea Ice; Vertical Isolation for Photodiodes in CMOS Imagers; Wide-Band Microwave Receivers Using Photonic Processing; L-Band Transmit/Receive Module for Phase-Stable Array Antennas; Microwave Power Combiner/Switch Utilizing a Faraday Rotator; Compact Low-Loss Planar Magic-T; Using Pipelined XNOR Logic to Reduce SEU Risks in State Machines; Quasi-Optical Transmission Line for 94-GHz Radar; Next Generation Flight Controller Trainer System; Converting from DDOR SASF to APF; Converting from CVF to AAF; Documenting AUTOGEN and APGEN Model Files; Sequence History Update Tool; Extraction and Analysis of Display Data; MRO DKF Post-Processing Tool; Rig Diagnostic Tools; MRO Sequence Checking Tool; Science Activity Planner for the MER Mission; UAVSAR Flight-Planning System; Templates for Deposition of Microscopic Pointed Structures; Adjustable Membrane Mirrors Incorporating G-Elastomers; Hall-Effect Thruster Utilizing Bismuth as Propellant; High-Temperature Crystal-Growth Cartridge Tubes Made by VPS; Quench Crucibles Reinforced with Metal; Deep-Sea Hydrothermal-Vent Sampler; Mars Rocket Propulsion System; Two-Stage Passive Vibration Isolator; Improved Thermal Design of a Compression Mold; Enhanced Pseudo-Waypoint Guidance for Spacecraft Maneuvers; Altimetry Using GPS-Reflection/Occultation Interferometry; Thermally Driven Josephson Effect; Perturbation Effects on a Supercritical C7H16/N2 Mixing Layer; Gold Nanoparticle Labels Amplify Ellipsometric Signals; Phase Matching of Diverse Modes in a WGM Resonator; WGM Resonators for Terahertz-to-Optical Frequency Conversion; Determining Concentration of Nanoparticles from Ellipsometry; Microwave-to-Optical Conversion in WGM Resonators; Four-Pass Coupler for Laser-Diode-Pumped Solid-State Laser; Low-Resolution Raman-Spectroscopy Combustion Thermometry; Temperature Sensors Based on WGM Optical Resonators; Varying the Divergence of Multiple Parallel Laser Beams; Efficient Algorithm for Rectangular Spiral Search; Algorithm-Based Fault Tolerance Integrated with Replication; Targeting and Localization for Mars Rover Operations; Terrain-Adaptive Navigation Architecture; Self-Adjusting Hash Tables for Embedded Flight Applications; Schema for Spacecraft-Command Dictionary; Combined GMSK Communications and PN Ranging; System-Level Integration of Mass Memory; Network-Attached Solid-State Recorder Architecture; Method of Cross-Linking Aerogels Using a One-Pot Reaction Scheme; An Efficient Reachability Analysis Algorithm.

Source record↗

NASA NTRS2016

Multi-Sensor Cloud and Aerosol Retrieval Simulator and Remote Sensing from Model Parameters : Aerosols - Part 2

The Multi-sensor Cloud Retrieval Simulator (MCRS) produces a simulated radiance product from any high-resolution general circulation model with interactive aerosol as if a specific sensor such as the Moderate Resolution Imaging Spectroradiometer (MODIS) were viewing a combination of the atmospheric column and land ocean surface at a specific location. Previously the MCRS code only included contributions from atmosphere and clouds in its radiance calculations and did not incorporate properties of aerosols. In this paper we added a new aerosol properties module to the MCRS code that allows users to insert a mixture of up to 15 different aerosol species in any of 36 vertical layers. This new MCRS code is now known as MCARS (Multi-sensor Cloud and Aerosol Retrieval Simulator). Inclusion of an aerosol module into MCARS not only allows for extensive, tightly controlled testing of various aspects of satellite operational cloud and aerosol properties retrieval algorithms, but also provides a platform for comparing cloud and aerosol models against satellite measurements. This kind of two-way platform can improve the efficacy of model parameterizations of measured satellite radiances, allowing the assessment of model skill consistently with the retrieval algorithm. The MCARS code provides dynamic controls for appearance of cloud and aerosol layers. Thereby detailed quantitative studies of the impacts of various atmospheric components can be controlled. In this paper we illustrate the operation of MCARS by deriving simulated radiances from various data field output by the Goddard Earth Observing System version 5 (GEOS-5) model. The model aerosol fields are prepared for translation to simulated radiance using the same model sub grid variability parameterizations as are used for cloud and atmospheric properties profiles, namely the ICA technique. After MCARS computes modeled sensor radiances equivalent to their observed counterparts, these radiances are presented as input to operational remote-sensing algorithms. Specifically, the MCARS-computed radiances are input into the processing chain used to produce the MODIS Data Collection 6 aerosol product (MOYD04). TheMOYD04 product is of course normally produced from MOYD021KM MODIS Level-1B radiance product directly acquired by the MODIS instrument. MCARS matches the format and metadata of a MOYD021KM product. The resulting MCARS output can be directly provided to MODAPS (MODIS Adaptive Processing System) as input to various operational atmospheric retrieval algorithms. Thus the operational algorithms can be tested directly without needing to make any software changes to accommodate an alternative input source. We show direct application of this synthetic product in analysis of the performance of the MOD04 operational algorithm. We use biomass-burning case studies over Amazonia employed in a recent Working Group on Numerical Experimentation (WGNE)-sponsored study of aerosol impacts on numerical weather prediction (Freitas et al., 2015). We demonstrate that a known low bias in retrieved MODIS aerosol optical depth appears to be due to a disconnect between actual column relative humidity and the value assumed by the MODIS aerosol product.

aerosol retrieval↗

NASA NTRS2004

Determining Sizes of Particles in a Flow from DPIV Data

A proposed method of measuring the size of particles entrained in a flow of a liquid or gas would involve utilization of data from digital particle-image velocimetry (DPIV) of the flow. That is to say, with proper design and operation of a DPIV system, the DPIV data could be processed according to the proposed method to obtain particle sizes in addition to particle velocities. As an additional benefit, one could then compute the mass flux of the entrained particles from the particle sizes and velocities. As in DPIV as practiced heretofore, a pulsed laser beam would be formed into a thin sheet to illuminate a plane of interest in a flow field and the illuminated plane would be observed by means of a charge-coupled device (CCD) camera aimed along a line perpendicular to the illuminated plane. Unlike in DPIV as practiced heretofore, care would be taken to polarize the laser beam so that its electric field would lie in the illuminated plane, for the reason explained in the next paragraph. The proposed method applies, more specifically, to transparent or semitransparent spherical particles that have an index of refraction different from that of the fluid in which they are entrained. The method is based on the established Mie theory, which describes the scattering of light by diffraction, refraction, and specular reflection of light by such particles. In the case of a particle illuminated by polarized light and observed in the arrangement described in the preceding paragraph, the Mie theory shows that the image of the particle on the focal plane of the CCD camera includes two glare spots: one attributable to light reflected toward the camera and one attributable to light refracted toward the camera. The distance between the glare spots is a known function of the size of the particle, the indices of refraction of the particle material, and design parameters of the camera optics. Hence, the size of a particle can be determined from the distance between the glare spots. The proposed method would be implemented in an algorithm that would automatically identify, and measure the distance between, the glare spots for each particle for which a suitable image has been captured in a DPIV image frame. The algorithm (see figure) would begin with thresholding of data from the entire image frame to reduce noise, thereby facilitating discrimination of particle images from the background and aiding in the separation of overlapping particles. It is important not to pick a threshold level so high that the light intensity between a given pair of glare spots does not fall below the threshold value, leaving the glare spots disconnected. The image would then be scanned in a sequence of rows and columns of pixels to identify groups of adjacent pixels that contain nonzero brightnesses and that are surrounded by pixels of zero brightness. Each such group would be assumed to constitute the image of one particle. Each such group would be further analyzed to determine whether the image was saturated; saturated particle images must be rejected because the locations of glare spots in saturated images cannot accurately be determined. Within each unsaturated particle image, the centroids (deemed to be the locations) of the glare spots would be determined by means of gradients of brightness distributions and three-point horizontal and three-point vertical Gaussian estimates based on the brightness values of the brightest pixels and the pixels adjacent to them. If the brightness of a given particle image contained only one peak, then it would be assumed that a second glare spot did not exist and that image would be rejected.

Wernet, M. P.↗

DOE OSTI2026

Preliminary proof-of-concept of real-time divertor heat flux control from infrared cameras with nitrogen injection in the DIII-D tokamak

In future tokamak reactors like ITER and the Fusion Pilot Plant (FPP), real-time feedback control of heat flux to the plasma-facing components (PFC) will be critical for steady-state operation. This work presents the first experimental demonstration of real-time divertor heat flux estimation with infrared thermography and feedback control with impurity seeding on the DIII-D tokamak. The flexible infrastructure of the Plasma Control System (PCS) on DIII-D makes this new capability possible. The PCS software runs on a gateway computer system, and five real-time compute nodes. An array of low latency streaming digitizers from D-TACQ Solutions connects to these real-time computers to collect and process data, and send commands to actuators during plasma discharges. This system handles the signal IO from the tokamak and allows the PCS to utilize the diagnostic data necessary to perform control in real-time. Feedback control on heat flux was accomplished by feeding infrared camera data from the “Infrared TV” (IRTV) camera to a custom-developed User Datagram Protocol (UDP) server. This server transmits infrared data to a newly developed PCS algorithm that estimates the heat flux to PFC. Here, a proportional integral derivative (PID) controller minimizes the error between a heat flux reference and the real-time estimate by injecting nitrogen gas into the divertor.

Algorithm development↗

NASA NTRS1993

Remote sounding of tropospheric minor constituents

The etalon interferometer, or Fabry-Perot interferometer (FPI), with its high throughput and high spectral resolution was widely used in the remote-sensing measurements of the earth's atmospheric composition, winds, and temperatures. The most recent satellite instruments include the Fabry-Perot interferometer flown on the Dynamics Explorer-2 (DE-2) and the High Resolution Doppler Imager (HRDI) to be flown on the Upper Atmosphere Research Satellite (UARS). These instruments measure the Doppler line profiles of the emission and absorption of certain atmospheric species (such as atomic oxygen) in the visible spectral region. The successful space flight of DE-FPI and the test and delivery of UARS-HRDI demonstrated the extremely high spectral resolution and ruggedness of the etalon system for the remote sensing of earth and planetary atmospheres. Recently, an innovative FPI focal plane detection technique called the Circle-to-Line Interferometer Optical (CLIO) system was invented at the Space Physics Research Laboratory (SPRL). The CLIO simplifies the FPI focal plane detection process by converting the circular rings or fringes into a linear pattern similar to that produced by a conventional spectrometer, while retaining the throughput advantage of the etalon interferometer. CLIO makes the use of linear array detectors more practical and efficient with FPI, the combination of FPI and CLIO represents a very promising new technique for the remote sensing of the lower atmospheres of Earth, Mars, Venus, Neptune, and other planets. The Multiorder Etalon Spectrometer (MOES), as a combination of the rugged etalon and the CLIO, compares very favorably to other spaceborne optical instruments in terms of performance versus complexity. The feasibility of an advanced etalon spectrometer for the remote sensing of tropospheric trace species, particularly carbon monoxide (CO), nitrous oxide (N2O), and methane (CH4) was discussed. The etalon atmospheric spectroscopy techniques are described, instrument design and related technical issues are discussed. The primary objective is to establish the concept of atmospheric spectroscopy with the CLIO and etalon system and its applications for the measurements of tropospheric trace species analyze system requirements and performance, determine the feasibility of components and subsystem implementation with available technology, and develop inversion algorithm for retrieval simulation and data analysis.

Drayson, S. Roland↗

NASA NTRS2005

The North Alabama Lightning Mapping Array (LMA): A Network Overview

The North Alabama Lightning Mapping Array (LMA) is s a 3-D VHF regional lightning detection system that provides on-orbit algorithm validation and instrument performance assessments for the NASA Lightning Imaging Sensor, as well as information on storm kinematics and updraft evolution that offers the potential to improve severe storm warning lead time by up t o 50% and decrease te false alarm r a t e ( for non-tornado producing storms). In support of this latter function, the LMA serves as a principal component of a severe weather test bed to infuse new science and technology into the short-term forecasting of severe and hazardous weather, principally within nearby National Weather Service forecast offices. The LMA, which became operational i n November 2001, consists of VHF receivers deployed across northern Alabama and a base station located at the National Space Science and Technology Center (NSSTC), which is on t h e campus of the University of Alabama in Huntsville. The LMA system locates the sources of impulsive VHF radio signals s from lightning by accurately measuring the time that the signals aririve at the different receiving stations. Each station's records the magnitude and time of the peak lightning radiation signal in successive 80 ms intervals within a local unused television channel (channel 5, 76-82 MHz in our case ) . Typically hundreds of sources per flash can be reconstructed, which i n t u r n produces accurate 3-dimensional lightning image maps (nominally <50 m error within 150 la. range). The data are transmitted back t o a base station using 2.4 GHz wireless Ethernet data links and directional parabolic grid antennas. There are four repeaters in the network topology and the links have an effective data throughput rate ranging from 600 kbits s -1 t o 1.5 %its s -1. This presentation provides an overview of t h e North Alabama network, the data processing (both real-time and post processing) and network statistics.

Blakeslee, R. J.↗

DOE OSTI2023

A differentiable perturbation-based weak lensing shear estimator

Upcoming imaging surveys will use weak gravitational lensing to study the large-scale structure of the Universe, demanding sub-per cent accuracy for precise cosmic shear measurements. We present a new differentiable implementation of our perturbation-based shear estimator (fpfs), using jax, which is publicly available as part of a new suite of analytic shear algorithms called anacal. This code can analytically calibrate the shear response of any non-linear observable constructed with the fpfs shapelets and detection modes utilizing autodifferentiation (ad), generalizing the formalism to include a family of shear estimators with corrections for detection and selection biases. Using the ad capability of jax, it calculates the full Hessian matrix of the non-linear observables, which improves the previously presented second-order noise bias correction in the shear estimation. As an illustration of the power of the new anacal framework, we optimize the effective galaxy number density in the space of the generalized shear estimators using an LSST-like galaxy image simulation for the 10 yr LSST. For the generic shear estimator, the magnitude of the multiplicative bias |m| is below 3 × 10 –3 (99.7 per cent confidence interval), and the effective galaxy number density is improved by 5 per cent. We also discuss some planned future additions to the anacal software suite to extend its applicability beyond the fpfs measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS2023

A Blind Convolutional Deep Autoencoder for Spectral Unmixing of Hyperspectral Images Over Waterbodies

Harmful algal blooms have dangerous repercussions for biodiversity, the ecosystem, and public health. Automatic identification based on remote sensing hyperspectral image analysis provides a valuable mechanism for extracting the spectral signatures of harmful algal blooms and their respective percentage in a region of interest. This paper proposes a new model called a non-symmetrical autoencoder for spectral unmixing to perform endmember extraction and fractional abundance estimation. The model is assessed in benchmark datasets, such as Jasper Ridge and Samson. Additionally, a case study of the HSI2 image acquired by NASA over Lake Erie in 2017 is conducted for extracting optical water types. The results using the proposed model for the benchmark datasets improve unmixing performance, as indicated by the spectral angle distance compared to five baseline algorithms. Improved results were obtained for various metrics. In the Samson dataset, the proposed model outperformed other methods for water (0.060) and soil (0.025) endmember extraction. Moreover, the proposed method exhibited superior performance in terms of mean spectral angle distance compared to the other five baseline algorithms. The non-symmetrical autoencoder for the spectral unmixing approach achieved better results for abundance map estimation, with a root mean square error of 0.091 for water and 0.187 for soil, compared to the ground truth. For the Jasper Ridge dataset, the non-symmetrical autoencoder for the spectral unmixing model excelled in the tree (0.039) and road (0.068) endmember extraction and also demonstrated improved results for water abundance maps (0.1121). The proposed model can identify the presence of chlorophyll-a in waterbodies. Chlorophyll-a is an essential indicator of the presence of the different concentrations of macrophytes and cyanobacteria. The non-symmetrical autoencoder for spectral unmixing achieves a value of 0.307 for the spectral angle distance metric compared to a reference ground truth spectral signature of chlorophyll-a. The source code for the proposed model, as implemented in this manuscript, can be found at https://github.com/EstefaniaAlfaro/autoencoder_owt_spectral.git.

hyperspectral imaging↗

DOE OSTI2019

Deep learning and radiomics: the utility of Google TensorFlow™ Inception in classifying clear cell renal cell carcinoma and oncocytoma on multiphasic CT

Purpose: Currently, all solid enhancing renal masses without microscopic fat are considered malignant until proven otherwise and there is substantial overlap in the imaging findings of benign and malignant renal masses, particularly between clear cell RCC (ccRCC) and benign oncocytoma (ONC). Radiomics has attracted increased attention for its utility in pre-operative work-up on routine clinical images. Radiomics based approaches have converted medical images into mineable data and identified prognostic imaging signatures that machine learning algorithms can use to construct predictive models by learning the decision boundaries of the underlying data distribution. The TensorFlow™ framework from Google is a state-of-the-art open-source software library that can be used for training deep learning neural networks for performing machine learning tasks. The purpose of this study was to investigate the diagnostic value and feasibility of a deep learning-based renal lesion classifier using open-source Google TensorFlow™ Inception in differentiating ccRCC from ONC on routine four-phase MDCT in patients with pathologically confirmed renal masses. Methods: With institutional review board approval for this 1996 Health Insurance Portability and Accountability Act compliant retrospective study and a waiver of informed consent, we queried our institution’s pathology, clinical, and radiology databases for histologically proven cases of ccRCC and ONC obtained between January 2000 and January 2016 scanned with a an intravenous contrast-enhanced four-phase renal mass protocol (unenhanced (UN), corticomedullary (CM), nephrographic (NP), and excretory (EX) phases). To extract features to be used for the machine learning model, the entire renal mass was contoured in the axial plane in each of the four phases, resulting in a 3D volume of interest (VOI) representative of the entire renal mass. We investigated thirteen different approaches to convert the acquired VOI data into a set of images that adequately represented each tumor which was used to train the final layer of the neural network model. Training was performed over 4000 iterations. In each iteration, 90% of the data were designated as training data and the remaining 10% served as validation data and a leave-one-out cross-validation scheme was implemented. Accuracy, sensitivity, specificity, positive (PPV) and negative predictive (NPV) values, and CIs were calculated for the classification of the thirteen processing modes. Results: We analyzed 179 consecutive patients with 179 lesions (128 ccRCC and 51 ONC). The ccRCC cohort had a mean size of 3.8 cm (range 0.8–14.6 cm) and the ONC cohort had a mean lesion size of 3.9 cm (range 1.0–13.1 cm). The highest specificity and PPV (52.9% and 80.3%, respectively) were achieved in the EX phase when we analyzed the single mid-slice of the tumor in the axial, coronal and sagittal plane, and when we increased the number of mid-slices of the tumor to three, with an accuracy of 75.4%, which also increased the sensitivity to 88.3% and the PPV to 79.6%. Using the entire tumor volume also showed that classification performance was best in the EX phase with an accuracy of 74.4%, a sensitivity of 85.8% and a PPV of 80.1%. When the entire tumor volume, plus mid-slices from all phases and all planes presented as tiled images, were submitted to the final layer of the neural network we achieved a PPV of 82.5%. Conclusions: The best classification result was obtained in the EX phase among the thirteen classification methods tested. Our proof of concept study is the first step towards understanding the utility of machine learning in the differentiation of ccRCC from ONC on routine CT images. We hope this could lead to future investigation into the development of a multivariate machine learning model which may augment our ability to accurately predict renal lesion histology on imaging.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

NASA NTRS2024

EdgeCortix SAKURA-I Machine-Learning, PCIe Accelerator SEE Heavy Ion Test Report

To enable autonomy in space, machine-learning and computer vision applications become invaluable for sensor processing. However, these algorithms are computationally complex and unfeasible for many embedded central processing units (CPUs) and usually require external coprocessors, such as graphics processing units (GPUs) or accelerators specific to the application, including application specific integrated circuits (ASICs). In power-constrained systems, GPUs tend to consume more power than is acceptable (>40W), so lower-power accelerators have shown promise to provide the performance needed under spacecraft constraints. For radiation engineers, developing methodologies that can properly test CPUs, GPUs, and accelerators, and enable comparisons between them remains a necessary complication to solve as the devices become more complex. The methodology in this test aims to be a start in developing a baseline single-event effect (SEE) test for client-device machine learning accelerators. This category of devices do not host their own operating system. This testing campaign is a continuation of a previous 200 MeV proton test performed in January 2024. This report covers two heavy ion tests of the SAKURA-I card: one in April 2024, and one in June 2024. Additional data was needed after the April test due to ion-range issues experienced at higher linear-energy transfers (LETs). These range issues are described in more detail in Section 8. This experiment characterizes SEEs and data error susceptibility of the EdgeCortix SAKURA-I machine-learning accelerator under heavy ions. The device was monitored for single event upsets (SEUs) and single event functional interrupts (SEFIs) at the Lawrence Berkeley National Laboratory’s 88-inch cyclotron. The SAKURA-I board accelerates machine-learning inference applications on a host computer through a PCIex16 connection. For the purposes of devising an end to end automated analysis workflow for this experiment, the YOLO-V5 and SSD300 objection-detection models, and the ResNet-50, EfficientNet, and MobileNetV2 image classification models were used as a representative suite of analytical machine-learning models.

Seth S Roffe↗

DOE OSTI2023

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗