Results for “value of data” — Page 18

NASA NTRS2004

Global Aerosol Profiling by Orbital Lidar, GLAS Results and Validation

The Geoscience Laser Altimeter System (GLAS) launched in 2003 is the first polar orbiting satellite lidar. The instrument was designed for high performance observations of the distribution and optical scattering cross sections of clouds and aerosol. GLAS is approaching six months of on orbit data operation. These data from thousands of orbits illustrate the ability of space lidar to accurately and dramatically measure the height distribution of global aerosol to an unprecedented degree. There were many intended science applications of the GLAS data and significant results have already been realized, profiling is a fundamentally new measurement from space with multiple applications. A most important aerosol application is providing input to global aerosol generation transport models. Another is improved measurement of aerosol optical depth. A main approach to verify the aerosol optical depth retrieval is comparison to surface measurements by Aeronet. A special feature of the GLAS satellite bus is to rapidly point the lidar instrument at off nadir targets with less than 100 m accuracy. About a dozen selected Aeronet sites were pointed at whenever the GLAS lidar came within 5 degrees of zenith. These plus a more general comparison to nearby sites support the GLAS data product values. In addition the GLAS data can be used to add vertical distribution information to Aeronet aerosol measurements. As an EOS project instrument, GLAS data products are openly available to the science community. First year results from GLAS are summarized.

Spinhirne, J. D.↗

NASA NTRS2004

Global Aerosol Profiling by Orbital Lidar, GLAS Results and Validation

The Geoscience Laser Altimeter System (GLAS) launched in 2003 is the first polar orbiting satellite lidar. The instrument was designed for high performance observations of the distribution and optical scattering cross sections of clouds and aerosol. GLAS is approaching six months of on orbit data operation. These data from thousands of orbits illustrate the ability of space lidar to accurately and dramatically measure the height distribution of global aerosol to an unprecedented degree. There were many intended science applications of the GLAS data and significant results have already been realized. profiling is a fundamentally new measurement from space with multiple applications. A most important aerosol application is providing input to global aerosol generation and transport models. Another is improved measurement of aerosol optical depth. A main approach to verify the aerosol optical depth retrieval is comparison to surface measurements by Aeronet. A special feature of the GLAS satellite bus is to rapidly point the lidar instrument at off nadir targets with less than 100 m accuracy. About a dozen selected Aeronet sites were pointed at whenever the G U S lidar came within 5 degrees of zenith. These plus a more general comparison to nearby sites support the G U S data product values. In addition the GUS data can be used to add vertical distribution information to Aeronet aerosol measurements.. As an EOS project instrument, GLAS data products are openly available to the science community. First year results from G U S are summarized.

Spinhirne, J. D.↗

DOE OSTI2022

Use of Machine Learning on PMU Data for Transmission System Fault Analysis

Synchrophasor technology has been used for monitoring, control, and protection of bulk power system for over 10 years. Deployment of phasor measurement units (PMUs) in the USA power system has surpassed 3000 units installed in the transmission substations as stand-alone intelligent electronic devices (IEDs) or as a software add-on to other devices such as digital protective relays (DPRs) or digital fault recorders (DFRs). By now, thousands of terabytes of PMU data may have been captured and stored by various transmission system operators (TSOs) and independent system operators (ISOs). This creates an opportunity to deploy advanced machine learning (ML) techniques to detect and classify faults recorded by PMUs automatically to be used by the system operators for rapid, critical decision-making when manual analysis of the past or unfolding events is not feasible. In this paper we offer a brief background on how the automated fault analysis may be done using DPR and/or DFR data, and compare some of the legacy approaches to the new ML approaches in the context of the system-wide PMU recordings. We then offer insights from developing practical ML solutions that have been applied on field recordings captured by close to 450 PMUs from all three US interconnections (Western, Eastern and ERCOT) over two years (2016-2017). We identify and illustrate ML challenges we addressed: inaccurate data, data with scarce and temporally imprecise fault labels, data recorded by PMUs sparsely located at substations resulting in the fault records taken afar from the ends of the faulted lines, data containing only positive sequence values, and data taken at different voltage levels. We then illustrate the ML model results for fault analysis under different application scenarios. The novelty of this study is not only in the design, implementation, and performance analysis of the ML algorithms, but also in the use of advanced fault modelling and simulation approaches to improve the training results when developing supervised ML models for fault detection and classification. Extensive simulations of faults were conducted on a 14-bus power system to create a training dataset with over 1400 accurately labelled faults. This dataset was applied to enhance the accuracy of fault detection and classification of machine learning-based models trained with small number of labelled faults in large datasets recorded in the grid interconnections ranging from 5,000 to 70,000 buses.

Synchrophasors, Machine Learning, Fault Analysis, ↗

DOE OSTI2020

Denoising atomic resolution 4D scanning transmission electron microscopy data with tensor singular value decomposition

Tensor singular value decomposition (SVD) is a method to find a low-dimensional representation of data with meaningful structure in three or more dimensions. Here, tensor SVD has been applied to denoise atomic-resolution 4D scanning transmission electron microscopy (4D STEM) data. On data simulated from a SrTiO 3 [100] perfect crystal and a Si [110] edge dislocation, tensor SVD achieved an average peak signal-to-noise ratio (PSNR) of ~40 dB, which matches or exceeds the performance of other denoising methods, with processing times at least 100 times shorter. On experimental data from SrTiO 3 [100] and LiZnSb [11 2 ¯ 0]/GaSb [110] samples, tensor SVD denoises multiple GB 4D STEM data sets in ten minutes on a typical personal computer. Denoising with tensor SVD improves both convergent beam electron diffraction patterns and virtual-aperture annular dark field images.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Effective Missing Value Imputation Methods for Building Monitoring Data

To understand behaviors of natural and man-made events, such as energy consumption of buildings, which accounts for 40% of energy uses in the US, we deploy automated monitoring devices to record periodic observations. However, such experimental and observation data often contains problems and irregularities that have to be cleaned up before analyses. Due to various conditions affecting sensor operations, the communication channels, recording steps, or the recording media, the recorded data might have missing values, errors, or anomalous values. An effective way to clean up these problems is to replace these missing values, errors and anomalous values with expected values, a process generally known as imputation. In this work, we survey commonly used missing value imputation techniques and compare their performance on a set of building monitoring data. To compare the different types of sensor measurements with widely varying characteristics, we use normalized root mean squared error (NRMSE) as the key metric for the effectiveness of the imputation methods. We additionally consider periodicity and run time when considering comparing methods. Through extensive testing, we find that for small gap sizes, up to 8 consecutive missing values, linear interpolation performs the best; for larger gaps stretching up to 48 consecutive missing values, K-nearest neighbors provides the most accurate imputations; for even larger gaps, more computational intensive methods, such as matrix factorization, achieve the smallest NRMSE. Additionally, we observe that these computationally intensive algorithms not only provide accurate imputations for large gaps, but are also more robust across all types of sensors.

Cho, B↗

DOE OSTI2021

Geostatistical interpolation of streambed hydrologic attributes with addition of left censored data and anisotropy

Spatial geostatistical interpolation of point measurements of streambed attributes in the hyporheic zone may be constrained by the streambed anisotropy, and data density and spatial distribution may significantly impact the results. Spatial clustering and low spatial data density can be caused by bedrock outcropping at the streambed limiting installation of in-stream piezometers. This study examines parameter error variability of the geostatistical interpolation using anisotropic interpolation methods and increasing the data density by adding left censored values (i.e., data below measurement limit) to locations where measurements were limited by exposed bedrock lining the streambed. The reduction in relative standard error of the interpolation was determined for the spatial distributions of streambed attributes including hydraulic conductivity, seepage flux, and mercury solute flux measured in two different years along a study reach in East Fork Poplar Creek, Tennessee, USA. Here, two methods to impute the left censored values were compared including the conventional half the detection limit substitution method, and the Stochastic Approximation of Expectation-Maximization (SAEM) algorithm, which both had comparable results. Imputing left censored data increased the data density to recommended ranges, reduced data clustering, increased the spatial dependence for some attributes, and reduced the standard error for each of the three attributes. For the reach considered herein, addition of the left censored values resulted in a larger error reduction than the consideration of anisotropy within the interpolation, which confirms the benefit of data addition to increase data density within data-limited river corridors.

58 GEOSCIENCES↗

DOE OSTI2022

UAE6 - Wind Tunnel Tests Data - UAE6 - Sequence P - Raw Data

Sequence P: Wake Flow Visualization, Upwind (P) This test sequence used an upwind, rigid turbine with a 0° cone angle. The wind speed ranged from 5 m/s to 15 m/s. Yaw angles of 0° to –60° were achieved. The blade tip pitch was 3°. The rotor rotated at 72 RPM. Blade and probe pressure measurements were collected. The teeter dampers were replaced with rigid links, and these two channels were flagged as not applicable by setting the measured values in the data file to –99999.99 Nm. The teeter link load cell was pre-tensioned to 40,000 N. The aluminum blade tip designed to contain a smoke generator was installed, and counterweights were installed in the non-instrumented blade tip to compensate. The turbine was positioned at the appropriate yaw angle, and the smoke generator was ignited remotely. The campaign duration was 3 minutes for all tests except P1000000, which was 2 minutes. The file name convention was the standard format except for P10000A0, which indicated a 3° pitch angle. File P1000000 used a 12° pitch angle. After these two campaigns were collected, it was determined that all subsequent data should be collected with a 3° pitch angle. Pressure data were not acquired during this sequence, so all associated data values were flagged as not applicable by setting the measured values in the data file to 0.000 Pa. Corresponding pressure data are available from Sequence H for the 3° pitch angle test points. Flow visualization data obtained from wall- and ceiling-mounted video cameras were recorded to videotape. The camera locations and calibration procedures are described in Appendix J.

17 WIND ENERGY↗

NASA NTRS2024

Maximizing the Volume of Collocated Data from Two Coordinated Suborbital Platforms

Suborbital (e.g., airborne) campaigns that carry advanced remote sensing and in situ payloads provide detailed observations of atmospheric processes, but can be challenging to use when it is necessary to geographically collocate data from multiple platforms that make repeated observations of a given geographic location at different altitudes. This study reports on a data collocation algorithm that maximizes the volume of collocated data from two coordinated suborbital platforms and demonstrates its value using data from the NASA Aerosol Cloud Meteorology Interactions Over the western Atlantic Experiment (ACTIVATE) suborbital mission. A robust data collocation algorithm is critical for the success of the ACTIVATE mission goal to develop new and improved remote sensing algorithms, and quantify their performance. We demonstrate the value of these collocated data to quantify the performance of a recently developed vertically resolved lidar + polarimeter–derived aerosol particle number concentration (Na ) product, resulting in a range-normalized mean absolute deviation (NMAD) of 9% compared to in situ measurements. We also show that this collocation algorithm increases the volume of collocated ACTIVATE data by 21% compared to using only nearest-neighbor finding algorithms alone. Additional to the benefits demonstrated within this study, the data files and routines produced by this algorithm have solved both the critical collocation and the collocation application steps for researchers who require collocated data for their own studies. This freely available and open-source collocation algorithm can be applied to future suborbital campaigns that, like ACTIVATE, use multiple platforms to conduct coordinated observations, e.g., a remote sensing aircraft together with in situ data collected from suborbital platforms.

Atmosphere↗

DOE OSTI2014

The R-factor gap in macromolecular crystallography: an untapped potential for insights on accurate structures

In macromolecular crystallography, the agreement between observed and predicted structure factors (Rcryst and Rfree) is seldom better than 20%. This is much larger than the estimate of experimental error (Rmerge). The difference between Rcryst and Rmerge is the R-factor gap. There is no such gap in small-molecule crystallography, for which calculated structure factors are generally considered more accurate than the experimental measurements. Perhaps the true noise level of macromolecular data is higher than expected? Or is the gap caused by inaccurate phases that trap refined models in local minima? By generating simulated diffraction patterns using the program MLFSOM, and including every conceivable source of experimental error, we show that neither is the case. Processing our simulated data yielded values that were indistinguishable from those of real data for all crystallographic statistics except the final Rcryst and Rfree. These values decreased to 3.8% and 5.5% for simulated data, suggesting that the reason for high R-factors in macromolecular crystallography is neither experimental error nor phase bias, but rather an underlying inadequacy in the models used to explain our observations. The present inability to accurately represent the entire macromolecule with both its flexibility and its proteinsolvent interface may be improved by synergies between small-angle X-ray scattering, computational chemistry and crystallography. The exciting implication of our finding is that macromolecular data contain substantial hidden and untapped potential to resolve ambiguities in the true nature of the nanoscale, a task that the second century of crystallography promises to fulfill.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

UAE6 - Wind Tunnel Tests Data - UAE6 - Sequence 8 - Raw Data

Sequences 8 and 9: Downwind Sonics (F,P) and Downwind Sonics Parked (P) This test sequence used an upwind, rigid turbine with a 0° cone angle. The wind speed ranged from 5 m/s to 25 m/s. Yaw angles of 0° to 60° were achieved. The blade tip pitch was 3°. The rotor rotated at 72 RPM during Sequence 8, but it was parked during Sequence 9. Blade pressure measurements were collected. The five-hole probes were removed and the plugs were installed. Plastic tape 0.03-mm-thick was used to smooth the interface between the plugs and the blade. The teeter dampers were replaced with rigid links, and these two channels were flagged as not applicable by setting the measured values in the data file to –99999.99 Nm. The teeter link load cell was pre-tensioned to 40,000 N. During post-processing, the probe channels were set to read -99999.99. Sonic anemometers were mounted on a strut downwind of the turbine. The strut was mounted to the T-frame, which was rotated to align the anemometers aft of the 9% and 49% radius locations at hub height. Because of this configuration, the tunnel balance data are considered invalid. Sequence 9 was designed to compare the downwind sonic anemometer readings with the upwind sonic anemometers without interference from the turbine. The rotor was parked with the instrumented blade at 0° azimuth. All pressure measurements obtained in Sequence 9 are invalid because sufficient time for temperature stabilization did not occur, thus all associated data values were flagged as not applicable by setting the measured values in the data file to 0.0000 Pa. This test is further described in Appendix G.

17 WIND ENERGY↗

DOE OSTI2022

UAE6 - Wind Tunnel Tests Data - UAE6 - Sequence 9 - Raw Data

Sequences 8 and 9: Downwind Sonics (F,P) and Downwind Sonics Parked (P) This test sequence used an upwind, rigid turbine with a 0° cone angle. The wind speed ranged from 5 m/s to 25 m/s. Yaw angles of 0° to 60° were achieved. The blade tip pitch was 3°. The rotor rotated at 72 RPM during Sequence 8, but it was parked during Sequence 9. Blade pressure measurements were collected. The five-hole probes were removed and the plugs were installed. Plastic tape 0.03-mm-thick was used to smooth the interface between the plugs and the blade. The teeter dampers were replaced with rigid links, and these two channels were flagged as not applicable by setting the measured values in the data file to –99999.99 Nm. The teeter link load cell was pre-tensioned to 40,000 N. During post-processing, the probe channels were set to read -99999.99. Sonic anemometers were mounted on a strut downwind of the turbine. The strut was mounted to the T-frame, which was rotated to align the anemometers aft of the 9% and 49% radius locations at hub height. Because of this configuration, the tunnel balance data are considered invalid. Sequence 9 was designed to compare the downwind sonic anemometer readings with the upwind sonic anemometers without interference from the turbine. The rotor was parked with the instrumented blade at 0° azimuth. All pressure measurements obtained in Sequence 9 are invalid because sufficient time for temperature stabilization did not occur, thus all associated data values were flagged as not applicable by setting the measured values in the data file to 0.0000 Pa. This test is further described in Appendix G.

17 WIND ENERGY↗

DOE OSTI2017

I/O routing in a multidimensional torus network

A method, system and computer program product are disclosed for routing data packet in a computing system comprising a multidimensional torus compute node network including a multitude of compute nodes, and an I/O node network including a plurality of I/O nodes. In one embodiment, the method comprises assigning to each of the data packets a destination address identifying one of the compute nodes; providing each of the data packets with a toio value; routing the data packets through the compute node network to the destination addresses of the data packets; and when each of the data packets reaches the destination address assigned to said each data packet, routing said each data packet to one of the I/O nodes if the toio value of said each data packet is a specified value. In one embodiment, each of the data packets is also provided with an ioreturn value used to route the data packets through the compute node network.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2018

I/O routing in a multidimensional torus network

A method, system and computer program product are disclosed for routing data packet in a computing system comprising a multidimensional torus compute node network including a multitude of compute nodes, and an I/O node network including a plurality of I/O nodes. In one embodiment, the method comprises assigning to each of the data packets a destination address identifying one of the compute nodes; providing each of the data packets with a toio value; routing the data packets through the compute node network to the destination addresses of the data packets; and when each of the data packets reaches the destination address assigned to said each data packet, routing said each data packet to one of the I/O nodes if the toio value of said each data packet is a specified value. In one embodiment, each of the data packets is also provided with an ioreturn value used to route the data packets through the compute node network.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

I/O routing in a multidimensional torus network

A method, system and computer program product are disclosed for routing data packet in a computing system comprising a multidimensional torus compute node network including a multitude of compute nodes, and an I/O node network including a plurality of I/O nodes. In one embodiment, the method comprises assigning to each of the data packets a destination address identifying one of the compute nodes; providing each of the data packets with a toio value; routing the data packets through the compute node network to the destination addresses of the data packets; and when each of the data packets reaches the destination address assigned to said each data packet, routing said each data packet to one of the I/O nodes if the toio value of said each data packet is a specified value. In one embodiment, each of the data packets is also provided with an ioreturn value used to route the data packets through the compute node network.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

I/O routing in a multidimensional torus network

A method, system and computer program product are disclosed for routing data packet in a computing system comprising a multidimensional torus compute node network including a multitude of compute nodes, and an I/O node network including a plurality of I/O nodes. In one embodiment, the method comprises assigning to each of the data packets a destination address identifying one of the compute nodes; providing each of the data packets with a toio value; routing the data packets through the compute node network to the destination addresses of the data packets; and when each of the data packets reaches the destination address assigned to said each data packet, routing said each data packet to one of the I/O nodes if the toio value of said each data packet is a specified value. In one embodiment, each of the data packets is also provided with an ioreturn value used to route the data packets through the compute node network.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

I/O routing in a multidimensional torus network

A method, system and computer program product are disclosed for routing data packet in a computing system comprising a multidimensional torus compute node network including a multitude of compute nodes, and an I/O node network including a plurality of I/O nodes. In one embodiment, the method comprises assigning to each of the data packets a destination address identifying one of the compute nodes; providing each of the data packets with a toio value; routing the data packets through the compute node network to the destination addresses of the data packets; and when each of the data packets reaches the destination address assigned to said each data packet, routing said each data packet to one of the I/O nodes if the toio value of said each data packet is a specified value. In one embodiment, each of the data packets is also provided with an ioreturn value used to route the data packets through the compute node network.

Chen, Dong↗

DOE OSTI2016

The high-temperature heat capacity of the (Th,U)O 2 and (U,Pu)O 2 solid solutions

The enthalpy increment data for the (Th,U)O 2 and (U,Pu)O 2 solid solutions are reviewed and complemented with new experimental data (400–1773 K) and many-body potential model simulations. The results of the review show that from room temperature up to about 2000 K the enthalpy data are in agreement with the additivity rule (Neumann-Kopp) in the whole composition range. Above 2000 K the effect of Oxygen Frenkel Pair (OFP) formation leads to an excess enthalpy (heat capacity) that is modeled using the enthalpy and entropy of OFP formation from the end-members. Here, a good agreement with existing experimental work is observed, and a reasonable agreement with the results of the many-body potential model, which indicate the presence of the diffuse Bredig (superionic) transition that is not found in the experimental enthalpy increment data.

36 MATERIALS SCIENCE↗

DOE OSTI2018

Multi-wavelength characterization of the blazar S5 0716+714 during an unprecedented outburst phase

Context. The BL Lac object S5 0716+714, a highly variable blazar, underwent an impressive outburst in January 2015 (Phase A), followed by minor activity in February (Phase B). The MAGIC observations were triggered by the optical flux observed in Phase A, corresponding to the brightest ever reported state of the source in the R-band. Aims.The comprehensive dataset collected is investigated in order to shed light on the mechanism of the broadband emission. Methods. Multi-wavelength light curves have been studied together with the broadband spectral energy distributions (SEDs). The sample includes data from Effelsberg, OVRO, Metsähovi, VLBI, CARMA, IRAM, SMA, Swift-UVOT, KVA, Tuorla, Steward, RINGO3, KANATA, AZT-8+ST7, Perkins, LX-200, Swift-XRT, NuSTAR, Fermi-LAT and MAGIC. Results. The flaring state of Phase A was detected in all the energy bands, providing for the first time a multi-wavelength sample of simultaneous data from the radio band to the very-high-energy (VHE, E > 100 GeV). In the constructed SED, the Swift-XRT+NuSTAR data constrain the transition between the synchrotron and inverse Compton components very accurately, while the second peak is constrained from 0.1 GeV to 600 GeV by Fermi+MAGIC data. The broadband SED cannot be described with a one-zone synchrotron self-Compton model as it severely underestimates the optical flux in order to reproduce the X-ray to γ-ray data. Instead we use a two-zone model. The electric vector position angle (EVPA) shows an unprecedented fast rotation. An estimation of the redshift of the source by combined high-energy (HE, 0.1 GeV < E < 100 GeV) and VHE data provides a value of z = 0.31 ± 0.02 stats ± 0.05 sys , confirming the literature value. Conclusions. The data show the VHE emission originating in the entrance and exit of a superluminal knot in and out of a recollimation shock in the inner jet. A shock–shock interaction in the jet seems responsible for the observed flares and EVPA swing. Finally, this scenario is also consistent with the SED modeling.

79 ASTRONOMY AND ASTROPHYSICS↗