Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Variables”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Discovering the Unknowns: A First Step

This article aims at discovering the unknown variables in the system through data analysis. The main idea is to use the time of data collection as a surrogate variable and try to identify the unknown variables by modeling gradual and sudden changes in the data. We use Gaussian process modeling and a sparse representation of the sudden changes to efficiently estimate the large number of parameters in the proposed statistical model. The method is tested on a realistic dataset generated using a one-dimensional implementation of a Magnetized Liner Inertial Fusion (MagLIF) simulation model, and encouraging results are obtained.

42 ENGINEERING↗

Effects of random forest modeling decisions on biogeochemical time series predictions

Abstract Random forests (RF) are an increasingly popular machine learning approach used to model biogeochemical processes in the Earth system. While RF models are robust to many assumptions that complicate deterministic models, there are several important parameterization decisions for appropriate use and optimal model fit. We explored the role that parameter decisions, including training/testing data splitting strategies, variable selection, and hyperparameters play on RF goodness‐of‐fit by constructing models using 1296 unique parameter combinations to predict concentrations of nitrate, a key nutrient for biogeochemical cycling in aquatic ecosystems. Models were built on long‐term, publicly available water quality and meteorology time series collected by the National Estuarine Research Reserve monitoring network for two contrasting ecosystems representing freshwater and brackish estuaries. We found that accounting for temporal dependence when splitting data into training and testing subsets was key for avoiding over‐estimation of model predictive power. In addition, variable selection, the ratio of training to testing data, and to a lesser degree, variables per split and number of trees, were significant parameters for optimizing RF goodness‐of‐fit. We also explored how model parameter decisions influenced interpretation of the relative importance of predictors to the model, and model predictor‐dependent variable relationships, with results suggesting that both data structure and model parameterization influence these factors. Because much of the current RF literature is written for the computational and statistical science communities, the primary goal of this study is to provide guidelines for aquatic scientists new to machine learning to apply RF techniques appropriately to aquatic biogeochemical datasets.

54 ENVIRONMENTAL SCIENCES↗

Modeling Stochastic Variability in Multiband Time-series Data

In preparation for the era of time-domain astronomy with upcoming large-scale surveys, we propose a state-space representation of a multivariate damped random walk process as a tool to analyze irregularly-spaced multifilter light curves with heteroscedastic measurement errors. We adopt a computationally efficient and scalable Kalman filtering approach to evaluate the likelihood function, leading to maximum O(k 3 n) complexity, where k is the number of available bands and n is the number of unique observation times across the k bands. This is a significant computational advantage over a commonly used univariate Gaussian process that can stack up all multiband light curves in one vector with maximum O(k 3 n 3 ) complexity. Using such efficient likelihood computation, we provide both maximum likelihood estimates and Bayesian posterior samples of the model parameters. Three numerical illustrations are presented: (i) analyzing simulated five-band light curves for a comparison with independent single-band fits; (ii) analyzing five-band light curves of a quasar obtained from the Sloan Digital Sky Survey Stripe 82 to estimate short-term variability and timescale; (iii) analyzing gravitationally lensed g- and r-band light curves of Q0957+561 to infer the time delay. Two R packages, Rdrw and timedelay, are publicly available to fit the proposed models.

79 ASTRONOMY AND ASTROPHYSICS↗

Meteorological data from the Billy Bar site at the East River, Colorado

This dataset includes Quality Assessed and Quality Controlled (QA/QC) meteorological data from the Billy Bar field site in the East River Watershed, Colorado in order to inform watershed hydrobiogeochemical processes. The data includes 1-hour aligned time series of Solar Radiation, Wind Speed, Wind Direction, Air Temperature, Relative Humidity, Barometric Pressure, and Precipitation. For each parameter, the QA flags are given: 1 is for extreme (potential abnormal values), and 0 is for values in the expected range. The Rmarkdown document is a stand-alone file/notebook that preserves the text, code, and code results, as well as formatting contained in the original R script. The Data profiling report is a summary and graphical presentation of the data exploration process for data analysis and model building, so that users could focus on understanding data and extracting insights. The report provides a summary of each variable and does data profiling.

54 ENVIRONMENTAL SCIENCES↗

Remote Structural Health Monitoring and Advanced Prognostics of Wind Turbines

The prospect of substantial investment in wind energy generation represents a significant capital investment strategy. In order to maximize the life-cycle of wind turbines, associated rotors, gears, and structural towers, a capability to detect and predict (prognostics) the onset of mechanical faults at a sufficiently early stage for maintenance actions to be planned would significantly reduce both maintenance and operational costs. Advancement towards this effort has been made through the development of anomaly detection, fault detection and fault diagnosis routines to identify selected fault modes of a wind turbine based on available sensor data preceding an unscheduled emergency shutdown. The anomaly detection approach employs spectral techniques to find an approximation of the data using a combination of attributes that capture the bulk of variability in the data. Fault detection and diagnosis (FDD) is performed using a neural network-based classifier trained from baseline and fault data recorded during known failure conditions. The approach has been evaluated for known baseline conditions and three selected failure modes: pitch rate failure, low oil pressure failure and a gearbox gear-tooth failure. Experimental results demonstrate the approach can distinguish between these failure modes and normal baseline behavior within a specified statistical accuracy.

17 WIND ENERGY↗

Variable rate neural compression for sparse detector data

Particle colliders produce data at extraordinary rates, posing major challenges for transmission and storage. High-throughput compression algorithms are therefore essential. In the sPHENIX experiment taking data at the Relativistic Heavy Ion Collider, a time projection chamber records three-dimensional (3D) particle trajectories that are highly sparse, making conventional learning-free lossy compression ineffective. Convolutional neural networks have surpassed traditional methods in compression ratio and accuracy. However, they fail to exploit sparsity for efficiency. To address these gaps, we present BCAE-VS, a bicephalous convolutional autoencoder with variable compression ratio for sparse data, which adapts compression to input complexity through key-point identification and sparse convolution. BCAE-VS achieves higher accuracy and compression ratios than prior neural approaches while being orders of magnitude smaller. Moreover, its throughput increases with sparsity—a property not observed in other methods. Although it was developed for collider experiments, BCAE-VS readily extends to other sparse data domains, such as light detection and ranging (LiDAR) sensing and 3D microscopy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Sub-Hour Solar Data for Power System Modeling From Static Spatial Variability Analysis: Preprint

High penetration renewable integration studies need high quality solar power data with spatial-temporal correlations that are representative of a real system. This paper will summarize the research relating sequential point-source sub-hour global horizontal irradiance (GHI) values to static, spatially distributed GHI values. This research led to the development of an algorithm for generatingcoherent sub-hour datasets that span distances ranging from 10 km to 4,000 km. The algorithm, in brief, generates synthetic GHI values at an interval of one-minute, for a specific location, using SUNY/Clean Power Research, satellite-derived, hourly irradiance values for the nearest grid cell to that location and grid cells within 40 km.

14 SOLAR ENERGY↗

Decoding the shift-invariant data: applications for band-excitation scanning probe microscopy *

A shift-invariant variational autoencoder (shift-VAE) is developed as an unsupervised method for the analysis of spectral data in the presence of shifts along the parameter axis, disentangling the physically-relevant shifts from other latent variables. Using synthetic data sets, we show that the shift-VAE latent variables closely match the ground truth parameters. The shift VAE is extended towards the analysis of band-excitation piezoresponse force microscopy data, disentangling the resonance frequency shifts from the peak shape parameters in a model-free unsupervised manner. The extensions of this approach towards denoising of data and model-free dimensionality reduction in imaging and spectroscopic data are further demonstrated. This approach is universal and can also be extended to analysis of x-ray diffraction, photoluminescence, Raman spectra, and other data sets.

36 MATERIALS SCIENCE↗

Polarization and variability of compact sources measured in Planck time-ordered data

This paper introduces a new Planck Catalog of Polarized and Variable Compact Sources (PCCS-PV) comprising 153 sources, the majority of which are extragalactic. The data include both the total flux density and linear polarization measured by Planck with frequency coverage from 30 to 353 GHz, and temporal spacing ranging from days to years. We classify most sources as beamed, extragalactic radio sources; the catalog also includes several radio galaxies, Seyfert galaxies, and Galactic and Magellanic Cloud sources, including H II regions and planetary nebulae. An advanced extraction method applied directly to the multifrequency Planck time-ordered data, rather than the mission sky maps, was developed to allow an assessment of the variability of polarized sources. Our analysis of the time-ordered data from the Planck mission, tod2flux, allowed us to catalog the time-varying emission and polarization properties for these sources at the full range of polarized frequencies employed by Planck, 30-353 GHz. PCCS-PV provides the time-and frequency-dependent, polarized flux densities for all 153 sources. To illustrate some potential applications of the PCCS-PV, we conducted preliminary comparisons of our measurements of selected sources with published data from other astronomical instruments. In summary, we find general agreement between the Planck and the Institut de Radioastronomie Millimétrique (IRAM) polarization measurements as well as with the Metsähovi 37 GHz values at closely similar epochs. Here, these combined measurements also show the value of PCCS-PV results and the PCCS2 catalog for filling in missing spectral (or temporal) coverage and helping to define the spectral energy distributions of extragalactic sources. In turn, these results provide useful clues as to the physical properties of the sources.

79 ASTRONOMY AND ASTROPHYSICS↗

Horizontal-Velocity and Variance Measurements in the Stable Boundary Layer Using Doppler Lidar: Sensitivity to Averaging Procedures

Quantitative data on turbulence variables aloft--above the region of the atmosphere conveniently measured from towers--has been an important but difficult measurement need for advancing understanding and modeling of the stable boundary layer (SBL). Vertical profiles of streamwise velocity variances obtained from NOAA’s High Resolution Doppler Lidar (HRDL), which have been shown to be numerically equivalent to turbulence kinetic energy (TKE) for stable conditions, are a measure of the turbulence in the SBL. In the present study, the mean horizontal wind component U and variance σu2 were computed from HRDL measurements of the line-of-sight (LOS) velocity using a technique described in Banta, et al. (2002). The technique was tested on datasets obtained during the Lamar Low-Level Jet Project (LLLJP) carried out in early September 2003, near the town of Lamar in southeastern Colorado. This paper compares U with mean wind speed obtained from sodar and sonic anemometer measurements. It then describes several series of averaging tests that produced the best correlation between TKE calculated from sonic anemometer data at several tower levels and lidar measurements of horizontal velocity variance σu2. The results show high correlation (0.71-0.97) of the mean U and average wind speed measured by sodar and in-situ instruments, independent of sampling strategies and averaging procedures. Comparison of estimates of variance, on the other hand, proved sensitive to both the spatial and temporal averaging techniques.

54 ENVIRONMENTAL SCIENCES↗

Journey to Time-Variable Moment Tensors through Inversion of Acoustic and Seismoacoustic Data

We explore the capability of acoustic and seismoacoustic datasets to directly resolve a complex, time-variable source consisting of a buried mechanism, represented as a moment tensor, and a spall mechanism, represented as a vertical force at the surface. Traditionally, each component of a resolved moment tensor assumes one underlying source time function, which likely fails to capture the full evolution of a dynamic source, such as an explosion followed by slip on near-source joints or development of spallation. Specifically, we expand previous work to resolve a time-variable moment tensor using single-modality and joint-modality inversion frameworks through analysis of infrasound and seismoacoustic data recorded as part of the Source Physics Experiment Phase II: Dry Alluvium Geology (DAG). We investigate the impact of including signals from seismic-to-air coupling that are local to each infrasound sensor in comparison to mainly atmosphere-propagating acoustic signals, which occur from coupling of the wavefield from the subsurface to the atmosphere directly above the source. Additionally, we assess the ability of our inversion algorithm to fit observed infrasound data using a variety of time-variable source mechanisms. First, we consider the buried moment tensor source alone, which assumes that the determined Green’s functions incorporate effects from spallation or that the impact from spallation is minimal. Second, we examine the estimated buried moment tensor and vertical surface spallation as terms that must both be resolved in the inversion. Third, we assess the ability for an estimated vertical surface spallation source to fit the acoustic data on its own. Finally, we compare results from the joint inversion of both seismic geophone and infrasound acoustic data for the buried-only source compared to buried and spallation sources. Our results are a preliminary investigation into the applications of the inversion technique to recorded datasets and show the technique has limited capabilities using acoustic data alone. Instead, this method shows promise for seismic and seismoacoustic datasets to resolve the time-variable mechanisms of a buried source.

47 OTHER INSTRUMENTATION↗

Alpha1 LASSO data bundles Lamont, OK

A data bundle is a unified package consisting of LASSO LES input and output, observations, evaluation diagnostics, and model skill scores. LES input includes model configuration information and forcing data. LES output includes profile statistics and full domain fields of cloud and environmental variables. Model evaluation data consists of LES output and ARM observations co-registered on the same grid and sampling frequency. Model performance is quantified by skill scores and diagnostics in terms of cloud and environmental variables.

54 ENVIRONMENTAL SCIENCES↗

LASSO Data Bundles

The Alpha 2 release is the second release from the LASSO Pilot Phase that builds upon the Alpha 1 release. Alpha 2 contains additional diagnostics in the data bundles and focuses on cases from spring-summer 2016. A data bundle is a unified package consisting of LASSO LES input and output, observations, evaluation diagnostics, and model skill scores. LES input include model configuration information and forcing data. LES output includes profile statistics and full domain fields of cloud and environmental variables. Model evaluation data consists of LES output and ARM observations co-registered on the same grid and sampling frequency. Model performance is quantified by skill scores and diagnostics in terms of cloud and environmental variables.

54 ENVIRONMENTAL SCIENCES↗

LIP: The Livermore Interpolation Package, Version 1.3

This report describes LIP, the Livermore Interpolation Package. Because LIP is a stand-alone version of the interpolation package in the Livermore Equation of State (LEOS) access library, the initials LIP alternatively stand for the ''LEOS Interpolation Package''. LIP was totally rewritten from the package described in [1]. In particular, the independent variables are now referred to as x and y, since the package need not be restricted to equation of state data, which uses variables {rho} (density) and T (temperature). LIP is primarily concerned with the interpolation of two-dimensional data on a rectangular mesh. The interpolation methods provided include piecewise bilinear, reduced (12-term) bicubic, and bicubic Hermite (biherm). There is a monotonicity-preserving variant of the latter, known as bimond. For historical reasons, there is also a biquadratic interpolator, but this option is not recommended for general use. A birational method was added at version 1.3. In addition to direct interpolation of two-dimensional data, LIP includes a facility for inverse interpolation (at present, only in the second independent variable). For completeness, however, the package also supports a compatible one-dimensional interpolation capability. Parametric interpolation of points on a two-dimensional curve can be accomplished by treating the components as a pair of one-dimensional functions with a common independent variable. LIP has an object-oriented design, but it is implemented in ANSI Standard C for efficiency and compatibility with existing applications. First, a ''LIP interpolation object'' is created and initialized with the data to be interpolated. Then the interpolation coefficients for the selected method are computed and added to the object. Since version 1.1, LIP has options to instead estimate derivative values or merely store data in the object. (These are referred to as ''partial setup'' options.) It is then possible to pass the object to functions that interpolate or invert the interpolant at an arbitrary number of points. The first section of this report describes the overall design of the package, including both forward and inverse interpolation. Sections 2-6 describe each interpolation method in detail. The software that implements this design is summarized function-by-function in Section 7. For a complete example of package usage, refer to Section 8. The report concludes with a few brief notes on possible software enhancements. For guidance on adding other functional forms to LIP, refer to Appendix B. The reader who is primarily interested in using LIP to solve a problem should skim Section 1, then skip to Sections 7.1-4. Finally, jump ahead to Section 8 and study the example. The remaining sections can be referred to in case more details are desired. Changes since version 1.1 of this document include the new Section 3.2.1 that discusses derivative estimation and new Section 6 that discusses the birational interpolation method. Section numbers following the latter have been modified accordingly.

97 MATHEMATICS AND COMPUTING↗

LIP: The Livermore Interpolation Package, Version 1.4

This report describes LIP, the Livermore Interpolation Package. Because LIP is a stand-alone version of the interpolation package in the Livermore Equation of State (LEOS) access library, the initials LIP alternatively stand for the 'LEOS Interpolation Package'. LIP was totally rewritten from the package described in [1]. In particular, the independent variables are now referred to as x and y, since the package need not be restricted to equation of state data, which uses variables {rho} (density) and T (temperature). LIP is primarily concerned with the interpolation of two-dimensional data on a rectangular mesh. The interpolation methods provided include piecewise bilinear, reduced (12-term) bicubic, and bicubic Hermite (biherm). There is a monotonicity-preserving variant of the latter, known as bimond. For historical reasons, there is also a biquadratic interpolator, but this option is not recommended for general use. A birational method was added at version 1.3. In addition to direct interpolation of two-dimensional data, LIP includes a facility for inverse interpolation (at present, only in the second independent variable). For completeness, however, the package also supports a compatible one-dimensional interpolation capability. Parametric interpolation of points on a two-dimensional curve can be accomplished by treating the components as a pair of one-dimensional functions with a common independent variable. LIP has an object-oriented design, but it is implemented in ANSI Standard C for efficiency and compatibility with existing applications. First, a 'LIP interpolation object' is created and initialized with the data to be interpolated. Then the interpolation coefficients for the selected method are computed and added to the object. Since version 1.1, LIP has options to instead estimate derivative values or merely store data in the object. (These are referred to as 'partial setup' options.) It is then possible to pass the object to functions that interpolate or invert the interpolant at an arbitrary number of points. The first section of this report describes the overall design of the package, including both forward and inverse interpolation. Sections 2-6 describe each interpolation method in detail. The software that implements this design is summarized function-by-function in Section 7. For a complete example of package usage, refer to Section 8. The report concludes with a few brief notes on possible software enhancements. For guidance on adding other functional forms to LIP, refer to Appendix B. The reader who is primarily interested in using LIP to solve a problem should skim Section 1, then skip to Sections 7.1-4. Finally, jump ahead to Section 8 and study the example. The remaining sections can be referred to in case more details are desired. Changes since version 1.1 of this document include the new Section 3.2.1 that discusses derivative estimation and new Section 6 that discusses the birational interpolation method. Section numbers following the latter have been modified accordingly.

97 MATHEMATICS AND COMPUTING↗

LIP: The Livermore Interpolation Package Version 1.1

This report describes LIP, the Livermore Interpolation Package. Because LIP is a standalone version of the interpolation package in the Livermore Equation of State (LEOS) access library, the initials LIP alternatively stand for the 'LEOS Interpolation Package'. LIP was totally rewritten from the package described in. In particular, the independent variables are now referred to as x and y, since the package need not be restricted to equation of state data, which uses variables {rho} (density) and T (temperature). LIP is primarily concerned with the interpolation of two-dimensional data on a rectangular mesh. The interpolation methods provided include piecewise bilinear, reduced (12-term) bicubic, and bicubic Hermite (biherm). There is a monotonicity-preserving variant of the latter, known as bimond. For historical reasons, there is also a biquadratic interpolator, but this option is not recommended for general use. In addition to direct interpolation of two-dimensional data, LIP includes a facility for inverse interpolation (at present, only in the second independent variable). For completeness, however, the package also supports a compatible one-dimensional interpolation capability. Parametric interpolation of points on a two-dimensional curve can be accomplished by treating the components as a pair of one-dimensional functions with a common independent variable. LIP has an object-oriented design, but it is implemented in ANSI Standard C for efficiency and compatibility with existing applications. First, a 'LIP interpolation object' is created and initialized with the data to be interpolated. Then the interpolation coefficients for the selected method are computed and added to the object. The current version has options to instead estimate derivative values or merely store data in the object. It is then possible to pass the object to functions that interpolate or invert the interpolant at an arbitrary number of points. The first section of this report describes the overall design of the package, including both forward and inverse interpolation. Sections 2-5 describe each interpolation method in detail. The software that implements this design is summarized function-by-function in Section 6. For a complete example of package usage, refer to Section 7. The report concludes with a few brief notes on possible software enhancements. For guidance on adding other functional forms to LIP, refer to Appendix B. The reader who is primarily interested in using LIP to solve a problem should skim Section 1, then skip to Sections 6.1-4. Finally, jump ahead to Section 7 and study the example. The remaining sections can be referred to in case more details are desired. Changes since the previous version of this document include the new Section 1.4 that discusses partial setup options and Section 6.3 that discusses the new function lip{_}setup{_}interp that implements them. Section 6.1 and the example in Section 7 have been modified accordingly.

99 GENERAL AND MISCELLANEOUS↗

Explainable Machine Learning for Functional Data

Black-box machine learning models are recognized as useful tools for prediction applications, but the algorithmic complexity of some models causes interpretation challenges. Explainability methods have been proposed to provide insight into these models, but there is little research focused on supervised modeling with functional data inputs. We argue that, especially in applications of high consequence, it is important to explicitly model the functional dependence in a black-box analysis to not obscure or misrepresent patterns in explanations. As such, we propose the V ariable importance E xplainable E lastic S hape A nalysis (VEESA) pipeline for training supervised machine learning models with functional inputs. The pipeline is an analysis process that includes the data preprocessing, modeling, and post-hoc explanations. The preprocessing is done using elastic functional principal components analysis, which accounts for vertical and horizontal variability in functional data and, ultimately, allows for explanations in the original data space that identify the important functional variability without bias due to correlated variables. Here, we demonstrate the pipeline on two high-consequence applications: explosives classification for national security and inkjet printer identification in forensic science. The applications exhibit the VEESA pipeline’s ability to provide an understanding of the characteristics of the functional data useful for prediction. Code for implementing the pipeline is available in the veesa R package (and supplemental python code).

Elastic Shape Analysis↗

Separated kaon electroproduction cross section and the kaon form factor from 6 GeV JLab data

The 1 H(e,e ' K + )Λ reaction was studied as a function of the Mandelstam variable -t using data from the E01-004 (FPI-2) and E93-018 experiments that were carried out in Hall C at the 6 GeV Jefferson Laboratory. The cross section was fully separated into longitudinal and transverse components, and two interference terms at four-momentum transfers Q 2 of 1.00, 1.36, and 2.07 GeV 2 . The kaon form factor was extracted from the longitudinal cross section using the Regge model by Vanderhaeghen et al. [Phys. Rev. C 57, 1454 (1998)]. Here, the results establish the method, previously used successfully for pion analyses, for extracting the kaon form factor. Data from 12 GeV Jefferson Laboratory experiments are expected to have sufficient precision to distinguish between theoretical predictions, for example, recent perturbative QCD calculations with modern parton distribution amplitudes. The leading-twist behavior for light mesons is predicted to set in for values of Q 2 between 5 and 10 GeV 2 , which makes data in the few-GeV regime particularly interesting. Finally, the Q 2 dependence at fixed x and -t of the longitudinal cross section that we extracted seems consistent with the QCD factorization prediction within the experimental uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗