Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Variables”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Distributed non-negative matrix factorization with determination of the number of latent features

The holistic analysis and understanding of the latent (that is, not directly observable) variables and patterns buried in large datasets is crucial for data-driven science, decision making and emergency response. Such exploratory analyses require devising unsupervised learning methods for data mining and extraction of the latent features, and non-negative matrix factorization (NMF) is one of the prominent such methods. NMF is based on compute-intense non-convex constrained minimization, which, for large datasets requires fast and distributed algorithms. However, current parallel implementations of NMF fail to estimate the number of latent features. In practice, identifying these features is both difficult and significant for pattern recognition and latent feature analysis, especially for large dense matrices. Here, we introduce a distributed NMF algorithm coupled with distributed custom clustering followed by a stability analysis on dense data, which we call DnMFk, to determine the number of latent variables. The results on synthetic data and the classical Swimmer data set demonstrate the accuracy of model determination while scaling nearly linearly across multiple processors for large data. Further, we employ DnMFk to determine the number of hidden features from a terabyte matrix.

97 MATHEMATICS AND COMPUTING↗

CONTROL AND DATA ACQUISITION IN A CYBER-PHYSICAL MIDSTREAM TESTBED

This thesis presents the development of a laboratory-scale cyber–physical midstream pipeline testbed designed to address this gap and support research in industrial control systems security. The platform integrates pumps, valves, sensors, programmable logic controllers (PLCs), and a human–machine interface (HMI) to emulate the monitoring and control architecture of real pipeline operations. The physical process is implemented as a closed-loop liquid circulation system designed to replicate flow behavior characteristic of midstream pipeline infrastructure. The testbed enables real-time data acquisition of key process variables, including flow rate and pressure facilitating the generation of datasets representative of normal pipeline operation. A threat model encompassing common ICS attack vectors was developed, including sensor spoofing, command injection, false data injection, denial-of-service attacks, and relay manipulation. Multiple attack scenarios were implemented and evaluated to demonstrate how cyber intrusions targeting sensors, actuators, networks, and software propagate into measurable physical consequences in pipeline flow and pressure. The developed platform serves as a practical, cost-effective environment for experimentation, education, and future cybersecurity research in midstream pipeline systems.

42 ENGINEERING↗

A comparison of model validation approaches for echo state networks using climate model replicates

As global temperatures continue to rise, climate mitigation strategies such as stratospheric aerosol injections (SAI) are increasingly discussed, but the downstream effects of these strategies are not well understood. As such, there is interest in developing statistical methods to quantify the evolution of climate variable relationships during the time period surrounding an SAI. Feature importance applied to echo state network (ESN) models has been proposed as a way to understand the effects of SAI using a data-driven model. This approach depends on the ESN fitting the data well. If not, the feature importance may place importance on features that are not representative of the underlying relationships. Typically, time series prediction models such as ESNs are assessed using out-of-sample performance metrics that divide the times series into separate training and testing sets. However, this model assessment approach is geared towards forecasting applications and not scenarios such as the motivating SAI example where the objective is using a data driven model to capture variable relationships. Here, in this paper, we demonstrate a novel use of climate model replicates to investigate the applicability of the commonly used repeated hold-out model assessment approach for the SAI application. Simulations of an SAI are generated using a simplified climate model, and different initialization conditions are used to provide independent training and testing sets containing the same SAI event. The climate model replicates enable out-of-sample measures of model performance, which are compared to the single time series hold-out validation approach. For our case study, it is found that the repeated hold-out sample performance is comparable, but conservative, to the replicate out-of-sample performance when the training set contains enough time after the aerosol injection.

54 ENVIRONMENTAL SCIENCES↗

Gaussian processes for autonomous data acquisition at large-scale synchrotron and neutron facilities

The execution and analysis of complex experiments are challenged by the vast dimensionality of the underlying parameter spaces. Although an increase in data-acquisition rates should allow broader querying of the parameter space, the complexity of experiments and the subtle dependence of the model function on input parameters remains daunting owing to the sheer number of variables. New strategies for autonomous data acquisition are being developed, with one promising direction being the use of Gaussian process regression (GPR). GPR is a quick, non-parametric and robust approximation and uncertainty quantification method that can be applied directly to autonomous data acquisition. We review GPR-driven autonomous experimentation and illustrate its functionality using real-world examples from large experimental facilities in the USA and France. We introduce the basics of a GPR-driven autonomous loop with a focus on Gaussian processes, and then shift the focus to the infrastructure that needs to be built around GPR to create a closed loop. Finally, the case studies we discuss show that Gaussian-process-based autonomous data acquisition is a widely applicable method that can facilitate the optimal use of instruments and facilities by enabling the efficient acquisition of high-value datasets.

36 MATERIALS SCIENCE↗

THE CATALINA SURVEYS PERIODIC VARIABLE STAR CATALOG

We present ∼47,000 periodic variables found during the analysis of 5.4 million variable star candidates within a 20,000 deg{sup 2} region covered by the Catalina Surveys Data Release-1 (CSDR1). Combining these variables with type ab RR Lyrae from our previous work, we produce an online catalog containing periods, amplitudes, and classifications for ∼61,000 periodic variables. By cross-matching these variables with those from prior surveys, we find that >90% of the ∼8000 known periodic variables in the survey region are recovered. For these sources, we find excellent agreement between our catalog and prior values of luminosity, period, and amplitude as well as classification. We investigate the rate of confusion between objects classified as contact binaries and type c RR Lyrae (RRc's) based on periods, colors, amplitudes, metallicities, radial velocities, and surface gravities. We find that no more than a few percent of the variables in these classes are misidentified. By deriving distances for this clean sample of ∼5500 RRc's, we trace the path of the Sagittarius tidal streams within the Galactic halo. Selecting 146 outer-halo RRc's with SDSS radial velocities, we confirm the presence of a coherent halo structure that is inconsistent with current N-body simulations of the Sagittarius tidal stream. We also find numerous long-period variables that are very likely associated within the Sagittarius tidal stream system. Based on the examination of 31,000 contact binary light curves we find evidence for two subgroups exhibiting irregular light curves. One subgroup presents significant variations in mean brightness that are likely due to chromospheric activity. The other subgroup shows stable modulations over more than a thousand days and thereby provides evidence that the O'Connell effect is not due to stellar spots.

79 ASTRONOMY AND ASTROPHYSICS↗

S-Preconditioner for Multi-fold Data Reduction with Guaranteed User-Controlled Accuracy

The growing gap between the massive amounts of data generated by petascale scientific simulation codes and the capability of system hardware and software to effectively analyze this data necessitates data reduction. Yet, the increasing data complexity challenges most, if not all, of the existing data compression methods. In fact, lossless compression techniques offer no more than 10% reduction on scientific data that we have experience with, which is widely regarded as effectively incompressible. To bridge this gap, in this paper, we advocate a transformative strategy that enables fast, accurate, and multi-fold reduction of double-precision floating-point scientific data. The intuition behind our method is inspired by an effective use of preconditioners for linear algebra solvers optimized for a particular class of computational dwarfs (e.g., dense or sparse matrices). Focusing on a commonly used multi-resolution wavelet compression technique as the underlying solver for data reduction we propose the S-preconditioner, which transforms scientific data into a form with high global regularity to ensure a significant decrease in the number of wavelet coefficients stored for a segment of data. Combined with the subsequent EQ-calibrator, our resultant method (called S-Preconditioned EQ-Calibrated Wavelets (SPEQC-WAVELETS)), robustly achieved a 4- to 5- fold data reduction while guaranteeing user-defined accuracy of reconstructed data to be within 1% point-by-point relative error, lower than 0:01 Normalized RMSE, and higher than 0:99 Pearson Correlation. In this paper, we show the results we obtained by testing our method on six petascale simulation codes including fusion, combustion, climate, astrophysics, and subsurface groundwater in addition to 13 publicly available scientific datasets. We also demonstrate that application-driven data mining tasks performed on decompressed variables or their derived quantities produce results of comparable quality with the ones for the original data.

Jin, Ye↗

Sensor Fish Communicator

The Sensor Fish collects information that can be used to evaluate conditions encountered by juvenile salmonids and other fish as they pass through hydroelectric dams on their way to the ocean. Sensor Fish are deployed in turbines, spillways, and sluiceways and measure changes in pressure, angular rate of change, and linear acceleration during passage. The software is need to make Sensor Fish fully functional and easy to use. Sensor Fish Communicator (SFC) links to Sensor Fish, allowing users to control data collection settings and download data. It may also be used to convert native raw data (.raw2) files into Comma Separated Variable (.csv) files and plot the results. The multiple capabilities of the SFC allow hardware communication, data conversion, and data plotting with one application.

Source record↗

Synoptic NO3 in Slate River Watershed, Colorado (2022)

The synoptic nitrate (NO3) dataset in the Slate River Watershed, Colorado consists of NO3 data collected at 19 locations three times during the summer of 2022. Stream samples were collected in early summer (early July), mid summer (late August), and late summer (late September). The samples include mainstem, tributary, and point source input water samples. These data were collected to evaluate spatiotemporal variability in stream NO3 during the summer, and evaluate anthropogenic controls on stream NO3 dynamics. This data package contains: (1) a csv of all NO3 samples and (2) a csv of locations for each sampling site. The dataset additionally includes a file-level metadata (flmd.csv) file that lists each file contained in the dataset with associated metadata; and a data dictionary (dd.csv) file that contains column/row headers used throughout the files along with a definition, units, and data type. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

EARTH SCIENCE > BIOSPHERE > ECOSYSTEMS > FRESHWATE↗

Final Technical and Scientific Report: Advanced Control of the Azura Wave Energy Device

The objective of the project was to develop a model predictive controller and associated hydraulic PTO for the Azura wave energy device to improve the annual energy production (AEP) and reduce the levelized cost of electricity (LCOE) of the device. Performance of the controller and hydraulic PTO were validated in a 1/15th scale wave tank test performed at the University of Maine. Three controllers, with three corresponding PTOs, were developed and tested as part of the project. The three controllers are an ideal MPC controller paired with an ideal PTO, an MPC controller with a heuristic paired with a directional force control hydraulic PTO, and a preliminary study of an MPC controller applied to a variable force hydraulic PTO. Experimental data was used to estimate the controller paired with the directional force control would increase the annual energy production of the Azura at WETS by 12%, with a corresponding reduction in LCOE of 10.8%. Preliminary testing of the variable force hydraulic PTO paired with a MPC shows this configuration has the potential to increase the AEP of the Azura at WETS by at least 33%. Further design and development work is necessary to develop the PTO technology to achieve these gains. Additionally, all control schemes require additional work to address the short-term wave prediction method needed to implement the control. In addition to validation of these control methods, NWEI demonstrated careful design of a wave tank test model, PTO, and instrumentation yields high quality test data, and the ability to test advanced control algorithms and include complex PTO dynamics via hardware-in-the-loop testing techniques.

16 TIDAL AND WAVE POWER↗

GEECS (Generalized Equipment and Experiment Control System)

GEECS (Generalized Equipment and Experiment Control System) monitors and controls equipment distributed across a network, performs experiments by scanning input variables, and collects and stores various types of data synchronously from devices. Examples of devices include cameras, motors and pressure gauges. GEEKS is based upon LabView graphical object oriented programming (GOOP), allowing for a modular and scalable framework. Data is published for subscription of an arbitrary number of variables over TCP. A secondary framework allows easy development of graphical user interfaces for a combined control of any available devices on the control system without the need of programming knowledge. This allows for rapid integration of GEECS into a wide variety of systems. A database interface provides for devise and process configuration while allowing the user to save large quantities of data to local or network drives.

Gonsalves, Anthony↗

IO strategies and data services for petascale data sets from a global cloud resolving model

Global cloud resolving models at 4km resolutions or less create significant challenges in generation of simulation data, data storage, data management, and post-simulation analysis and visualization. To support efficient model output as well as data analysis, new models for IO and data organization must be evaluated. The model we are supporting, the Global Cloud Resolving Model being developed at Colorado State University, uses a geodesic grid. The non-monotonic nature of the grid's coordinate variables requires enhancements to existing data processing tools and community standards for describing and manipulating grids. The resolution, size and extent of the data suggest the need for parallel analysis tools and allow for the possibility of new techniques in data mining, filtering and comparison to observations. We describe the challenges posed by various aspects of data generation, management, and analysis, our work exploring IO strategies for the model, and a preliminary architecture, web portal, and tool enhancements which, when complete, will enable broad community access to the data sets in a way that is familiar to the community.

54 ENVIRONMENTAL SCIENCES↗

Plackett-Burman Analysis of Glass Microballoon Filled Syntactic Foams

Syntactic foams are an important category of composite materials that have abundant applications in a wide variety of fields. The current study utilized a Plackett-Burman (PB) experimental design to investigate the main effects of six variables on properties of syntactic foams formulated from a silicone elastomer and glass microballoons(MB). Findings from this investigation are meant to identify the most significant variables with respect to foam properties. Eight foam samples were created and tested using thermal, physical and mechanical techniques. The data from these tests was then evaluated using a Plackett-Burman response coefficient calculation (RCC). This calculation was applied to determine the statistical significance of the selected variables by comparison with a dummy variable. The data suggests that thermal properties, such as glass transition temperature and coefficient of thermal expansion, do not rely on any of the studied variables. Physical and mechanical measurements however were found to depend heavily on the matrix composition and the vacuum pressure used during mixing. Some variables were found to have little to no effect on any of the studied properties. Ultimately, this data could be used to formulate a comprehensive catalogue of syntactic foams based on their compositions. This type of database would allow customers in industry to identify which syntactic foam would best fit their application according to one or two properties.

36 MATERIALS SCIENCE↗

A consistent positive association between landscape simplification and insecticide use across the Midwestern US from 1997 through 2012

During 2007, counties across the Midwestern US with relatively high levels of landscape simplification (i.e., widespread replacement of seminatural habitats with cultivated crops) had relatively high crop-pest abundances which, in turn, were associated with relatively high insecticide application. These results suggested a positive relationship between landscape simplification and insecticide use, mediated by landscape effects on crop pests or their natural enemies. A follow-up study, in the same region but using different statistical methods, explored the relationship between landscape simplification and insecticide use between 1987 and 2007, and concluded that the relationship varied substantially in sign and strength across years. Here, we explore this relationship from 1997 through 2012, using a single dataset and two different analytical approaches. We demonstrate that, when using ordinary least squares (OLS) regression, the relationship between landscape simplification and insecticide use is, indeed, quite variable over time. However, the residuals from OLS models show strong spatial autocorrelation, indicating spatial structure in the data not accounted for by explanatory variables, and violating a standard assumption of OLS. When modeled using spatial regression techniques, relationships between landscape simplification and insecticide use were consistently positive between 1997 and 2012, and model fits were dramatically improved. We argue that spatial regression methods are more appropriate for these data, and conclude that there remains compelling correlative support for a link between landscape simplification and insecticide use in the Midwestern US. We discuss the limitations of inference from this and related studies, and suggest improved data collection campaigns for better understanding links between landscape structure, crop-pest pressure, and pest-management practices.

54 ENVIRONMENTAL SCIENCES↗

Ontology-Enriched Specifications Enabling Findable, Accessible, Interoperable, and Reusable Marine Metagenomic Datasets in Cyberinfrastructure Systems

Marine microbial ecology requires the systematic comparison of biogeochemical and sequence data to analyze environmental influences on the distribution and variability of microbial communities. With ever-increasing quantities of metagenomic data, there is a growing need to make datasets Findable, Accessible, Interoperable, and Reusable (FAIR) across diverse ecosystems. FAIR data is essential to developing analytical frameworks that integrate microbiological, genomic, ecological, oceanographic, and computational methods. Although community standards defining the minimal metadata required to accompany sequence data exist, they haven’t been consistently used across projects, precluding interoperability. Moreover, these data are not machine-actionable or discoverable by cyberinfrastructure systems. By making ‘omic and physicochemical datasets FAIR to machine systems, we can enable sequence data discovery and reuse based on machine-readable descriptions of environments or physicochemical gradients. In this work, we developed a novel technical specification for dataset encapsulation for the FAIR reuse of marine metagenomic and physicochemical datasets within cyberinfrastructure systems. This includes using Frictionless Data Packages enriched with terminology from environmental and life-science ontologies to annotate measured variables, their units, and the measurement devices used. This approach was implemented in Planet Microbe, a cyberinfrastructure platform and marine metagenomic web-portal. Here, we discuss the data properties built into the specification to make global ocean datasets FAIR within the Planet Microbe portal. We additionally discuss the selection of, and contributions to marine-science ontologies used within the specification. Finally, we use the system to discover data by which to answer various biological questions about environments, physicochemical gradients, and microbial communities in meta-analyses. This work represents a future direction in marine metagenomic research by proposing a specification for FAIR dataset encapsulation that, if adopted within cyberinfrastructure systems, would automate the discovery, exchange, and re-use of data needed to answer broader reaching questions than originally intended.

59 BASIC BIOLOGICAL SCIENCES↗

Coincident Above- and Below-ground Autonomous Monitoring to Quantify Co-variability in Permafrost, Soil and Vegetation Properties in Arctic Tundra: Supporting Data

These data are provided in support of an NGEE Arctic publication (Dafflon et al., 2017) available at doi: 10.1002/2016JG003724 The dataset (221 *.csv data files) contains measurements obtained through 1) electrical resistivity tomography (ERT) to monitor soil properties, 2) pole-mounted optical cameras to monitor vegetation dynamics, and 3) point probes to measure soil temperature, and periodic manual measurements of thaw layer thickness, snow thickness and soil dielectric permittivity at a study site in the Barrow Environmental Observatory (BEO) in 2013 and 2014. The BEO is located within the Arctic coastal region, about 6 km from the ocean shore and the village of Barrow, AK.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Bayesian Integration of multiscale environmental data

The software is designed for efficiently integrating large-size of multi-scale environmental data using the Bayesian framework. Suppose we need to estimate the spatial distribution of variable X with high spatial resolution. The available data include (1) direct measurements Z of the unknowns with high resolution in a subset of the spatial domain (small spatial coverage), (2) measurements C of the unknowns at the median scale, and (3) measurements A of the unknowns at the coarsest scale but with large spatial coverage. The goal is to estimate the unknowns at the fine grids by conditioning to all the available data. We first consider all the unknowns as random variables and estimate conditional probability distribution of those variables by conditioning to the limited high-resolution observations (Z). We then treat the estimated probability distribution as the prior distribution. Within the Bayesian framework, we combine the median and large-scale measurements (C and A) through likelihood functions. Since we assume that all the relevant multivariate distributions are Gaussian, the resulting posterior distribution is a multivariate Gaussian distribution. The developed software provides numerical solutions of the posterior probability distribution. The software can be extended in several different ways to solve more general multi-scale data integration problems.

CHEN, JINSONG↗

Bayesian Integration of multiscale environmental data

The software is designed for efficiently integrating large-size of multi-scale environmental data using the Bayesian framework. Suppose we need to estimate the spatial distribution of variable X with high spatial resolution. The available data include (1) direct measurements Z of the unknowns with high resolution in a subset of the spatial domain (small spatial coverage), (2) measurements C of the unknowns at the median scale, and (3) measurements A of the unknowns at the coarsest scale but with large spatial coverage. The goal is to estimate the unknowns at the fine grids by conditioning to all the available data. We first consider all the unknowns as random variables and estimate conditional probability distribution of those variables by conditioning to the limited high-resolution observations (Z). We then treat the estimated probability distribution as the prior distribution. Within the Bayesian framework, we combine the median and large-scale measurements (C and A) through likelihood functions. Since we assume that all the relevant multivariate distributions are Gaussian, the resulting posterior distribution is a multivariate Gaussian distribution. The developed software provides numerical solutions of the posterior probability distribution. The software can be extended in several different ways to solve more general multi-scale data integration problems.

CHEN, JINSONG↗

Contemporaneous observations of the radio galaxy NGC 1275 from radio to very high energy γ -rays

The radio galaxy NGC 1275, recently identified as a very high energy (VHE, >100 GeV) γ-ray emitter by MAGIC, is one of the few non-blazar active galactic nuclei detected in the VHE regime. The purpose of this work is to better understand the origin of the γ-ray emission and locate it within the galaxy. We studied contemporaneous multifrequency observations of NGC 1275 and modeled the overall spectral energy distribution. We analyzed unpublished MAGIC observations carried out between October 2009 and February 2010, and the previously published observations taken between August 2010 and February 2011. Here, we studied the multiband variability and correlations by analyzing data of Fermi-LAT in the 100 MeV–100 GeV energy band, as well as Chandra (X-ray), KVA (optical), and MOJAVE (radio) data taken during the same period. Using customized Monte Carlo simulations corresponding to early MAGIC stereoscopic data, we detect NGC 1275 also in the earlier MAGIC campaign. The flux level and energy spectra are similar to the results of the second campaign. The monthly light curve above 100 GeV shows a hint of variability at the 3.6σ level. In the Fermi-LAT band, both flux and spectral shape variabilities are reported. Furthermore, the optical light curve is also variable and shows a clear correlation with the γ-ray flux above 100 MeV. In radio, three compact components are resolved in the innermost part of the jet. One of these components shows a similar trend as the Fermi-LAT and KVA light curves. The γ-ray spectra measured simultaneously with MAGIC and Fermi-LAT from 100 MeV to 650 GeV can be well fitted either by a log-parabola or by a power-law with a subexponential cutoff for the two observation campaigns. A single-zone synchrotron-self-Compton model, with an electron spectrum following a power-law with an exponential cutoff, can explain the broadband spectral energy distribution and the multifrequency behavior of the source. But, this model suggests an untypical low bulk-Lorentz factor or a velocity alignment closer to the line of sight than the parsec-scale radio jet.

79 ASTRONOMY AND ASTROPHYSICS↗