Search NASA⌕ Search

SEARCH · Search NASA

Results for “volume visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Accelerating Multigrid-based Hierarchical Scientific Data Refactoring on GPUs

Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth make it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data volumes: ideally, methods that can scale data volumes adaptively so as to enable negotiation of performance and fidelity tradeoffs in different situations. Multigrid-based hierarchical data representations hold promise as a solution to this problem, allowing for flexible conversion between different fidelities so that, for example, data can be created at high fidelity and then transferred or stored at lower fidelity via logically simple and mathematically sound operations. However, the effective use of such representations has been hindered until now by the relatively high costs of creating, accessing, reducing, and otherwise operating on such representations. We describe here highly optimized data refactoring kernels for GPU accelerators that enable efficient creation and manipulation of data in multigrid-based hierarchical forms. We demonstrate that our optimized design can achieve up to 250 TB/s aggregated data refactoring throughput—83% of theoretical peak—on 1024 nodes of the Summit supercomputer. We showcase our optimized design by applying it to a large-scale scientific visualization workflow and the MGARD lossy compression software.

Chen, Jieyang↗

Visualization and prediction of supercritical CO 2 distribution in sandstones during drainage: An in situ synchrotron X-ray micro-computed tomography study

Pore-scale distribution of supercritical CO 2 (scCO 2 ) exerts significant control on a variety of key hydrologic as well as geochemical processes, including residual trapping and dissolution. Despite such importance, only a small number of experiments have directly characterized the three-dimensional distribution of scCO 2 in geologic materials during the invasion (drainage) process. Here, we present a study which couples dynamic high-resolution synchrotron X-ray micro-computed tomography imaging of a scCO 2 /brine system at in situ pressure/temperature conditions with quantitative pore-scale modeling to allow direct validation of a pore-scale description of scCO2 distribution. The experiment combines high-speed synchrotron radiography with tomography to characterize the brine saturated sample, the scCO 2 breakthrough process, and the partially saturated state of a sandstone sample from the Domengine Formation, a regionally extensive unit within the Sacramento Basin (California, USA). The availability of a 3D dataset allowed us to examine correlations between grains and pores morphometric parameters and the actual distribution of scCO 2 in the sample, including the examination of the role of small-scale sedimentary structure on CO2 distribution. The segmented scCO 2 /brine volume was also used to validate a simple computational model based on the local thickness concept, able to accurately simulate the distribution of scCO 2 after drainage. The same method was also used to simulate Hg capillary pressure curves with satisfactory results when compared to the measured ones. Finally, this predictive approach, requiring only a tomographic scan of the dry sample, proved to be an effective route for studying processes related to CO 2 invasion structure in geological samples at the pore scale.

3D quantitative morphometric analysis↗

Rise of an argon bubble in liquid steel in the presence of a transverse magnetic field

The rise of gaseous bubbles in viscous liquids is a fundamental problem in fluid physics, and it is also a common phenomenon in many industrial applications such as materials processing, food processing, and fusion reactor cooling. In this work, the motion of a single argon gas bubble rising in quiescent liquid steel under an external magnetic field is studied numerically using a Volume-of-Fluid method. To mitigate spurious velocities normally generated during numerical simulation of multiphase flows with large density differences, an improved algorithm for surface tension modeling, originally proposed by Wang and Tong [“Deformation and oscillations of a single gas bubble rising in a narrow vertical tube,” Int. J. Therm. Sci. 47, 221–228 (2008)] is implemented, validated and used in the present computations. The governing equations are integrated by a second-order space and time accurate numerical scheme, and implemented on multiple Graphics Processing Units with high parallel efficiency. The motion and terminal velocities of the rising bubble under different magnetic fields are compared and a reduction in rise velocity is seen in cases with the magnetic field applied. The shape deformation and the path of the bubble are discussed. An elongation of the bubble along the field direction is seen, and the physics behind these phenomena is discussed. The wake structures behind the bubble are visualized and effects of the magnetic field on the wake structures are presented. A modified drag coefficient is obtained to include the additional resistance force caused by adding a transverse magnetic field.

42 ENGINEERING↗

A microfluidic platform for pharmaceutical salt screening

We describe a microfluidic platform comprised of 48 wells to screen for pharmaceutical salts. Solutions of pharmaceutical parent compounds (PCs) and salt formers (SFs) are mixed on-chip in a combinatorial fashion in arrays of 87.5-nanolitre wells, which constitutes a drastic reduction of the volume of PC solution needed per condition screened compared to typical high throughput pharmaceutical screening approaches. Nucleation and growth of salt crystals is induced by diffusive and/or convective mixing of solutions containing, respectively, PCs and SFs in a variety of solvents. Here, to enable long term experiments, solvent loss was minimized by reducing the thickness of the absorptive polymeric material, polydimethylsiloxane (PDMS), and by using solvent impermeable top and bottom layers. Additionally, well isolation was enhanced via the incorporation of pneumatic valves that are closed at rest. Brightfield and polarized light microscopy and Raman spectroscopy were used for on-chip analysis and crystal identification. Using a gold-coated glass substrate and minimizing the thickness of the PDMS control layer drastically improved the signal-to-noise ratio for Raman spectra. Two drugs, naproxen (acid) and ephedrine (base), were used for validation of the platform's ability to screen for salts. Each PC was mixed combinatorially with potential SFs in a variety of solvents. Crystals were visualized using brightfield polarized light microscopy. Subsequent on-chip analyses of the crystals with Raman spectroscopy identified four different naproxen salts and five different ephedrine salts.

47 OTHER INSTRUMENTATION↗

WE-B-19A-01: SRT II: Uncertainties in SRT

SRS delivery has undergone major technical changes in the last decade, transitioning from predominantly frame-based treatment delivery to imageguided, frameless SRS. It is important for medical physicists working in SRS to understand the magnitude and sources of uncertainty involved in delivering SRS treatments for a multitude of technologies (Gamma Knife, CyberKnife, linac-based SRS and protons). Sources of SRS planning and delivery uncertainty include dose calculation, dose fusion, and intra- and inter-fraction motion. Dose calculations for small fields are particularly difficult because of the lack of electronic equilibrium and greater effect of inhomogeneities within and near the PTV. Going frameless introduces greater setup uncertainties that allows for potentially increased intra- and interfraction motion, The increased use of multiple imaging modalities to determine the tumor volume, necessitates (deformable) image and contour fusion, and the resulting uncertainties introduced in the image registration process further contribute to overall treatment planning uncertainties. Each of these uncertainties must be quantified and their impact on treatment delivery accuracy understood. If necessary, the uncertainties may then be accounted for during treatment planning either through techniques to make the uncertainty explicit, or by the appropriate addition of PTV margins. Further complicating matters, the statistics of 1-5 fraction SRS treatments differ from traditional margin recipes relying on Poisson statistics. In this session, we will discuss uncertainties introduced during each step of the SRS treatment planning and delivery process and present margin recipes to appropriately account for such uncertainties. Learning Objectives: To understand the major contributors to the total delivery uncertainty in SRS for Gamma Knife, CyberKnife, and linac-based SRS. Learn the various uncertainties introduced by image fusion, deformable image registration, and contouring variation. Learn a variety of strategies for dealing with uncertainty, including margin recipes and explicit visualization of uncertainty. Understand how the assessment of PTV margins differs from regular fractionation (van Herk recipe) for 1–5 fraction deliveries.

60 APPLIED LIFE SCIENCES↗

Utah FORGE 2439: Well 16B(78)-32 Field-Test Data from Mini-Frac Tests

This submittal includes the field-test data collected during stress tests conducted in the Utah FORGE 16B(78)-32 wellbore to measure/characterize the stresses in the geothermal reservoir. The type of stress test performed is referred to as a mini-frac test or a micro-frac test. The test is a hydraulic fracture test that involves injecting a small volume of water into a short interval of the reservoir that is isolated by a straddle packer to create a fracture. The test provides information about the minimum and maximum horizontal stress at the test depths. A total of seven mini-frac tests were performed within the upper (vertical or nearly vertical) section of the 9-5/8-inch diameter uncased wellbore, between depths of 5,202 ft MD [5,202 ft TVD] and 5,980 ft MD [5966.18 ft TVD]. Two types of data were generated as part of the mini-frac tests. The first type of data is time-series data for each mini-frac test (e.g., injection-rate, test-interval pressure), and are contained in the "Mini-Frac Test Data.zip" file below. The second type is geophysical log data, attached below in the "Geophysical Logs.zip" file. Here, two types of image logs and acoustic logs were obtained before and after the mini-frac tests to examine each test depth for visual evidence of induced fracture(s) and to measure the azimuth (orientation) of any observed fractures. The attached Readme file includes the test depth information and contents of each data file included here. Analysis of the field-test data was conducted and is documented in the attached report below.

15 GEOTHERMAL ENERGY↗

Structural and Stratigraphic Controls on Methane Hydrate occurrence and distribution: Gulf of Mexico, Walker Ridge 313 and Green Canyon 955: Final Report

The goal of this project was to determine structural and stratigraphic controls on hydrate occurrence and distribution in Green Canyon (GC) 955 and Walker Ridge (WR) 313 blocks using seismic and well data. Gas hydrate was discovered in these blocks in coarse- and fine-grained sediments during the 2009 Joint Industrial project (JIP) Leg 11 drilling expedition. Although the immediate interest of the exploration community is exclusively hydrate which is present in coarse–grained sediments, factors that control hydrate and free gas distribution in the two blocks and whether coarse and fine-grained hydrate-bearing units are related in any manner, formed the core of this research. The project spanned from 10/01/2012 to 07/31/2016. In the project, in both the leased blocks, the interval spanning the gas hydrate stability zone (GHSZ) was characterized using a joint analysis of sparse Ocean Bottom Seismic (OBS) and dense, surface–towed multichannel seismic (MCS) data. The project team had the luxury of calibrating their results with two well logs. Advance processing methods such as depth migration and full-waveform inversion (FWI) were used for seismic data analysis. Hydrate quantification was achieved through interpretation of the FWI velocity field using appropriate rock physics models at both blocks. The seismic modeling/inversion methodology (common to both GC955 and WR313 blocks) was as follows. First, the MCS data were depth migrated using a P-wave velocity (VP) model constructed using inversion of reflection arrival times of a few (four in both cases) key horizons carefully picked in the OBS data to farthest possible offsets. Then, the resolution of the traveltime VP model was improved to wavelength scale by inverting OBS gathers up to the highest frequency possible (21.75 Hz for GC955 and 17.5 for WR313) using FWI. Finally, the hydrate saturation (or the volume fraction) was estimated at the well location assuming one of the other hydrate morphology (filling the primary or the secondary porosity) was extrapolated out from the wells using the FWI VP as a guide. General outcomes were as follows. First and foremost, an imaging methodology using sparse seismic data, which is easily replicable at other sites with similar datasets, has been demonstrated. The end product of this methodology at both the leased blocks is quantitative estimates of hydrate distribution. Second, at both locations there is strong evidence that the base of the GHSZ, which does not appear as a clear Bottom Simulating Reflection (BSR), manifests in the VP perturbations created by FWI, suggesting that FWI is sensitive to subtle compositional changes in shallow sediments and establishes it as a valuable tool for investigations of hydrate-bearing basins. Third, through joint interpretation of the depth migrated image and the FWI VP model, how structure and stratigraphy jointly determine hydrate and free gas distribution in both blocks could be clearly visualized. The joint interpretation also suggests that the coarse and fine grained hydrate-bearing sediments at both leased are connected. Site specific results, in addition to general results, are as follows. At GC955 the overlying fine-grained hydrate-bearing unit could have been sourced from the underlying hydrate coarse-grained channel-levee complex through a chimney feature. The channel-levee system at GC955 is compartmentalized by faults, of which only a few may be impermeable. Although compartmentalized, the channel-levee system in the GC955 as a whole might be in communication except selected zones. At WR313 the overlying fine-grained fracture-filled hydrate unit appears to be sourced from below the GHSZ. The reason that only a particular fine-grained unit has hydrate, despite having lower porosity that the bounding units, could be the presence of secondary porosity (such as those formed from clay dewatering under compaction). In conclusion, the project was a pioneering effort in in joint analysis of OBS and MCS datasets for advancing the knowledge about a hydrate and free–gas system dynamics using advanced processing methods such as FWI and depth migration. Results obtained in this project can greatly advance the tools and techniques used for delineating specific hydrate prospects. Results obtained in this project can also be seamlessly incorporated into other DOE funded project on modeling the potential productivity and commercial viability of hydrate from sand-dominated reservoirs. The OBS and MCS data in this project were acquired in 2012 (after the JIP II drilling) by the USGS and therefore the results are a posteriori. Nonetheless, the seismic inversion workflow established through this project can be used to generate various what-if quantification scenarios even in absence of logs and serve as a valuable tool for guiding drilling operations. Results from this project can augment other DOE sponsored projects on determining the commercial viability of methane production from the Gulf of Mexico.

03 NATURAL GAS↗

A dual-view digital tomosynthesis imaging technique for improved chest imaging

Purpose: Digital tomosynthesis (DTS) has been shown to be useful for reducing the overlapping of abnormalities with anatomical structures at various depth levels along the posterior–anterior (PA) direction in chest radiography. However, DTS provides crude three-dimensional (3D) images that have poor resolution in the lateral view and can only be displayed with reasonable quality in the PA view. Furthermore, the spillover of high-contrast objects from off-fulcrum planes generates artifacts that may impede the diagnostic use of the DTS images. In this paper, the authors describe and demonstrate the use of a dual-view DTS technique to improve the accuracy of the reconstructed volume image data for more accurate rendition of the anatomy and slice images with improved resolution and reduced artifacts, thus allowing the 3D image data to be viewed in views other than the PA view. Methods: With the dual-view DTS technique, limited angle scans are performed and projection images are acquired in two orthogonal views: PA and lateral. The dual-view projection data are used together to reconstruct 3D images using the maximum likelihood expectation maximization iterative algorithm. In this study, projection images were simulated or experimentally acquired over 360° using the scanning geometry for cone beam computed tomography (CBCT). While all projections were used to reconstruct CBCT images, selected projections were extracted and used to reconstruct single- and dual-view DTS images for comparison with the CBCT images. For realistic demonstration and comparison, a digital chest phantom derived from clinical CT images was used for the simulation study. An anthropomorphic chest phantom was imaged for the experimental study. The resultant dual-view DTS images were visually compared with the single-view DTS images and CBCT images for the presence of image artifacts and accuracy of CT numbers and anatomy and quantitatively compared with root-mean-square-deviation (RMSD) values computed using the digital chest phantom or the CBCT images as the reference in the simulation and experimental study, respectively. High-contrast wires with vertical, oblique, and horizontal orientations in a PA view plane were also imaged to investigate the spatial resolutions and how the wire signals spread in the PA view and lateral view slice images. Results: Both the digital phantom images (simulated) and the anthropomorphic phantom images (experimentally generated) demonstrated that the dual-view DTS technique resulted in improved spatial resolution in the depth (PA) direction, more accurate representation of the anatomy, and significantly reduced artifacts. The RMSD values corroborate well with visual observations with substantially lower RMSD values measured for the dual-view DTS images as compared to those measured for the single-view DTS images. The imaging experiment with the high-contrast wires shows that while the vertical and oblique wires could be resolved in the lateral view in both single- and dual-view DTS images, the horizontal wire could only be resolved in the dual-view DTS images. This indicates that with single-view DTS, the wire signals spread liberally to off-fulcrum planes and generated wire shadow there. Conclusions: The authors have demonstrated both visually and quantitatively that the dual-view DTS technique can be used to achieve more accurate rendition of the anatomy and to obtain slice images with improved resolution and reduced artifacts as compared to the single-view DTS technique, thus allowing the 3D image data to be viewed in views other than the PA view. These advantages could make the dual-view DTS technique useful in situations where better separation of the objects-of-interest from the off-fulcrum structures or more accurate 3D rendition of the anatomy are required while a regular CT examination is undesirable due to radiation dose considerations.

60 APPLIED LIFE SCIENCES↗

DEMONSTRATION OF SIMULATED WASTE TRANSFERS FROM TANK AY-102 TO THE HANFORD WASTE TREATMENT FACILITY

In support of Hanford's AY-102 Tank waste certification and delivery of the waste to the Waste Treatment and Immobilization Plant (WTP), Savannah River National Laboratory (SRNL) was tasked by the Washington River Protection Solutions (WRPS) to evaluate the effectiveness of mixing and transferring the waste in the Double Shell Tank (DST) to the WTP Receipt Tank. This work is a follow-on to the previous 'Demonstration of Internal Structures Impacts on Double Shell Tank Mixing Effectiveness' task conducted at SRNL 1. The objective of these transfers was to qualitatively demonstrate how well waste can be transferred out of a mixed DST tank and to provide insights into the consistency between the batches being transferred. Twelve (12) different transfer demonstrations were performed, varying one parameter at a time, in the Batch Transfer Demonstration System. The work focused on visual comparisons of the results from transferring six batches of slurry from a 1/22nd scale (geometric by diameter) Mixing Demonstration Tank (MDT) to six Receipt Tanks, where the consistency of solids in each batch could be compared. The simulant used in this demonstration was composed of simulated Hanford Tank AZ-101 supernate, gibbsite particles, and silicon carbide particles, the same simulant/solid particles used in the previous mixing demonstration. Changing a test parameter may have had a small impact on total solids transferred from the MDT on a given test, but the data indicates that there is essentially no impact on the consistency of solids transferred batch to batch. Of the multiple parameters varied during testing, it was found that changing the nozzle velocity of the Mixer Jet Pumps (MJPs) had the biggest impact on the amount of solids transferred. When the MJPs were operating at 8.0 gpm (22.4 ft/s nozzle velocity, U{sub o}D=0.504 ft{sup 2}/s), the solid particles were more effectively suspended, thus producing a higher volume of solids transferred. When the MJP flow rate was reduced to 5 gpm (14 ft/s nozzle velocity, U{sub o}D = 0.315 ft{sup 2}/s) to each pump, dead zones formed in the tank, resulting in fewer solids being transferred in each batch to the Receipt Tanks. The larger, denser particles were displaced (preferentially to the smaller particles) to one of the two dead zones and not re-suspended for the duration of the test. As the liquid level dropped in the MDT, re-suspending the particles became less effective (6th batch). The poor consistency of the solids transferred in the 6th batch was due to low liquid level in the MDT, thus poor mixing by the MJPs. Of the twelve tests conducted the best transfer of solids occurred during Test 6 and 8 where the MJP rotation was reduced to 1.0 rpm.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Data Fusion for the Development of a Multimodal Freight Transload Facilities Dataset in the U.S.

To withstand the growing demand of commodity volume and its strain on the transportation infrastructure, it is necessary to identify the flow of commodities by route and mode. However, a national multimodal freight routing model does not exist for the U.S. The development of such model requires multiple building blocks, such as virtual representations of roadway, railway, and waterway networks, transload facilities (TFs), and access/egress links. Most of these blocks have a robust database in the U.S., except for the TFs. Here, this paper presents the fusion of dispersed and heterogeneous representations of multimodal TFs into a single, comprehensive, geospatial freight TF dataset. The TF dataset is derived from several sources, including the U.S. Army Corps of Engineers Master Docks Plus, the National Transportation Atlas Database, the Intermodal Association of North America, industry publications, and other public information. First, individual datasets were queried and reconciled. A geocoding/reverse geocoding process was applied to get the best street address and latitude/longitude location for each terminal. Then, duplicate terminals were identified by a fuzzy match algorithm based on terminal name and location, and removed. Validation was performed by visual inspection of random facilities. The main contributions of this work are: a publicly available version of the TF dataset, including facility location and multimodal transfer capability of 9,003 facilities, and an enterprise-version with the same facilities but including commodity handling capabilities. The main purpose of developing the TF dataset is to inform multimodal routing algorithms. The proposed TF dataset allows for credibly modeling the multimodal transfer of commodities within shipment routes.

Commodity Routing↗

Deactivation and decommissioning web log analysis using big data technology - 15710

The D and D Knowledge Management Information Tool (D and D KM- IT) is a web-based knowledge management information tool built for the D and D user community. Big data is a massive volume of structured and unstructured datasets which is so large that it's difficult to process using traditional database techniques. Web logs are the repository of files which are generated automatically for any operation on the web site. Web log files generated from the D and D KM-IT will be processed using the Apache Hadoop Framework to extract meaningful data. Hadoop is an open-source software framework for storing and processing big data in a distributed environment on large clusters of commodity hardware. Hadoop framework consists of two main layers: Hadoop distributed file system (HDFS) and the Execution engine (MapReduce). Automatic parallelization and distribution; clean and simple programming abstraction. Implementation: Web log files from the D and D KM-IT server are fetched using Apache Flume and loaded into the Hadoop distributed file system. Using the Apache Hcatalog tool, the web log data is parsed and converted into a structured table format. A Pig program is developed to query the tables to retrieve and store the significant information onto the HDFS. The extracted data is fed to business visualization tools such as Microsoft Excel for analysis and reporting. Results The reports generated through the web log data processing will be analyzed to improve the usability and performance of the D and D KM-IT. Conclusion/Future Work: User keyword information can be explored to add new trending topics to the D and D KM-IT application. Statistics generated can be compared to analysis reports from existing analytical tools.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A complex approach to assessing porous structure of structured ceramics obtained by SPS technique

Highlights: • A complex approach to microstructural analysis of nanostructured SPS ceramics was presented. • A bunch of gas, intrusion and microscopic methods were applied for open/closed porosity determination in nanoceramics. • Kinetic TPR analysis for structural changes in nanoceramic was carried out. • 3D pore visualization for nanoceramics was provided via SEM/FIB tomography • Porosity calculations were performed via BET, BJH, t-plot, Washburn equation, FEI Avizo 9.1 software results. - Abstract: Spark plasma sintering (SPS) is a highly prospective technology providing rapid consolidation of nano-disperse compositions into structured ceramics with complex structural organization. Characterizing pore structure of such systems remains a challenge due to different types, size and shape of the pores as well as structural defects occurring in the material, thus requiring special methods to quantify certain porosity type. The paper presents a complex approach to studying structure of SPS hematite-based structured ceramics. The method involves a number of gas, intrusion and electron microscopy probing techniques to characterize open and closed pores in the ceramics bulk. Low temperature nitrogen sorption has been implemented to estimate open micro- and mesoporosity in the size range 0.7–50 nm using BET, BJH and t-plot methods to process experimental data. Additionally, structural peculiarities of consolidated structured ceramics have been studied using temperature-programmed reduction (TPR) with the kinetic analysis of the results being carried out. Volume of macropores sized above 50 nm has been measured with mercury intrusion. Closed pores and structural defects have been quantified with SEM and FIB/SEM tomography. By comparing experimental and estimated results we have shown that addressing all porosity types provides a highly precise structural characterization of the material.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Evaluation of Four Volume-Based Image Registration Algorithms

We evaluated 4 volume-based automatic image registration algorithms from 2 commercially available treatment planning systems (Philips Syntegra and BrainScan). The algorithms based on cross correlation (CC), local correlation (LC), normalized mutual information (NMI), and BrainScan mutual information (BSMI) were evaluated with: (1) the synthetic computed tomography (CT) images, (2) the CT and magnetic resonance (MR) phantom images, and (3) the CT and MR head image pairs from 12 patients with brain tumors. For the synthetic images, the registration results were compared with known transformation parameters, and all algorithms achieved accuracy of submillimeter in translation and subdegree in rotation. For the phantom images, the registration results were compared with those provided by frame and marker-based manual registration. For the patient images, the results were compared with anatomical landmark-based manual registration to qualitatively determine how the results were close to a clinically acceptable registration. NMI and LC outperformed CC and BSMI, with the sense of being closer to a clinically acceptable result. As for the robustness, NMI and BSMI outperformed CC and LC. A guideline of image registration in our institution was given, and final visual assessment is necessary to guarantee reasonable results.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Defining a Metric Space of Host Logs and Operational Use Cases

Host logs, in particular, Windows Event Logs, are a valuable source of information often collected by security operation centers (SOCs). The semi-structured nature of host logs inhibits automated analytics, and while manual analysis is common, the sheer volume makes manual inspection of all logs impossible. Although many powerful algorithms for analyzing time-series and sequential data exist, utilization of such algorithms for most cyber security applications is either infeasible or requires tailored, research-intensive preparations. In particular, basic mathematic and algorithmic developments for providing a generalized, meaningful similarity metric on system logs is needed to bridge the gap between many existing sequential data mining methods and this currently available but under-utilized data source. In this paper, we provide a rigorous definition of a metric product space on Windows Event Logs, providing an embedding that allows for the application of established machine learning and time-series analysis methods. We then demonstrate the utility and flexibility of this embedding with multiple use-cases on real data: (1) comparing known infected to new host log streams for attack detection and forensics, (2) collapsing similar streams of logs into semantically-meaningful groups (by user, by role), thereby reducing the quantity of data but not the content, (3) clustering logs as well as short sequences of logs to identify and visualize user behaviors and background processes over time. Overall, we provide a metric space framework for general host logs and log sequences that respects semantic similarity and facilitates a wide variety of data science analytics to these logs without data-specific preparations for each.

Verma, Miki↗

Soil Water Retention and Hydraulic Conductivity Data and Model at Pump House in East River Watershed, Colorado 2019-2024

This data package includes soil water retention and hydraulic conductivity data and model fitting results from measurements of ex-situ soil samples and in-situ soil sensors near Pump House at Mount Crested Butte in the East River Watershed. Soil water retention curves (SWRC) characterize soil water content as a function of soil water potential. SWRC depends on soil texture and pore structure and can be used to describe the constraints on biogeochemical processes in terms of soil water availability. In this data package, the sample identification follows the format ER-X-Y, where ER refers to East River, X is the location identifier, and Y is the depth identifier at the same X (shallow Y=1). Specifically, ER-PHS, ER-LMC, ER-LMF, and ER-SMN are associated with ecohydrology sites under the East-Taylor Watershed Community Observatory Sites directory, and ER-RBTn (upslope n=1) are sampling transects during the 2019 Rootball Campaign. The sample and location information can be found in metadata.csv. Sampling and Measurements Each sample falls into one of the three sampling methods – (1) intact cores, (2) repacked samples, or (3) soil sensors – and one of the two measurement methods – (a) laboratory or (b) in-situ. Both intact cores and repacked samples were measured using the laboratory methods, which include measurements of soil water potential (HYPROP & WP4C, METER), saturated (KSAT, METER) and unsaturated hydraulic conductivity (HYPROP). The in-situ method uses a pair of co-located soil sensors to measure volumetric water content (TEROS12, METER) and soil water potential (TEROS21, METER), and the hydraulic conductivity was not measured. In comparison, the laboratory methods progress from full saturation to dry conditions, and the in-situ method includes both dry-to-wet and wet-to-dry cycles. The sampling and measurement methods for each sample can be found in metadata.csv, and more information about the measurements is detailed in the Methods section below. Models Retention and hydraulic conductivity data were fitted with four van-Genuchten-type models (specified by “model_name” column in the files): (1) traditional constrained van Genuchten model (“vG_constrained”), (2) traditional unconstrained van Genuchten model (“vG_unconstrained”), (3) PDI-variant of the constrained van Genuchten model (“vG_constrained_PDI”), and (4) PDI-variant of the unconstrained van Genuchten model (“vG_unconstrained_PDI”). The difference between the constrained (1: n) and the unconstrained (2: n, m) van Genuchten models is the number of pore-size distribution parameters in the model equations, giving the unconstrained model more degrees of freedom when fitting the data. Between the traditional and the PDI-variant models, model fitting differs the most at the dry end of the measurements. The traditional models allow infinite suction at the residual water content (water content does not drop below residual water content), and the PDI-variant models enforce a soil water potential value of pF=6.8 (~ -630 MPa) at oven-dryness (water content reaches 0). The inclusion of the van-Genuchten-type models is due to their common application. If other retention models are required, users can access the data in data.csv for further data fitting. More information about the models can be found in the Methods section below. Fitting Tasks The model fitting can be categorized into three levels of tasks (specified by “fitting_task” column in the files). Level 1 (“fit_retention”) only includes retention data fitting (the only level available for the in-situ method). Level 2 (“fit_retention_conductivity”) includes both retention and hydraulic conductivity data fitting, and the saturated hydraulic conductivity (Ks, a parameter of the hydraulic conductivity functions) is fixed by the measurements from KSAT. Level 3 (“fit_retention_conductivity_Ks”) also includes both retention and hydraulic conductivity data fitting, but Ks is a fitted parameter without the constraints from KSAT measurements. Among the same retention models (e.g. vG_constrained models of the same sample), level 1 should produce the best retention data fitting. Level 2 should have the highest misfit of the retention and hydraulic conductivity data, because the retention and hydraulic conductivity functions share common model parameters, and the unsaturated hydraulic conductivity (HYPROP) data fitting is subject to Ks measured independently by KSAT. Level 3 should have mid-level misfits of the retention and hydraulic conductivity data. While level 3 fits the hydraulic conductivity data better than level 2, the fitted Ks value might be unreasonable due to the lack of constraints at the wet end of the measurements. General recommendation when using this data package: (1) Choice of sampling methods: Intact cores and in-situ soil sensors could be prioritized because these sampling methods are less destructive. While the repacked samples were packed to the target bulk density (estimated post-sampling, when sample volume was known), these samples had altered pore structures. Nevertheless, intact cores might suffer from sample gaps that would lead to overestimation of Ks (sample gaps can be inferred from the “soil_sample_volume” column in metadata.csv when the value is < 249). In-situ method also has higher uncertainty in characterizing the wet end of the SWRC because of sensor limitations and the difficulty in reaching full saturation under natural conditions. (2) Choice of fitting tasks: When only retention data is needed, level 1 (“fit_retention”) should be prioritized. When both retention and hydraulic conductivity data are needed, level 2 (“fit_retention_conductivity”) could be prioritized. (3) Choice of models: This could depend on what the downstream models call for. If no specific model is required, model misfit could be used as a ranking criterion. Model misfit values in terms of RMSE can be found in model_parameters.csv. The following files are included in this data package: (1) metadata.csv – This file includes the general information of each sample, including location (description, geocoordinates, elevation), sampling and measurements details (method, depth, time or period, volume, instruments), and soil physical properties (bulk density, saturated hydraulic conductivity, only applicable to physical soil samples). (2) data.csv – This file includes soil water potential, volumetric water content, and unsaturated hydraulic conductivity data of each sample. Column “instrument” specifies the instrument (HYPROP, WP4C, or TEROS) used to perform the measurements. (3) model_fit.csv – This file includes soil water potential, volumetric water content, and unsaturated hydraulic conductivity fitted from the four models and three fitting tasks. Column “model_name” specifies the retention model used, and “fitting_task” specifies the level of data fitting. Missing values indicate that the variable does not apply to that fitting task. (4) model_parameters.csv – This file includes the fitted model parameters, model misfits, and conventional water content thresholds (field capacity and wilting point) from the four models and three fitting tasks. Column “model_name” specifies the retention model used, and “fitting_task” specifies the level of data fitting. Missing values indicate that the parameter does not apply to that model and/or that fitting task. (5) data_Ks.csv – This file includes the saturated hydraulic conductivity measurements from KSAT. (6) /figure/*.png – This folder includes three quick visualizations of the data, retention model fitting results and misfits, and hydraulic conductivity model fitting results, misfits, and parameters. The model fitting results are separated by samples and fitting tasks and colored by models. Zoom-in required. (7) /hyprop/*.bdhx – This folder includes proprietary hyprop files that require the free Labros SoilView-Analysis (METER) to open. Users can explore data fitting using other retention models (i.e. Brooks-Corey, Fredlund-Xing, Kosugi, bimodal models). Be aware that Ks value is pre-entered under “Fitting tab, Conductivity functions parameters” for level 2 fitting. If the value is lost, please refer to metadata.csv under “Ks” column. (8) Six file-level metadata that summarize file, header, column, and variable information of all files. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

EARTH SCIENCE > LAND SURFACE > SOILS↗

Soil Water Retention and Hydraulic Conductivity Data and Model at Trail Creek in Taylor River Watershed, Colorado 2024-2025

This data package includes soil water retention and hydraulic conductivity data and model fitting results from measurements of ex-situ soil samples and in-situ soil sensors near Trail Creek. Soil water retention curves (SWRC) characterize soil water content as a function of soil water potential. SWRC depends on soil texture and pore structure and can be used to describe the constraints on biogeochemical processes in terms of soil water availability. In this data package, the sample identification follows the format TR-X-Y, where TR refers to Trail Creek, X is the treatment block identifier, and Y is the location identifier. Specifically, TR-ASCC1 is the control treatment block under the Adaptive Silviculture for Climate Change (ASCC) project, and TR-ASCC2 is the clear-cut treatment block. TR-ASCC-EHSn is associated with ecohydrology sites under the East-Taylor Watershed Community Observatory Sites directory, and TR-ASCC-ERTn (upslope n=1) are ecohydrology sites along the electrical resistivity tomography transects. The sample and location information can be found in metadata.csv, and the data from the soil sensors will be included in a future data version when the observation period becomes sufficiently long for data analysis. Sampling and Measurements Each sample falls into one of the two sampling methods – (1) intact cores or (2) soil sensors – and one of the two measurement methods – (a) laboratory or (b) in-situ. The intact cores were measured using the laboratory methods, which include measurements of soil water potential (HYPROP & WP4C, METER), saturated (KSAT, METER) and unsaturated hydraulic conductivity (HYPROP). The in-situ method uses a pair of co-located soil sensors to measure volumetric water content (TEROS12, METER) and soil water potential (TEROS21, METER), and the hydraulic conductivity was not measured. In comparison, the laboratory methods progress from full saturation to dry conditions, and the in-situ method includes both dry-to-wet and wet-to-dry cycles. The sampling and measurement methods for each sample can be found in metadata.csv, and more information about the measurements is detailed in the Methods section below. Models Retention and hydraulic conductivity data were fitted with four van-Genuchten-type models (specified by “model_name” column in the files): (1) traditional constrained van Genuchten model (“vG_constrained”), (2) traditional unconstrained van Genuchten model (“vG_unconstrained”), (3) PDI-variant of the constrained van Genuchten model (“vG_constrained_PDI”), and (4) PDI-variant of the unconstrained van Genuchten model (“vG_unconstrained_PDI”). The difference between the constrained (1: n) and the unconstrained (2: n, m) van Genuchten models is the number of pore-size distribution parameters in the model equations, giving the unconstrained model more degrees of freedom when fitting the data. Between the traditional and the PDI-variant models, model fitting differs the most at the dry end of the measurements. The traditional models allow infinite suction at the residual water content (water content does not drop below residual water content), and the PDI-variant models enforce a soil water potential value of pF=6.8 (~ -630 MPa) at oven-dryness (water content reaches 0). The inclusion of the van-Genuchten-type models is due to their common application. If other retention models are required, users can access the data in data.csv for further data fitting. More information about the models can be found in the Methods section below. Fitting Tasks The model fitting can be categorized into three levels of tasks (specified by “fitting_task” column in the files). Level 1 (“fit_retention”) only includes retention data fitting (the only level available for the in-situ method). Level 2 (“fit_retention_conductivity”) includes both retention and hydraulic conductivity data fitting, and the saturated hydraulic conductivity (Ks, a parameter of the hydraulic conductivity functions) is fixed by the measurements from KSAT. Level 3 (“fit_retention_conductivity_Ks”) also includes both retention and hydraulic conductivity data fitting, but Ks is a fitted parameter without the constraints from KSAT measurements. Among the same retention models (e.g. vG_constrained models of the same sample), level 1 should produce the best retention data fitting. Level 2 should have the highest misfit of the retention and hydraulic conductivity data, because the retention and hydraulic conductivity functions share common model parameters, and the unsaturated hydraulic conductivity (HYPROP) data fitting is subject to Ks measured independently by KSAT. Level 3 should have mid-level misfits of the retention and hydraulic conductivity data. While level 3 fits the hydraulic conductivity data better than level 2, the fitted Ks value might be unreasonable due to the lack of constraints at the wet end of the measurements. General recommendation when using this data package: (1) Choice of sampling methods: Intact cores might suffer from sample gaps that would lead to overestimation of Ks (sample gaps can be inferred from the “soil_sample_volume” column in metadata.csv when the value is < 249). In-situ method has higher uncertainty in characterizing the wet end of the SWRC because of sensor limitations and the difficulty in reaching full saturation under natural conditions. (2) Choice of fitting tasks: When only retention data is needed, level 1 (“fit_retention”) should be prioritized. When both retention and hydraulic conductivity data are needed, level 2 (“fit_retention_conductivity”) could be prioritized. (3) Choice of models: This could depend on what the downstream models call for. If no specific model is required, model misfit could be used as a ranking criterion. Model misfit values in terms of RMSE can be found in model_parameters.csv. The following files are included in this data package: (1) metadata.csv – This file includes the general information of each sample, including location (description, geocoordinates, elevation), sampling and measurements details (method, depth, time or period, volume, instruments), and soil physical properties (bulk density, saturated hydraulic conductivity, only applicable to physical soil samples). (2) data.csv – This file includes soil water potential, volumetric water content, and unsaturated hydraulic conductivity data of each sample. Column “instrument” specifies the instrument (HYPROP, WP4C, or TEROS) used to perform the measurements. (3) model_fit.csv – This file includes soil water potential, volumetric water content, and unsaturated hydraulic conductivity fitted from the four models and three fitting tasks. Column “model_name” specifies the retention model used, and “fitting_task” specifies the level of data fitting. Missing values indicate that the variable does not apply to that fitting task. (4) model_parameters.csv – This file includes the fitted model parameters, model misfits, and conventional water content thresholds (field capacity and wilting point) from the four models and three fitting tasks. Column “model_name” specifies the retention model used, and “fitting_task” specifies the level of data fitting. Missing values indicate that the parameter does not apply to that model and/or that fitting task. (5) data_Ks.csv – This file includes the saturated hydraulic conductivity measurements from KSAT. (6) /figure/*.png – This folder includes three quick visualizations of the data, retention model fitting results and misfits, and hydraulic conductivity model fitting results, misfits, and parameters. The model fitting results are separated by samples and fitting tasks and colored by models. Zoom-in required. (7) /hyprop/*.bdhx – This folder includes proprietary hyprop files that require the free Labros SoilView-Analysis (METER) to open. Users can explore data fitting using other retention models (i.e. Brooks-Corey, Fredlund-Xing, Kosugi, bimodal models). Be aware that Ks value is pre-entered under “Fitting tab, Conductivity functions parameters” for level 2 fitting. If the value is lost, please refer to metadata.csv under “Ks” column. (8) Six file-level metadata that summarize file, header, column, and variable information of all files. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

EARTH SCIENCE > LAND SURFACE > SOILS↗

Soil Water Retention and Hydraulic Conductivity Data and Model at Snodgrass Mountain in East River Watershed, Colorado 2020-2025

This data package includes soil water retention and hydraulic conductivity data and model fitting results from measurements of ex-situ soil samples and in-situ soil sensors at Snodgrass Mountain. Soil water retention curves (SWRC) characterize soil water content as a function of soil water potential. SWRC depends on soil texture and pore structure and can be used to describe the constraints on biogeochemical processes in terms of soil water availability. In this data package, the sample identification follows the format SG-X-Y, where SG refers to Snodgrass Mountain, X is the location identifier, and Y is the depth identifier at the same X (shallow Y=1). Specifically, SG-EHS is associated with ecohydrology sites under the East-Taylor Watershed Community Observatory Sites directory, and SG-ERTn (upslope n=1) are points along the Snodgrass electrical resistivity tomography transect not associated with the existing site names in the directory. The sample and location information can be found in metadata.csv. Sampling and Measurements Each sample falls into one of the three sampling methods – (1) intact cores, (2) repacked samples, or (3) soil sensors – and one of the two measurement methods – (a) laboratory or (b) in-situ. Both intact cores and repacked samples were measured using the laboratory methods, which include measurements of soil water potential (HYPROP & WP4C, METER), saturated (KSAT, METER) and unsaturated hydraulic conductivity (HYPROP). The in-situ method uses a pair of co-located soil sensors to measure volumetric water content (TEROS12, METER) and soil water potential (TEROS21, METER), and the hydraulic conductivity was not measured. In comparison, the laboratory methods progress from full saturation to dry conditions, and the in-situ method includes both dry-to-wet and wet-to-dry cycles. The sampling and measurement methods for each sample can be found in metadata.csv, and more information about the measurements is detailed in the Methods section below. Models Retention and hydraulic conductivity data were fitted with four van-Genuchten-type models (specified by “model_name” column in the files): (1) traditional constrained van Genuchten model (“vG_constrained”), (2) traditional unconstrained van Genuchten model (“vG_unconstrained”), (3) PDI-variant of the constrained van Genuchten model (“vG_constrained_PDI”), and (4) PDI-variant of the unconstrained van Genuchten model (“vG_unconstrained_PDI”). The difference between the constrained (1: n) and the unconstrained (2: n, m) van Genuchten models is the number of pore-size distribution parameters in the model equations, giving the unconstrained model more degrees of freedom when fitting the data. Between the traditional and the PDI-variant models, model fitting differs the most at the dry end of the measurements. The traditional models allow infinite suction at the residual water content (water content does not drop below residual water content), and the PDI-variant models enforce a soil water potential value of pF=6.8 (~ -630 MPa) at oven-dryness (water content reaches 0). The inclusion of the van-Genuchten-type models is due to their common application. If other retention models are required, users can access the data in data.csv for further data fitting. More information about the models can be found in the Methods section below. Fitting Tasks The model fitting can be categorized into three levels of tasks (specified by “fitting_task” column in the files). Level 1 (“fit_retention”) only includes retention data fitting (the only level available for the in-situ method). Level 2 (“fit_retention_conductivity”) includes both retention and hydraulic conductivity data fitting, and the saturated hydraulic conductivity (Ks, a parameter of the hydraulic conductivity functions) is fixed by the measurements from KSAT. Level 3 (“fit_retention_conductivity_Ks”) also includes both retention and hydraulic conductivity data fitting, but Ks is a fitted parameter without the constraints from KSAT measurements. Among the same retention models (e.g. vG_constrained models of the same sample), level 1 should produce the best retention data fitting. Level 2 should have the highest misfit of the retention and hydraulic conductivity data, because the retention and hydraulic conductivity functions share common model parameters, and the unsaturated hydraulic conductivity (HYPROP) data fitting is subject to Ks measured independently by KSAT. Level 3 should have mid-level misfits of the retention and hydraulic conductivity data. While level 3 fits the hydraulic conductivity data better than level 2, the fitted Ks value might be unreasonable due to the lack of constraints at the wet end of the measurements. General recommendation when using this data package: (1) Choice of sampling methods: Intact cores and in-situ soil sensors could be prioritized because these sampling methods are less destructive. While the repacked samples were packed to the target bulk density (estimated post-sampling, when sample volume was known), these samples had altered pore structures. Nevertheless, intact cores might suffer from sample gaps that would lead to overestimation of Ks (sample gaps can be inferred from the “soil_sample_volume” column in metadata.csv when the value is < 249). In-situ method also has higher uncertainty in characterizing the wet end of the SWRC because of sensor limitations and the difficulty in reaching full saturation under natural conditions. (2) Choice of fitting tasks: When only retention data is needed, level 1 (“fit_retention”) should be prioritized. When both retention and hydraulic conductivity data are needed, level 2 (“fit_retention_conductivity”) could be prioritized. (3) Choice of models: This could depend on what the downstream models call for. If no specific model is required, model misfit could be used as a ranking criterion. Model misfit values in terms of RMSE can be found in model_parameters.csv. The following files are included in this data package: (1) metadata.csv – This file includes the general information of each sample, including location (description, geocoordinates, elevation), sampling and measurements details (method, depth, time or period, volume, instruments), and soil physical properties (bulk density, saturated hydraulic conductivity, only applicable to physical soil samples). (2) data.csv – This file includes soil water potential, volumetric water content, and unsaturated hydraulic conductivity data of each sample. Column “instrument” specifies the instrument (HYPROP, WP4C, or TEROS) used to perform the measurements. (3) model_fit.csv – This file includes soil water potential, volumetric water content, and unsaturated hydraulic conductivity fitted from the four models and three fitting tasks. Column “model_name” specifies the retention model used, and “fitting_task” specifies the level of data fitting. Missing values indicate that the variable does not apply to that fitting task. (4) model_parameters.csv – This file includes the fitted model parameters, model misfits, and conventional water content thresholds (field capacity and wilting point) from the four models and three fitting tasks. Column “model_name” specifies the retention model used, and “fitting_task” specifies the level of data fitting. Missing values indicate that the parameter does not apply to that model and/or that fitting task. (5) data_Ks.csv – This file includes the saturated hydraulic conductivity measurements from KSAT. (6) /figure/*.png – This folder includes three quick visualizations of the data, retention model fitting results and misfits, and hydraulic conductivity model fitting results, misfits, and parameters. The model fitting results are separated by samples and fitting tasks and colored by models. Zoom-in required. (7) /hyprop/*.bdhx – This folder includes proprietary hyprop files that require the free Labros SoilView-Analysis (METER) to open. Users can explore data fitting using other retention models (i.e. Brooks-Corey, Fredlund-Xing, Kosugi, bimodal models). Be aware that Ks value is pre-entered under “Fitting tab, Conductivity functions parameters” for level 2 fitting. If the value is lost, please refer to metadata.csv under “Ks” column. (8) Six file-level metadata that summarize file, header, column, and variable information of all files. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

EARTH SCIENCE > LAND SURFACE > SOILS↗

Final Scientific/Technical Report for DE-FG02-07ER64500 Study of Lignocellulosic Material Degradation with CARS Microscopy

The program of research undertaken by our Harvard group, in collaboration with Dr. Ding at the National Renewable Energy Laboratory (NREL) in Golden, CO, seeks to introduce, validate and apply a new analytical technique to study the conversion of lignocellulosic biomass into ethanol. This conversion process has been the subject of intense interest over the past few years because of its potential to provide a clean, renewable source of energy to meet increasing global demand. During the funding period, we have clearly demonstrated visualization of lignin and cellulose using intrinsic vibrational contrast with simulated Raman scattering (SRS) microscopy, developed at Harvard. Our approach offers high spatial resolution and time resolution that is sufficient to capture the kinetics of a pre‐treatment process. This is reflected by the publications listed below, as well as the use of SRS microscopy at NREL as a routine analysis tool for research on lignocellulosic biomass. In our original proposal, we envisioned moving to near‐field CARS imaging in order to perform chemical mapping at the nanoscale. However, given the dramatic progress made by our group in SRS imaging, we concentrated our efforts on using multi‐component SRS (lignin, cellulose, lipid, water, protein, deuterated metabolites, etc.) to quantitatively understand the spatially dispersed kinetics in a variety of plant samples under a variety of conditions. In addition, we built a next generation laser system based on fiber laser technology that allowed rugged and portable instrumentation for SRS microscopy. We also pursued new imaging approaches to improve the acquisition speed of SRS imaging of lignocellulose without sacrificing signal‐to‐noise ratio. This allowed us to image larger volumes of tissue with higher time resolution to get a more comprehensive picture of the heterogeneity of this chemical process from the submicron up to the centimeter scale.

09 BIOMASS FUELS↗