Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression (Computer science)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Data from: 'Abiotic influences on continuous conifer forest structure across a subalpine watershed'

This package archives the core data used for analysis and inference in 'Abiotic influences on continuous conifer forest structure across a subalpine watershed' (Worsham et al., 2025). All data were collected in the East River, Washington Gulch, Slate River, and Coal Creek watersheds of Colorado. In the paper, we quantified the relative influence of climate, topographic, edaphic, and geologic factors on conifer stand structure and composition, and their functional relationships, at the watershed scale. We used waveform LiDAR data to derive spatially continuous stand structure metrics. We fused these with a species-level classification map to estimate tree species abundance. We applied generalized additive and generalized boosted models to evaluate the covariability of structural and compositional metrics with abiotic variables. The package contains the essential products required for reproducing our analysis and the tables and figures reported in the publication. The products comprise four classes: (1) geospatial data, (2) tabular data used for inferential analysis, (3) tabular data describing analytical results and performance statistics, and (4) a data user guide. (1) includes discretized waveform LiDAR data, locations and attributes of individual tree crowns, sampling locations and domain boundaries, a canopy height model, and raster files of estimated forest structural and compositional metrics at 100 m grid scale. (2) includes all response and explanatory variable values applied in inferential models. Response variables include conifer forest stand density, basal area, 95th percentile height, quadratic mean diameter, and others. Explanatory variables include climatic water deficit, actual evapotranspiration, elevation, heat load, soil available water content, and others. (3) includes results of training and testing several individual tree detection (ITD) algorithms, as well as inferential modeling results. (4) is a PDF user guide for this data package, including detailed descriptions and data dictionaries for all files. The data package root contains 17 assets: 8 compressed tape archive (.tar.gz) files, 5 comma-separated values (.csv) files, 3 Geographic Tagged Image File Format (GeoTIFF) (.tif) files, and 1 Portable Document Format (.pdf) file. The compressed .tar.gz archives contain ESRI shapefiles (.shp) .tif, compressed LASer (.laz), and .csv files. The archives must first be decompressed using the widely distributed command-line software utility TAR. All other files, including constituent files within the .tar.gz archives, can be opened in the open-source R statistical computing environment. Alternatively, .csv files may also be read in any simple text editor software or Microsoft Excel. Geospatial files including .shp and .tif files can also be opened in GIS software, such as QGIS (open-source) or ESRI ArcGIS (proprietary). The .pdf Data User Guide can be read with Adobe Acrobat Reader or other compatible readers.

2018 NEON and 2025 CHESS Campaigns↗

Damage progression and failure of SiC/SiC composite tubes under hard-contact radial expansion

The response of silicon carbide (SiC) fiber-reinforced SiC matrix (SiC/SiC) composite cladding to mechanical interaction with fissile fuel is a knowledge gap that must be overcome to design and assess SiC-based cladding systems for advanced nuclear applications. This study developed the relevant mechanical testing capability and identified the failure behavior and the critical microstructural features and processing defects. Sections of SiC composite tube were subjected to a modified expansion-due-to-compression (EDC) test in an X-ray computed tomography microscope: a polyurethane plug pressed surrogate Al 2 O 3 into the inner walls of the SiC/SiC composite tubes to achieve hard contact. A pure EDC test with just a polyurethane plug was also performed as a reference. Through the use of displacement fields, digital volume correlation revealed inhomogeneous deformation fields in the tubes, even for pure EDC, which was related to the inherent defects in the structure. Deep learning–aided segmentation and systematic data analysis revealed that the presence of inhomogeneous deformation applied by the hard contact was exaggerated by the presence of inner surface imperfections left behind from the matrix densification process. In conclusion, the findings provide insights into the applications, highlighting the necessity for improvements in inner surface roughness and the incorporation of localized contacts in pellet–cladding mechanical interaction computational models.

Composites↗

Polynomial Chaos–Based Bayesian Inference of K -Profile Parameterization in a General Circulation Model of the Tropical Pacific

The authors present a polynomial chaos (PC)–based Bayesian inference method for quantifying the uncertainties of the K-profile parameterization (KPP) within the MIT general circulation model (MITgcm) of the tropical Pacific. The inference of the uncertain parameters is based on a Markov chain Monte Carlo (MCMC) scheme that utilizes a newly formulated test statistic taking into account the different components representing the structures of turbulent mixing on both daily and seasonal time scales in addition to the data quality, and filters for the effects of parameter perturbations over those as a result of changes in the wind. To avoid the prohibitive computational cost of integrating the MITgcm model at each MCMC iteration, a surrogate model for the test statistic using the PC method is built. Because of the noise in the model predictions, a basis-pursuit-denoising (BPDN) compressed sensing approach is employed to determine the PC coefficients of a representative surrogate model. The PC surrogate is then used to evaluate the test statistic in the MCMC step for sampling the posterior of the uncertain parameters. Results of the posteriors indicate good agreement with the default values for two parameters of the KPP model, namely the critical bulk and gradient Richardson numbers; while the posteriors of the remaining parameters were barely informative.

54 ENVIRONMENTAL SCIENCES↗

An algorithm for LES of premixed compressible flows using the Conditional Moment Closure model

A novel numerical method has been developed to couple a recent high order accurate fully compressible upwind method with the Conditional Moment Closure combustion model. The governing equations, turbulence modelling and numerical methods are presented in full. The new numerical method is validated against direct numerical simulation (DNS) data for a lean premixed methane slot burner. Although the modelling approaches are based on non-premixed flames and hence not expected to be valid for a wide range of premixed flames, the predicted flame is just 10% longer than that in the DNS and excellent agreement of mean mass fractions, conditional mass fractions and temperature is demonstrated. This new numerical method provides a very useful framework for future application of CMC to premixed as well as non-premixed combustion.

Computer Science↗

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗

Low Resolution Picture Transmission (LRPT) Demonstration System

Low-Resolution Picture Transmission (LRPT) is a proposed standard for direct broadcast transmission of satellite weather images. This standard is a joint effort by the European Organization for the Exploitation of Meteorological Satellites (EUMETSAT) and the National Oceanic Atmospheric Administration (NOAA). As a digital transmission scheme, its purpose is to replace the current analog Automatic Picture Transmission (APT) system for use in the Meteorological Operational (METOP) satellites. Goddard Space Flight Center has been tasked to build an LRPT Demonstration System (LDS). It's main objective is to develop or demonstrate the feasibility of a low-cost receiver utilizing a Personal Computer (PC) as the primary processing component and determine the performance of the protocol in the simulated Radio Frequency (RF) environment. The approach would consist of two phases. In the phase 1, a Commercial-off-the-Shelf (COTS) Modulator-Demodulator (MODEM) board that would perform RF demodulation would be purchased allowing the Central Processing Unit (CPU) to perform the Consultative Committee for Space Data Systems (CCSDS) protocol processing. Also since the weather images are compressed the PC would perform the decompression. Phase 1 was successfully demonstrated on December 1997. Phase 2 consists of developing a high-fidelity receiver, transmitter and environment simulator. Its goal is to find out how the METOP Specification performs in a simulated noise environment in a cost-effective receiver. The approach would be to produce a receiver using as much software as possible to perform front-end processing to take advantage of the latest high-speed PCs. Thus the COTS MODEM used in Phase 1 is performing RF demodulation along with data acquisition providing data to the receiving software. Also, environment simulator is produced using the noise patterns generated by Institute for Telecommunications Sciences (ITS) from their noise environment study.

Fong, Wai↗

A mesoscale 3D model of irradiated concrete informed via a 2.5 U-Net semantic segmentation

The concrete biological shield in light-water reactors is exposed to neutron and gamma irradiation, which deteriorates the concrete’s mechanical properties in the long term. To assess the irradiation-induced damage, predictive mechanical models are developed and used in parallel with the characterization of irradiated concrete samples. Realistic 3D simulation domains can drastically improve a model’s prediction. In this work, we utilized x-ray computed tomography (XCT) data of a concrete specimen to reconstruct its 3D microstructure. The XCT data shows low contrast between the concrete’s aggregates and cement paste, resulting in poor image segmentation when using traditional unsupervised techniques. To address this issue, we developed and trained a 2.5D U-Net model on only 24 pre-labeled XCT layers to segment 651 layers of the XCT data. The overall F1-score of the model is approximately 96%. Then, we created a 3D finite element (FE) mesh based on the stack of segmented images. The FE model contains radiation-induced expansion, damage, and creep. The constitutive equations are adapted to each phase (aggregates and cement paste). Here, we simulated the effects of neutron irradiation in the concrete specimen as well as the specimen’s mechanical response to uniaxial compression. Finally, model validation was performed using experimental data on similar concrete specimens in the literature.

2.5D U-Net↗

The mechanical response of micron-sized molecular crystals

Abstract Microstructures and corresponding properties of compacted powders ultimately depend on the mechanical response of individual particles. In principle, computational simulations can predict the results of powder compaction processes, but the selection of appropriate models for both particle–particle interactions and particle deformations across all relevant length scales remain nontrivial tasks, especially in material systems lacking detailed mechanical property information. The work presented here addresses these issues by conducting uniaxial compressions in situ inside of a scanning electron microscope to characterize the mechanical response of individual micron-sized particles of a molecular crystal, hexanitrohexaazaisowurtzitane (CL-20). This experimental approach enabled the collection of quantitative force and displacement data alongside simultaneous imaging to capture morphology changes. The results reveal information about elastic deformation, yield, plastic deformation, creep, and fracture phenomena. Accordingly, this work demonstrates a generalizable approach for assessing the mechanical response of individual micron-sized molecular crystal particles and utilizing those responses in particle-level models. Graphic abstract

36 MATERIALS SCIENCE↗

Different bonding type along each crystallographic axis: Computational study of poly($\textit{p}$-phenylene terephthalamide)

Poly($\textit{p}$-phenylene terephthalamide) (PPTA) exhibits van der Waals (vdW) bonding along its $\textit{a}$ axis, hydrogen bonding along its $\textit{b}$ axis, and covalent bonding along its $\textit{c}$ axis. In this work, we explore the structural and mechanical properties of PPTA using density functional theory with various functionals including LDA, PBE, PBE+rVV10L, SCAN, and SCAN+rVV10, compared with available experiments. The hierarchy of nonempirical semilocal functionals LDA, PBE, and SCAN (not fitted to any multicenter bonded system) includes differing amounts of intermediate-range vdW interaction. rVV10 is the long-range vdW correction. (rVV10L differs from rVV10 only in the value of a range parameter.) Among the tested functionals, SCAN shows the best performance for the lattice parameters of PPTA along the two crystal directions involving vdW or hydrogen-bond interaction. The equilibrium lattice constants obtained by SCAN and PBE+rVV10L are closest to experimental data, while SCAN+rVV10 slightly overbinds the system. We study the mechanical response of PPTA by applying strain along three lattice directions. Due to the inclusion of vdW interaction, SCAN, PBE+rVV10L, and SCAN+rVV10 all exhibit correct bonding strain-energy curves. On the contrary, PBE strongly underestimates the vdW interaction needed to resist uniaxial stretching along the $\textit{a}$ axis. The Young's modulus and yield strength of PPTA are computed and compared with previous results. The experimental values are much smaller than the computed ones, mainly due to the fact that the PPTA fiber samples used for measurements are mechanically weaker than the perfect molecular crystals considered in the simulations. Interestingly, when a compressive uniaxial stress of 25 Kbar is applied along the $\textit{b}$ axis, a structural phase transition, in which the hydrogen bonds reform along one diagonal of the $\textit{ab}$ rectangle, is predicted by SCAN.

36 MATERIALS SCIENCE↗

Automated Processing of ISIS Topside Ionograms into Electron Density Profiles

Modeling of the topside ionosphere has for the most part relied on just a few years of data from topside sounder satellites. The widely used Bent et al. (1972) model, for example, is based on only 50,000 Alouette 1 profiles. The International Reference Ionosphere (IRI) (Bilitza, 1990, 2001) uses an analytical description of the graphs and tables provided by Bent et al. (1972). The Alouette 1, 2 and ISIS 1, 2 topside sounder satellites of the sixties and seventies were ahead of their times in terms of the sheer volume of data obtained and in terms of the computer and software requirements for data analysis. As a result, only a small percentage of the collected topside ionograms was converted into electron density profiles. Recently, a NASA-funded data restoration project has undertaken and is continuing the process of digitizing the Alouette/ISIS ionograms from the analog 7-track tapes. Our project involves the automated processing of these digital ionograms into electron density profiles. The project accomplished a set of important goals that will have a major impact on understanding and modeling of the topside ionosphere: (1) The TOPside Ionogram Scaling and True height inversion (TOPIST) software was developed for the automated scaling and inversion of topside ionograms. (2) The TOPIST software was applied to the over 300,000 ISIS-2 topside ionograms that had been digitized in the fkamework of a separate AISRP project (PI: R.F. Benson). (3) The new TOPIST-produced database of global electron density profiles for the topside ionosphere were made publicly available through NASA s National Space Science Data Center (NSSDC) ftp archive at . (4) Earlier Alouette 1,2 and ISIS 1, 2 data sets of electron density profiles from manual scaling of selected sets of ionograms were converted fiom a highly-compressed binary format into a user-friendly ASCII format and made publicly available through nssdcftp.gsfc.nasa.gov. The new database for the topside ionosphere established as a result of this project, has stimulated a multitude of new studies directed towards a better description and prediction of the topside ionosphere. Marinov et al. (2004) developed a new model for the upper ion transition height (Oxygen to Hydrogen and Helium) and Bilitza (2004) deduced a correction term for the I N topside electron density model. Kutiev et al. (2005) used this data to develop a new model for the topside ionosphere scale height (TISH) as a function of month, local time, latitude, longitude and solar flux F10.7. Comparisons by Belehaki et al. (2005) show that TISH is in general agreement with scale heights deduced from ground ionosondes but the model predicts post-midnight and afternoon maxima whereas the ionosonde data show a noon maximum. Webb and Benson (2005) reported on their effort to deduce changes in the plasma temperature and ion composition from changes in the topside electron density profile as recorded by topside sounders. Limitations and possible improvements of the IRI topside model were discussed by Coisson et al. (2005) including also the possible use of the NeQuick model, Our project progressed in close collaboration and coordination with the GSFC team involved in the ISIS digitization effort. The digitization project was highly successful producing a large amount of digital topside ionograms. Several no-cost extensions of the TOPIST project were necessary to keep up with the pace and volume of the digitization effort.

Reinisch, bodo W.↗

A generalized reconstruction framework for unconventional PET systems

Purpose: Quantitative estimation of the radionuclide activity concentration in positron emission tomography (PET) requires precise modeling of PET physics. The authors are focused on designing unconventional PET geometries for specific applications. This work reports the creation of a generalized reconstruction framework, capable of reconstructing tomographic PET data for systems that use right cuboidal detector elements positioned at arbitrary geometry using a regular Cartesian grid of image voxels. Methods: The authors report on a variety of design choices and optimization for the creation of the generalized framework. The image reconstruction algorithm is maximum likelihood-expectation–maximization. System geometry can be specified using a simple script. Given the geometry, a symmetry seeking algorithm finds existing symmetry in the geometry with respect to the image grid to improve the memory usage/speed. Normalization is approached from a geometry independent perspective. The system matrix is computed using the Siddon’s algorithm and subcrystal approach. The program is parallelized through open multiprocessing and message passing interface libraries. A wide variety of systems can be modeled using the framework. This is made possible by modeling the underlying physics and data correction, while generalizing the geometry dependent features. Results: Application of the framework for three novel PET systems, each designed for a specific application, is presented to demonstrate the robustness of the framework in modeling PET systems of unconventional geometry. Three PET systems of unconventional geometry are studied. (1) Virtual-pinhole half-ring insert integrated into Biograph-40: although the insert device improves image quality over conventional whole-body scanner, the image quality varies depending on the position of the insert and the object. (2) Virtual-pinhole flat-panel insert integrated into Biograph-40: preliminary results from an investigation into a modular flat-panel insert are presented. (3) Plant PET system: a reconfigurable PET system for imaging plants, with resolution of greater than 3.3 mm, is shown. Using the automated symmetry seeking algorithm, the authors achieved a compression ratio of the storage and memory requirement by a factor of approximately 50 for the half-ring and flat-panel systems. For plant PET system, the compression ratio is approximately five. The ratio depends on the level of symmetry that exists in different geometries. Conclusions: This work brings the field closer to arbitrary geometry reconstruction. A generalized reconstruction framework can be used to validate multiple hypotheses and the effort required to investigate each system is reduced. Memory usage/speed can be improved with certain optimizations.

60 APPLIED LIFE SCIENCES↗

The Anomalous Refraction of ShockWaves in Materials with General Equations of State. Part II Anomalous Refraction Wave Systems

In Part II we develop a theory of anomalous refraction with which one can predict the structure of the shock wave at the material interface as a function of the strength of the incident shock wave, the angle that the incident shock makes with the material interface, and the material properties of the two materials.We show that the critical angle for the onset of anomalous refraction is satisfied in at least three circumstances. Firstly, the classical case when the system is fast-slow a > 1 and the incident shock is over-run by downstream expansion waves and the wave impedance Z decreases. Secondly, even with increasing Z, and still with a > 1, the critical angle can be attained with a reflected compression. Thirdly, for a slow-fast system a < 1, the critical angle can be obtained with precursor waves which may be either shocks or evanescent compressions. We present conditions for the onset of evanescence. We find that the classical model of anomalous refraction is only partly correct, a remnant of a centered expansion wave must be added to it and its existence is confined to refractions that we define as being weak. A variety of degenerate anomalous refractions are discussed. They are essentially the regular and irregular shock pair refractions described in Part I. In the regime for which experiments have been conducted (i.e., for relatively weak shocks) we demonstrate that our theory agrees completely with available experimental data (e.g., Jahn 1956, Abdel- Fattah & Henderson 1978a) and with our computations. However, our theory also predicts a shock structure that has not yet been observed experimentally in the Air/CO2 gas combination, since this structure occurs when the incident shock is relatively strong; i.e., with a shock Mach number of 10 or greater. We have verified these predictions with our computations and expect that they will eventually be confirmed by experiment.

36 MATERIALS SCIENCE↗

Equation of state of boron nitride combining computation, modeling, and experiment

The equation of state (EOS) of materials at warm dense conditions poses significant challenges to both theory and experiment. We report a combined computational, modeling, and experimental investigation leveraging new theoretical and experimental capabilities to investigate warm-dense boron nitride (BN). The simulation methodologies include path integral Monte Carlo (PIMC), several density functional theory (DFT) molecular dynamics methods [plane-wave pseudopotential, Fermi operator expansion (FOE), and spectral quadrature (SQ)], activity expansion (actex), and all-electron Green's function Korringa-Kohn-Rostoker (mecca), and compute the pressure and internal energy of BN over a broad range of densities and temperatures. Our experiments were conducted at the Omega laser facility and the Hugoniot response of BN to unprecedented pressures (1200–2650 GPa). The EOSs computed using different methods cross validate one another in the warm-dense matter regime, and the experimental Hugoniot data are in good agreement with our theoretical predictions. By comparing the EOS results from different methods, we assess that the largest discrepancies between theoretical predictions are ≲ 4% in pressure and ≲ 3% in energy and occur at 10 6 K, slightly below the peak compression that corresponds to the K -shell ionization regime. At these conditions, we find remarkable consistency between the EOS from DFT calculations performed on different platforms and using different exchange-correlation functionals and those from PIMC using free-particle nodes. This provides strong evidence for the accuracy of both PIMC and DFT in the high-pressure, high-temperature regime. Moreover, the recently developed SQ and FOE methods produce EOS data that have significantly smaller statistical error bars than PIMC, and so represent significant advances for efficient computation at high temperatures. The shock Hugoniot predicted by PIMC, actex, and mecca shows a maximum compression ratio of 4.55 ± 0.05 for an initial density of 2.26 g/cm 3 , higher than the Thomas-Fermi predictions by about 5%. In addition, we construct tabular EOS models that are consistent with the first-principles simulations and the experimental data. Our findings clarify the ionic and electronic structure of BN over a broad range of temperatures and densities and quantify their roles in the EOS and properties of this material. The tabular models may be utilized for future simulations of laser-driven experiments that include BN as a candidate ablator material.

36 MATERIALS SCIENCE↗

Generation of a suite of 3D computer-generated breast phantoms from a limited set of human subject data

Purpose: The authors previously reported on a three-dimensional computer-generated breast phantom, based on empirical human image data, including a realistic finite-element based compression model that was capable of simulating multimodality imaging data. The computerized breast phantoms are a hybrid of two phantom generation techniques, combining empirical breast CT (bCT) data with flexible computer graphics techniques. However, to date, these phantoms have been based on single human subjects. In this paper, the authors report on a new method to generate multiple phantoms, simulating additional subjects from the limited set of original dedicated breast CT data. The authors developed an image morphing technique to construct new phantoms by gradually transitioning between two human subject datasets, with the potential to generate hundreds of additional pseudoindependent phantoms from the limited bCT cases. The authors conducted a preliminary subjective assessment with a limited number of observers (n= 4) to illustrate how realistic the simulated images generated with the pseudoindependent phantoms appeared. Methods: Several mesh-based geometric transformations were developed to generate distorted breast datasets from the original human subject data. Segmented bCT data from two different human subjects were used as the 'base' and 'target' for morphing. Several combinations of transformations were applied to morph between the 'base' and 'target' datasets such as changing the breast shape, rotating the glandular data, and changing the distribution of the glandular tissue. Following the morphing, regions of skin and fat were assigned to the morphed dataset in order to appropriately assign mechanical properties during the compression simulation. The resulting morphed breast was compressed using a finite element algorithm and simulated mammograms were generated using techniques described previously. Sixty-two simulated mammograms, generated from morphing three human subject datasets, were used in a preliminary observer evaluation where four board certified breast radiologists with varying amounts of experience ranked the level of realism (from 1 ='fake' to 10 ='real') of the simulated images. Results: The morphing technique was able to successfully generate new and unique morphed datasets from the original human subject data. The radiologists evaluated the realism of simulated mammograms generated from the morphed and unmorphed human subject datasets and scored the realism with an average ranking of 5.87 {+-} 1.99, confirming that overall the phantom image datasets appeared more 'real' than 'fake.' Moreover, there was not a significant difference (p > 0.1) between the realism of the unmorphed datasets (6.0 {+-} 1.95) compared to the morphed datasets (5.86 {+-} 1.99). Three of the four observers had overall average rankings of 6.89 {+-} 0.89, 6.9 {+-} 1.24, 6.76 {+-} 1.22, whereas the fourth observer ranked them noticeably lower at 2.94 {+-} 0.7. Conclusions: This work presents a technique that can be used to generate a suite of realistic computerized breast phantoms from a limited number of human subjects. This suite of flexible breast phantoms can be used for multimodality imaging research to provide a known truth while concurrently producing realistic simulated imaging data.

60 APPLIED LIFE SCIENCES↗

BinaryCIF and CIFTools—Lightweight, efficient and extensible macromolecular data management

3D macromolecular structural data is growing ever more complex and plentiful in the wake of substantive advances in experimental and computational structure determination methods including macromolecular crystallography, cryo-electron microscopy, and integrative methods. Efficient means of working with 3D macromolecular structural data for archiving, analyses, and visualization are central to facilitating interoperability and reusability in compliance with the FAIR Principles. We address two challenges posed by growth in data size and complexity. First, data size is reduced by bespoke compression techniques. Second, complexity is managed through improved software tooling and fully leveraging available data dictionary schemas. To this end, we introduce BinaryCIF, a serialization of Crystallographic Information File (CIF) format files that maintains full compatibility to related data schemas, such as PDBx/mmCIF, while reducing file sizes by more than a factor of two versus gzip compressed CIF files. Moreover, for the largest structures, BinaryCIF provides even better compression—factor ten and four versus CIF files and gzipped CIF files, respectively. Herein, we describe CIFTools, a set of libraries in Java and TypeScript for generic and typed handling of CIF and BinaryCIF files. Together, BinaryCIF and CIFTools enable lightweight, efficient, and extensible handling of 3D macromolecular structural data.

59 BASIC BIOLOGICAL SCIENCES↗

Homomorphic data compression for real time photon correlation analysis

The construction of highly coherent X-ray sources, combined with next-generation detectors that are larger and faster, has enabled new research opportunities across the scientific landscape. Among the techniques that benefit most from these advancements is X-ray photon correlation spectroscopy (XPCS), where faster acquisition unlocks the ability to study faster dynamics within samples. However, faster acquisition on larger detectors also introduces unprecedented challenges for online data processing and offline data storage. Such challenges are particularly prominent for XPCS, where real time analyses require simultaneous calculation of all the previously acquired data in the time series. We present a homomorphic compression scheme to effectively reduce the computational time and memory space required for XPCS analysis. Leveraging similarities in the mathematical expression between a matrix-based compression algorithm and the correlation calculation, our approach allows direct operation on the compressed data without their decompression. The offline compression scheme extends storage capacity by a factor of 40 while preserving key features in the lossy compressed data. Meanwhile, the online compression scheme reduces the computational time to below 1 ms, enabling real time calculation of the correlation functions at kHz framerate. Our demonstration of a homomorphic compression of scientific data provides an effective solution to the big data challenge at coherent light sources. Beyond the example shown in this work, the framework can be extended to facilitate real-time operations directly on a compressed data stream for other techniques.

36 MATERIALS SCIENCE↗