slaclab/mldp-pvxs-driver
MLDP ingestion driver for EPICS and beyond
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
MLDP ingestion driver for EPICS and beyond
This framework was developed to ingest images/video images to train and test artificial neural network structures for image-based detection of fire and smoke. The code includes data preprocessing, model development, and testing. The framework is designed to work with RGB video imagery.
The Readiness Engine for Data Integration (REDI) is an open-source framework for automating, standardizing, and assessing the process of preparing scientific data for AI training. REDI implements a five-stage pipeline (ingest, preprocess, transform, structure, output) with per-stage provenance instrumentation via Flowcept, domain-aware transformation logic (PII anonymization, regridding, graph encoding, and more), and built-in readiness assessment and validation modes. REDI has been evaluated across climate, proteomics, materials science, and nuclear fusion datasets, demonstrating near-ideal parallel scaling to 100 nodes on OLCF's Frontier system. REDI is deployable as an agent-callable skill in coding environments such as Claude Code and OpenAI Codex, and is complemented by SetGo for FAIR compliance and catalog publication.
The Modern-Era Retrospective Analysis for Research and Applications, version 2 (MERRA-2), updates NASA’s previous satellite-era (1980 onward) reanalysis system to include additional observations and improvements to the Goddard Earth Observing System, version 5 (GEOS-5), Earth system model. As a major step toward a full Integrated Earth Systems Analysis (IESA), in addition to meteorological observations, MERRA-2 now includes assimilation of aerosol optical depth (AOD) from various ground- and space-based remote sensing platforms. Here, in the first of a pair of studies, the MERRA-2 aerosol assimilation is documented, including a description of the prognostic model (GEOS-5 coupled to the GOCART aerosol module), aerosol emissions, and the quality control of ingested observations. Initial validation and evaluation of the analyzed AOD fields are provided using independent observations from ground, aircraft, and shipborne instruments. The positive impact of the AOD assimilation on simulated aerosols is demonstrated by comparing MERRA-2 aerosol fields to an identical control simulation that does not include AOD assimilation. Fianlly, after showing the AOD evaluation, this paper takes a first look at aerosol–climate interactions by examining the shortwave, clear-sky aerosol direct radiative effect. The companion paper (Part II) evaluates and validates available MERRA-2 aerosol properties not directly impacted by the AOD assimilation (e.g., aerosol vertical distribution and absorption). Importantly, while highlighting the skill of the MERRA-2 aerosol assimilation products, both studies point out caveats that must be considered when using this new reanalysis product for future studies of aerosols and their interactions with weather and climate.
Recent developments in “headline-making” deep neural networks (DNNs), specifically convolutional neural networks (CNNs), along with advancements in computational power, open great opportunities to integrate massive amounts of real-time observations to characterize spatiotemporal structures of surface precipitation. This study aims to develop a CNN algorithm, named Deep Neural Network High Spatiotemporal Resolution Precipitation Estimation (Deep-STEP), that ingests direct satellite passive microwave (PMW) brightness temperatures (Tbs) at emission and scattering frequencies combined with infrared (IR) Tbs from geostationary satellites and surface information to automatically extract geospatial features related to the precipitable clouds. These features allow the end-to-end Deep-STEP algorithm to instantaneously map surface precipitation intensities with a spatial resolution of 4 km. The main advantages of Deep-STEP, as compared to current state-of-the-art techniques, are 1) it learns and estimates complex precipitation systems directly from raw measurements in near–real time, 2) it uses the automatic spatial neighborhood feature extraction approach, and 3) it fuses coarse-resolution PMW footprints with IR images to reliably retrieve surface precipitation at a high spatial resolution. We anticipate our proposed DNN algorithm to be a starting point for more sophisticated and efficient precipitation retrieval systems in terms of accuracy, fine spatial pattern detection skills, and computational costs.
The NASA Investigation of Microphysics and Precipitation for Atlantic Coast Threatening Snowstorms (IMPACTS) field campaign provides high-quality, high-altitude aircraft lidar (532 nm), radar (W-band) and in-cloud microphysical aircraft data taken during wintertime storm events impacting the United States. This study evaluates two mass-dimensional relationships (Brown and Francis (1995, BF95); Heymsfield (2014, H14) and two lidar-radar microphysical retrieval algorithms (Cloudsat and CALIPSO Ice Cloud Property Product (2C-ICE); VarPy (a variational method derived from the satellite lidar-radar data community)) to estimate aircraft-retrieved volume extinction coefficient (σ), ice water content (IWC), and effective radius (r e ) during the 2020 IMPACTS deployment. BF95 and H14 have a close 1:1 correlation (R 2 = 0.98) with in-situ observations of σ. However, only BF95 displays a linear, consistent, and almost temperature-independent low bias for IWC and r e , which likely arises from the environmental conditions used to determine each. Unlike the field-campaign-derived BF95 and H14 relationships, VarPy and 2C-ICE directly ingest the aircraft-based lidar and radar data to simulate σ, IWC, and r e . For all three microphysical parameters, VarPy and 2C-ICE retrieval errors became notably more pronounced around the dendritic growth zone (-15°C to -10°C) and near freezing (≥-5°C), which suggests that both algorithms experience difficulty addressing riming and aggregation processes and with larger particles (dendrites and plates) due in part to their simplified ice particle assumptions. However, the mean-melt diameter ice-particle assumption did yield more accurate IWC estimates, which led to slightly better overall results for VarPy.
Abstract Tropical cyclone formation is known to require abundant water vapor in the lower to middle troposphere within the incipient disturbance. In this study, we assess the impacts of local water vapor analysis uncertainty on the predictability of the formation of Hurricane Irma (2017). To this end, we reduce the magnitude of the incipient disturbance’s water vapor perturbations obtained from an ensemble-based data assimilation system that constrained moisture by assimilating all-sky infrared and microwave radiances. Five-day ensemble forecasts are initialized two days before genesis using each set of modified analysis perturbations. Growth of convective differences and intensity uncertainty are evaluated for each ensemble forecast. We observe that when initializing an ensemble forecast with only moisture uncertainty within the incipient disturbance, the resulting intensity uncertainty at every lead time exceeds half that of an ensemble containing initial perturbations to all variables throughout the domain. Although ensembles with different initial moisture uncertainty amplitudes reveal a similar pathway to genesis, uncertainty in genesis timing varies substantially across ensembles since moister members exhibit earlier spinup of the low-level vortex. These differences in genesis timing are traced back to the first 6–12 h of integration, when differences in the position and intensity of mesoscale convective systems across ensemble members develop more quickly with greater initial moisture uncertainty. In addition, the rapid growth of intensity uncertainty may be greatly modulated by the diurnal cycle. Ultimately, this study underscores the importance of targeting the incipient disturbance with high spatiotemporal water vapor observations for ingestion into data assimilation systems. Significance Statement Hurricanes form from clusters of thunderstorms that organize into a coherent system. One of the key ingredients for the formation process is an abundance of moisture. In this study, we test the sensitivity of hurricane formation to the initial moisture content in the vicinity of the cluster of thunderstorms that would become Hurricane Irma (2017). To do so, we initialize sets of forecasts each having a different variability of initial moisture content within the embryonic disturbance. Our results show that the predictability of hurricane formation is highly dependent on the uncertainty of the moisture content within the initial disturbance. Consequently, more high-quality observations of the moisture within the precursor disturbances to hurricanes are expected to improve forecasts of their formation.
We propose an approach for improved reproducibility that includes capturing and relating provenance characteristics and performance metrics, in a hybrid queriable system, the ProvEn server. The system capabilities are illustrated on two use cases: scientific reproducibility of results in the ACME climate simulations and performance reproducibility in molecular dynamics workflows on HPC computing platforms.
Background: Studies report that residential use of pesticides in low-income homes is common because of poor housing conditions and pest infestations; however, exposure data on contemporary-use pesticides in lowincome households is limited. We conducted a study in low-income homes from urban and agricultural communities to: characterize and compare house dust levels of agricultural and residential-use pesticides; evaluate the correlation of pesticide concentrations in samples collected several days apart; examine whether concentrations of pesticides phased-out for residential uses, but still used in agriculture (i.e., chlorpyrifos and diazinon) have declined in homes in the agricultural community; and estimate resident children’s pesticide exposures via inadvertent dust ingestion. Methods: In 2006, we collected up to two dust samples 5-8 days apart from each of 13 urban homes in Oakland, California and 15 farmworker homes in Salinas, California, an agricultural community (54 samples total). We measured 22 insecticides including organophosphates (chlorpyrifos, diazinon, diazinon-oxon, malathion, methidathion, methyl parathion, phorate, and tetrachlorvinphos) and pyrethroids (allethrin-two isomers, bifenthrin, cypermethrin-four isomers, deltamethrin, esfenvalerate, imiprothrin, permethrin-two isomers, prallethrin, and sumithrin), one phthalate herbicide (chlorthal-dimethyl), one dicarboximide fungicide (iprodione), and one pesticide synergist (piperonyl butoxide). Results: More than half of the households reported applying pesticides indoors. Analytes frequently detected in both locations included chlorpyrifos, diazinon, permethrin, allethrin, cypermethrin, and piperonyl butoxide; no differences in concentrations or loadings were observed between locations for these analytes. Chlorthal-dimethyl was detected solely in farmworker homes, suggesting contamination due to regional agricultural use. Concentrations in samples collected 5-8 days apart in the same home were strongly correlated for the majority of the frequently detected analytes (Spearman r = 0.70-1.00, p < 0.01). Additionally, diazinon and chlorpyrifos concentrations in Salinas farmworker homes were 40-80% lower than concentrations reported in samples from Salinas farmworker homes studied between 2000-2002, suggesting a temporal reduction after their residential phase-out. Finally, estimated non-dietary pesticide intake for resident children did not exceed current U.S. Environmental Protection Agency’s (U.S. EPA) recommended chronic reference doses (RfDs). Conclusion: Low-income children are potentially exposed to a mixture of pesticides as a result of poorer housing quality. Historical or current pesticide use indoors is likely to contribute to ongoing exposures. Agricultural pesticide use may also contribute to additional exposures to some pesticides in rural areas. Although children’s non-dietary intake did not exceed U.S. EPA RfDs for select pesticides, this does not ensure that children are free of any health risks as RfDs have their own limitations, and the children may be exposed indoors via other pathways. The frequent pesticide use reported and high detection of several home-use pesticides in house dust suggests that families would benefit from integrated pest management strategies to control pests and minimize current and future exposures.
Plastic accumulation in the environment is rapidly increasing, and nanoplastics (NP), byproducts of environmental weathering of bulk plastic waste, pose a significant public health risk. Particles may enter the human body through many possible routes such as ingestion, inhalation, and skin absorption. However, studies on NP penetration and accumulation in human skin are limited. Loss or reduction of the keratinized skin barrier may enhance the skin penetration of NPs. The present study investigated the entry of NPs into a human skin system modeling skin with compromised barrier functions and cellular responses to the intracellular accumulations of NPs. Two in vitro models were employed to simulate human skin lacking keratinized barriers. The first model was an ex vivo human skin culture with the keratinized dermal layer (stratum corneum) removed. The second model was a 3D keratinocyte/dermal fibroblast cell co-culture model with stratified keratinocytes on the top and a monolayer of skin fibroblast cells co-cultured at the bottom. The penetration and accumulation of the NPs in different cell types were observed using fluorescent microscopy, confocal microscopy, and cryogenic electron microscopy (cryo-EM). The cellular responses of keratinocytes and dermal fibroblast cells to stress induced by NPs stress were measured. The genetic regulatory pathway of keratinocytes to the intracellular NPs was identified using transcript analyses and KEGG pathway analysis. The cellular uptake of NPs by skin cells was confirmed by imaging analyses. Transepidermal transport and penetration of NPs through the skin epidermis were observed. According to the gene expression and pathway analyses, an IL-17 signaling pathway was identified as the trigger for cellular responses to internal NP accumulation in the keratinocytes. The transepidermal NPs were also found in co-cultured dermal fibroblast cells and resulted in a large-scale transition from fibroblast cells to myofibroblast cells with enhanced production of α-smooth muscle actin and pro-Collagen Ia. The upregulation of inflammatory factors and cell activation may result in skin inflammation and ultimately trigger immune responses.
Background: Through the food and water they ingest, the air they breathe, and the consumer products with which they interact at home and at work, humans are exposed to tens of thousands of chemicals, many of which have not been evaluated to determine their potential toxicities. Furthermore, while current chemical testing tends to focus on individual chemicals, the exposures that people actually experience involve mixtures of chemicals. Unfortunately, the number of mixtures that can be formed from the thousands of environmental chemicals is enormous, and testing all of them would be impossible. Objectives: We seek to develop and demonstrate a method for identifying those mixtures that are most prevalent in humans. Methods: We applied frequent itemset mining, a technique traditionally used for market basket analysis, to biomonitoring data from the 2009–2010 cycle of the continuous National Health and Nutrition Examination Survey (NHANES) to identify combinations of chemicals that frequently co-occur in people. Results: We identified 90 chemical combinations consisting of relatively few chemicals that occur in at least 30% of the U.S. population, as well as three supercombinations consisting of relatively many chemicals that occur in a small but nonnegligible proportion of the U.S. population. Conclusions: We demonstrated how FIM can be used in conjunction with biomonitoring data to narrow a large number of possible chemical combinations down to a smaller set of prevalent chemical combinations. https://doi.org/10.1289/EHP1265
This is a data release from the AbacusSummit suite of cosmological N-body simulations. It contains dark matter halo catalogs and particle samples from those halos. The halo catalogs have been augmented (cleaned) using halo merger tree information. Descriptions of AbacusSummit, the cleaned halo catalogs, and instructions for manipulating these catalogs can be found at the following URL: abacussummit.readthedocs.io/ The halo catalog cleaning is structured as a set of auxiliary files that are ingested by the reader code at runtime. But this release contains both the original catalogs and the auxiliary files, thus forming a self-contained dataset. The files in this release are aggregated by redshift. We define sets of simulations (like all c000 sims or all hugebase sims), and then store one redshift from all simulations per tarball. This is designed to support the use-case where a user wants to analyze multiple simulations at a certain redshift.
Selenium (Se) hyperaccumulator plants can concentrate the toxic element Se up to 1% of shoot (DW) which is known to protect hyperaccumulator plants from generalist herbivores. There is evidence for Se-resistant insect herbivores capable of feeding upon hyperaccumulators. In this study, resistance to Se was investigated in seed chalcids and seed beetles found consuming seeds inside pods of Se-hyperaccumulator species Astragalus bisulcatus and Stanleya pinnata. Selenium accumulation, localization and speciation were determined in seeds collected from hyperaccumulators in a seleniferous habitat and in seed herbivores. Astragalus bisulcatus seeds were consumed by seed beetle larvae (Acanthoscelides fraterculus Horn, Coleoptera: Bruchidae) and seed chalcid larvae (Bruchophagus mexicanus, Hymenoptera: Eurytomidae). Stanleya pinnata seeds were consumed by an unidentified seed chalcid larva. Micro X-ray absorption near-edge structure (mXANES) and micro-X-Ray Fluorescence mapping (mXRF) demonstrated Se was mostly organic C-Se-C forms in seeds of both hyperaccumulators, and S. pinnata seeds contained ,24% elemental Se. Liquid chromatography–mass spectrometry of Secompounds in S. pinnata seeds detected the C-Se-C compound seleno-cystathionine while previous studies of A. bisulcatus seeds detected the C-Se-C compounds methyl-selenocysteine and c-glutamyl-methyl-selenocysteine. Micro-XRF and mXANES revealed Se ingested from hyperaccumulator seeds redistributed throughout seed herbivore tissues, and portions of seed C-Se-C were biotransformed into selenocysteine, selenocystine, selenodiglutathione, selenate and selenite. Astragalus bisulcatus seeds contained on average 5,750 mg Se g21 , however adult beetles and adult chalcid wasps emerging from A. bisulcatus seed pods contained 4–6 mg Se g21 . Stanleya pinnata seeds contained 1,329 mg Se g21 on average; however chalcid wasp larvae and adults emerging from S. pinnata seed pods contained 9 and 47 mg Se g21 . The results suggest Se resistant seed herbivores exclude Se, greatly reducing tissue accumulation; this explains their ability to consume high-Se seeds without suffering toxicity, allowing them to occupy the unique niche offered by Se hyperaccumulator plants.
Liver injuries due to ingestion or exposure to chemicals and industrial toxicants pose a serious health risk that may be hard to assess due to a lack of non-invasive diagnostic tests. Mapping chemical injuries to organ-specific damage and clinical outcomes via biomarkers or biomarker panels will provide the foundation for highly specific and robust diagnostic tests. Here, we have used DrugMatrix, a toxicogenomics database containing organ-specific gene expression data matched to dose-dependent chemical exposures and adverse clinical pathology assessments in Sprague Dawley rats, to identify groups of co-expressed genes (modules) specific to injury endpoints in the liver. We identified 78 such gene co-expression modules associated with 25 diverse injury endpoints categorized from clinical pathology, organ weight changes, and histopathology. Using gene expression data associated with an injury condition, we showed that these modules exhibited different patterns of activation characteristic of each injury. We further showed that specific module genes mapped to 1) known biochemical pathways associated with liver injuries and 2) clinically used diagnostic tests for liver fibrosis. As such, the gene modules have characteristics of both generalized and specific toxic response pathways. Using these results, we proposed three gene signature sets characteristic of liver fibrosis, steatosis, and general liver injury based on genes from the co-expression modules. Out of all 92 identified genes, 18 (20%) genes have well-documented relationships with liver disease, whereas the rest are novel and have not previously been associated with liver disease. In conclusion, identifying gene co-expression modules associated with chemically induced liver injuries aids in generating testable hypotheses and has the potential to identify putative biomarkers of adverse health effects.
Bacillus anthracis is the causative agent of anthrax in animals and humans. The organism lies in a dormant state in the soil until introduced into an animal via, ingestion, cutaneous inoculation or inhalation. Once in the host, spores germinate into rapidly growing vegetative cells elaborating toxins. When animals die of anthrax, vegetative bacteria sporulate upon nutrient limitation in the carcass or soil while in the presence of air. After release into the soil environment, spores form a localized infectious zone (LIZ) at and around the carcass. Laboratory strains of B. anthracis produce fewer proteins associated with growth and sporulation compared to wild strains isolated from recent zoonotic disease events. We verified wild strains grow more rapidly than lab strains demonstrating a greater responsiveness to nutrient availability. Sporulation was significantly more rapid in these wild strains compared to lab strains, indicating wild strains are able to sporulate faster due to nutrient limitation while laboratory strains have a decrease in the speed at which they utilize nutrients and an increase in time to sporulation. These findings have implications for disease control at the LIZ as well as on the infectious cycle of this dangerous zoonotic pathogen.
The ectoparasitic mite Varroa destructor is one of the most destructive pests of the honey bee (Apis mellifera) and the primary biotic cause of colony collapse in many regions of the world. These mites inflict physical injury on their honey bee hosts from feeding on host hemolymph and fat body cells/cellular components, and serve as the vector for deadly honey bee viruses, including Deformed wing virus (DWV) and the related Varroa destructor virus-1 (VDV-1) (i.e., DWV-like viruses). Studies focused on elucidating the dynamics of Varroa-mediated vectoring and transmission of DWV-like viruses may be confounded by viruses present in ingested host tissues or the mites themselves. Here we describe a system that includes an artificial diet free of insect tissue-derived components for maintaining Varroa mites for in vitro experimentation. Using this system, together with the novel engineered cDNA clone-derived genetically tagged VDV-1 and wild-type DWV, we demonstrated for the first time that Varroa mites provided an artificial diet supplemented with engineered viruses for 36 hours could acquire and transmit sufficient numbers of virus particles to establish an infection in virus-naïve hosts. While the in vitro system described herein provides for only up to five days of mite survival, precluding study of the long-term impacts of viruses on mite health, the system allows for extensive insights into the dynamics of Varroa-mediated vectoring and transmission of honey bee viruses.
Naegleria fowleri , the causative agent of primary amoebic meningoencephalitis (PAM), requires increased research attention due to its high lethality and the potential for increased incidence as a result of global warming. The aim of this study was to investigate the interactions between N. fowleri and host cells in order to elucidate the mechanisms underlying the pathogenicity of this amoeba. A co-culture system comprising human fibrosarcoma cells was established to study both contact-dependent and contact-independent cytopathogenicity. Proteomic analyses of the amoebas exposed to human cell cultures or passaged through mouse brain were used to identify novel virulence factors. Our results indicate that actin dynamics, regulated by Arp2/3 and Src kinase, play a considerable role in ingestion of host cells by amoebae. We have identified three promising candidate virulence factors, namely lysozyme, cystatin and hemerythrin, which may be critical in facilitating N. fowleri evasion of host defenses, migration to the brain and induction of a lethal infection. Long-term co-culture secretome analysis revealed an increase in protease secretion, which enhances N. fowleri cytopathogenicity. Raman microspectroscopy revealed significant metabolic differences between axenic and brain-isolated amoebae, particularly in lipid storage and utilization. Taken together, our findings provide important new insights into the pathogenic mechanisms of N. fowleri and highlight potential targets for therapeutic intervention against PAM.
Connected components is a fundamental kernel in graph applications. The fastest existing multicore algorithms for solving graph connectivity are based on some form of edge sampling and/or linking and compressing trees. However, many combinations of these design choices have been left unexplored. In this paper, we design the ConnectIt framework, which provides different sampling strategies as well as various tree linking and compression schemes. ConnectIt enables us to obtain several hundred new variants of connectivity algorithms, most of which extend to computing spanning forest. In addition to static graphs, we also extend ConnectIt to support mixes of insertions and connectivity queries in the concurrent setting. We present an experimental evaluation of ConnectIt on a 72-core machine, which we believe is the most comprehensive evaluation of parallel connectivity algorithms to date. Compared to a collection of state-of-the-art static multicore algorithms, we obtain an average speedup of 12.4x (2.36x average speedup over the fastest existing implementation for each graph). Using ConnectIt, we are able to compute connectivity on the largest publicly-available graph (with over 3.5 billion vertices and 128 billion edges) in under 10 seconds using a 72-core machine, providing a 3.1x speedup over the fastest existing connectivity result for this graph, in any computational setting. For our incremental algorithms, we show that our algorithms can ingest graph updates at up to several billion edges per second. To guide the user in selecting the best variants in ConnectIt for different situations, we provide a detailed analysis of the different strategies. Finally, we show how the techniques in ConnectIt can be used to speed up two important graph applications: approximate minimum spanning forest and SCAN clustering.