An automated OpenMP mutation testing framework for performance optimization
Not Available
97 MATHEMATICS AND COMPUTING↗
SEARCH · Search NASA
Results for “Mutation testing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
MUPPET: An automated OpenMP mutation testing framework for performance optimization
MUPPET is a tool for OpenMP programs that identifies program modifications, called mutations, aimed at improving program performance. Existing performance optimization techniques, including profiling-based and auto-tuning techniques, fail to indicate program modifications at the source level thus preventing their portability across compilers. MUPPET aims to help HPC developers reason about performance defects and missed opportunities to improve performance at the source code level.
Parasyris, Konstantinos↗
Automating test case generation for coverages required by FAA standard DO-178B
Coverage testing techniques are required by the FAA for various levels of subsystem criticality at the unit testing level. Higher levels of criticality require coverage schemes that frequently require more and more test cases, particularly when the number of conditions in a decision grows. For example, if we have a decision with n conditions of the form: if (/ci/ or /c2/ or .... or /cn/) then there are 2(n) possible combinations of condition outcomes. Given the enormous number of inputs that may be required to satisfy different coverages, and given that there are no automated tools for determining these inputs (to our knowledge), we will show how one alternative testing technique, mutation testing, can be coerced into generating inputs that satisfy a code coverage scheme X, i.e., if we modify the rules for mutant generation during mutation testing, this technique will provide test cases that satisfy X.
Voas, Jeffrey M.↗
Testing convolutional neural network based deep learning systems: a statistical metamorphic approach
Machine learning technology spans many areas and today plays a significant role in addressing a wide range of problems in critical domains,i.e., healthcare, autonomous driving, finance, manufacturing, cybersecurity,etc. Metamorphic testing (MT) is considered a simple but very powerful approach in testing such computationally complex systems for which either an oracle is not available or is available but difficult to apply. Conventional metamorphic testing techniques have certain limitations in verifying deep learning-based models (i.e., convolutional neural networks (CNNs)) that have a stochastic nature (because of randomly initializing the network weights) in their training. In this article, we attempt to address this problem by using a statistical metamorphic testing (SMT) technique that does not require software testers to worry about fixing the random seeds (to get deterministic results) to verify the metamorphic relations (MRs). We propose seven MRs combined with different statistical methods to statistically verify whether the program under test adheres to the relation(s) specified in the MR(s). We further use mutation testing techniques to show the usefulness of the proposed approach in the healthcare space and test two CNN-based deep learning models (used for pneumonia detection among patients). The empirical results show that our proposed approach uncovers 85.71% of the implementation faults in the classifiers under test (CUT). Furthermore, we also propose an MRs minimization algorithm for the CUT, thus saving computational costs and organizational testing resources.
Computer Science↗
Genetic effects on heavy ions in drosophila
Drosophila sex-linked recessive lethal mutation test was used to study the dose response relation and relative biological effectiveness of heavy ions. The experiments were performed using the heavy ion beams at BEVALAC of Lawrence Berkeley Laboratory. These experiments were undertaken according to the proposed milestones and included Ne-20, A-40 and Fe-65 ions with respective energies of 600 MeV, 840 MeV and 850 MeV. At these energies several doses of these radiations ranging from 20 to 1280 R were used. Space radiation exposure to astronauts is supposed to be quite low and therefore very low dose experiments i.e., 20 R, were also performed for the three ions. The mutation response was measured in all germ cell types i.e., spermatozoa, spermatids, spermatocytes and spermatogonia of treated Drosophila males. A linear dose frequency relation was observed for most of the range except at high doses where the saturation effect was observed. Also, a very significant difference was observed among the sensitivity of the four germ cell stages where spermatozoa and spermatids were more sensitive. At the higher doses of this range, most of the spermatogonia and spermatocytes were killed. Although comparative and identical experiments with X-rays or neutrons have not been performed, the compassion of our data with the ones available in literature suggest that the heavy ions have a high rbe and that they are several times more effective than low LET X-rays. The rbe compared to neutrons however appears to be only slightly higher.
Kale, P. G.↗
Enhancing Developer Productivity - L2 Milestone (Final Report)
This report documents the work done as part of the “Enhancing Developer Productivity” level 2 milestone. The team surveyed developers about impediments and successes; improved our CI pipeline monitoring and reporting; developed tools for line coverage reporting and analysis; improved compiler warning adherence in SIERRA; prototyped static analysis, AI, and mutation testing tooling in SIERRA; and developed a 3-5 year SIERRA plan document to help these initiatives continue past this milestone.
97 MATHEMATICS AND COMPUTING↗
Benchmarking Computational Tools for Calling SNPs and Indels in Complex Microbial Populations
The NASA BioNutrients missions seek to understand the suitability of microorganisms for bioproduction during space flight. One topic of interest is the stability of microbial genomes during long-term ambient storage and subsequent rehydration and growth. To address these questions, samples from 8 species were flown to ISS for 5 years of desiccated storage at ambient temperature (Stasis Packs) and 2 species were packaged along with powdered media inside a bioreactor system to allow hydration and growth in microgravity (Production Packs). For both systems, Whole Genome Sequencing (WGS) of the DNA extracted from the returned samples and paired ground controls will be conducted to identify changes in genome stability due to time, storage conditions and growth in space. Across the technical replicates, ground controls, 10 timepoints, and multiple experimental conditions, ~300 samples have been selected for initial analysis with WGS sequencing to 100x coverage. A flexible and resource efficient mutation calling pipeline is needed to process this large dataset and allow for comparisons between species. Many bioinformatics tools for calling Indels and Single Nucleotide Variants (SNVs) are designed for use with pure isolates, where true variations from the reference genome are expected to dominate the reads aligning to the location of mutation. In contrast, DNA from the Stasis Pack (SP) samples was collected directly after recovery from desiccated storage and the Production Pack (PP) samples were collected after fermentation. In this context, reads with mutations are expected to be less frequent than reads that align with the reference genome, as each sample will include multiple lines of cells. Thus, BioNutrients samples are expected to be similar to samples from cancer cell or “pooled” sequencing approaches. In preparation for the analysis of the BioNutrients samples, we have tested three mutation calling tools (GATK for Microbes, BreSeq and DiscoSNP) designed for complex samples. A challenge of validating mutation identification pipelines is a lack of “Ground Truth” datasets, especially for complex samples. To compare these three tools, we sought to identify mutations in pre-existing WGS data collected from populations of Chlamydomonas reinhardtii that were exposed to UV mutagenesis and growth in LEO as part of the Space Algae-1 mission. Here we present a summary of these tools against the analysis originally conducted using the CRISP tool. Critical metrics are compared such as runtime, the number of SNPs, the number and size of Indels, and patterns of transversion and transitions identified by each tool are reported. By sharing these benchmarking results collected in support of the BioNutrients mission, we aim to guide others seeking to identify SNVs in similarly complex microbial samples.
Biology↗
Advanced information processing system: Fault injection study and results
The objective of the AIPS program is to achieve a validated fault tolerant distributed computer system. The goals of the AIPS fault injection study were: (1) to present the fault injection study components addressing the AIPS validation objective; (2) to obtain feedback for fault removal from the design implementation; (3) to obtain statistical data regarding fault detection, isolation, and reconfiguration responses; and (4) to obtain data regarding the effects of faults on system performance. The parameters are described that must be varied to create a comprehensive set of fault injection tests, the subset of test cases selected, the test case measurements, and the test case execution. Both pin level hardware faults using a hardware fault injector and software injected memory mutations were used to test the system. An overview is provided of the hardware fault injector and the associated software used to carry out the experiments. Detailed specifications are given of fault and test results for the I/O Network and the AIPS Fault Tolerant Processor, respectively. The results are summarized and conclusions are given.
Burkhardt, Laura F.↗
Hardware Fuzzing with An Emulator
Bugs in digital logic have led to some significant security vulnerabilities. Hardware bugs are particularly troublesome since they cannot be easily patched. Additionally, if the bug is in the root of trust, all trust built upon it can be vulnerable. Traditional testing either require a deep knowledge of the system, creative attack vectors and lots of human interaction. This is not scalable as there are very few engineers that can wear the hat of a designer, a verification engineer, and a cybersecurity expert. Hardware fuzzing is a relatively new research area in dynamic hardware testing. It has proven to be an effective method for discovering bugs, unexpected behaviors, and security vulnerabilities in software. While hardware fuzzing is new to the hardware domain, it has a strong track record in software testing. Fuzzing is a testing technique that randomly mutates the input data to uncover bugs or vulnerabilities in the design. It is especially good at finding corner cases that test engineers can not envision. Another advantage over other dynamic testing techniques is that, if done well, deep knowledge of the design is not required. Additionally, fuzzing scales well. If the system is set up correctly, it can run unsupervised for weeks if necessary. In this work, we propose using hardware fuzzing to improve the input vector generation for an information flow tracking tool. To get reasonable throughput of test vectors, an emulator is targeted as the execution platform. Efficient emulator execution has some specific requirements.
42 ENGINEERING↗
Tre-DST: A Drug Susceptibility Test for Mycobacterium tuberculosis Using Solvatochromic Trehalose Probes
In 2024, an estimated 10 million people developed Tuberculosis (TB), nearly half a million of whom were infected with drug-resistant tuberculosis (DR-TB). Early detection of infection and drug resistance enables rapid engagement in effective care. Bacterial culture and nucleic acid testing remain the primary diagnostic methods, with smear microscopy being phased out. However, these methods present significant limitations for diagnosing drug resistance, such as lengthy time-to-result for phenotypic tests, as well as the need for prior knowledge of resistance mutations and prohibitive cost for molecular tests. To address this, we developed a rapid phenotypic TB drug susceptibility test, termed Tre-DST, based on novel metabolically incorporated trehalose probes, which specifically detect live mycobacteria. We used the nonpathogenic Mycobacterium smegmatis and the virulence-attenuated Mycobacterium tuberculosis (Mtb) H37Ra or auxotrophic Mtb to demonstrate a strong correlation between cost-effective plate reader results and flow cytometry data, suggesting that the plate reader is a suitable fluorescence detector for Tre-DST. We determined that adding a 1-week incubation step allowed Mtb samples originally seeded at 10 4 CFU/mL to become detectable, over 2 weeks earlier than colony-forming unit analysis. We found that Tre-DST reports on drug susceptibility in a drug-agnostic manner, demonstrating loss of fluorescence with frontline TB drugs as well as the newer drug bedaquiline. Tre-DST distinguished RIF- and INH-resistant auxotrophs from susceptible controls and accurately reported the resistance activity. Ultimately, because Tre-DST is agnostic to mechanisms of drug resistance, this assay is likely compatible with all WHO-recommended and future DR-TB drugs as a diagnostic in reference laboratories.
diagnostics↗
Estimation and enhancement of real-time software reliability through mutation analysis
A simulation-based technique for obtaining numerical estimates of the reliability of N-version, real-time software is presented. An extended stochastic Petri net is employed to represent the synchronization structure of N versions of the software, where dependencies among versions are modeled through correlated sampling of module execution times. Test results utilizing specifications for NASA's planetary lander control software indicate that mutation-based testing could hold greater potential for enhancing reliability than the desirable but perhaps unachievable goal of independence among N versions.
Geist, Robert↗
Continued results of the seeds in space experiment
Two million seeds of 120 different varieties representing 106 species, 97 genera, and 55 plant families were flown aboard the Long Duration Exposure Facility (LDEF). The seeds were housed on the Space Exposed Experiment Developed for Students (SEEDS) tray in the sealed canister number 6 and in two small vented canisters. The seeds were germinated and the germination rates and development of the resulting plants compared to the control seed that stayed in the storage facility. There was a better survival rate in the sealed canister in space than in the storage facility. At least some of the seed in the vented canisters survived the exposure to vacuum for almost six years. The number of observed mutations was very low. In the initial testing, the small seeded crops were not grown to maturity to check for mutation and obtain a second generation seed. These small seeded crops are now being grown for evaluation.
Alston, Jim A.↗
Continued results of the seeds in space experiment
Two million seeds of 120 different varieties representing 106 species, 97 genera, and 55 plant families were flown aboard the Long Duration Exposure Facility (LDEF). The seed were housed on the Space Exposed Experiment Developed for Students (SEEDS) tray in the sealed canister number 6 and in two small vented canisters. The tray was in the F-2 position. The seed were germinated and the germination rates and the development of the resulting plants were compared to the performance of the control seed that stayed in Park Seed's seed storage facility. The initial results were presented in a paper at the First LDEF Post-Retrieval Symposium. There was a better survival rate of the seed in the sealed canister in space than in the storage facility at Park Seed. At least some of the seed in each of the vented canisters survived the exposure to vacuum for almost six years. The number of observed apparent mutations was very low. In the initial testing, the small seeded crops were not grown to maturity to check for mutations and obtain second generation seed. These small seeded crops have now been grown for evaluation and second generation seed collected.
Alston, Jim A.↗
Robust Synthetic Biology Toolkit to Advance Carboxysome Study and Redesign
Carboxysomes are polyhedral protein organelles that microorganisms use to facilitate carbon dioxide assimilation. They are composed of a modular protein shell that envelops an enzymatic core mainly composed of physically coupled Rubisco and carbonic anhydrase. While the modular construction principles of carboxysomes make them attractive targets as customizable metabolic platforms, their size and complexity can be a hindrance. In this work, we design and validate a plasmid set, the pXpressome toolkit, in which α-carboxysomes are robustly expressed and remain intact and functional after purification. We tested this toolkit by introducing mutations that influence carboxysome structure and performance. We find that deletion of vertex-capping genes results in formation of larger carboxysomes, while deletion of facet forming genes produces smaller particles, suggesting that adjusting the ratio of these proteins can rationally affect morphology. Through a series of fluorescently labeled constructs, we observe that this toolkit leads to more uniform expression and better cell health than previously published carboxysome expression systems. Overall, the pXpressome toolkit facilitates the study and redesign of carboxysomes with robust performance and improved phenotype uniformity. The pXpressome toolkit will support efforts to remodel carboxysomes for enhanced carbon fixation or serve as a platform for other nanoencapsulation goals.
59 BASIC BIOLOGICAL SCIENCES↗
Over-Expression, Purification and Crystallization of Human Dihydrolipoamide Dehydrogenase
Dehydrolipoamide dehydrogenase (E3; dihydrolipoan-tide:NAD+ oxidoreductase, EC 1.8.1.4) is a common catalytic component found in pyruvate dehydrogenase complex, alpha-ketoglutarate dehydrogenase complex, and branched-chain cc-keto acid dehydrogenase complex. E3 is also a component (referred to as L protein) of the glycine cleavage system in bacterial metabolism (2). Active E3 forms a homodimer with four distinctive subdomain structures (FAD binding, NAD+ binding, central and interface domains) with non-covalently but tightly bound FAD in the holoenzyme. Deduced amino acids from cloned full-length human E3 gene showed a total of 509 amino acids with a leader sequence (N-terminal 35 amino acids) that is excised (mature form) during transportation of expressed E3 into mitochondria membrane. So far, three-dimensional structure of human E3 has not been reported. Our effort to achieve the elucidation of the X-ray crystal structure of human E3 will be presented. Recombinant pPROEX-1 expression vector (from GIBCO BRL Life Technologies) having the human E3 gene without leader sequence was constructed by Polymerase Chain Reaction (PCR) and subsequent ligation, and cloned in E.coli XL1-Blue by transformation. Since pPROEX-1 vector has an internal His-tag (six histidine peptide) located at the upstream region of a multicloning site, one-step affinity purification of E3 using nickelnitriloacetic acid (Ni-NTA) agarose resin, which has a strong affinity to His-tag, was feasible. Also a seven-amino-acid spacer peptide and a recombinant tobacco etch virus protease recognition site (seven amino acids peptide) found between His-tag and first amino acid of expressed E3 facilitated the cleavage of His-tag from E3 after the affinity purification. By IPTG induction, ca. 15 mg of human E3 (mature form) was obtained from 1L LB culture with overnight incubation at 25C. Over 98% of purity of E3 from one-step Ni-NTA agarose affinity purification was confirmed by SDS-PAGE analysis. For crystallization, E3 samples were prepared with and without His-tag. To minimize the aggregation of E3, apo- and holo- forms of E3s were tested, as well as a mutated E3. Dynamic light scattering measurements revealed that the E3 preparations without His-tag and substrate are highly monodispersive with regard to homodimers. Consequent crystallization trials of this E3 preparation led to single crystals of E3 grown by the vapor diffusion method. Crystals were obtained within a few days from solution containing poly (ethylene glycol) monomethyl ether 5000 as a precipitant. Autoindexing and integration of the X-ray diffraction data showed that E3 crystals belong to an orthorhombic system with unit cell parameters a-- 123. 1, b= 165.3 and c=214.3A. Further optimization of protein preparation and crystallization experiments for the structural determination will be discussed.
Hong, Y. S.↗
Cloning and characterization of ftsZ and pyrF from the archaeon Thermoplasma acidophilum
To characterize cytoskeletal components of archaea, the ftsZ gene from Thermoplasma acidophilum was cloned and sequenced. In T. acidophilum ftsZ, which is involved in cell division, was found to be in an operon with the pyrF gene, which encodes orotidine-5'-monophosphate decarboxylase (ODC), an essential enzyme in pyrimidine biosynthesis. Both ftsZ and pyrF from T. acidophilum were expressed in Escherichia coli and formed functional proteins. FtsZ expression in wild-type E. coli resulted in the filamentous phenotype characteristic of ftsZ mutants. T. acidophilum pyrF expression in an E. coli mutant lacking pyrF complemented the mutation and rescued the strain. Sequence alignments of ODCs from archaea, bacteria, and eukarya reveal five conserved regions, two of which have homology to 3-hexulose-6-phosphate synthase (HPS), suggesting a common substrate recognition and binding motif. Copyright 2000 Academic Press.
Bacterial Proteins/chemistry/genetics/metabolism↗
Leaky ribosomal scanning enables tunable translation of bicistronic ORFs in green algae
Advances in sequencing technology have unveiled examples of nucleus-encoded polycistrons, once considered rare. Exclusively polycistronic transcripts are prevalent in green algae, although the mechanism by which multiple polypeptides are translated from a single transcript is unknown. Here, we used bioinformatic and in vivo mutational analyses to evaluate competing mechanistic models for translation of bicistronic mRNAs in green algae. High-confidence manually curated datasets of bicistronic loci from two divergent green algae, Chlamydomonas reinhardtii and Auxenochlorella protothecoides, revealed a preference for weak Kozak-like sequences for ORF 1 and an underrepresentation of potential initiation codons before the ORF 2 start codon, which are suitable conditions for leaky ribosome scanning to allow ORF 2 translation. We used mutational analysis in A. protothecoides to test the mechanism. In vivo manipulation of the ORF 1 Kozak-like sequence and start codon altered reporter expression at ORF 2, with a weaker Kozak-like sequence enhancing expression and a stronger one diminishing it. A synthetic bicistronic dual reporter demonstrated inversely adjustable activity of green fluorescent protein expressed from ORF 1 and luciferase from ORF 2, depending on the strength of the ORF 1 Kozak-like sequence. Our findings demonstrate that translation of multiple ORFs in green algal bicistronic transcripts is consistent with episodic leaky scanning of ORF 1 to allow translation at ORF 2. This work has implications for the potential functionality of upstream open reading frames (uORFs) found across eukaryotic genomes and for transgene expression in synthetic biology applications.
59 BASIC BIOLOGICAL SCIENCES↗
Thermophilic Chassis-Enabled High-Throughput Selection of a Thermostable Fluorogenic Reporter
Thermostable proteins show increased shelf life and performance at elevated temperatures and under harsh conditions, resulting in lower costs for various industrial and biotechnological applications. However, due to a limited understanding of the relationship between stability and function, protein stabilization remains primarily a trial-and-error approach. Therefore, building a combinatorial library of mutations predicted to improve stability, followed by experimental testing, represents a markedly improved methodology. However, the lack of high-throughput approaches to screen even a moderately sized library presents a major bottleneck in the field. Here, in this study, we use a thermophile, Parageobacillus thermoglucosidasius (Ptherm) to rapidly screen combinatorial libraries consisting of rationally designed thermostabilizing mutations (∼10 3 –10 4 ) of a mesophilic fluorescent reporter, Y-FAST. On a Petri dish, microbial growth at an elevated temperature and exposure to fluorogen yielded several colonies of Ptherm that showed distinct fluorescence at 55 and 68 °C in our two sequentially generated libraries using Rosetta and ProteinMPNN, respectively. The Y-FAST variants isolated from fluorescent colonies were brighter than Y-FAST and showed higher resistance to thermal and chemical denaturation. AlphaFold-predicted structures and MD simulations revealed stability-enhancing salt bridges and hydrogen bond networks in the isolated FAST variants. The moderately thermostable FAST (tsFAST) and hyperstable FAST (hsFAST) were then demonstrated as translation reporters for protein expression and folding at elevated temperatures, such as 55 and 68 °C. Our approach of combinatorial library generation and high-throughput screening in a thermophilic chassis could, in principle, be extended to other proteins fused to these translation reporters. Furthermore, the hsFAST protein is small─half the size of the green fluorescent protein─and does not require oxygen for maturation, making it ideal for engineering extremophilic anaerobes for biosensing and bioconversion.
59 BASIC BIOLOGICAL SCIENCES↗