Search NASA⌕ Search

SEARCH · Search NASA

Results for “read performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Conversion of Environment Files from ORDEM 3 & MEM 3 to STENVI

To perform Micrometeoroid and Orbital Debris (MMOD) analyses, NASA describes the orbital debris particle environment using the ORDEM 3 tool and the micrometeoroid environment using the MEM 3 tool. Both output files that detail the flux of particles as a function of several parameters. European MMOD analyses use different tools to perform similar functions, including the Meteoroid And Space debris Terrestrial Environment Reference (MASTER) environment model, which outputs flux data in the Standard Environment Interface (STENVI) format. The NASA Johnson Space Center Hypervelocity Impact Technology Group was asked to create a converter to translate flux data from the output file formats used by ORDEM 3.x and MEM 3 into the STENVI file format. Validation was performed to ensure that the converter was reproducing the input data correctly. The Bumper 3 MMOD risk assessment tool has a capability for reading ORDEM 3.x, MEM 3, and STENVI environment file formats and was used to compare MMOD risk results generated using the converter’s output STENVI files to the risk results generated using the input ORDEM 3.x and MEM 3 igloo files. Specific point comparisons validated that the converter translated the environment data correctly, producing the intended output. However, realistic risk assessments showed that the bin methodology employed by Bumper for determining particle flux as a function of particle size when reading files in STENVI format produces much higher MMOD risk than the point-interpolation methodology used in Bumper risk assessments using ORDEM and MEM. Modifications to how Bumper 3 reads STENVI files during analyses are considered to improve Bumper’s ability to perform useful analyses with environment files in this format.

STENVI↗
NASA NTRS2023

Conversion of ORDEM 3.X & MEM 3 Into STENVI File Format

To perform Micrometeoroid and Orbital Debris (MMOD) analyses, NASA describes the orbital debris particle environment using the ORDEM 3 tool and the micrometeoroid environment using the MEM 3 tool. Both output files that detail the flux of particles as a function of several parameters. European MMOD analyses use different tools to perform similar functions, including the Meteoroid And Space debris Terrestrial Environment Reference (MASTER) environment model, which outputs flux data in the Standard Environment Interface (STENVI) format. The NASA Johnson Space Center Hypervelocity Impact Technology Group was asked to create a converter to translate flux data from the output file formats used by ORDEM 3.x and MEM 3 into the STENVI file format. Validation was performed to ensure that the converter was reproducing the input data correctly. The Bumper 3 MMOD risk assessment tool has a capability for reading ORDEM 3.x, MEM 3, and STENVI environment file formats and was used to compare MMOD risk results generated using the converter’s output STENVI files to the risk results generated using the input ORDEM 3.x and MEM 3 igloo files. Specific point comparisons validated that the converter translated the environment data correctly, producing the intended output. However, realistic risk assessments showed that the bin methodology employed by Bumper for determining particle flux as a function of particle size when reading files in STENVI format produces much higher MMOD risk than the point-interpolation methodology used in Bumper risk assessments using ORDEM and MEM. Modifications to how Bumper 3 reads STENVI files during analyses are considered to improve Bumper’s ability to perform useful analyses with environment files in this format.

STENVI↗
DOE OSTI2025

Post-DTL Beam Delivery

Ensuring that the beam delivered from the upgraded Front-End (FE) meets the Key Performance Parameters (KPPs) at each user facility is critical to the success of the LANSCE Accelerator Modernization Project (LAMP). For a high-intensity, multi-user facility like LANSCE, compliance with beam loss and radiation thresholds is as important as the charge delivered to each target. While early LAMPF/LANSCE operations relied on iterative tuning to minimize losses from beam halo and tail particles, the new FE may introduce different beam distributions and loss modes—making predictive modeling essential. To manage this, the F2E (Front-End to End) effort is developing detailed particle-tracking models that reflect realistic beamline conditions, including halo formation and expected diagnostic readings. These "snapshot" simulations aim to benchmark live machine performance at a given moment. This will help quantify how beam quality from the new FE will propagate downstream through the facility. Only by validating these models can we confidently assess and mitigate the potential impacts of the LAMP FE on beam delivery. Post-DTL, the beam splits to serve five major user facilities. Historically, low-energy beam transport has been modeled using TRACE, and higher-energy sections with TRANSPORT. These have now been unified into MAD-X format and validated with codes such as Elegant, pyOrbit, XSuite, Impact-Z, and HPSim. The primary focus now is on accurate modeling of full particle distributions (including beam halo) as they traverse the accelerator and beamlines to each experimental station. All models are at various stages of validation with empirical data.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Long-read sequencing transcriptome quantification with lr-kallisto

RNA abundance quantification has become routine and affordable thanks to high-throughput “short-read” technologies that provide accurate molecule counts at the gene level. Similarly accurate and affordable quantification of definitive full-length, transcript isoforms has remained a stubborn challenge, despite its obvious biological significance across a wide range of problems. “Long-read” sequencing platforms now produce data-types that can, in principle, drive routine definitive isoform quantification. However some particulars of contemporary long-read datatypes, together with isoform complexity and genetic variation, present bioinformatic challenges. We show here, using ONT data, that fast and accurate quantification of long-read data is possible and that it is improved by exome capture. To perform quantifications we developed lr-kallisto, which adapts the kallisto bulk and single-cell RNA-seq quantification methods for long-read technologies.

Loving, Rebekah K. (ORCID:0000000187250376)↗
DOE OSTI2015

SU-E-T-575: Novel Quality Assurance Procedure for the Small Animal Radiation Research Platform Using Commercial OSLDs

Purpose: To support radiobiological research with the Xstrahl small animal radiation research platform (SARRP) by developing a simple and effective method using commercially available optically stimulated luminescent dosimeters (OSLDs) that ensures dose output consistency. Methods: The SARRP output is calibrated according to the vendor standards and TG-61 protocol utilizing an ADCL calibrated ion chamber and electrometer at 2 cm depth of solid water. A cross calibration is performed by replacing the ion chamber with five OSLDs at the 2 cm depth. The OSLDs are irradiated to 500 cGy with 220 keV at 13 mA (78s delivery time) with a copper filter for an uncollimated 17×17 cm{sup 2} aperture. Instead of the absolute dose, the total amount of raw counts are collected from the OSLD reader and used for analysis. This constancy procedure was performed two more times over the course of three weeks with two OLSDs for validity. Results: The average reading for all OSLDs is 494939 with a 1-sigma standard deviation of the 5.8%. With an acceptable dose output range of ±10%, the OSLD readings have a counts range of [445445, 544433]. Conclusion: This method of using nanoDot™ OSLDs to perform output constancy checks for the SARRP ensures the output of the device is within 10% from the time of calibration and is convenient as well as time efficient. Because this, the frequency of output checks can be increased, which can improve the output stability for research with this device. The output trend of the SARRP will continue to be monitored in the future to establish a timeline for constancy checks and recalibration.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

Side readout of long scintillation crystal elements with digital SiPM for TOF-DOI PET

Purpose: Side readout of scintillation light from crystal elements in positron emission tomography (PET) is an alternative to conventional end-readout configurations, with the benefit of being able to provide accurate depth-of-interaction (DOI) information and good energy resolution while achieving excellent timing resolution required for time-of-flight PET. This paper explores different readout geometries of scintillation crystal elements with the goal of achieving a detector that simultaneously achieves excellent timing resolution, energy resolution, spatial resolution, and photon sensitivity. Methods: The performance of discrete LYSO scintillation elements of different lengths read out from the end/side with digital silicon photomultipliers (dSiPMs) has been assessed. Results: Compared to 3 × 3 × 20 mm{sup 3} LYSO crystals read out from their ends with a coincidence resolving time (CRT) of 162 ± 6 ps FWHM and saturated energy spectra, a side-readout configuration achieved an excellent CRT of 144 ± 2 ps FWHM after correcting for timing skews within the dSiPM and an energy resolution of 11.8% ± 0.2% without requiring energy saturation correction. Using a maximum likelihood estimation method on individual dSiPM pixel response that corresponds to different 511 keV photon interaction positions, the DOI resolution of this 3 × 3 × 20 mm{sup 3} crystal side-readout configuration was computed to be 0.8 mm FWHM with negligible artifacts at the crystal ends. On the other hand, with smaller 3 × 3 × 5 mm{sup 3} LYSO crystals that can also be tiled/stacked to provide DOI information, a timing resolution of 134 ± 6 ps was attained but produced highly saturated energy spectra. Conclusions: The energy, timing, and DOI resolution information extracted from the side of long scintillation crystal elements coupled to dSiPM have been acquired for the first time. The authors conclude in this proof of concept study that such detector configuration has the potential to enable outstanding detector performance in terms of timing, energy, and DOI resolution.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Initial demonstration of automated fuel performance modeling with 1977 EBR-II metallic fuel pins using BISON code with FIPD and IMIS databases

Using the BISON fuel performance code, simulations were conducted using an automated process to read initial and operating conditions from the Fuels Irradiation and Physics Database (FIPD) and Integral Fast Reactor materials information system (IMIS) database, which contains metallic fuel data from the Experimental Breeder Reactor-II (EBR-II). This work demonstrates use of an integrated framework to access the vast majority of EBR-II experimental fuel pin data to support rapid development of fuel performance models for next-generation metallic fuel systems. With this capability, validation for fuel qualification can be performed rapidly. Between IMIS and FIPD, there is enough information to conduct 1977 unique EBR-II metallic fuel pin histories from 24 different experiments, at varying levels of detail between the two databases. Each of these histories includes a high-resolution power history, flux history, coolant channel flow rates, and coolant channel temperatures. Fission gas release (FGR), cumulative damage fraction (CDF), fuel axial swelling, cladding profilometry, and burnup were all simulated in BISON. The results were compared to post-irradiation examination (PIE) results for the initial demonstration of automated BISON modeling. BISON simulations conducted with IMIS and FIPD were in rough agreement with PIE measurements and calculations. Cladding profilometry, FGR, and fuel axial swelling were found to be in rough agreement with PIE measurements, depending on the physics used within the BISON input files. Here, the mechanical contact solver chosen was found to significantly impact axial fuel swelling and cladding strain predictions. CDF values were assessed to see whether pin failure may have been predicted (CDF ≥ 1). This work suggests that continued development of an automated tool for BISON should focus on inclusion of the Fast Flux Test Facility (FFTF) experimental data for a larger database for metallic fuel, improved physical models to better capture fuel performance, such as fuel-cladding interactions, and a more detailed comparison with available PIE data to further the BISON model development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2016

SU-F-J-94: Development of a Plug-in Based Image Analysis Tool for Integration Into Treatment Planning

Purpose: To extend the functionality of a commercial treatment planning system (TPS) to support (i) direct use of quantitative image-based metrics within treatment plan optimization and (ii) evaluation of dose-functional volume relationships to assist in functional image adaptive radiotherapy. Methods: A script was written that interfaces with a commercial TPS via an Application Programming Interface (API). The script executes a program that performs dose-functional volume analyses. Written in C#, the script reads the dose grid and correlates it with image data on a voxel-by-voxel basis through API extensions that can access registration transforms. A user interface was designed through WinForms to input parameters and display results. To test the performance of this program, image- and dose-based metrics computed from perfusion SPECT images aligned to the treatment planning CT were generated, validated, and compared. Results: The integration of image analysis information was successfully implemented as a plug-in to a commercial TPS. Perfusion SPECT images were used to validate the calculation and display of image-based metrics as well as dose-intensity metrics and histograms for defined structures on the treatment planning CT. Various biological dose correction models, custom image-based metrics, dose-intensity computations, and dose-intensity histograms were applied to analyze the image-dose profile. Conclusion: It is possible to add image analysis features to commercial TPSs through custom scripting applications. A tool was developed to enable the evaluation of image-intensity-based metrics in the context of functional targeting and avoidance. In addition to providing dose-intensity metrics and histograms that can be easily extracted from a plan database and correlated with outcomes, the system can also be extended to a plug-in optimization system, which can directly use the computed metrics for optimization of post-treatment tumor or normal tissue response models. Supported by NIH - P01 - CA059827.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2004

Clarissa Spoken Dialogue System for Procedure Reading and Navigation

Speech is the most natural modality for humans use to communicate with other people, agents and complex systems. A spoken dialogue system must be robust to noise and able to mimic human conversational behavior, like correcting misunderstandings, answering simple questions about the task and understanding most well formed inquiries or commands. The system aims to understand the meaning of the human utterance, and if it does not, then it discards the utterance as being meant for someone else. The first operational system is Clarissa, a conversational procedure reader and navigator, which will be used in a System Development Test Objective (SDTO) on the International Space Station (ISS) during Expedition 10. In the present environment one astronaut reads the procedure on a Manual Procedure Viewer (MPV) or paper, and has to stop to read or turn pages, shifting focus from the task. Clarissa is designed to read and navigate ISS procedures entirely with speech, while the astronaut has his eyes and hands engaged in performing the task. The system also provides an MPV like graphical interface so the procedure can be read visually. A demo of the system will be given.

Hieronymus, James↗
DOE OSTI2022

BioADAPT-MRC: adversarial learning-based domain adaptation improves biomedical machine reading comprehension task

ABSTRACT Motivation Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requirement for domain knowledge, inducing the scarcity of labeled data and the need for transfer learning from the labeled general-purpose (source) domain to the biomedical (target) domain. However, there is a discrepancy in marginal distributions between the general-purpose and biomedical domains due to the variances in topics. Therefore, direct-transferring of learned representations from a model trained on a general-purpose domain to the biomedical domain can hurt the model’s performance. Results We present an adversarial learning-based domain adaptation framework for the biomedical machine reading comprehension task (BioADAPT-MRC), a neural network-based method to address the discrepancies in the marginal distributions between the general and biomedical domain datasets. BioADAPT-MRC relaxes the need for generating pseudo labels for training a well-performing biomedical-MRC model. We extensively evaluate the performance of BioADAPT-MRC by comparing it with the best existing methods on three widely used benchmark biomedical-MRC datasets—BioASQ-7b, BioASQ-8b and BioASQ-9b. Our results suggest that without using any synthetic or human-annotated data from the biomedical domain, BioADAPT-MRC can achieve state-of-the-art performance on these datasets. Availability and implementation BioADAPT-MRC is freely available as an open-source project at https://github.com/mmahbub/BioADAPT-MRC. Supplementary information Supplementary data are available at Bioinformatics online.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

SU-D-213-05: Design, Evaluation and First Applications of a Off-Site State-Of-The-Art 3D Dosimetry System

Purpose: To design, construct and commission a prototype in-house three dimensional (3D) dose verification system for stereotatic body radiotherapy (SBRT) verification at an off-site partner institution. To investigate the potential of this system to achieve sufficient performance (1mm resolution, 3% noise, within 3% of true dose reading) for SBRT verification. Methods: The system was designed utilizing a parallel ray geometry instigated by precision telecentric lenses and an LED 630nm light source. Using a radiochromic dosimeter, a 3D dosimetric comparison with our gold-standard system and treatment planning software (Eclipse) was done for a four-field box treatment, under gamma passing criteria of 3%/3mm/10% dose threshold. Post off-site installation, deviations in the system’s dose readout performance was assessed by rescanning the four-field box irradiated dosimeter and using line-profiles to compare on-site and off-site mean and noise levels in four distinct dose regions. As a final step, an end-to-end test of the system was completed at the off-site location, including CT-simulation, irradiation of the dosimeter and a 3D dosimetric comparison of the planned (Pinnacle{sup 3}) to delivered dose for a spinal SBRT treatment(12 Gy per fraction). Results: The noise level in the high and medium dose regions of the four field box treatment was relatively 5% pre and post installation. This reflects the reduction in positional uncertainty through the new design. This At 1mm dose voxels, the gamma pass rates(3%,3mm) for our in-house gold standard system and the off-site system were comparable at 95.8% and 93.2% respectively. Conclusion: This work will describe the end-to-end process and results of designing, installing, and commissioning a state-of-the-art 3D dosimetry system created for verification of advanced radiation treatments including spinal radiosurgery.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Leveraging Radiofrequency Identification Success Beyond Hazardous Material Inventory Management at a National Laboratory

Effective inventory management can be overshadowed by conflicting priorities in organizational procedures, particularly in research-focused institutions such as national laboratories that handle expensive, delicate, and hazardous materials. Here, this study investigated the potential of radiofrequency identification (RFID) technology, currently used for hazardous chemical inventory, in applications with higher metal interference and absorption, specifically pressure release device (PRD) compliance and nuclear container management, at Lawrence Livermore National Laboratory (LLNL). This study was done to document best practices to enhance inventory identification speeds for inventory reconciliation and inventory recall and to explore optimal configurations for RFID implementation compared to traditional manual methods of equipment management. Tests were conducted to determine the ideal RFID tag orientation (read at angles of 0°, 90°, and 270°), various container layouts (linear, separated, curved, operational), and ID methods such as manual, barcode, and RFID performing three trials per method per orientation. Results indicated that 0° was the optimal read angle for minimizing metallic interference, and the operational and curved arrangements significantly outperformed the linear and separated configurations in read speed. 3D printed mounts were developed and tested, increasing the read range of the RFID reader by up to 235% in cases of high metallic interference. The RFID technology demonstrated an average speed increase of 65% over a simplified manual identification, which supports the conclusion that RFID is a more efficient method for large hazardous inventory management and equipment reconciliation. Additionally, capturing meta-data, such as location and date, can be used to query for inventory recall and automated updating of record information.

42 ENGINEERING↗
DOE OSTI2023

Performance of methods for SARS-CoV-2 variant detection and abundance estimation within mixed population samples

The accurate identification of SARS-CoV-2 (SC2) variants and estimation of their abundance in mixed population samples (e.g., air or wastewater) is imperative for successful surveillance of community level trends. Assessing the performance of SC2 variant composition estimators (VCEs) should improve our confidence in public health decision making. Here, we introduce a linear regression based VCE and compare its performance to four other VCEs: two re-purposed DNA sequence read classifiers (Kallisto and Kraken2), a maximum-likelihood based method (Lineage deComposition for Sars-Cov-2 pooled samples (LCS)), and a regression based method (Freyja). We simulated DNA sequence datasets of known variant composition from both Illumina and Oxford Nanopore Technologies (ONT) platforms and assessed the performance of each VCE. We also evaluated VCEs performance using publicly available empirical wastewater samples collected for SC2 surveillance efforts. Bioinformatic analyses were performed with a custom NextFlow workflow (C-WAP, CFSAN Wastewater Analysis Pipeline). Relative root mean squared error (RRMSE) was used as a measure of performance with respect to the known abundance and concordance correlation coefficient (CCC) was used to measure agreement between pairs of estimators. Based on our results from simulated data, Kallisto was the most accurate estimator as it had the lowest RRMSE, followed by Freyja. Kallisto and Freyja had the most similar predictions, reflected by the highest CCC metrics. We also found that accuracy was platform and amplicon panel dependent. For example, the accuracy of Freyja was significantly higher with Illumina data compared to ONT data; performance of Kallisto was best with ARTICv4. However, when analyzing empirical data there was poor agreement among methods and variations in the number of variants detected (e.g., Freyja ARTICv4 had a mean of 2.2 variants while Kallisto ARTICv4 had a mean of 10.1 variants). This work provides an understanding of the differences in performance of a number of VCEs and how accurate they are in capturing the relative abundance of SC2 variants within a mixed sample (e.g., wastewater). Such information should help officials gauge the confidence they can have in such data for informing public health decisions.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

The Anatomy of Mr. Scan: A Dissection of Performance of an Extreme Scale GPU-Based Clustering Algorithm, In: 2014 5th Workshop on Latest Advances in Scalable Algorithms for Large-Scale Systems

The emergence of leadership class systems with GPU-equipped nodes has the potential to vastly increase the performance of existing distributed applications. However, the inclusion of GPU computation into existing extreme scale distributed applications can reveal scalability issues that were absent in the CPU version. The issues exposed in scaling by a GPU can become limiting factors to overall application performance. We developed an extreme scale GPU-based application to perform data clustering on multi-billion point datasets. In this application, called Mr. Scan, we ran into several of these performance limiting issues. Through the use of complete end-to-end benchmarking of Mr. Scan (measuring time from reading and distribution to final output), we were able to identify three major sources of real world performance issues: data distribution, GPU load balancing, and system specific issues such as start-up time. These issues comprised a vast majority of the run time of Mr. Scan. Data distribution alone accounted for 68% of the total run time of Mr. Scan when processing 6.5 billion points on Cray Titan at 8192 nodes. With improvements in these areas, we have been able able to cut total run time of Mr. Scan from 17.5 minutes to 8.3 minutes when clustering 6.5 billion points.

Computer Science↗
DOE OSTI2020

Standardized phylogenetic and molecular evolutionary analysis applied to species across the microbial tree of life

There is growing interest in reconstructing phylogenies from the copious amounts of genome sequencing projects that target related viral, bacterial or eukaryotic organisms. To facilitate the construction of standardized and robust phylogenies for disparate types of projects, we have developed a complete bioinformatic workflow, with a web-based component to perform phylogenetic and molecular evolutionary (PhaME) analysis from sequencing reads, draft assemblies or completed genomes of closely related organisms. Furthermore, the ability to incorporate raw data, including some metagenomic samples containing a target organism (e.g. from clinical samples with suspected infectious agents), shows promise for the rapid phylogenetic characterization of organisms within complex samples without the need for prior assembly.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Design Optimization and Measurement Uncertainty of an Electromagnetic Level Sensor for Liquid Metal Reactors

Here, this article describes the design and operation of a prototype mutual inductance level sensor (MILS) and the development and validation of a finite-element analysis (FEA) model describing its behavior. The MILS was designed for use in liquid sodium up to temperatures of 650 °C in the Mechanisms Engineering Test Loop (METL) at Argonne National Laboratory (ANL). Preliminary testing was performed in a room temperature test stand with aluminum acting as an analog for the sodium to better understand sensor performance and provide accurate code validation data. This experimental data, along with material properties found in literature, were used to validate an FEA model in ANSYS Maxwell. The validated ANSYS Maxwell model was used to examine the performance of the MILS in various environments and under various operating conditions. Simulations suggest the following: The MILS will perform adequately in liquid sodium and liquid lead at temperatures up to 650 °C . The temperature dependence of electrical conductivity imposes a temperature dependence on the sensor that requires proper compensation. The MILS signal sensitivity is maximized when mutual inductance between sensor coils is maximized, and sensor geometry should be selected to account for this factor. The operating frequency of the MILS can be optimized and is dependent on process fluid material, operating temperature, and materials/geometry of sensor system. Finally, the use of a stainless-steel isolating thimble does not adversely affect the sensor signal. The primary sources of error for this MILS system are the accuracy of the calibration standard against which the sensor is calibrated, and the temperature dependence of the sensor. This work contains all the necessary details to recreate the FEA model and results. This model can be used to optimize the performance of a MILS in any operating environment to read any electrically conductive working fluid.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2015

FireHose Streaming Benchmarks

The FireHose Streaming Benchmarks are a suite of stream-processing benchmarks defined to enable comparison of streaming software and hardware, both quantitatively vis-a-vis the rate at which they can process data, and qualitatively by judging the effort involved to implement and run the benchmarks. Each benchmark has two parts. The first is a generator which produces and outputs datums at a high rate in a specific format. The second is an analytic which reads the stream of datums and is required to perform a well-defined calculation on the collection of datums, typically to find anomalous datums that have been created in the stream by the generator. The FireHose suite provides code for the generators, sample code for the analytics (which users are free to re-implement in their own custom frameworks), and a precise definition of each benchmark calculation.

Plimpton, Steve↗