Search NASA⌕ Search

SEARCH · Search NASA

Results for “DATA ACQUISITION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Statistically elucidated responses from low-signal contrast mechanisms in ultrafast electron microscopy

The emergence of ultrafast electron microscopy (UEM) has enabled the discovery of strongly correlated dynamic mechanisms, including electron–phonon coupling, structural phase transitions, thermal transport, and electromagnetic deflection. Most UEM systems operate stroboscopically, meaning that the technique is susceptible to artifacts, mistakes, and misinterpretation of the data due to extensive experimental effort. In contrast to the ultrafast designation, data acquisition is extraordinarily slow because the electron beam has significantly reduced signal compared to traditional transmission electron microscopy due to pulsing the electron beam. Consequently, the sample may drift, tilt, or undergo irreversible structural changes that are independent of the time-resolved dynamics throughout the experimental time frame. Furthermore, these datasets require significant user interpretation that can be problematic when proper controls are not implemented thoroughly. Here, we demonstrate a new algorithm designed to separate ultrafast structural dynamics from long-term artifacts using a LiNbO 3 sample experiencing electrically driven surface acoustic wave propagation. Additionally, we provide examples of the impact of user bias when analyzing the data and provide a methodology, which enables the extraction of time-resolved responses when the image signal is extraordinarily low. Overall, the goal of this publication is to provide methods that validate the experimental results and reduce researcher biases during UEM data interpretation.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A prototype scintillator real‐time beam monitor for ultra‐high dose rate radiotherapy

Background: FLASH Radiotherapy (RT) is an emergent cancer RT modality where an entire therapeutic dose is delivered at more than 1000 times higher dose rate than conventional RT. For clinical trials to be conducted safely, a precise and fast beam monitor that can generate out-of-tolerance beam interrupts is required. This paper describes the overall concept and provides results from a prototype ultra-fast, scintillator-based beam monitor for both proton and electron beam FLASH applications. Purpose: A FLASH Beam Scintillator Monitor (FBSM) is being developed that employs a novel proprietary scintillator material. The FBSM has capabilities that conventional RT detector technologies are unable to simultaneously provide: (1) large area coverage; (2) a low mass profile; (3) a linear response over a broad dynamic range; (4) radiation hardness; (5) real-time analysis to provide an IEC-compliant fast beam-interrupt signal based on true two-dimensional beam imaging, radiation dosimetry and excellent spatial resolution. Methods: The FBSM uses a proprietary low mass, less than 0.5 mm water equivalent, non-hygroscopic, radiation tolerant scintillator material (designated HM: hybrid material) that is viewed by high frame rate CMOS cameras. Folded optics using mirrors enable a thin monitor profile of ∼10 cm. A field programmable gate array (FPGA) data acquisition system generates real-time analysis on a time scale appropriate to the FLASH RT beam modality: 100–1000 Hz for pulsed electrons and 10–20 kHz for quasi-continuous scanning proton pencil beams. An ion beam monitor served as the initial development platform for this work and was tested in low energy heavy-ion beams ( 86 Kr +26 and protons). A prototype FBSM was fabricated and then tested in various radiation beams that included FLASH level dose per pulse electron beams, and a hospital RT clinic with electron beams. Results: Results presented in this report include image quality, response linearity, radiation hardness, spatial resolution, and real-time data processing. Furthermore, the HM scintillator was found to be highly radiation damage resistant. It exhibited a small 0.025%/kGy signal decrease from a 216 kGy cumulative dose resulting from continuous exposure for 15 min at a FLASH compatible dose rate of 237 Gy/s. Measurements of the signal amplitude versus beam fluence demonstrate linear response of the FBSM at FLASH compatible dose rates of >40 Gy/s. Comparison with commercial Gafchromic film indicates that the FBSM produces a high resolution 2D beam image and can reproduce a nearly identical beam profile, including primary beam tails. The spatial resolution was measured at 35–40 µm. Tests of the firmware beta version show successful operation at 20 000 Hz frame rate or 50 µs/frame, where the real-time analysis of the beam parameters is achieved in less than 1 µs. Conclusions: The FBSM is designed to provide real-time beam profile monitoring over a large active area without significantly degrading the beam quality. A prototype device has been staged in particle beams at currents of single particles up to FLASH level dose rates, using both continuous ion beams and pulsed electron beams. Using a novel scintillator, beam profiling has been demonstrated for currents extending from single particles to 10 nA currents. Radiation damage is minimal and even under FLASH conditions would require ≥50 kGy of accumulated exposure in a single spot to result in a 1% decrease in signal output. Beam imaging is comparable to radiochromic films, and provides immediate images without hours of processing. Real-time data processing, taking less than 50 µs (combined data transfer and analysis times), has been implemented in firmware for 20 kHz frame rates for continuous proton beams.

2D beam imaging↗

The critical importance of software for HEP

Particle physics has an ambitious and broad global experimental programme for the coming decades. Large investments in building new facilities are already underway or under consideration. Scaling the present processing power and data storage needs by the foreseen increase in data rates in the next decade for HL-LHC is not sustainable within the current budgets. As a result, a more efficient usage of computing resources is required in order to realise the physics potential of future experiments. Software and computing are an integral part of experimental design, trigger and data acquisition, simulation, reconstruction, and analysis, as well as related theoretical predictions. A significant investment in computing and software is therefore critical. Advances in software and computing, including artificial intelligence (AI) and machine learning (ML), will be key for solving these challenges. Making better use of new processing hardware such as graphical processing units (GPUs) or ARM chips is a growing trend. This forms part of a computing solution that makes efficient use of facilities and contributes to the reduction of the environmental footprint of HEP computing. The HEP community already provided a roadmap for software and computing for the last EPPSU, and this paper updates that, with a focus on the most resource critical parts of our data processing chain.

97 MATHEMATICS AND COMPUTING↗

A novel integrated time-resolved array avalanche photodiode detection system for nuclear resonant scattering measurements

Here, the nuclear resonant scattering (NRS) experiment requires photon-counting detectors with high time resolution, short dead time, large dynamic range, low noise, and large detection area. An 8-channel avalanche photodiode (APD) array detector system with high integrity, flexibility, and reliability has been developed to adapt to the demands of NRS experiments. The detector system mainly consists of four key parts: (i) an array-APD sensor, (ii) 8-channel integrated fast preamplifiers, (iii) the time-to-digital converter readout electronics, and (iv) a data acquisition system and EPICS support software. Remarkably, the system exhibits a time resolution of better than 500 ps and has a sufficiently low noise level, allowing for the lowest detection energy threshold of 4 keV. The performance of the new array-APD system as well as its real application in nuclear forward scattering (NFS) and nuclear resonant inelastic x-ray scattering (NRIXS) experiments was tested in two synchrotron facilities. With the new system, the NFS signal very close to the prompt electronic scattering signal can be extracted. Thanks to the customized EPICS-areaDetector-based control software, NRIXS spectra can be readily measured with time and energy information of the NRIXS signal stored in the raw data, which is promising for developing NRIXS data analysis in the time domain. The array-APD detector can be deployed for nuclear resonant scattering experiments at various synchrotron radiation facilities.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Comparison of pyrometry and thermography for thermal analysis of thermite reactions

This article examines the thermal behavior of a laser ignited thermite composed of aluminum and bismuth trioxide. Temperature data were collected during the reaction using a four-color pyrometer and a high-speed color camera modified for thermography. The two diagnostics were arranged to collect data simultaneously, with similar fields of view and with similar data acquisition rates, so that the two techniques could be directly compared. Results show that at initial and final stages of the reaction, a lower signal-to-noise ratio affects the accuracy of the measured temperatures. Both diagnostics captured the same trends in transient thermal behavior, but the average temperatures measured with thermography were about 750 K higher than those from the pyrometer. This difference was attributed to the lower dynamic range of the thermography camera’s image sensor, which was unable to resolve cooler temperatures in the field of view as well as the photomultiplier tube sensors in the pyrometer. Overall, while the camera could not accurately capture the average temperature of a scene, its ability to capture peak temperatures and spatial data make it the preferred method for tracking thermal behavior in thermite reactions.

36 MATERIALS SCIENCE↗

GeoDAWN West Central Nevada EarthMRI Data

This submission includes both the original product resolution (OPR) and LiDAR point cloud (LPC) LiDAR data collected as part of GeoDAWN: Geoscience Data Acquisition for Western Nevada. The USGS Earth Mapping Resources Initiative (EarthMRI) and USGS 3D Elevation Program (3DEP), Department of Energy Geothermal Technologies Office, Natural Resources Conservation Services, and Bureau of Land Management have partnered to conduct airborne geophysical and 3DEP lidar surveys over parts of Nevada and California to collect information on undiscovered geothermal, critical mineral, and groundwater resources in the western Great Basin and the Walker Lane region.

15 GEOTHERMAL ENERGY↗

eCounter: Inline Per-IP Network Monitoring at Millisecond Resolution via eBPF

Scientific data acquisition (SciDAQ) systems are shifting from archive-based workflows to streaming paradigms, where real-time, fine-grained network monitoring becomes essential. While P4-enabled devices offer per-packet in-band observability, they require specialized switches and routers. Host-side tools like Prometheus exporters lack sufficient temporal granularity. To bridge this gap, we present eCounter, a lightweight, hardware-agnostic, inline telemetry agent built on extended Berkeley Packet Filter (eBPF). eCounter captures per-interface ingress and egress traffic, categorized by IP address and protocol, at millisecond to sub-millisecond resolution. In a 100 Gbps environment, it continuously exports up to 3,257 time-series bins per second with only 4% CPU utilization at a 35¿KiB/s data rate. We evaluate eCounter across diverse NIC MTU settings, hook types, CPU architectures and operating systems, and observed negligible impact on concurrent high-throughput streaming applications. Complexity analysis confirms that it can be readily scaled to distributed SciDAQ deployments.

Mei, Xinxin [Computational Sciences and Technology↗

2.2.2.405 - Verdant/NREL Research Measurement Campaign

The marine renewable energy industry primarily uses thermoset composite materials for blades and other hydrodynamic components, which can have up to 50% reduction in strength when exposed to seawater and are not recyclable. Thermoplastic composite materials have been shown at a coupon-scale to have improved seawater saturated properties but have not been validated at full scale. The primary goal of the project is to demonstrate the structural properties of thermoplastic-fiberglass composite blades compared to epoxy-fiberglass composite blades in seawater at a tidal energy site on an operational turbine. Through this work, NREL manufactured, tested and deployed thermoplastic blades and a data acquisition system on Verdant Power's turbine TriFrame in the East River, NYC. The thermoplastic blades and DAQ were retrieved after a 6-month deployment with no signs of degradation and all cable connections, structural supports and strain gages had a 100% survival rate. The blades are currently undergoing post-deployment structural validation to compare their performance to traditional epoxy blades that were deployed for the same amount of time. This will increase confidence in thermoplastic materials and move it closer to commercial adoption, as well as increase confidence in the design of a DAQ and instrumentation method for a tidal turbine. However, due to an error in the DAQ software that was introduced after the DAQ and software were validated, there was no loads data collected during the deployment.

blade testing↗

Cybersecurity Anomaly Detection in SCADA-Assisted OT Networks Using Ensemble-Based State Prediction Model

The cybersecurity threats of power system gradually grow due to the increased sophisticated interactions between Information Technology (IT) and Operational Technology (OT) networks. False data injection attack (FDIA) that aims to compromise the Supervisory Control and Data Acquisition (SCADA) measurement and disturb the system operation is one of such cyber threats. Such attacks can potentially lead to significant operational issues at the control centers and substations, and hence, result in severe physical consequences. To avoid catastrophic failure across the power grid resulting from these attacks, it is essential to arm the OT network with real-time vulnerability assessment tools. To this end, this paper outlines various drawbacks of the Purdue architecture model to defend against cyberattacks in the OT network. Furthermore, a novel ensemble-based state prediction model is proposed to detect cybersecurity anomalies in SCADA assisted OT networks. The proposed model uses control center level generation and load forecasts, scheduled, and forced outages, power flow solutions, and the substation level historical data. The hypothesis of the proposed scheme relies on the fact that additional control center and substation data can hardly be accessed and compromised by attackers. One of the vital features of the proposed scheme is an hour-ahead prediction of the operational feasibility of the SCADA measurement range at the control center and substation in real time helps in detecting anomalies in measurements across both substation and the control center.

24 POWER TRANSMISSION AND DISTRIBUTION↗

GeoDAWN Northwestern Elko County Nevada EarthMRI Data

This submission includes both the original product resolution (OPR) and LiDAR point cloud (LPC) LiDAR data collected as part of GeoDAWN: Geoscience Data Acquisition for Northwestern Elko County, Nevada. The USGS Earth Mapping Resources Initiative (EarthMRI) and USGS 3D Elevation Program (3DEP), Department of Energy Geothermal Technologies Office, Natural Resources Conservation Services, and Bureau of Land Management have partnered to conduct airborne geophysical and 3DEP lidar surveys over parts of Nevada and California to collect information on undiscovered geothermal, critical mineral, and groundwater resources in the western Great Basin and the Walker Lane region.

15 GEOTHERMAL ENERGY↗

Elucidating and predicting the dynamic evolution of water and land systems due to natural and energy-related forcings

Focal Area(s): 3. Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI; & 1. Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization, unsupervised learning (including deep learning), and hardware-related efforts involving AI (e.g., edge computing). Science Challenge: Interactions between water, land, and energy systems are complex and occur on a variety of scales, ranging from local to basinal to regional. Accurately predicting the behavior of ground water and surface water systems for 5-10 years and beyond requires an understanding of the current system and the ability to model both the natural system at scale and human-induced forcings related to energy and other activities. Artificial intelligence and machine learning (AI/ML) combined with modern compilation and integration efforts for U.S. groundwater and surface water systems present potential solutions to bolstering detailed physics-based models of these systems. Big data tied with ML and physics-based modeling can drive breakthroughs in understanding the earth system, but research is often impeded by data access (e.g., privacy issues), quality, formats, gaps, multi-source, multi-scale, integration, and spatiotemporal challenges. Effective integration of real data and simulated (synthetic) data that fill gaps is critical. Overcoming these complex data and model integration challenges will enable a transformational approach to acquiring enhanced understanding of environmental systems.

54 ENVIRONMENTAL SCIENCES↗

Development of a Radiation-Tolerant Front End Digitizer

High-radiation and high-temperature environments represent notoriously detrimental conditions for electronics. Yet sensors and instrumentation are critically important for the safe operation of nuclear reactors and for the validity of the scientific experiments conducted within them. Traditionally, sensors in such extreme environments operate with few active components, resulting in small signals (mV–V, nA–µA range) that must be transmitted through long cable runs before digitization by sensitive data acquisition systems located in clean, less-harsh environments. Long cables are prone to picking up noise through electromagnetic interference and distortion caused by their parasitic impedances, resulting in signal degradation. The Front End Digitizer (FREND) system described and demonstrated herein seeks to address these issues by enabling the placement of a radiation-resistant analog front end within reactor containment, or other high-radiation environments. FREND will enable early signal pre-amplification, digitization, and optical encoding within the high-radiation field to transmit sensor signals over an optical fiber to the non-nuclear environment of an instrument room. Early signal pre-amplification and digitization maintain signal integrity, whereas optical transmission renders the system blind to induced electromagnetic noise over the long cable runs. This report describes the FREND initial prototype, which can multiplex and optically encode data from up to four sensor inputs, though, in principle, this can be extended to any number of sensor inputs. The end result is an extremely flexible, high-fidelity system.

42 ENGINEERING↗

Intelligent Experiments Through Real-time AI: Fast Data Processing and Autonomous Detector Control for sPHENIX and Future EIC Detectors (Final Report)

The overall vision of this project was to integrate real-time artificial intelligence (AI) directly into the data acquisition and detector-control systems of nuclear physics experiments, including both fast online event selection and an autonomous detector-control feedback loop. The work carried out under the award focused on the fast online event-selection half of that vision: the efficient recording of low-momentum heavy-flavor (HF) hadron decays in proton-proton collisions at the sPHENIX experiment at the Relativistic Heavy Ion Collider (RHIC)—an observable that requires fast tracking and topological trigger selection not previously demonstrated at RHIC, and that is essential for QCD studies at future facilities such as the Electron-Ion Collider (EIC). The autonomous detector-control (GPU-based feedback) component named in the project title remained a design concept and was not implemented under this award. The Massachusetts Institute of Technology (MIT) group led the offline simulation and data processing needed to train the machine-learning (ML) models, the translation of trained models to Field-Programmable Gate Array (FPGA) firmware using the hls4ml framework, and the physics validation of heavy-flavor reconstruction. Over the award period, the team developed and hardware-tested the principal components of an AI-based heavy-flavor trigger on simulated and recorded sPHENIX tracker data: a software Bipartite Graph Attention Network (BiGAT) trigger model reaching > 95% signal efficiency at 99% background rejection; an FPGA-native hit clusterizer matching the offline clustering; smaller networks synthesized to FPGA within the required sub-10 µs latency; and an assembled decoder–clusterizer–inference firmware chain exercised on the FELIX readout board. A complete, fully integrated hardware demonstrator was not finished within the award period. This report documents the project goals, the MIT group’s contributions, the technical accomplishments, and the outlook toward applications at the future EIC ePIC detector.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

AOI-2, A Novel Access Control Blockchain Paradigm for Cybersecure Sensor Infrastructure in Fossil Power Generation Systems

Fossil power generation systems are increasingly vulnerable to attack from both cybercriminals as well as internal threats. These vulnerabilities demand that emerging technologies such as blockchains be utilized to secure the data involved in the information flows within the Supervisory Control and Data Acquisition (SCADA) systems of the fossil power generation plants. The publicly accessible blockchain protocols, although secure, are visible to everyone. Even private blockchains currently are unable to support different levels of access to different participants, which is a critical requirement for the existing SCADA systems running the power plants. In light of the above, novel blockchain protocols that are specifically adapted to fossil power generation environments need to be developed in order to achieve the goal of cybersecure sensor networks. In this work, we address this question by creating a novel blockchain technology, namely smart private ledger, for cybersecure communication within the fossil power generation systems. A lab-scale sensor network consisting of strain and temperature sensors is constructed to develop the ledger. The technology has hierarchical access control which is compatible with the existing SCADA systems in fossil power plants. The sensor data is used with cryptographic digital signatures and secret sharing protocols within the nodes of the blockchain technology. The research results will lead to cybersecurity for machine-to-machine interactions, infrastructure for secure data logging for sensors, decentralized data storage, and second-layer technologies for high volume machine-to-machine interactions in the power plants. The work aims to largely address the concerns for the security of distributed sensor networks in such systems that can be compromised by insider threats and by cybercriminals. The research has led to the training of the next generation of engineers and scientists in the important areas of sensor engineering and blockchain technology.

01 COAL, LIGNITE, AND PEAT↗

Influence of soil heterogeneity on soybean plant development and crop yield evaluated using time-series of UAV and ground-based geophysical imagery

Understanding the interactions among agricultural processes, soil, and plants is necessary for optimizing crop yield and productivity. This study focuses on developing effective monitoring and analysis methodologies that estimate key soil and plant properties. These methodologies include data acquisition and processing approaches that use unmanned aerial vehicles (UAVs) and surface geophysical techniques. In particular, we applied these approaches to a soybean farm in Arkansas to characterize the soil–plant coupled spatial and temporal heterogeneity, as well as to identify key environmental factors that influence plant growth and yield. UAV-based multitemporal acquisition of high-resolution RGB (red–green–blue) imagery and direct measurements were used to monitor plant height and photosynthetic activity. We present an algorithm that efficiently exploits the high-resolution UAV images to estimate plant spatial abundance and plant vigor throughout the growing season. Such plant characterization is extremely important for the identification of anomalous areas, providing easily interpretable information that can be used to guide near-real-time farming decisions. Additionally, high-resolution multitemporal surface geophysical measurements of apparent soil electrical conductivity were used to estimate the spatial heterogeneity of soil texture. By integrating the multiscale multitype soil and plant datasets, we identified the spatiotemporal co-variance between soil properties and plant development and yield. Our novel approach for early season monitoring of plant spatial abundance identified areas of low productivity controlled by soil clay content, while temporal analysis of geophysical data showed the impact of soil moisture and irrigation practice (controlled by topography) on plant dynamics. Our study demonstrates the effective coupling of UAV data products with geophysical data to extract critical information for farm management.

54 ENVIRONMENTAL SCIENCES↗

Associated Particle Imaging of Neutron Inelastic Scatter: 3-D Reconstruction, Capabilities, and Challenges

Associated particle imaging (API) offers unique advantages for 3-D imaging of neutron inelastic scatter, including single-view tomographic imaging and data acquisition when access is limited to only one side of the interrogated object. However, widespread adoption of neutron inelastic scatter imaging has been impeded by several inherent challenges, most prominently spatial resolution, self-attenuation, and statistical noise. Here, in this work, the capabilities and challenges of neutron inelastic scatter imaging are investigated. Instead of focusing on a single imaging application, we identify imaging principles that hold for various neutron inelastic scatter imaging techniques. The primary challenges for 3-D imaging are characterized. The inherent spatial resolution in the time-of-flight (TOF) dimension is derived based on the known system timing resolution and scan geometry. Three reconstruction algorithms are described and demonstrated, including the introduction of modern iterative reconstruction incorporating a physics-based system model. Simulation is leveraged to demonstrate imaging capability with varying coincidence count levels and system timing resolution. An example of measured data with both back-scatter and forward-scatter detector positioning is presented. System design characteristics and their effects on image quality are identified. The imaging framework presented in this article has the potential to facilitate growth of 3-D neutron inelastic scatter API by identifying applications that are a good match for the technique and by targeting system development resources toward the requirements of a specific imaging task.

Associated particle imaging (API)↗

Cloud Droplet Measurement System for the ARM Tethered Balloon System (TBS) Field Campaign Report

The Mesa Photonics' cloud droplet measurement system (CDMS) performs in situ measurement of droplet size distribution and droplet number density in clouds. These characteristics are important cloud microphysical properties that are critical input parameters for atmospheric models and are also useful for proper calibration and validation of performance of other atmospheric measurement instrumentation. This small campaign was the first project (out of two) that involved integration of the CDMS into the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility’s tethered balloon system (TBS) and its initial testing at the ARM Southern Great Plains (SGP) atmospheric observatory. The follow-up campaign (AFC07016) involved testing of the CDMS under relevant conditions at the third ARM Mobile Facility (AMF3) at Oliktok Point, Alaska and making in situ measurements in clouds. The goal of this small field campaign was to deploy the CDMS on the ARM TBS, demonstrate its integrity and compatibility with the TBS, and test the wireless telecommunication system in preparation for subsequent in-cloud measurements at ARM’s North Slope of Alaska (NSA) observatory at Utqiagvik (formerly Barrow). The specific technical objectives included: (1) Integration of the Mesa Photonics' CDMS into the ARM TBS, (2) testing of the wireless telecommunication system of the CDMS, (3) evaluating the data acquisition software and image processing algorithms especially under high-background-illumination conditions, and (4) testing the ruggedness of the instrument's optical alignment and other performance characteristics. All objectives have been successfully met. The mounting hardware was designed and built mostly at Sandia National Laboratories (SNL), which allowed reliable mounting of the CDMS on the TBS and co-locating the CDMS with other instruments. The field tests were performed by the principal investigator (PI) in collaboration with the TBS operational crew led by D. Dexheimer. The field testing demonstrated good compatibility of the CDMS with the TBS. During the TBS flights, the crew did not experience any operational issues with the CDMS. The instrument demonstrated reliable operational characteristics, including sufficient battery life and good thermal management. The wireless telecommunication system has been successfully tested at TBS flight altitudes of up to 1000 m. During all flights, the CDMS raw data were wirelessly transmitted to the ground station and processed in real time. The ruggedness of the instrument's optical alignment was evaluated by performing calibration of the CDMS (using Mesa Photonics' fixed-size monodisperse droplet generator) before and after the campaign. The calibration was stable within the instrument's measurement precision. In summary, the campaign demonstrated good compatibility of the Mesa Photonics' CDMS with the ARM TBS. The flight tests confirmed the mechanical integrity of the CDMS and stability of its optical layout, as well as reliability of the wireless telecommunication system. Successful completion of this campaign provided a solid basis for the next campaign (AFC07016, November 2020), that involved testing of the CDMS during in-cloud TBS flights at AMF3 at Oliktok Point.

54 ENVIRONMENTAL SCIENCES↗

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗