Search NASA⌕ Search

SEARCH · Search NASA

Results for “internal validity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Test Plan for the Horizontal Dry Cask Simulator

The thermal performance of commercial spent nuclear fuel dry storage casks is evaluated through detailed numerical analysis. These modeling efforts are completed by the vendor to demonstrate performance and regulatory compliance. The calculations are then independently verified by the Nuclear Regulatory Commission(NRC). Canistered dry storage cask systems rely on ventilation between the inner canister and the overpack to convect heat away from the canister to the surrounding environment for both horizontal and vertical configurations. Recent advances in dry storage cask designs have significantly increased the maximum thermal load allowed in a cask in part by increasing the efficiency of internal conduction pathways and by increasing the internal convection through greater canister helium pressure. Carefully measured data sets generated from testing of full sized casks or smaller cask analogs are widely recognized as vital for validating these models. While several testing programs have been previously conducted, these earlier validation studies did not integrate all the physics or components important in a modern, horizontal dry cask system. The purpose of the investigation described in this test plan is to produce data sets that can be used to benchmark the codes and best practices presently used to determine cladding temperatures and induced cooling air flows in modern horizontal dry storage systems. The horizontal dry cask simulator(HDCS) has been designed to generate this benchmark data and add to the existing knowledgebase. The pressure vessel representing the canister has been designed, fabricated, and pressure tested for a maximum allowable pressure(MAWP)rating of 2,400 kPa at400 °C. An existing electrically heated but otherwise prototypic boiling water reactor(BWR), Incoloy-clad test assembly will be deployed inside of a representative storage basket and canister. An insulated sheet metal enclosure will be used to mimic the thermal properties of the concrete vault enclosure used in a modern horizontal storage system. Radial and axial temperature profiles along with induced cooling air flow will be measured for a wide range of decay powers and representative(and higher)cask pressures using various backfills of helium, argon, or air. The single assembly geometry with well-controlled boundary conditions simplifies computational requirements while preserving relevant physics. The proposed test apparatus integrates all the underlying thermal-hydraulics important to defining the performance of a modern horizontal storage system. These include combined-mode heat transfer from the electrically-heated assembly to the canister walls and the primarily natural-convective heat transfer from the canister to the cooling air flow passing through the horizontal vault enclosure. The objective of the HDCS is not to reproduce the performance of a commercial dry storage system for any given set of operational parameters. Rather ,the objective is to capture the dominant physics in a well-characterized test apparatus. The close coupling between the thermal response of the canister system and the resulting induced cooling air flow rate is of particular importance. While incorporating the best available information based on thermal-hydraulic scaling arguments as well as previous vertical testing, this test plan is subject to changes due to improved understanding or from as built deviations to designs. As-built conditions and actual procedures will be documented in the final test report.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Assessment of Heavy-Duty Fueling Methods and Components-Modeling and Analysis

The goal of the Assessment of Heavy-Duty Fueling Methods and Components project was to comprehensively assess heavy-duty (HD) fuel cell electric vehicle fueling protocols and their effects on techno-economic assessments (TEA) and total cost of ownership (TCO). The project leveraged and built upon ongoing international HD fueling protocols and fueling component development activities to deliver component performance assessments, modeling tools and methods evaluations, TEA of industry-selected protocol structures, and experimental validations of the strategies at the station scale. The effects of the protocols on the fueling times, station costs, and TCO were explored. Fueling time, which was influenced by temperature and protocol selection, had a large impact on the station cost due to component sizing and satisfying hourly demand. As the fleet size increased, the station cost was shown to exponentially decrease by achieving economies of scale. Technology year and fuel economy were the largest contributors to the TCO; however, the choice of fueling protocol had a minor impact on the TCO.

33 ADVANCED PROPULSION SYSTEMS↗

Reassessing Double-Ended Guillotine Break Requirements: Evidence-Based Analysis of Regulatory Assumptions After Five Decades of Nuclear Operation

After five decades of nuclear power operation encompassing more than 20,000 reactor-years across 35 countries and 647 reactors, zero double-ended guillotine breaks (DEGBs) have been documented in commercial reactor coolant systems—despite DEGB being the fundamental design-basis assumption driving Emergency Core Cooling System (ECCS) sizing, structural protection requirements, and containment design specifications. This report examines the basis for DEGB requirements in nuclear power plant design. The DEGB postulate assumes the instantaneous, complete circumferential severance of the largest diameter pipes in reactor coolant systems, driving major design requirements under 10 Code of Federal Regulations 50.46, General Design Criterion 4 and containment design specifications. The United States (4,880 reactor-years) and France (2,505 reactor-years) contribute the largest operational datasets. Probabilistic assessments estimate direct DEGB occurrence probabilities with extremely low event frequencies, far below the 10-5/reactor-year thresholds typically used to define non-credible events in nuclear-safety analyses; i.e., events with probability this low fall into beyond-design-basis events. Current material-science knowledge demonstrates that the ductile steel materials used in nuclear piping systems exhibit stable crack-growth behavior fundamentally incompatible with instantaneous severance. International regulatory experience, particularly Germany’s comprehensive break-preclusion implementation, and successful leak-before-break (LBB) applications in almost all of U.S. pressurized water reactor units validate that alternatives can maintain safety performance while reducing economic burden. Current DEGB protection systems impose estimated lifetime costs of hundreds of millions of dollars per unit, over the life of a plant across the nuclear industry (including ongoing costs), representing substantial resource allocation toward scenarios with extremely low probability. Although this report acknowledges uncertainties regarding long-term aging effects, potential synergistic degradation mechanisms, and site-specific seismic considerations that warrant continued evaluation as regulatory policy evolves, there remains no documented evidence that a DEGB has occurred as a consequence of the conditions or mechanisms described in this report. This report acknowledges the Nuclear Regulatory Commission’s (NRC’s) recent efforts—outlined in the draft Interim Staff Guidance (ISG) NRC-DSS-ISG-2025-XX (“Treatment of Certain Loss-of-Coolant Accident Locations as Beyond-Design-Basis Accidents Draft Interim Staff Guidance”)—to reduce overly conservative requirements for large-break loss of coolant accidents through technical justifications and exemptions. However, extensive operating experience and validated methodologies—such as LBB and in-service inspection programs—demonstrate that the probability of a DEGB in reactor coolant-loop piping is extremely low, even under seismic conditions. The authors and reviewers of this report recommend that DEGB be removed as a design-basis event through formal rulemaking, rather than case-by-case exemptions, to better reflect credible failure modes, align with current data, and align with modern, risk-informed safety analysis.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Measurements of Physical Parameters of White Dwarfs: A Test of the Mass–Radius Relation

We present a detailed spectroscopic and photometric analysis of 219 DA and DB white dwarfs for which trigonometric parallax measurements are available. Our aim is to compare the physical parameters derived from the spectroscopic and photometric techniques, and then to test the theoretical mass–radius relation for white dwarfs using these results. The agreement between spectroscopic and photometric parameters is found to be excellent, especially for effective temperatures, showing that our model atmospheres and fitting procedures provide an accurate, internally consistent analysis. The values of surface gravity and solid angle obtained, respectively, from spectroscopy and photometry, are combined with parallax measurements in various ways to study the validity of the mass–radius relation from an empirical point of view. After a thorough examination of our results, we find that 73% and 92% of the white dwarfs are consistent within 1 σ and 2 σ confidence levels, respectively, with the predictions of the mass–radius relation, thus providing strong support to the theory of stellar degeneracy. Our analysis also allows us to identify 15 stars that are better interpreted in terms of unresolved double degenerate binaries. Atmospheric parameters for both components in these binary systems are obtained using a novel approach. We further identify a few white dwarfs that are possibly composed of an iron core rather than a carbon/oxygen core, since they are consistent with Fe-core evolutionary models.

79 ASTRONOMY AND ASTROPHYSICS↗

Overview of the Nordic Seas CARINA data and salinity measurements

Water column data of carbon and carbon relevant hydrographic and hydrochemical parameters from 188 previously non-publicly available cruises in the Arctic, Atlantic, and Southern Ocean have been retrieved and merged into a new database: CARINA (CARbon IN the Atlantic). The data have been subject to rigorous quality control (QC) in order to ensure highest possible quality and consistency. The data for most of the parameters included were examined in order to quantify systematic biases in the reported values, i.e. secondary quality control. Significant biases have been corrected for in the data products, i.e. the three merged files with measured, calculated and interpolated values for each of the three CARINA regions; the Arctic Mediterranean Seas (AMS), the Atlantic (ATL) and the Southern Ocean (SO).With the adjustments the CARINA database is consistent both internally as well as with GLODAP (Key et al., 2004) and is suitable for accurate assessments of, for example, oceanic carbon inventories and uptake rates and for model validation. The Arctic Mediterranean Seas include the Arctic Ocean and the Nordic Seas, and the quality control was carried out separately in these two areas. This contribution provides an overview of the CARINA data from the Nordic Seas and summaries the findings of the QC of the salinity data. One cruise had salinity data that were of questionable quality, and these have been removed from the data product. An evaluation of the consistency of the quality controlled salinity data suggests that they are consistent to at least 0.005.

54 ENVIRONMENTAL SCIENCES↗

Recent Measurements of the Orbital Debris Environment at NASA Johnson Space Center

Space debris presents many challenges to current space operations. Although, the probability of collision between an operational spacecraft and a piece of space debris is quite small, the potential losses can be quite high. Prior to 1990, characterization of the orbital debris environment was divided into two categories. Objects larger than 10 cm are monitored by the United States Space Surveillance Network (SSN) and documented in the U.S. Space Command (USSPACECOM) catalog. Knowledge of debris smaller than 0.1 cm has come from the analyses of returned surfaces. The lack of information about the debris environment in the size range from 0.1 to 1 0 cm led to a joint NASA-DOD effort for orbital debris measurements using the Haystack radar and the unbuilt Haystack Auxiliary (HAX) radars. The data from these radars have been critical to the design of shielding for the International Space Station and have been extensively used in the creation of recent models describing the orbital debris environment. Recent debris campaigns have been conducted to verify and validate through comparative measurements, the results and conclusions drawn from the Haystack/HAX measurements. The Haystack/HAX measurements and results will be described as well as the results of the recent measurement campaigns.

Stansbery, E. G.↗

An Overview of the SOLVE-THESEO 2000 Campaign

Between November 1999 and April 2000, two major field experiments, the SAGE III Ozone Loss and Validation Experiment (SOLVE) and the Third European Stratospheric Experiment on Ozone (THESEO 2000), collaborated to form the largest field campaign yet mounted to study Arctic ozone loss. This international campaign involved more than 500 scientists from over 20 countries spread across the high and mid-latitudes of the northern hemisphere. The main scientific aims of SOLVE-THESEO 2000 were to study (a) the processes leading to ozone loss in the Arctic vortex and (b) the effect on ozone amounts over northern mid-latitudes. The campaign included satellites, heavy lift balloon launches, 6 different aircraft, ground stations, and scores of ozone-sonde. Campaign activities were principally conducted in 3 intensive measurement phases centered on early December 1999, late January 2000, and early March 2000. Observations made during the campaign showed that temperatures were unusually cold in the polar lower stratosphere over the course of the 1999-2000 winter. These cold temperatures resulted in the formation of extensive polar stratospheric clouds (PSCs) across the Arctic. Heterogeneous chemical reactions on the surfaces of the PSC particles produced high levels of reactive chlorine within the polar vortex by early January. This reactive chlorine catalytically destroyed about 60% of the ozone in a layer near 20 km between late January and mid-March 2000.

Newman, Paul A.↗

Atomic Oxygen Durability of Aluminized Polymers

The atomic oxygen durability of aluminized polymers will be investigated. Such aluminized polymers are commonly used in space and specifically on the International Space Station. Recent data from in-space results indicates that vapor deposited aluminum coatings are highly defected with many small pin windows. However, electron microscopy to validate the size and aerial density of such defects remains to be demonstrated. The research project is planned to compare electron microscopy analysis of pristine and atomic oxygen exposed aluminized polyimide Kapton with the results of ground laboratory atomic oxygen erosion data, in-space results and computational Monte Carlo modeling to develop a self consistent understanding of the atomic oxygen degradation processes and effects.

Yang, Judith C.↗

Challenging Issues for On-orbit Calibration in the VIS and NIR

On-orbit calibration of Earth-observing sensors in the VIS and NIR spectral regions is usually performed using the sensors on-board devices such as internal lamp(s) or solar diffuser plate(s) to provide calibration parameters. For sensors with no (or with less reliable) on-board calibrators, lunar calibration or ground validation approaches are often used. Each of these has its own set of problems that need to be fully addressed in order to support high quality on-orbit calibration and characterization. Some science products, such as Ocean color, may impose more stringent requirements that demand greater calibration precision. This paper uses MODIS as an example to illustrate challenging issues involved in VIS and NIR on-orbit calibration. It focuses on the solar diffuser (SD) calibration approach, including the effects due to SD BRF, SD attenuation screen(s), and earthshine. The impact of optics (solar diffuser and scan mirror) on-orbit degradation, including changes in the sensor s response versus scan angle (RVS), on the calibration and subsequent data quality is also discussed.

Xiong, X.↗

A Dynamic/Anisotropic Low Earth Orbit (LEO) Ionizing Radiation Model

The International Space Station (ISS) provides the proving ground for future long duration human activities in space. Ionizing radiation measurements in ISS form the ideal tool for the experimental validation of ionizing radiation environmental models, nuclear transport code algorithms, and nuclear reaction cross sections. Indeed, prior measurements on the Space Transportation System (STS; Shuttle) have provided vital information impacting both the environmental models and the nuclear transport code development by requiring dynamic models of the Low Earth Orbit (LEO) environment. Previous studies using Computer Aided Design (CAD) models of the evolving ISS configurations with Thermo Luminescent Detector (TLD) area monitors, demonstrated that computational dosimetry requires environmental models with accurate non-isotropic as well as dynamic behavior, detailed information on rack loading, and an accurate 6 degree of freedom (DOF) description of ISS trajectory and orientation.

Badavi, Francis F.↗

The NASA Langley Isolator Dynamics Research Lab

The Isolator Dynamics Research Lab (IDRL) is under construction at the NASA Langley Research Center in Hampton, Virginia. A unique test apparatus is being fabricated to support both wall and in-stream measurements for investigating the internal flow of a dual-mode scramjet isolator model. The test section is 24 inches long with a 1-inch by 2-inch cross sectional area and is supplied with unheated, dry air through a Mach 2.5 converging-diverging nozzle. The test section is being fabricated with two sets (glass and metallic) of interchangeable sidewalls to support flow visualization and laser-based measurement techniques as well as static pressure, wall temperature, and high frequency pressure measurements. During 2010, a CFD code validation experiment will be conducted in the lab in support of NASA s Fundamental Aerodynamics Program. This paper describes the mechanical design of the Isolator Dynamics Research Lab test apparatus and presents a summary of the measurement techniques planned for investigating the internal flow field of a scramjet isolator model.

Middleton, Troy F.↗

Test Validation of the Repair to the Space Station Solar Alpha Rotary Joint (SARJ)

The SARJ LITE (Lubrication Interval Test) test rig was built as a method to evaluate the performance of the grease repair on the Starboard SARJ of the International Space Station(ISS). The on-orbit SARJ was temporarily parked after receiving significant degradation on one of its race ring nitrided surfaces as a result of inadequate lubrication ( high dry contact friction) and unaccounted for roller traction kinematics. In a scaled down rig, flight like roller bearings were preloaded and cycled on a nitrided 15-5 race surface. Grease was added to the track and with instrumentation monitoring performance, trending data will be extracted and used to determine lubrication intervals for both Port and Starboard ISS SARJ's. The grease lubrication was found to be effective in eliminating the high friction that contributed to the on-orbit race degradation.

Allmon, Curtis↗

Under the Radar: Trials and Tribulations of Landing on Mars

The Mars Phoenix Mission requires a ground-sensing radar altimeter/ velocimeter to meet touchdown velocity requirements During Phase C/D, the radar underwent a testing triptych: a) Aerial Testing, both captive carry and tethered drop tests (36 sorties, approx. 80 hrs). b) Testing with Electronic Ground Support Equipment (EGSE) on the bench (500+ hrs). c) Detailed Simulation including both RF physics and internal firmware logic (100,000+ simulated landings). All three venues were implemented to provide sufficient uniqueness and overlap to: a) Verify the radar is meeting its requirements. b) Validate radar performance within the flight system and environment. Significant discoveries were attributed to each of the three elements of the testing triptych, leading to greatly improved EDL system robustness. An overview of the testing triptych methodology, discoveries, and responses to them will be subsequently discussed.

Mars Phoenix Mission↗

Maximizing Science Return from Future Rodent Experiments on the International Space Station (ISS): Tissue Preservation

To better understand how mammals adapt to long duration habitation in space, a system for performing rodent experiments on the ISS is under development; Rodent Research-1 is the first flight and will include validation of both on-orbit animal support and tissue preservation. To evaluate plans for on-orbit sample dissection and preservation, we simulated conditions for euthanasia, tissue dissection, and prolonged sample storage on the ISS, and we also developed methods for post-flight dissection and recovery of high quality RNA from multiple tissues following prolonged storage in situ for future science. Mouse livers and spleens were harvested under conditions that simulated nominal, on-orbit euthanasia and dissection operations including storage at -80 C for 4 months. The RNA recovered was of high quality (RNA Integrity Number, RIN(is) greater than 8) and quantity, and the liver enzyme contents and activities (catalase, glutathione reductase, GAPDH) were similar to positive controls, which were collected under standard laboratory conditions. We also assessed the impact of possible delayed on-orbit dissection scenarios (off-nominal) by dissecting and preserving the spleen (RNAlater) and liver (fast-freezing) at various time points post-euthanasia (from 5 min up to 105 min). The RNA recovered was of high quality (spleen, RIN (is) greater than 8; liver, RIN (is) greater than 6) and liver enzyme activities were similar to positive controls at all time points, although an apparent decline in select enzyme activities was evident at the latest time (105 min). Additionally, various tissues were harvested from either intact or partially dissected, frozen carcasses after storage for approximately 2 months; most of the tissues (brain, heart, kidney, eye, adrenal glands and muscle) were of acceptable RNA quality for science return, whereas some tissues (small intestine, bone marrow and bones) were not. These data demonstrate: 1) The protocols developed for future flight experiments will support science return despite delayed preservation post-euthanasia or prolonged storage, and 2) Many additional tissues for gene expression analysis can be obtained by dissection following prolonged storage of the tissue in situ at -80 C. These findings have relevance both to high value, ground-based experiments when sample collection capability is severely constrained, and to all future spaceflight experiments that entail on-orbit sample recovery by the ISS crew.

tissues↗

Maximizing Science Return from Future Rodent Experiments on the International Space Station (ISS): Tissue Preservation

To better understand how mammals adapt to long duration habitation in space, a system for performing rodent experiments on the ISS is under development. Rodent Research-1 is the first flight and will include validation of both on-orbit animal support and tissue preservation. To evaluate plans for on-orbit sample dissection and preservation, we simulated conditions for euthanasia, tissue dissection, and prolonged sample storage on the ISS, and we also developed methods for post-flight dissection and recovery of high quality RNA from multiple tissues following prolonged storage in situ for future science return. Livers and spleens from mice were harvested under conditions that simulated nominal, on-orbit euthanasia and dissection procedures including storage at minus 80 degrees Centigrade for 4 months. The RNA recovered was of high quality (RNA Integrity Number, RNA Integrity Number (RIN) greater than 8) and quantity, and the liver enzyme contents and activities (catalase, glutathione reductase, GAPDH) were similar to positive controls, which were collected under standard laboratory conditions. We also assessed the impact of possible delayed on-orbit dissection scenarios (off-nominal) by dissecting and preserving the spleen (RNA, later) and liver (fast-freezing) at various time points post-euthanasia (from 5 minutes up to 105 minutes). The RNA recovered was of high quality (spleen, RIN greater than 8; liver, RIN greater than 6) and liver enzyme activities were similar to positive controls at all time points, although an apparent decline in select enzyme activities was evident at 105 minutes. Additionally, various tissues were harvested from either intact or partially dissected, frozen carcasses after storage for approximately 2 months; most of the tissues (brain, heart, kidney, eye, adrenal glands and muscle) were of acceptable RNA quality for science return, whereas some tissues (small intestine, bone marrow and bones) were not. These data demonstrate: 1) The protocols developed for future flight experiments will support science return despite delayed preservation post-euthanasia or prolonged storage, and 2) High-quality RNA samples from many different tissues can be recovered by dissection following prolonged storage of the tissue in situ at minus 80 degrees Centigrade. These findings have relevance both to high-value, ground-based experiments when sample collection capability is severely constrained, and to future spaceflight experiments that entail on-orbit sample recovery by the ISS crew.

tissues↗

Accommodations for Secondary Payloads in NASA's Space Launch System

NASA's new heavy-lift launch vehicle, the Space Launch System (SLS), is moving closer to its planned 2019 launch, with the in-space stage and spacecraft adapters complete and all other major elements of the rocket manufactured and currently being outfitted for flight. Exploration Mission-1 (EM-1), the first flight of SLS and the new Orion crew vehicle, will verify and validate new systems and provide an unparalleled opportunity for 13 6U CubeSat-class payloads to be released into deep space. Payloads are being developed by NASA, industry, international and academic partners and were selected for the EM-1 flight to address strategic knowledge gaps in the agency's plans for human deep space exploration. Destinations range from the lunar surface to an asteroid to an orbit around the Earth-moon L2 libration point. Missions include studying the effects of space radiation on a living organism (yeast), landing the smallest lander to date on the moon, and searching for water in permanently shaded lunar craters. Propulsion technology demonstrations include solar sails, use of inert water to carry out lunar gravity assist maneuvers, and use of new "green" chemical propellants. SLS employs an evolutionary design approach, with an initial capability of at least 26 metric tons (t) to trans-lunar injection (TLI). The later Block 1B configuration, which will become the Agency's workhorse launch vehicle into the 2020s, will lift at least 34 t to TLI in its crew configuration and at least 37 t in the cargo configuration. In addition to greater lift capability, Block 1B will also offer larger payload volume than Block 1 for both co-manifested and secondary payloads. In Block 1B, various combinations of 6U, 12U and 27U payloads may be accommodated in the vehicle's stage adapter. Opportunities for deep space research once out of reach for small science payloads will be within reach, opening many possibilities for exciting new technology demonstrations and scientific missions. This paper will provide an overview of the capabilities and the status of the Block 1 vehicle, with particular emphasis on the secondary payload accommodations and the deployment system. Brief descriptions of the 13 6U EM-1 payloads will be included. In addition, a discussion of the payload developers' responsibilities and the Space Launch System Program's roles and responsibilities in accommodating these and future payloads will be included. Finally, the author will look ahead to SLS Block 1B and missions beyond EM-1 and the opportunities for 6U, 12U and 27U CubeSats.

Robinson, Kimberly F.↗

LUNAR REGOLITH:SMALL SCALE ROBOTIC SITE PREPARATION AND GEOTECHNICAL EXPERIMENTSWITH SCOOPS

NASA’s Moon-To-Mars Planetary Autonomous Construction Technology (MMPACT) project seeks to research, develop, and demonstrate lunar surface construction capabilities. Quantification of lunar regolith’s geotechnical properties allows for effective prediction of forces and displacement during excavation and construction and is critical to facilitating regolith sintering capabilities all of which benefit lunar infrastructure plans. Knowledge of shear strength, Mohr-Coulomb cohesion, angle of internal friction, bearing strength, bulk density, etc. is needed. The use of ground-based testing of various lunar simulants with relevant hardware (e.g., robotic arm tools) enables validation of technology choices, tool paths, and lunar surface construction activities. In addition, the use of Taguchi methods will minimize the number of needed experiments to explore critical input parameters.

R. P. Mueller↗

Cloud Mask Intercomparison eXercise (CMIX): An evaluation of cloud masking algorithms for Landsat 8 and Sentinel-2

Cloud cover is a major limiting factor in exploiting time-series data acquired by optical spaceborne remote sensing sensors. Multiple methods have been developed to address the problem of cloud detection in satellite imagery and a number of cloud masking algorithms have been developed for optical sensors but very few studies have carried out quantitative intercomparison of state-of-the-art methods in this domain. This paper summarizes results of the first Cloud Masking Intercomparison eXercise (CMIX) conducted within the Committee Earth Observation Satellites (CEOS) Working Group on Calibration & Validation (WGCV). CEOS is the forum for space agency coordination and cooperation on Earth observations, with activities organized under working groups. CMIX, as one such activity, is an international collaborative effort aimed at intercomparing cloud detection algorithms for moderate-spatial resolution (10–30 m) spaceborne optical sensors. The focus of CMIX is on open and free imagery acquired by the Landsat 8 (NASA/USGS) and Sentinel-2 (ESA) missions. Ten algorithms developed by nine teams from fourteen different organizations representing universities, research centers and industry, as well as space agencies (CNES, ESA, DLR, and NASA), are evaluated within the CMIX. Those algorithms vary in their approach and concepts utilized which were based on various spectral properties, spatial and temporal features, as well as machine learning methods. Algorithm outputs are evaluated against existing reference cloud mask datasets. Those datasets vary in sampling methods, geographical distribution, sample unit (points, polygons, full image labels), and generation approaches (experts, machine learning, sky images). Overall, the performance of algorithms varied depending on the reference dataset, which can be attributed to differences in how the reference datasets were produced. The algorithms were in good agreement for thick cloud detection, which were opaque and had lower uncertainties in their identification, in contrast to thin/semi-transparent clouds detection. Not only did CMIX allow identification of strengths and weaknesses of existing algorithms and potential areas of improvements, but also the problems associated with the existing reference datasets. The paper concludes with recommendations on generating new reference datasets, metrics, and an analysis framework to be further exploited and additional input datasets to be considered by future CMIX activities.

Sergii Skakun↗