Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality issues”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Connecting Space to Village: Tethys Adoption Within SERVIR

The SERVIR program, a joint development initiative of National Aeronautics and Space Administration (NASA) and United States Agency for International Development (USAID), works in partnership with leading regional organizations world-wide to help developing countries use information provided by Earth observing satellites and geospatial technologies for managing climate risks and land use. SERVIR empowers decision-makers with tools, products, and services to act locally on critical issues related to four key areas: Food Security and Agriculture, Water and Water-related Disasters, Land Use/Land Cover and Ecosystems, Weather and Climate. SERVIR is improving awareness, increasing access to information, and supporting analysis to help people in West Africa, Eastern and Southern Africa, Hindu Kush-Himalaya (HKH), the Lower Mekong, South America and Mesoamerica. NASA funds an Applied Sciences Team (AST), composed of experts from universities and research institutions around the United States. Through AST, SERVIR adopted the Tethys platform introduced by Brigham Young University (BYU) for the implementation of tools to deliver scientific data to stakeholders in the Hindu Kush-Himalaya region. Several Tethys applications developed within SERVIR have raised interest amongst decision makers in the countries served by our regional hubs. They see these new apps as key vehicles to disseminate complex information related to weather models, hydrological models, and air quality monitoring, and as such the scope of our Tethys efforts continue to expand to other regions. As of July 2019, each one of the SERVIR hubs (with the exception of Amazonia, which has only recently started), have stood up Tethys portals and have at least one individual trained in the implementation and maintenance of a Tethys portal and in the creation of basic applications. HKH, with BYU's valuable support, has implemented very sophisticated applications that showcase the possibilities and the benefits that the Tethys platform brings.

Tethys↗

Dynamics retrieval from stochastically weighted incomplete data by low-pass spectral analysis

Time-resolved serial femtosecond crystallography (TR-SFX) provides access to protein dynamics on sub-picosecond timescales, and with atomic resolution. Due to the nature of the experiment, these datasets are often highly incomplete and the measured diffracted intensities are affected by partiality. To tackle these issues, one established procedure is that of splitting the data into time bins, and averaging the multiple measurements of equivalent reflections within each bin. This binning and averaging often involve a loss of information. Here, we propose an alternative approach, which we call low-pass spectral analysis (LPSA). In this method, the data are projected onto the subspace defined by a set of trigonometric functions, with frequencies up to a certain cutoff. This approach attenuates undesirable high-frequency features and facilitates retrieving the underlying dynamics. A time-lagged embedding step can be included prior to subspace projection to improve the stability of the results with respect to the parameters involved. Subsequent modal decomposition allows to produce a low-rank description of the system's evolution. Using a synthetic time-evolving model with incomplete and partial observations, we analyze the LPSA results in terms of quality of the retrieved signal, as a function of the parameters involved. We compare the performance of LPSA to that of a range of other sophisticated data analysis techniques. We show that LPSA allows to achieve excellent dynamics reconstruction at modest computational cost. Finally, we demonstrate the superiority of dynamics retrieval by LPSA compared to time binning and merging, which is, to date, the most commonly used method to extract dynamical information from TR-SFX data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Color Transformations of Photometric Measurements of Galaxies in Optical and Near-infrared Wide-field Imaging Surveys*

Abstract Over the past 2 decades, wide-field photometric surveys in optical and infrared domains reached a nearly all-sky coverage thanks to numerous observational facilities operating in both hemispheres. However, subtle differences among exact realizations of Johnson and SDSS photometric systems require one to convert photometric measurements into the same system prior to analysis of composite data sets originating from multiple surveys. It turns out that the published photometric transformations lead to substantial biases when applied to integrated photometry of galaxies from the corresponding catalogs. Here we present photometric transformations based on piece-wise linear approximations of integrated photometry of galaxies in the optical surveys SDSS, DECaLS, BASS, MzLS, DES, DELVE, KiDS, VST ATLAS, and the near-infrared surveys UKIDSS, UHS, VHS, and VIKING. We validate our transformations by constructing k -corrected color–magnitude diagrams of non-active galaxies and measuring the position and tightness of the “red sequence.” We also provide transformations for aperture magnitudes and show how they are affected by the image quality difference among the surveys. We present the implementation of the derived transformations in python and idl and also a web-based color transformation calculator for galaxies. By comparing DECaLS and DES, we identified systematic issues in DECaLS photometry for extended galaxies, which we attribute to the photometric software package used by DECaLS. As an application of our method, we compiled two multi-wavelength photometric catalogs for over 200,000 low- and intermediate-redshift galaxies originating from CfA FAST and Hectospec spectral archives.

Astronomy & Astrophysics↗

TU-C-17A-07: FusionARC Treatment with Adaptive Beam Selection Method

Purpose: Recently, a new treatment scheme, FusionARC, has been introduced to compensate for the pitfalls in single-arc VMAT planning. It basically allows for the static field treatment in selected locations, while the remaining is treated by single-rotational arc delivery. The important issue is how to choose the directions for static field treatment. This study presents an adaptive beam selection method to formulate fusionARC treatment scheme. Methods: The optimal plan for single-rotational arc treatment is obtained from two-step approach based on the reweighted total-variation (TV) minimization. To choose the directions for static field treatment with extra segments, a value of our proposed cost function at each field is computed on the new fluence-map, which adds an extra segment to the designated field location only. The cost function is defined as a summation of equivalent uniform dose (EUD) of all structures with the fluence-map, while assuming that the lower cost function value implies the enhancement of plan quality. Finally, the extra segments for static field treatment would be added to the selected directions with low cost function values. A prostate patient data was applied and evaluated with three different plans: conventional VMAT, fusionARC, and static IMRT. Results: The 7 field locations, corresponding to the lowest cost function values, are chosen to insert extra segment for step-and-shoot dose delivery. Our proposed fusionARC plan with the selected angles improves the dose sparing to the critical organs, relative to static IMRT and conventional VMAT plans. The dose conformity to the target is significantly enhanced at the small expense of treatment time, compared with VMAT plan. Its estimated treatment time, however, is still much faster than IMRT. Conclusion: The fusionARC treatment with adaptive beam selection method could improve the plan quality with insignificant damage in the treatment time, relative to the conventional VMAT.

60 APPLIED LIFE SCIENCES↗

A knowledge based approach to matching human neurodegenerative disease and animal models

Neurodegenerative diseases present a wide and complex range of biological and clinical features. Animal models are key to translational research, yet typically only exhibit a subset of disease features rather than being precise replicas of the disease. Consequently, connecting animal to human conditions using direct data-mining strategies has proven challenging, particularly for diseases of the nervous system, with its complicated anatomy and physiology. To address this challenge we have explored the use of ontologies to create formal descriptions of structural phenotypes across scales that are machine processable and amenable to logical inference. As proof of concept, we built a Neurodegenerative Disease Phenotype Ontology (NDPO) and an associated Phenotype Knowledge Base (PKB) using an entity-quality model that incorporates descriptions for both human disease phenotypes and those of animal models. Entities are drawn from community ontologies made available through the Neuroscience Information Framework (NIF) and qualities are drawn from the Phenotype and Trait Ontology (PATO). We generated ~1200 structured phenotype statements describing structural alterations at the subcellular, cellular and gross anatomical levels observed in 11 human neurodegenerative conditions and associated animal models. PhenoSim, an open source tool for comparing phenotypes, was used to issue a series of competency questions to compare individual phenotypes among organisms and to determine which animal models recapitulate phenotypic aspects of the human disease in aggregate. Overall, the system was able to use relationships within the ontology to bridge phenotypes across scales, returning non-trivial matches based on common subsumers that were meaningful to a neuroscientist with an advanced knowledge of neuroanatomy. The system can be used both to compare individual phenotypes and also phenotypes in aggregate. This proof of concept suggests that expressing complex phenotypes using formal ontologies provides considerable benefit for comparing phenotypes across scales and species.

59 BASIC BIOLOGICAL SCIENCES↗

Non-Invertible Transforms for Image-Based Verification

Imaging may play a unique role in verifying the presence and distribution of warhead components in warhead counting and dismantlement settings where image information content can distinguish among shapes, forms, and material composition of items. However, a major issue with imaging is the high level of intrusiveness, and in particular, the possible need to store sensitive comparison images in the inspection system that would violate information barrier (IB) principles. Reducing images via transformations or feature extraction can produce image features (e.g. attributes) for verification, but with enough prior information about structure the reduced information itself may be sufficient to deduce sensitive details of the original image. Further reducing resolution of the transformed image information is an option, but too much reduction destroys the quality of the attribute. We study the possibility of a one-way transform that allows storage of non-sensitive reference information and analysis to enable comparison of transformed images within IB constraints. In particular, we consider the degree to which images can be reconstructed from image intensity histograms depending on the number of pixel intensity bins and the degree of frequency data quantization, as well as assumed knowledge of configuration of objects in the images. We also explore the concept of a 'perceptual hash' as a class of transforms that may enable verification with provable non-invertibility, leading to an effective one-way transform that preserves the nature of the image feature data without revealing sufficient information to reconstruct the original image.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Fractals and Spatial Methods for Mining Remote Sensing Imagery

The rapid increase in digital remote sensing and GIS data raises a critical problem -- how can such an enormous amount of data be handled and analyzed so that useful information can be derived quickly? Efficient handling and analysis of large spatial data sets is central to environmental research, particularly in global change studies that employ time series. Advances in large-scale environmental monitoring and modeling require not only high-quality data, but also reliable tools to analyze the various types of data. A major difficulty facing geographers and environmental scientists in environmental assessment and monitoring is that spatial analytical tools are not easily accessible. Although many spatial techniques have been described recently in the literature, they are typically presented in an analytical form and are difficult to transform to a numerical algorithm. Moreover, these spatial techniques are not necessarily designed for remote sensing and GIS applications, and research must be conducted to examine their applicability and effectiveness in different types of environmental applications. This poses a chicken-and-egg problem: on one hand we need more research to examine the usability of the newer techniques and tools, yet on the other hand, this type of research is difficult to conduct if the tools to be explored are not accessible. Another problem that is fundamental to environmental research are issues related to spatial scale. The scale issue is especially acute in the context of global change studies because of the need to integrate remote-sensing and other spatial data that are collected at different scales and resolutions. Extrapolation of results across broad spatial scales remains the most difficult problem in global environmental research. There is a need for basic characterization of the effects of scale on image data, and the techniques used to measure these effects must be developed and implemented to allow for a multiple scale assessment of the data before any useful process-oriented modeling involving scale-dependent data can be conducted. Through the support of research grants from NASA, we have developed a software module called ICAMS (Image Characterization And Modeling System) to address the need to develop innovative spatial techniques and make them available to the broader scientific communities. ICAMS provides new spatial techniques, such as fractal analysis, geostatistical functions, and multiscale analysis that are not easily available in commercial GIS/image processing software. By bundling newer spatial methods in a user-friendly software module, researchers can begin to test and experiment with the new spatial analysis methods and they can gauge scale effects using a variety of remote sensing imagery. In the following, we describe briefly the development of ICAMS and present application examples.

Lam, Nina↗

Low Level and Transuranic Waste Segregation and Low Level Waste Characterization at the 200 Area of the Hanford Site - 12424

This paper describes the waste measurement and waste characterization activities carried out by ANTECH Corporation (ANTECH) and CH2M Hill Plateau Remediation Company (CHPRC) at the 200 Area of the Hanford Site under Contracts No. 22394 and No. 40245 for the US Department of Energy (DOE). These include Low Level Waste (LLW) and Transuranic (TRU) Waste segregation and LLW characterization for both 55-gallon (200-litre) drums with gross weight up to 454 kg and 85-gallon over-pack drums. In order to achieve efficient and effective waste drum segregation and assay, ANTECH deployed an automated Gamma Mobile Assay Laboratory (G-MAL) at the trench face in both 200 Area West and East. The unit consists of a modified 40 foot ISO shipping container with an automatic flow through roller conveyor system with internal drum weigh scale, four measurement and drum rotation positions, and four high efficiency high purity Germanium (HPGe) detectors with both detector and shadow shields. The unit performs multiple far-field measurements and is able to segregate drums at levels well below 100 nCi/g. The system is sufficiently sensitive that drums, which are classified as LLW, are characterized at measurement levels that meet the Environmental Restoration Disposal Facility (ERDF) Waste Acceptance Criteria (WAC). With measurement times of between 20 and 30 minutes the unit can classify and characterize over 40 drums in an 8-hour shift. The system is well characterized with documented calibrations, lower limits of detection (LLD) and total measurement uncertainty. The calibrations are confirmed and verified using nationally traceable standards in keeping with the CHPRC measurement requirements. The performance of the system has been confirmed and validated throughout the measurement process by independent CHPRC personnel using traceable standards. All of the measurement and maintenance work has been conducted during the period under a Quality Assurance Plan (QAP) compliant with the applicable criteria of NQA-1 (2000). This includes not only the calibrations and measurements but also the data analysis activities of the ANTECH Subject Matter Experts (SME) and ANTECH support and maintenance activities as well as the activities of CHPRC staff who recover, transport and load waste drums and disposition measured and characterized drums. The overall processes of drum recovery and analysis are described in the paper. Specific spectral data is presented which illustrates the segregation, sentencing and assay process for different types of drums with different radionuclide profiles. The process of identifying and quantifying a wide range of non-TRU radionuclide isotopes is explained and illustrated with spectral examples. The difficulties associated with the measurement of drums with a high gamma ray background, usually arising from high levels of Cs-137 are considered. These drums, which would normally be declared indeterminate and treated as TRU, are addressed under contract No. 40245 by the deployment of the ANTECH Neutron Mobile Assay Laboratory. This is an Active-Passive neutron assay system housed in a modified ISO shipping container. The unit is designed for the measurement and assay of both drums and crates (including B-25 boxes and SWB containers) and will quantify the content of both plutonium and uranium. The neutron system has been employed to perform further evaluation on indeterminate drums to classify them to either LLW or TRU. The experiences of both gamma ray and neutron system operation in different conditions are described; as are the issues of throughput, drum handling and system maintenance. All of these are considered in the overriding context of safe drum handling and safe assay system operation. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Space View Issues for Hyperspectral Sounders

The expectation for climate quality measurements from hyperspectral sounders is absolute calibration accuracy at the 100 mK level and stability at the < 40 mK/decade level. The Atmospheric InfraRed Sounder (AIRS)1, Cross-track Infrared Sounder (CrIS), and Infrared Atmospheric Sounding Interferometer (IASI) hyperspectral sounders currently in orbit have been shown to agree well over most of their brightness temperature range. Some larger discrepancies are seen, however, at the coldest scene temperatures, such as those seen in Antarctic winter and deep convective clouds. A key limiting factor for the calibrated scene radiance accuracy for cold scenes is how well the effective radiance of the cold space view pertains to the scene views. The space view signal is composed of external sources and instrument thermal emission at about 270 K from the scan mirror, external baffles, etc. Any difference in any of these contributions between space views and scene views will impact the absolute calibration accuracy, and the impact can be critical for cold scenes. Any change over time in these will show up as an apparent trend in calibrated radiances. We use AIRS data to investigate the validity of the space view assumption in view of the 100 mK accuracy and 40 mK/decade trend expectations. We show that the space views used for the cold calibration point for AIRS v5 Level-1B products meet these standards except under special circumstances and that AIRS v6 Level-1B products will meet them under all circumstances. This analysis also shows the value of having multiple distinct space views to give operational redundancy and analytic data, and that reaching climate quality requires continuing monitoring of aging instruments and adjustment of calibration.

trends↗

Tropospheric Ozone Assessment Report: Database and Metrics Data of Global Surface Ozone Observations

In support of the first Tropospheric Ozone Assessment Report (TOAR) a relational database of global surface ozone observations has been developed and populated with hourly measurement data and enhanced metadata. A comprehensive suite of ozone data products including standard statistics, health and vegetation impact metrics, and trend information, are made available through a common data portal and a web interface. These data form the basis of the TOAR analyses focusing on human health, vegetation, and climate relevant ozone issues, which are part of this special feature. Cooperation among many data centers and individual researchers worldwide made it possible to build the world's largest collection of in-situ hourly surface ozone data covering the period from 1970 to 2015. By combining the data from almost 10,000 measurement sites around the world with global metadata information, new analyses of surface ozone have become possible, such as the first globally consistent characterisations of measurement sites as either urban or rural/remote. Exploitation of these global metadata allows for new insights into the global distribution, and seasonal and long-term changes of tropospheric ozone and they enable TOAR to perform the first, globally consistent analysis of present-day ozone concentrations and recent ozone changes with relevance to health, agriculture, and climate. Considerable effort was made to harmonize and synthesize data formats and metadata information from various networks and individual data submissions. Extensive quality control was applied to identify questionable and erroneous data, including changes in apparent instrument offsets or calibrations. Such data were excluded from TOAR data products. Limitations of a posteriori data quality assurance are discussed. As a result of the work presented here, global coverage of surface ozone data for scientific analysis has been significantly extended. Yet, large gaps remain in the surface observation network both in terms of regions without monitoring, and in terms of regions that have monitoring programs but no public access to the data archive. Therefore future improvements to the database will require not only improved data harmonization, but also expanded data sharing and increased monitoring in data-sparse regions.

54 ENVIRONMENTAL SCIENCES↗

Cumulative Measurement Errors for Dynamic Testing of Space Flight Hardware

Located at the NASA Johnson Space Center in Houston, TX, the Six-Degree-of-Freedom Dynamic Test System (SDTS) is a real-time, six degree-of-freedom, short range motion base simulator originally designed to simulate the relative dynamics of two bodies in space mating together (i.e., docking or berthing). The SDTS has the capability to test full scale docking and berthing systems utilizing a two body dynamic docking simulation for docking operations and a Space Station Remote Manipulator System (SSRMS) simulation for berthing operations. The SDTS can also be used for nonmating applications such as sensors and instruments evaluations requiring proximity or short range motion operations. The motion base is a hydraulic powered Stewart platform, capable of supporting a 3,500 lb payload with a positional accuracy of 0.03 inches. The SDTS is currently being used for the NASA Docking System testing and has been also used by other government agencies. The SDTS is also under consideration for use by commercial companies. Examples of tests include the verification of on-orbit robotic inspection systems, space vehicle assembly procedures and docking/berthing systems. The facility integrates a dynamic simulation of on-orbit spacecraft mating or de-mating using flight-like mechanical interface hardware. A force moment sensor is used for input during the contact phase, thus simulating the contact dynamics. While the verification of flight hardware presents unique challenges, one particular area of interest involves the use of external measurement systems to ensure accurate feedback of dynamic contact. The measurement systems for the test facility have two separate functions. The first is to take static measurements of facility and test hardware to determine both the static and moving frames used in the simulation and control system. The test hardware must be measured after each configuration change to determine both sets of reference frames. The second function is to take dynamic measurements during hardware motion and contact. While performing dynamic testing of an active docking system, researchers found that the data from the motion platform, test hardware and two external measurement systems exhibited frame offsets and rotational errors. While the errors were relatively small when considering the motion scale overall, they substantially exceeded the individual accuracies for each component. After evaluating both the static and dynamic measurements, researchers found that the static measurements introduced significantly more error into the system than the dynamic measurements even though, in theory, the static measurement errors should be smaller than the dynamic. In several cases, the magnitude of the errors varied widely for the static measurements. Upon further investigation, researchers found the larger errors to be a consequence of hardware alignment issues, frame location and measurement technique whereas the smaller errors were dependent on the number of measurement points. This paper details and quantifies the individual and cumulative errors of the docking system and describes methods for reducing the overall measurement error. The overall quality of the dynamic docking tests for flight hardware verification was improved by implementing these error reductions.

Winnitoy, Susan↗

Design, Development, and Operation of an Integrated Fluidized Carbon Capture Unit Using Polyethylenimine Sorbents

In this paper, we present the design, development, and operation of a reactor system for CO 2 capture. Modifications were implemented to address differences in sorbent from 180 μm Geldart group B to 115 μm Geldart group A material; operational issues were discovered during experimental trials. The major obstacle in system operation was the ability to maintain a constant circulation of a solid sorbent stemming from this change in sorbent material. The system consisted of four fluid beds, through which a polyamine impregnated sorbent was circulated and adsorption, preheat, regeneration, and cooling processes occurred. Pressure transducers, thermocouples, gas flow meters, and gas composition instrumentation were used to characterize thermal, hydrodynamic, and gas adsorption performance in this integrated unit. A series of shakedown tests were performed and the configuration altered to meet the needs of the sorbent performance and achieve desired target capture efficiencies. Methods were identified, tested, and applied to continuously monitor critical operating parameters including solids circulation rate, adsorbed and desorbed CO 2 , solids inventories, and pressures. The working capacity and CO 2 capture efficiency were used to assess sorbent performance while CO 2 closure was used to define data quality and approach to steady-state. Testing demonstrated >90% capture efficiencies and identified the regenerator to be the process step limiting throughput. Sorbent performance was found to be related to the reactant stoichiometry. Finally, a stochastic model with an exponential dependence on the relative CO 2 /amine concentration was used to describe 90% of the variance in the data.

01 COAL, LIGNITE, AND PEAT↗

Exascale Virtualized and Programmable Distributed Cyber Resource Control: Final Scientific Technical Report

Extreme-science drives the need for distributed exascale processing and communications that are carefully, yet flexibly, managed. Exponential growth of data for scientific simulations, experimental data, collaborative data analyses, remote visualization and GRID computing requirements of scientists in fields as diverse as high energy physics, climate change, genomics, fusion, synchrotron radiation, material science, medicine, and other scientific disciplines cannot be accommodated by simply applying existing transport protocols to faster pipes. Further, scientific challenges today demand diverse research teams, heightening the need for and increasing the complexity of collaboration. To address these issues within the network layer and physical layer, we have performed a number of research activities surrounding effective allocation and management of elastic optical network (EON) resources, particularly focusing on FlexGrid transponders. FlexGrid transponders support the opportunity to build Layer-1 connections at a wide range of bandwidths and to reconfigure them rapidly. The new flexibility supports complex new ways of using the physical layer that must be carefully managed and hidden from the scientist end-users. FlexGrid networks utilize flexible (or elastic) spectral bandwidths for each data link without using fixed wavelength grids. The flexibility in spectrum allocation brings many appealing features to network operations. Current networks are designed for the worst case impairments in transmission performance and the assigned spectrum is over-provisioned. In contrast, the FlexGrid networks can operate with the highest spectral efficiency and minimum bandwidth for the given traffic demand while meeting the minimum quality of transmission (QoT) requirement. Two primary focuses of our research are: (1) resource and spectrum allocation (RSA) for IP traffic over EONs, and (2) RSA for cross-domain optical networks. Previous work concentrates primarily on large file transfers within a single domain. Adding support for IP traffic changes the nature of the RSA problem: instead of choosing to accept or deny each request for network support, IP traffic is inherently elastic and thus lends itself to a bandwidth maximization formulation. We developed a number of algorithms that could be easily deployed within existing and new FlexGrid networks, leading to networks that better support scientific collaboration. Cross-domain RSA research is essential to support large-scale FlexGrid networks, since configuration information is generally not shared or coordinated across domains. The results presented here are in their early stages. They are technically feasible and practical, but still require coordination among organizations and equipment owners and a higher-layer framework for managing network requests.

42 ENGINEERING↗

LLNL Response to the DOE ASCR RFI, "Stewardship of Software for Scientific and High-Performance Computing"

For decades, Lawrence Livermore National Laboratory (LLNL) has been engaged in significant research, development, and support for software to enable scientific computing and, particularly, the use of high performance computing (HPC) in the NNSA mission space. In particular, the move in the mid-1990’s to simulation as a leading component of stockpile stewardship through the ASCI and the successor ASC programs, as well as the need for reliable data acquisition and control software for the National Ignition Facility, have been important drivers in building expertise in production-quality software development at LLNL. LLNL has also been a leader in the DOE SciDAC FASTMath Institute and the DOE Exascale Computing Project (ECP), both of which have striven to make scientific computing software – in particular, the enabling technologies underpinning simulation capabilities – more widely adopted and sustainable. As such, we believe that our experience can inform the broader goal of software stewardship for scientific and high-performance computing. LLNL strongly supports the formation of a new DOE ASCR program element in software stewardship and sustainment. Historically, DOE ASCR has funded applied mathematics and computer science research that has led to the development of important new capabilities and algorithms that are expressed as artifacts in research software. Such frameworks, libraries, and tools have seldom been directly funded to address the important issues of code maintenance, documentation, robustness, and community building. Software engineering and support have typically been done on the side in support of the ASCR-driven research products. DOE funding priorities have been slow to recognize that good software engineering, the kind that ensures research investments have more adoption and longevity, requires significant resources. Based upon our experiences, we have prepared this response to highlight the concerns and issues we believe to be important as DOE ASCR considers its role in scientific software stewardship. We believe that role is important and will require a significant investment of new funding to legitimately support the technologies past and future DOE ASCR investments have and will produce to facilitate their uptake and adoption in the broader scientific computing community. Following a summary of our involvement in scientific software development, the remainder our response is organized around the nine topics specifically identified in the RFI.

97 MATHEMATICS AND COMPUTING↗

Validation of CTF Droplet Entrainment and Annular/Mist Closure Models using Riso Steam/Water Experiments

This report summarizes the work done to validate the droplet entrainment and de-entrainment models as well as two-phase closure models in the CTF code by comparison with experimental data obtained at Riso National Laboratory. The Riso data included a series of over 250 steam/water experiments that were performed in both tube and annulus geometries over a range of various pressures and outlet qualities. Experimental conditions were set so that the majority of cases were in the annular/mist ow regime. Measurements included liquid lm ow rate, droplet ow rate, lm thickness, and two-phase pressure drop. CTF was used to model 180 of the tubular geometry cases, matching experimental geometry, outlet pressure, and outlet ow quality to experimental values. CTF results were compared to the experimental data at the outlet of the test section in terms of vapor and entrained liquid ow fractions, pressure drop per unit length, and liquid lm thickness. The entire process of generating CTF input decks, running cases, extracting data, and generating comparison plots was scripted using Python and Matplotlib for a completely automated validation process. All test cases and scripting tools have been committed to the COBRA-TF master repository and selected cases have been added to the continuous testing system to serve as regression tests. The dierences between the CTF- and experimentally-calculated ow fraction values were con- sistent with previous calculations by Wurtz, who applied the same entrainment correlation to the same data. It has been found that CTF's entrainment/de-entrainment predictive capability in the annular/mist ow regime for this particular facility is comparable to the licensed industry code, COBRAG. While lm and droplet predictions are generally good, it has been found that accuracy is diminished at lower ow qualities. This nding is consistent with the noted deciencies in the Wurtz entrainment model employed by CTF. The CTF predicted two-phase pressure drop in the annular/mist ow regime has been found to be highly inaccurate, exhibiting a clear bias with respect to the experimental data. This inaccuracy led to an investigation that revealed deciencies in the implementation of the annular/mist interfacial friction model, which should be investigated further in the future. Looking to published COBRAG results for this same facility reveal it exhibits no bias with regard to experimental pressure drop results. In addition to the problems with pressure drop prediction, the lm thickness was also signicantly under-predicted by CTF compared to both experimental data and Wurtz's analytical calculations. Film thickness is calculated using a simple geometric relationship and lm void fraction in CTF, which is dependent on slip ratio and interfacial friction. It is possible that the issues aecting the pressure drop and lm void prediction are related.

97 MATHEMATICS AND COMPUTING↗

Estimation of Supersonic Stage Separation Aerodynamics of Winged-Body Launch Vehicles Using Response Surface Methods

A collection of statistical and mathematical techniques referred to as response surface methodology was used to estimate the longitudinal stage separation aerodynamic characteristics of a generic, bimese, winged multi-stage launch vehicle configuration using data obtained on small-scale models at supersonic speeds in the NASA Langley Research Center Unitary Plan Wind Tunnel. The simulated Mach 3 staging was dominated by multiple shock wave interactions between the orbiter and booster vehicles throughout the relative spatial locations of interest. This motivated a partitioning of the overall inference space into several contiguous regions within which the separation aerodynamics were presumed to be well-behaved and estimable using cuboidal and spherical central composite designs capable of fitting full second-order response functions. The primary goal was to approximate the underlying overall aerodynamic response surfaces of the booster vehicle in belly-to-belly proximity to the orbiter vehicle using relatively simple, lower-order polynomial functions that were piecewise-continuous across the full independent variable ranges of interest. The quality of fit and prediction capabilities of the empirical models were assessed in detail, and the issue of subspace boundary discontinuities was addressed. The potential benefits of augmenting the central composite designs to full third order using computer-generated D-optimality criteria were also evaluated. The usefulness of central composite designs, the subspace sizing, and the practicality of fitting low-order response functions over a partitioned inference space dominated by highly nonlinear and possibly discontinuous shock-induced aerodynamics are discussed.

Erickson, Gary E.↗

Simulations of the edge plasma: the role of atomic, molecular and surface physics

Atomic, molecular and surface physics plays an important role in simulations of the edge plasma in present day tokamaks, and in the predictive simulations of new devices. The edge plasma - in this context, the Scrape-Off Layer (SOL), the Private Flux Region (PFR) and core region close to the separatrix (or Last Closed Flux Surface, LCFS) - provides the boundary conditions for the main plasma, and is the region where much of the power and all of the particle exhaust occurs. It is also the region where the plasma interacts with solid surfaces, puffed gases and gas arising from recycling. The results of plasma edge simulations can depend strongly on the availability and quality of the atomic, molecular and surface data (the peak plasma temperature at the divertor was found to vary by a factor of five dependent on the choice of atomic physics data in a recent sensitivity analysis). The current material choice for ITER with Plasma Facing Components (PFCs) consisting of C, Be and W also presents challenges, both in the availability of the necessary data for W, and in the plethora of charge states for W. Another challenge presented by the material choice is the likely presence of mixed materials formed by the migration of material from one surface to another. These introduce effects like alloying and preferential sputtering as well as new (much longer) time-scales in the problem.Efforts to incorporate a bundled charge state model within one of the present edge simulation codes, SOLPS, will be described, as well as efforts to address some of the questions raised by mixed materials. Some issues related to data consistency and traceability within the context of the European effort on Integrated Tokamak Modelling will also be addressed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Initial Efforts Organizing WPNCS SG-8: Preservation of Expert Knowledge and Judgement Applied to Criticality Benchmarks

The Working Party on Nuclear Criticality Safety (WPNCS) under the guidance of the Organization for Economic Co-operation and Development (OECD) Nuclear Energy Agency (NEA) has over 20 years of experience addressing concerns related to static and transient configurations encountered within the nuclear fuel cycle: fuel fabrication, transportation, reprocessing, storage, and geological disposal. One of the cornerstone activities of the WPNCS is the International Criticality Safety Benchmark Evaluation Project (ICSBEP), which was established to identify a comprehensive set of criticality benchmark data, evaluate the data, including quantification of overall uncertainties; compile the data into a standardized format, perform sample calculations utilizing modern nuclear data sets and codes utilized in nuclear criticality safety, and formally document the work into a single source of verified benchmark data. Annually, members of the ICSBEP Technical Review Group (TRG) contribute evaluated benchmark data that undergoes comprehensive technical review prior to publication in the ICSBEP Handbook. In the years since the ICSBEP was established, there has been much work to prepare benchmark data to support validation activities in nuclear criticality safety. The 2020 edition of the ICSBEP Handbook contains acceptable benchmark specifications for 5,053 critical, subcritical, or near-critical configurations in 582 benchmark evaluations. Modern benchmark development benefits from decades of experienced international participants, a well-established handbook format, supplementary guides to deal with uncertainty quantification, and a comprehensive review process based upon independent reviews from international experts. The ICSBEP Handbook also contains 838 configurations deemed unacceptable to support criticality safety efforts. They are recorded, with the reasoning for their rejection, to preserve the experimental data, prevent reevaluation of data that are incomplete or contain known errors, and/or to potentially allow future reevaluation of the experiment pending the identification of sufficient data to resolve identified inconsistencies and errors. Users of the ICSBEP Handbook today might notice that the rigor and quality of modern criticality safety benchmarks is much greater than those prepared within the initial decade of the project. Benchmarks with 1s uncertainties in k eff greater than 1% were traditionally rejected unless they were identified as unique experiment types that encompassed materials, fuels, or designs not available from other benchmark experiments. However, benchmarks developed using modern experimental techniques and practices typically have uncertainties on the order of a few tenths of a percent. There have been ongoing efforts to improve the overall quality of previously published benchmark evaluations. Seventy-eight evaluations, containing approximately 600 configurations, have been revised just within the past decade. An additional eleven benchmarks are under revision for updated release in the 2020 edition of the ICSBEP Handbook. If some of the historic benchmarks were resubmitted in their current form to the TRG today, they would be rejected due to lack of data, missing components in the uncertainty analysis, or incomplete benchmark model development. The use of historic criticality safety benchmarks that underestimate the total uncertainty, lack properly quantified biases, or provide inadequate benchmark specifications do not sufficiently support modern criticality safety and nuclear data efforts. Although the ICSBEP Handbook is recognized by regulating bodies to support criticality safety, users are required to justify their reasons to ignore historic benchmark data and include additional safety margins within their designs. Discussions were held at the WPNCS 23rd Annual Meeting in September 2019 regarding the aforementioned issues. The resultant decision was to establish Subgroup 8 (SG-8): Preservation of Expert Knowledge and Judgement Applied to Criticality Benchmarks. The current activities of SG-8 are discussed herein.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗