Search NASA⌕ Search

SEARCH · Search NASA

Results for “collaborative interfaces.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Control of the Plasma-Material Interface for Long Pulse Optimization in the Experimental Advanced Superconducting Tokamak (EAST) (Final Report)

This project involved a collaborative effort, led by Dr. Rajesh Maingi of Princeton Plasma Physics Laboratory, to understand and control the plasma-material interface to improve long pulse discharge control and performance in the EAST devices. The focus is on long pulse recycling control and optimization, which can be challenging because of their broad range of materials used for plasma-facing components (PFC) and wall conditioning techniques. The purpose of the EAST device is to demonstrate long-pulse, stable, high performance plasma operation, providing a test-bed for key physics and technology issues for next step devices. As part of these tests, EAST has deployed carbon for the lower divertor PFC, tungsten for the upper divertor, and molybdenum for the main wall. In addition wall coatings are deployed for long pulse recycling control: lithium (Li) via several delivery tools, boronization, and recently also siliconization; for example, in 2013, a layer of SiC was deposited on all of the graphite tiles. Oxygen is also present at trace levels, making for a complex mix of materials and plasma-materials interactions (PMI). This mix of materials and the limited durability of wall coatings, coupled to partially optimized cryo-pumping, lead to evolution of the recycling off the PFCs, which restricts the duration of stationary, high performance, long pulse discharges. Comparing the wall conditioning techniques, Li enables the highest energy confinement and lowest recycling for the longest duration, while also suppressing ELMs in certain discharges. More specifically, research activities at the University of Tennessee focused on heat flux profile measurements in EAST, modeling the surface response, including the bonding energetics and chemical interactions between Li with carbon, tungsten, hydrogen and impurities, in addition to post situ experimental characterization and analysis of the divertor plasma facing components in EAST. This final report describes the overall progress within each of these tasks at the University of Tennessee within the project.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Apollo: Democratizing genome annotation

Genome annotation is the process of identifying the location and function of a genome's encoded features. Improving the biological accuracy of annotation is a complex and iterative process requiring researchers to review and incorporate multiple sources of information such as transcriptome alignments, predictive models based on sequence profiles, and comparisons to features found in related organisms. Because rapidly decreasing costs are enabling an ever-growing number of scientists to incorporate sequencing as a routine laboratory technique, there is widespread demand for tools that can assist in the deliberative analytical review of genomic information. To this end, we present Apollo, an open source software package that enables researchers to efficiently inspect and refine the precise structure and role of genomic features in a graphical browser-based platform. Some of Apollo's newer user interface features include support for real-time collaboration, allowing distributed users to simultaneously edit the same encoded features while also instantly seeing the updates made by other researchers on the same region in a manner similar to Google Docs. Its technical architecture enables Apollo to be integrated into multiple existing genomic analysis pipelines and heterogeneous laboratory workflow platforms. Finally, we consider the implications that Apollo and related applications may have on how the results of genome research are published and made accessible.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Navy Flight Testing Environmental Data Transfer Format Standard

This document outlines key elements of a data format standard for transferring Navy environmental flight test data between members of the Collaborative Environments Characterization Working Group (CECWG). The plan applies to measured data as well as analyzed or processed data. This plan is intended to foster a more productive collaboration between CECWG members by providing a common interface format such that each agency only has to receive and transmit data in one common format. Ideally, each agency is thus only responsible for translating formats between the native format of each agency’s respective database of flight measurements and this common data transfer format.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Deep Learning for Fish Identification from Sonar Data: CRADA 481 [Abstract only]

To help solve the challenges of hydropower energy production related to the potential for eel injury and mortality from passage through hydropower turbines, we will develop a deep learning method for identifying migrating eels from imaging sonar. This project continues with a prior project conducted by the Pacific Northwest National Laboratory (PNNL) and the Electric Power Research Institute (EPRI) in FY2018-2019. The proposed method employs Convolution Neural Network (CNN), a powerful deep learning method for image classification, to distinguish between images of eels and non-eel moving objects. We propose to collect more laboratory data and add more existing field data to train a powerful deep learning model. In addition to eels and sticks as classified in previous studies, we will add images containing several non-eel fish species and macrophyte mats to the training data. A multi-class classification model will be developed to distinguish these objects. Object detection algorithm will be explored and developed to locate and identify multiple objects in each sonar frame. Motion analysis will be performed to track the movement of objects in sonar video clips. We will also improve the data conversion algorithm so that it can read in both DIDSON and ARIS (both are imaging sonars developed by Sound Metrics Corp) data files and convert them to images with comparably high resolution, regardless of the varying detection ranges in different environments. The developed algorithms will be packaged as a software with a graphic user interface. The software will be evaluated by external collaborators in the field. The developed framework can be generalized for automatic monitoring of fish passage and migration using other imaging sonars like ARIS and will benefit the design and operation of ecologically friendly hydroelectric projects. The developed wavelet and CNN model configuration parameters can potentially be transferred to lamprey detection in similar riverine environments.

13 HYDRO ENERGY↗
DOE OSTI2023

High Efficiency PEM Water Electrolysis Enabled by Advanced Catalysts, Membranes and Processes

In this project, advanced membranes and catalysts were integrated into membrane electrode assembles (porous transport electrodes (PTE) or catalyst coated membranes (CCM)) leveraging precision coating methods to enable control of electrode structures and demonstration of the best component performance possible with these materials. Partner collaborations allowed for advanced characterization of the formed interfaces and degradation mechanisms. New methods of forming hydrogen recombination layers were also developed, to move away from wet chemistry processes that would have limited realization and implementation of the optimized electrode configurations in a commercial environment.

08 HYDROGEN↗
DOE OSTI2024

Deep Learning for Fish Identification from Sonar Data (CRADA 481 Final Report)

In eastern regions of the United States, the American eel is a species of management and regulatory concern because of significant population declines, despite the species’ previous abundance in all tributaries of rivers flowing into the Atlantic Ocean. The American eel is also a candidate for listing under the U.S. Endangered Species Act. While hydropower construction and operation are only one of several factors contributing to this population decline, such a listing could impose additional regulatory challenges for a large number of hydropower projects. In this CRADA project, we improved technologies for identifying migrating eels with the goal of reducing the cost and time required for future American eel hydropower impact assessment and mitigation studies, while maintaining accuracy. We built on results from a previous FOA project (FOA# DE-FOA-0001662), led by the Electric Power Research Institute (EPRI), which developed a highly accurate, deep-learning method for identifying migrating eels from imaging sonar data. The current study aimed to further optimize this deep-learning model, originally designed for image classification, and to develop an object detection software capable of identifying fish from sonar videos in real time, enabling the detection of events like fish migrations and specific species, such as the American eel, at hydropower dams. The data conversion algorithms were packaged as software with a graphical user interface, and the software is evaluated by external collaborators. We focused on the American eel in this project and explored the transferability of the developed deep learning models to the sea lamprey, given the similar body shape and swimming behavior between the two species.

13 HYDRO ENERGY↗
DOE OSTI2022

Feedstock-Conversion Interface Consortium Annual Review of Research – FY 2021

Led by the U.S. Department of Energy’s Bioenergy Technologies Office, the Feedstock-Conversion Interface Consortium (FCIC) is a multi-lab collaboration that develops first-principles-based knowledge and tools to understand, quantify, and mitigate the effects of feedstock and process variability across the bioenergy value chain, from the field and forest through downstream conversion. The FCIC recently published its Annual Review of Research Fiscal Year (FY) 2021 report, which presents an overview of the research accomplishments of FCIC members in FY 2021, covering both the low- and high-temperature conversion pathways and all three process areas: Feedstock harvest and storage Preprocessing Conversion. The key research achievements of each task are presented, along with planned FY 2022 work that will build on the FY 2021 accomplishments.

09 BIOMASS FUELS↗
DOE OSTI2021

Fostering Remote Visualization: Experiences in Two Different HPC Sites

Visualization of scientific data is crucial for scientific discovery to gain insight into the results of simulations and experiments. Remote visualization is of crucial importance to access infrastructure, data and computational resources and, to avoid data movement from where data is produced and to where data will be analyzed. Remote visualization enables geographically diverse collaboration and enhances user experience through graphical user interfaces. This paper presents two approaches deployed by two different HPC centers: The SC3 - Supercomputación y Cálculo Científico Center in Colombia and the Oak Ridge Leadership Computing Facility in USA. We overview our remote visualization experiences, adopted technologies, use cases, and challenges encountered. Our contribution is to signal the commonality between approaches in terms of the end goal, showing their fitness for their contexts, while not focusing only on attempting to provide a general picture of remote visualization, given the differences between centers in terms of purposes, needs, resources, and national impact.

Gelvez Cortes, Sergio Augusto↗
DOE OSTI2025

ReVise: A Human-AI Interface for Incremental Algorithmic Recourse

The recent adoption of artificial intelligence in socio-technical systems raises concerns about the black-box nature of the resulting decisions in fields such as hiring, finance, admissions, etc. If data subjects—such as job applicants, loan applicants, and students—receive an unfavorable outcome, they may be interested in algorithmic recourse, which involves updating certain features to yield a more favorable result when re-evaluated by algorithmic decision-making. Unfortunately, when individuals do not fully understand the incremental steps needed to change their circumstances, they risk following misguided paths that can lead to significant, long-term adverse consequences. Existing recourse approaches focus exclusively on the final recourse goal but neglect the possible incremental steps to reach the goal with real-life constraints, user preferences, and model artifacts. To address this gap, we formulate a visual analytic workflow for incremental recourse planning in collaboration with AI/ML experts and contribute an interactive visualization interface that helps data subjects efficiently navigate the recourse alternatives and make an informed decision. We also present one of the many usage scenarios, developed during exploratory feedback sessions with twelve graduate students using a real-world dataset, which demonstrates that our approach can be instrumental for data subjects in choosing a suitable recourse path.

algorithmic recourse↗
DOE OSTI2024

Electronic Visualization Laboratory's 50th Anniversary Retrospective: Look to the Future, Build on the Past

September 2023 marks the 50th anniversary of the Electronic Visualization Laboratory (EVL) at University of Illinois Chicago (UIC). EVL's introduction of the CAVE Automatic Virtual Environment in 1992, the first widely replicated, projection-based, walk-in, virtual-reality (VR) system in the world, put EVL at the forefront of collaborative, immersive data exploration and analytics. However, the journey did not begin then. Since its founding in 1973, EVL has been developing tools and techniques for real-time, interactive visualizations—pillars of VR. But EVL's culture is also relevant to its successes, as it has always been an interdisciplinary lab that fosters teamwork, where each person's expertise contributes to the development of the necessary tools, hardware, system software, applications, and human interface models to solve problems. Over the years, as multidisciplinary collaborations evolved and advanced scientific instruments and data resources were distributed globally, the need to access and share data and visualizations while working with colleagues, local and remote, synchronous and asynchronous, also became important fields of study. This paper is a retrospective of EVL's past 50 years that surveys the many networked, immersive, collaborative visualization and VR systems and applications it developed and deployed, as well as lessons learned and future plans.

Johnson, Andrew E.↗
DOE OSTI2023

Optimizing Geant4 Hadronic Models

Geant4, the leading detector simulation toolkit used in high energy physics, employs a set of physics models to simulate interactions of particles with matter across a wide range of energies. These models, especially the hadronic ones, rely largely on directly measured cross-sections and inclusive characteristics, and use physically motivated parameters. However, they generally aim to cover a broad range of possible simulation tasks and may not always be optimized for a particular process or a given material. The Geant4 collaboration recently made many parameters of the models accessible via a configuration interface. This opens a possibility to fit simulated distributions to the thin target experimental datasets and extract optimal values of the model parameters and the associated uncertainties. Such efforts are currently undertaken by the Geant4 collaboration with the goal of offering alternative sets of model parameters, also known as "tunes", for certain applications. The effort should subsequently lead to more accurate estimates of the systematic errors in physics measurements given the detector simulation role in performing the physics measurements. Results of the study are presented to illustrate how Geant4 model parameters can be optimized through applying fitting techniques, to improve the agreement between the Geant4 and the experimental data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Cooperative Research and Development Agreement between National Energy Technology Laboratory and University of Kentucky (Abstract)

The National Energy Technology Laboratory (NETL) and University of Kentucky (Participant) will collaborate in the development of “Deep Learning Potential-based Molecular Dynamics Simulation Investigation of Chemical Conversion-Absorption Coupling of CO 2 at Air-Reactive Deep Eutectic Solvent Interface.” This project is supported by DOE-Office of Science Graduate Student Research (SCGSR) program and managed by Oak Ridge Institute for Science and Education (ORISE). Deep eutectic solvents (DESs) are promising alternative sorbents for direct air capture (DAC) CO 2 due to their low vapor pressure, low corrosion, non-toxicity, relatively low cost, and biodegradable nature. Understanding the CO 2 reaction-transport mechanisms at the interface can help develop cost-effective DAC by DESs with high capacity and stability. The collaboration will investigate the absorption and chemical conversion of CO 2 at the air-DES interface to facilitate the development of novel DAC technology using reactive DESs. The anticipated results will make DAC more efficient, allow more sustainable use of our Nation’s fossil energy resources, and advance NETL’s ongoing CO 2 capture efforts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Waste Management Project Success - Regulatory Assurance Systems - 20118

Waste management (WM) and remediation projects are essential within a restorative environmental culture. Despite years of experience, challenges and obstacles associated with efficient and effective WM project execution remain. Although some obstacles are project specific, a common challenge is navigating the regulatory landscape from planning through execution, particularly with first of a kind (FOAK) and first in a while (FIAW) projects. The absence of a comprehensive regulatory assurance strategy places significant hurdles in the path of project success. To clear a path for the successful execution of increasingly complex WM projects, this paper focuses on development of a comprehensive regulatory assurance strategy and implementation plan that effectively engages stakeholders, agencies, and performers to produce project plans that fully and cost effectively integrate applicable regulatory requirements. The most reliable way to align regulatory processes and decisions needed for mission success is through a regulatory assurance system. This system establishes a healthy interface with regulatory decision makers, to work in a collaborative manner, to create a common vision for regulatory decisions on an agreed upon schedule. A regulatory assurance system consists of several elements. Although the mission may vary from cleanup to site closure to nuclear component production, the elements of a regulatory assurance system remain essentially constant and must include: 1) identifying a common vision or end state, 2) developing a long-term, integrated strategy and schedule, 3) establishing a regulatory partnering team consisting of key decision-makers, 4) regular and frequent communication with decision-makers, 5) ensuring consistent surveillance for early identification of issues and changes that may impact the project, 6) quick resolution of emerging issues to prevent schedule impact, 7) identifying core compliance functions, 8) periodically assessing progress of the project as it relates to regulatory assurance and, 9) providing constructive feedback to improve the process. A regulatory assurance system provides a living, multi-faceted approach to planning, visioning, communicating and tracking to avoid surprises and ensure smooth and timely progress to the project. The overall success measures will be whether the system produces common sense regulatory decisions supporting the vision on time without appeal. Effective regulatory frameworks rarely happen on their own. Balanced, common-sense regulatory decisions stem from teams that are trained to work together to achieve shared goals. In this paper, particular attention is placed on the importance of starting with a shared vision for a regulatory assurance and execution strategy that leverages experience to establish optimal approaches. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Use of Stable Mercury Isotopes to Assess Mercury and Methylmercury Transformation and Transport across Critical Interfaces from the Molecular to the Watershed Scale (Final Report)

This project titled “Use of Stable Mercury Isotopes to Assess Mercury and Methylmercury Transformation and Transport across Critical Interfaces from the Molecular to the Watershed Scale” represents a collaborative effort between the University of Michigan (Jason Demers, PI) and Oak Ridge National Laboratory (Scott Brooks, co-I). Much has been learned about mercury (Hg) cycling in stream ecosystems, and East Fork Poplar Creek (EFPC) in particular, through decades of previous research. Nevertheless, some of the most fundamental questions regarding the sources of bioavailable Hg and its transformation to toxic methylmercury (MeHg) have remained unanswered. These fundamental questions include: (1) what are the sources and biogeochemical processes that lead to the input of dissolved Hg to stream water across critical subsurface interfaces within stream ecosystems, and EFPC in particular? and (2) what are the sources and biogeochemical processes that control the production and fate of bioaccumulative MeHg within stream ecosystems, and in EFPC in particular? To address these fundamental questions, our project aimed to couple laboratory experiments and field observations, both utilizing natural abundance Hg stable isotope techniques, to identify the processes responsible for generating mobile, bioavailable dissolved Hg from recalcitrant legacy sources within critical subsurface zones (e.g., streambed hyporheic zone, riparian floodplain subsurface). We used the isotopic signature of this bioavailable dissolved Hg to track its mobilization across these critical interfaces in order to link diffuse subsurface sources of dissolved Hg with increases in surface water dissolved Hg flux measured at the watershed scale. Additionally, our research aimed to determine the isotopic composition of MeHg within these same critical subsurface zones. We directly assessed the isotopic composition of MeHg within biota in order to gain insight into which subsurface sources of inorganic Hg and toxic MeHg are available for bioaccumulation within the EFPC ecosystem. Net fluxes of dissolved Hg along the flow path of EFPC were shown to vary spatially and temporally. In the Upper EFPC, within the Y12 boundary, stream water flux of dissolved Hg consistently decreased between the outfall and the downstream boundary of Y12 (57% ± 29%, 1SD). Within the Upper EFPC, an assessment of Hg isotopic composition suggested that losses were strongly reaction-driven, although isotopic diagnostics did not conform to any known processes. Downstream of Y12, in the upper reach of the Lower EFPC, dissolved Hg fluxes tended to increase during the dormant season (net gain of 11-120%), and decrease during the growing season (net loss of 23% +/- 18%, 1SD). In the downstream-most reach of Lower EFPC, dissolved Hg fluxes increased by 12-108% in 9 out of 10 monthly assessments. Overall, diffuse fluxes from the non-Y12 watershed accounted for 34% (+/- 17%, 1SD) of all dissolved Hg exported during base flow. Within Lower EFPC, an assessment of Hg isotopic composition was consistent with the contribution of diffuse Hg inputs from high-concentration hotspots within riparian floodplains and streambed hyporheic pore water. To investigate remobilization of recalcitrant Hg from legacy sediment sources, we developed procedures that coupled isotopic analysis with sequential extractions of streambed sediment. We found that the proportion of weakly-bound Hg within EFPC streambed sediment was relatively small, but could still account for a large proportion of the annual flux of dissolved Hg from EFPC. These sequential extractions also showed that this weakly-bound Hg fraction could be replenished from the much larger fraction of recalcitrant Hg in sediment. The isotopic composition of these weakly-bound and remobilized recalcitrant Hg fractions within the sediment was consistent with high-concentration dissolved Hg hotspots within hyporheic pore water. Thus, this research provided novel evidence that legacy mercury sources within streambed sediment could provide an ongoing contribution of dissolved Hg to surface waters. Finally, we developed new methods for the direct determination of the MeHg isotopic composition of organisms, which allowed a more direct evaluation of inorganic Hg and MeHg sources accumulating in the food web. We found that fish and aquatic invertebrates in both EFPC and a regional background site obtained inorganic Hg and MeHg from multiple isotopically distinct sources, including sediment, suspended particulates, and periphyton. Photodemethylation was found to be an important reaction influencing MeHg dynamics at both sites. However, the balance of microbial methylation and demethylation processes differed between the two streams, with fractionation resulting from methylation and demethylation processes being relatively in balance within the regional background site, whereas microbial methylation appeared to be dominant over microbial demethylation within the EFPC ecosystem. Broadly, the application of Hg isotopic analysis in this study led to numerous novel insights regarding the biogeochemical cycling of Hg in stream ecosystems. This research project promoted the development of two new approaches, including the coupling of sequential extractions with Hg isotopic analysis to assess remobilization of recalcitrant Hg within sediments, and a new method for the isotopic analysis of MeHg isolated from environmental samples. Both of these efforts represent advances in capacity for the field of mercury isotopic analysis and environmental assessment. Overall, this study demonstrates that the application of Hg stable isotope techniques continues to provide new insights into the biogeochemical cycling of Hg in complex aquatic environments, both within the EFPC and beyond.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

A Simple and Portable Multi-Channel Pyrometer allowing temperature measurements down to 800 K on the microsecond scale

The measurement of transient temperatures less than 1000 K for samples in laser-heated diamond anvil cells remains a challenge. Here we present a design and performance characteristics for a multi-channel pyrometer that works in the NIR from 1200 to 2000 nm. It has a relatively small footprint, is portable, only requires low voltage power supplies and can report temperatures down to 800 K on the millisecond scale or faster. A single data point without averaging can be acquired in 14 microseconds (sampling rate of 70'000 times/s). In conjunction with a diamond anvil cell, the system still works down to about 830 K. The pyrometer has been interfaced several times with the laser heating system at the High Pressure Collaborative Access Team (HPCAT) at the Advanced Photon Source in Chicago with good results.

Montgomery, Jeffrey M.↗
DOE OSTI2019

High performance III-V photoelectrodes for solar water splitting via synergistically tailored structure and stoichiometry

Abstract Catalytic interface of semiconductor photoelectrodes is critical for high-performance photoelectrochemical solar water splitting because of its multiple roles in light absorption, electrocatalysis, and corrosion protection. Nevertheless, simultaneously optimizing each of these processes represents a materials conundrum owing to conflicting requirements of materials attributes at the electrode surface. Here we show an approach that can circumvent these challenges by collaboratively exploiting corrosion-resistant surface stoichiometry and structurally-tailored reactive interface. Nanoporous, density-graded surface of ‘black’ gallium indium phosphide (GaInP 2 ), when combined with ammonium-sulfide-based surface passivation, effectively reduces reflection and surface recombination of photogenerated carriers for high efficiency photocatalysis in the hydrogen evolution half-reaction, but also augments electrochemical durability with lifetime over 124 h via strongly suppressed kinetics of corrosion. Such synergistic control of stoichiometry and structure at the reactive interface provides a practical pathway to concurrently enhance efficiency and durability of semiconductor photoelectrodes without solely relying on the development of new protective materials.

14 SOLAR ENERGY↗
DOE OSTI2023

ASC Data Science Infrastructure Project June 2023 [Slides]

Data Science Infrastructure (DSI) Project offers a standardized but flexible way of storing data and associated metadata to support AI/ML and data intensive scientific workflows: Establish requirements via use case interviews; Develop DSI framework to support flexible, secure, and accessible data stores tailored to researcher needs; Augment existing institutional frameworks for code management, performance testing and file indexing via automated DSI interfaces; Deploy DSI framework to support key use cases in collaboration with domain scientists.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Practical Probabilistic Programming

Recent advances in probabilistic programming languages (PPLs) have provided the capability for exact inference: computing a closed-form probability distribution for a given probabilistic program. In particular, the new language Roulette uses a language oriented programming (LOP) approach, wherein analysts build new programming languages on top of a set of primitives provided by Roulette, which then translates these structures into a weighted model counting problem which can be solved by automated reasoning tools. However, because Roulette provides few convenience features, developing these new languages is challenging even for expert users. We developed a standard library of common probability functions for Roulette with the goal of improved usability. This included approximation of continuous probability density functions using discrete probability mass functions. We demonstrated this approach by modeling a cosmic ray striking a RAM controller. We found that Roulette provides a powerful interface for highly expressive probabilistic programs to be generated. In collaboration with the NNSA Advanced Simulation and Computing program, which resulted in development of a tool called Circulette, we were able to model complex circuits expressed in Verilog using probabilistic programs with an expressivity not previously possible. Our research question that motivated the development of a Roulette standard library was to determine whether non-experts could use a PPL to model relevant problems regarding radiation effects on microelectronics. This standard library improved the expressivity of Roulette by implementing common probability density functions, mathematical operators on distributions, and support for empirical distributions. While Roulette is a powerful modeling language, the untyped, LOP approach makes error messages difficult to understand and requires expert aid. We recommend further research on Roulette, especially with its error messages, to enable improved usability. At the same time, this project demonstrated that for users familiar with Roulette and the LOP approach, Roulette provides powerful new capabilities that can be integrated with other Sandia modeling capabilities.

97 MATHEMATICS AND COMPUTING↗