Search NASA⌕ Search

SEARCH · Search NASA

Results for “Deep Reinforcement Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

313 records · Page 18

Damage progression and failure of SiC/SiC composite tubes under hard-contact radial expansion

The response of silicon carbide (SiC) fiber-reinforced SiC matrix (SiC/SiC) composite cladding to mechanical interaction with fissile fuel is a knowledge gap that must be overcome to design and assess SiC-based cladding systems for advanced nuclear applications. This study developed the relevant mechanical testing capability and identified the failure behavior and the critical microstructural features and processing defects. Sections of SiC composite tube were subjected to a modified expansion-due-to-compression (EDC) test in an X-ray computed tomography microscope: a polyurethane plug pressed surrogate Al 2 O 3 into the inner walls of the SiC/SiC composite tubes to achieve hard contact. A pure EDC test with just a polyurethane plug was also performed as a reference. Through the use of displacement fields, digital volume correlation revealed inhomogeneous deformation fields in the tubes, even for pure EDC, which was related to the inherent defects in the structure. Deep learning–aided segmentation and systematic data analysis revealed that the presence of inhomogeneous deformation applied by the hard contact was exaggerated by the presence of inner surface imperfections left behind from the matrix densification process. In conclusion, the findings provide insights into the applications, highlighting the necessity for improvements in inner surface roughness and the incorporation of localized contacts in pellet–cladding mechanical interaction computational models.

Composites↗

DOC-DICAM: Domain Aware One Class Defect Identification in Composite Aerostructure Material

Fiber-reinforced composites are a common material used in the design of aircraft structures due to their good tensile strength and resistance to compression. During the manufacturing process, these structures are thoroughly inspected for flaws and defects to ensure structural integrity during commercial use. Non-destructive testing (NDT) is a collection of inspection methods that allow inspectors to evaluate material without altering it. Due to the high safety standards in aerospace manufacturing, the NDT process is done manually and can be a significant bottleneck in the development workflow. In this paper, we develop an AI-based assistance tool to drastically reduce inspection time. Typical AI workflows require large amounts of annotated data, but defects rarely occur resulting in strong class imbalance. To overcome this, we formulate the problem of defect identification as an anomaly detection task in which our primary focus is learning non-defect characteristics. To do this, we develop a multi-task self-supervised learning framework that embeds problem specific domain knowledge into the deep learning model. We verify our method using fuselage data generated in a production environment. As a result, we show that our method can effectively identify defects and requires minimal training and inference time.

anomaly detection↗

The phylogenetic roots of addiction: compulsive drug seeking, natural and drug-sensitive reward, and the acquisition of learned habits

Our rational faculties permit us humans to maximize the utility of our actions. We perform a fundamental type of cost-benefit analysis in which we frame a problem, assign values to the different paths, and then choose from among a set of available options, the course that promises the most favorable outcome. So why then does addiction appear to be so impervious to the associated costs, so unaffected by undesired consequences, and ultimately so resistant to cognitive oversight? The answer may likely be found in the fact that the drivers for compulsive drug seeking and drug taking are located in affective brain circuits, circuits that are structured and patterned by learning with repeated activation. These deep processes exhibit significant resistance to control by our cognitive faculties. The general consensus is that addiction arises from mechanisms that overvalue the magnitude of reward, discount the associated risks, and thereby bias individuals towards compulsive pursuit of addictive drugs. Behavioral disruption and dependence appear to arise at the intersection of a number of connected but separate phenomena: expectations for the occurrence of specific events, behaviors that seek encounters with them, the ability to notice and learn nonrandom, co-occurring conditions, the prediction and valuation of consequences, the forming of enduring memories, and the drivers of focused behavior through compulsion, habits, and acquired routines. It is important to recognize that each one of these individual faculties are present and well developed across the entire phylogenetic tree of bilateral metazoans. The goal of this special volume is dedicated to exploring the degree to which inherent elements can account for addiction and addiction-associated phenomena. In much of the literature on addiction, the underlying processes are often viewed as distinctly mammalian, arising, in part, from the strong cognitive capacities of this taxon. Some phenomena may even be regarded to exist only in primates, or even solely in humans. This supposition arises from the fact that studies are conducted almost exclusively in mammals and primates, while evolutionary antecedents of the behavior are rarely considered. A more comprehensive perspective that examines drug reward and reinforcement in a wider range of organisms demonstrates that many of the component traits are actually well developed across the greater metazoan lineage, and they may well predate the emergence of a mammalian clade by a wide margin. The collection of papers assembled here supports the notion that the capacity to associate cues and quences has not arisen in mammals de novo. Rather, the neural mechanisms for detecting contingencies and for predicting future outcomes are very deeply rooted across broad phylogenetic divisions. Our understanding of an ability to associate paired events has been enriched by work in invertebrate preparations in both classical and operant conditioning scenarios [Cook and Carew, 1986, 1989a, 1989b]. The ability to learn allows us to connect cues and behavioral actions to their associated consequences. Pavlovian conditioning enriches surrounding cues with predictive value. Outcomes with positive valence generate appetitive responses and approach to the associated cues, while those perceived as aversive bring cue avoidance and withdrawal. Humans are not the only life forms capable of such short- and long-term modulations of behavior

59 BASIC BIOLOGICAL SCIENCES↗

Crossing the Cleft: Communication Challenges Between Neuroscience and Artificial Intelligence

Historically, neuroscience principles have heavily influenced artificial intelligence (AI), for example the influence of the perceptron model, essentially a simple model of a biological neuron, on artificial neural networks. More recently, notable recent AI advances, for example the growing popularity of reinforcement learning, often appear more aligned with cognitive neuroscience or psychology, focusing on function at a relatively abstract level. At the same time, neuroscience stands poised to enter a new era of large-scale high-resolution data and appears more focused on underlying neural mechanisms or architectures that can, at times, seem rather removed from functional descriptions. While this might seem to foretell a new generation of AI approaches arising from a deeper exploration of neuroscience specifically for AI, the most direct path for achieving this is unclear. Here we discuss cultural differences between the two fields, including divergent priorities that should be considered when leveraging modern-day neuroscience for AI. For example, the two fields feed two very different applications that at times require potentially conflicting perspectives. We highlight small but significant cultural shifts that we feel would greatly facilitate increased synergy between the two fields.

60 APPLIED LIFE SCIENCES↗

Drilling, Completion, and Data Collection Plans An Assessment of Geological Carbon Sequestration Options in the Illinois Basin: Phase III

Executive Summary The Illinois Basin – Decatur Project (IBDP) is managed by the Midwest Geological Sequestration Consortium (MGSC) and is led by the Illinois State Geological Survey (ISGS) at the University of Illinois. The project site is located on the Archer Daniels Midland Company (ADM) property in Decatur, Illinois, and is a fully integrated carbon capture and storage (CCS) project that uses CO₂ captured from the ethanol-producing fermentation process at the ADM corn-processing plant (Finley et. al., 2013). IBDP has a goal of injecting one million tonnes of CO₂ into the basal sands of the Mt. Simon Sandstone over a three-year period. This is a multifaceted project, and this report details the planning and results of the drilling, completions, well testing, log data acquisition, and the Health, Safety, and Environment (HSE) aspects of the project. Three deep wells were planned for the IBDP: • The injection well: Injection Well #1 (CCS1); • The monitoring well (both in-zone and above seal): Verification Well #1 (VW1); and • The geophone monitoring well: Geophysical Monitoring Well #1 (GM1). The detailed plans for these wells are attached to the appendices of this document. The wells were drilled successfully with little deviation from the original plans. The biggest change from the plan to execution was the need to adjust for larger-than-expected loss of circulation in the Potosi section of the Knox Formation. The completions reports also attached to this document detail the well constructions as they were actually built. Injectivity testing was carried out, and the perforating plans were adjusted based on the results. Additional perforations and acidizing were performed as a result of the injectivity testing. The testing plans are detailed in this report along with the actual testing results. The injectivity testing results were used in the modeling and simulation efforts. Detailed HSE plans were developed and implemented during the planning and execution phases of the project. The implementation included an HSE Bridging Document, which served to unify the HSE policies of the project partners and key subcontractors. The HSE plan and actual HSE results are presented in this document. There were no recordable HSE incidents during the project. A detailed logging program was developed based on project needs. The log data were acquired in accordance with the plan, and both the plan and log results are presented in this report. Log data were heavily utilized by the research staff, modelers, reservoir engineers, and for technical and permitting efforts. 5 Several key lessons were learned during the project: • Safety in operations and execution is paramount and is only achieved through proper planning and behavior control. The certainty of this was reinforced through implementation of this lesson and the resultant flawless HSE performance during the project. • Losses of drilling fluid circulation were larger than anticipated within the Potosi Formation. Circulation was only recovered through cementing the loss zones. • When possible, minimizing complexity in permit requirements and well designs is preferable. • The size of the wells were outside of the standard experience and expertise typical within the basin, and therefore required substantial planning and ramp-up of contractors and partners to meet project objectives. • With multiple stakeholders and research partners, establishing objectives and requirements early and adhering to change request procedures throughout the project are critical to manage competing data and sampling objectives that may be detrimental to overall progress. The well construction and completion operations were successfully executed, with all wells built in a manner that achieved excellent wellbore integrity. Log planning involved a number of stakeholders and technical specialists. Data collection from logging, coring, and testing was excellent. Time and effort spent with the associated contractors and suppliers to develop a well plan beyond normal scope proved highly successful, resulting in a well-construction and completion project that surpassed expectations. The world-class HSE results also demonstrate the commitment of all stakeholders in the project. The details follow in the body of this document

01 COAL, LIGNITE, AND PEAT↗

DEEP Solar: Data DrivEn Modeling and Analytics for Enhanced System Layer ImPlementation

Realizing the SETO 2030 mission of reducing solar energy costs to 3-5 c/kWh will require innovative enabling research on effective, cost-efficient integration of local PV within distribution systems. However, the intermittent and variable nature of PVs compels operators to impose conservative hosting capacity constraints. Given the extremely high variability of (intermittent and unpredictable) solar energy generation, relaxing the capacity constraints (which are currently around 15%) and achieving 100% or greater integration of renewables will require a fundamental transformation of the power grid via the utilization of exponentially larger amounts of AMI enabled fine-grained data. To address the challenges in increasing the penetration of renewable energy based DERs, this project envisions an Enhanced System Layer (ESL) at the distribution network level that is reliable, cost-effective and scalable to millions of Distributed Energy Resources (DERs)/devices. This includes developing: 1) Transformative and highly scalable machine learning based predictive analytics tools that plug into distribution system planning and provide real-time situational awareness at the distribution level for short and long-term operational planning. The tools will be built using novel data-driven energy models of millions of active nodes with AMI, 2) Adaptive stochastic analysis and optimization algorithms for real-time grid operations, 3) Dynamic Scenario Analysis using parallel Cloudenabled implementations with < 1 minute computational cycle times.

14 SOLAR ENERGY↗

Need for an Independent Monitoring of Nuclear Waste Repository: Lessons from WIPP Experience - 18130

The Waste Isolation Pilot Plant (WIPP) is the only operating deep geological repository for the permanent disposal of defense transuranic (TRU) waste in the world. The facility recently resumed waste disposal operations after recovering from a February 2014 accident involving a radiological release from a waste container in the WIPP underground. WIPP had been a DOE success story, operating nearly 15 years with no significant incidents or accidents. Many factors contributed to this success, one of the most important being the overwhelming support exhibited by the local community and the local elected officials. One component of the broad public acceptance by the citizens of Southeast New Mexico has been the concept of independent, third party monitoring of environmental effluents at the site. Independent environmental monitoring ensures a role for the local community in ongoing evaluation of the safety and performance of the site. At WIPP this has been achieved through an independent environmental monitoring program operated by the Carlsbad Environmental Monitoring and Research Center (CEMRC). The CEMRC has been conducting independent environmental monitoring activities on and around the WIPP site since 1991 and makes the results of monitoring activities available and easily accessible to members the general public. The public's free and open access to this data and their direct participation in the CEMRC's whole body counting program provides transparency, which is key to maintaining public trust and confidence. The circumstances following the 2014 radiological release event at WIPP reinforced the value of independent environmental monitoring in order to maintain the high level of transparency necessary for long term local acceptance and support for nuclear facilities. Following what was a minor radiological release event, there were understandably fearful reactions from a number of citizens residing in Carlsbad and the nearby communities of Hobbs, Loving, and Artesia. CEMRC's independent environmental monitoring program and their early public engagement proved invaluable in providing timely and accurate environmental data to local community leaders and members of the general public. The data, and open communication from CEMRC, helped reassure citizens in Carlsbad and the surrounding area that the release was extremely low and the extent was very limited. CEMRC further communicated that the probability of any environmental or health impacts from the release was extremely low. It is unlikely the local community would have placed the same level of trust in similar assurances of safety coming from DOE or other State and Federal regulators. The CEMRC's performance in the days following the release meant the local community had access to independent monitoring data and an independent voice in the dialogue with DOE and state officials that shaped the recovery and eventual re-opening of the WIPP facility. The WIPP radiological release event yielded a plethora of lessons learned that will frame the next phase of operational, oversight, and emergency planning surrounding the facility. In this presentation we will be discussing the value and viability of federally-funded, university-housed independent monitoring programs in maintaining trust of state officials and the local communities. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗