Results for “urban environments” — Page 5

DOE OSTI2024

Hyper‐Local Temperature Prediction Using Detailed Urban Climate Informatics

The accurate modeling of urban microclimate is a challenging task given the high surface heterogeneity of urban land cover and the vertical structure of street morphology. Recent years have witnessed significant efforts in numerical modeling and data collection of the urban environment. Nonetheless, it is difficult for the physical‐based models to fully utilize the high‐resolution data under the constraints of computing resources. The advancement in machine learning (ML) techniques offers the computational strength to handle the massive volume of data. In this study, we proposed a modeling framework that uses ML approach to estimate point‐scale street‐level air temperature from the urban‐resolving meso‐scale climate model and a suite of hyper‐resolution urban geospatial data sets, including three‐dimensional urban morphology, parcel‐level land use inventory, and weather observations from a sensor network. We implemented this approach in the City of Chicago as a case study to demonstrate the capability of the framework. The proposed approach vastly improves the resolution of temperature predictions in cities, which will help the city with walkability, drivability, and heat‐related behavioral studies. Moreover, we tested the model's reliability on out‐of‐sample locations to investigate the modeling uncertainties and the application potentials to the other areas. This study aims to gain insights into next‐gen urban climate modeling and guide the observation efforts in cities to build the strength for the holistic understanding of urban microclimate dynamics.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

VA EDH Data Curation Documentation (FY24-Q1)

The U.S. Department of Veterans Affairs (VA) places the health and well-being of our nation’s veterans as its top priority. VA is dedicated to offering timely access to high-quality, evidence-based mental health care that meets the needs of veterans and supports their reintegration into society. One of our core missions is to prevent suicide among veterans through innovative approaches and resources. Health outcomes, including suicide, are typically influenced by both genetics and environmental factors, such as air quality, transportation access, food availability, homelessness, and more. Mental health outcomes are associated with various stressors across socioeconomic, economic, and physical environments. Analyzing the connections between these stressors, covariates, and health outcomes relies on standardized data, which can be integrated into models like the VA’s Recovery Engagement and Coordination for Health, Veterans Enhanced Treatment (REACH VET). The World Health Organization (WHO) defines Environmental Determinants of Health (EDH) as factors like clean air, stable climate, water and sanitation, chemical safety, radiation protection, safe workplaces, sustainable agriculture, healthy urban environments, and nature preservation, all of which are crucial for good health.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

VA EDH Data Curation Documentation (FY24-Q2)

The U.S. Department of Veterans Affairs (VA) places the health and well-being of our nation’s veterans as its top priority. VA is dedicated to offering timely access to high-quality, evidence-based mental health care that meets the needs of veterans and supports their reintegration into society. One of our core missions is to prevent suicide among veterans through innovative approaches and resources. Health outcomes, including suicide, are typically influenced by both genetics and environmental factors, such as air quality, transportation access, food availability, homelessness, and more. Mental health outcomes are associated with various stressors across socioeconomic, economic, and physical environments. Analyzing the connections between these stressors, covariates, and health outcomes relies on standardized data, which can be integrated into models like the VA’s Recovery Engagement and Coordination for Health, Veterans Enhanced Treatment (REACH VET). The World Health Organization (WHO) defines Environmental Determinants of Health (EDH) as factors like clean air, stable climate, water and sanitation, chemical safety, radiation protection, safe workplaces, sustainable agriculture, healthy urban environments, and nature preservation, all of which are crucial for good health.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

VA EDH Data Curation Documentation (FY24-Q3)

The U.S. Department of Veterans Affairs (VA) places the health and well-being of our nation’s veterans as its top priority. VA is dedicated to offering timely access to high-quality, evidence-based mental health care that meets the needs of veterans and supports their reintegration into society. One of our core missions is to prevent suicide among veterans through innovative approaches and resources. Health outcomes, including suicide, are typically influenced by both genetics and environmental factors, such as air quality, transportation access, food availability, homelessness, and more. Mental health outcomes are associated with various stressors across socioeconomic, economic, and physical environments. Analyzing the connections between these stressors, covariates, and health outcomes relies on standardized data, which can be integrated into models like the VA’s Recovery Engagement and Coordination for Health, Veterans Enhanced Treatment (REACH VET). The World Health Organization (WHO) defines Environmental Determinants of Health (EDH) as factors like clean air, stable climate, water and sanitation, chemical safety, radiation protection, safe workplaces, sustainable agriculture, healthy urban environments, and nature preservation, all of which are crucial for good health.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

VA EDH Data Curation Documentation FY24-Q4

The U.S. Department of Veterans Affairs (VA) places the health and well-being of our nation’s veterans as its top priority. VA is dedicated to offering timely access to high-quality, evidence-based mental health care that meets the needs of veterans and supports their reintegration into society. One of our core missions is to prevent suicide among veterans through innovative approaches and resources. Health outcomes, including suicide, are typically influenced by both genetics and environmental factors, such as air quality, transportation access, food availability, homelessness, and more. Mental health outcomes are associated with various stressors across socioeconomic, economic, and physical environments. Analyzing the connections between these stressors, covariates, and health outcomes relies on standardized data, which can be integrated into models like the VA’s Recovery Engagement and Coordination for Health, Veterans Enhanced Treatment (REACH VET). The World Health Organization (WHO) defines Environmental Determinants of Health (EDH) as factors like clean air, stable climate, water and sanitation, chemical safety, radiation protection, safe workplaces, sustainable agriculture, healthy urban environments, and nature preservation, all of which are crucial for good health.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2022

Automated Mobility Platforms: A Framework for Versatile, Energy-Efficient Urban Transportation for the 21st Century: Preprint

This paper presents automated mobility platforms (AMPs) as a framework to deliver high-quality urban mobility. AMPs leverage advances in sensing technology developed from automated roadway vehicles to provide opportunities for efficient movement of people and goods in dense urban environments, campuses, and large facilities like airports. In this paper, we layout the concept of AMPs and how they can serve the mobility needs of the population by providing service at the intersection of micromobility (services such as electric scooters or bikes), personal rapid transit, and moving walkways. Several key attributes and justification for the AMPs concept are described, including improvements to accessibility (inherent in design) covering both socioeconomic and disability equity, safety, energy efficiency, cost-effectiveness, urban land and space management, and scalability. We summarize the results from an ongoing national laboratory-sponsored, faculty-supported, student-led investigation into AMPs that includes stakeholder engagement and technical feasibility assessment.

ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2022

Flexible Siting Criteria and Staff Minimization for Micro-Reactors

The economic potential of micro-reactors is vast and underestimated. Commonly-emphasized applications include niche markets such as remote communities, mines and military bases. However, micro-reactors could be used as flexible energy generators also for larger markets, such as mobile and containerized agriculture and manufacturing facilities, district heating, micro-grids for data centers, sea ports, airports and hospitals. The implication is that micro-reactors may have to be deployed also in non-remote locations. Successful implementation of micro-reactors needs a navigable and predictable licensing process, technology-appropriate siting restrictions, risk-informed emergency and safety requirements, and practical operating and maintenance requirements. The primary goal of this project was to develop siting criteria that are tailored to micro-reactors deployable in densely-populated areas, e.g., urban environments. To achieve that goal, we compared the characteristics of the MIT research reactor (MITR) with those of leading micro-reactor concepts (e.g., eVinci, USNC, Aurora), and evaluated whether and how the MITR design basis (e.g., inherent safety features, engineered safety systems, source term, emergency planning and emergency operating procedures) and associated regulations may be applicable to these new micro-reactors as well. What makes MITR a unique analogue in this context is its small power rating (6 MWt) and physical size, mode of operations (24/7 with a somewhat more commercial flavor than typical university reactors), and especially its urban location. Of course significant differences exist, such as mission (power production vs. research) and the reactor design itself. Leveraging the MITR experience, this project was able to generate criteria that will allow micro-reactors to realize their full economic potential as flexible heat and electricity generators for a diverse portfolio of applications in non-remote locations. As such, the outcome of this project might encourage investment in and use of micro-reactors. A second goal of the project was to conceptualize a model of operations for micro-reactors that would minimize the staffing requirements, and thus reduce the cost of electricity and heat generated by these systems. Here too our approach was to systematically review the MITR experience and requirements, as well as survey the innovations in autonomous control technologies and monitoring (e.g., advanced sensors, drones, robotics, AI) that would permit a dramatic reduction in staffing at future micro-reactor installations. The scope of work was expanded after the start date to include also an evaluation of micro-reactor security, using the so-called consequence-based analysis, and the development of a methodology to perform dynamic risk assessment for micro-reactors, using system theory and modeling and simulation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Logistics simulation of a remediation effort for a hypothetical radiological contamination scenario

To mitigate the effects following a large-scale nuclear or radiological material release in an urban environment and to expedite recovery, the Integrated Wash-Aid Treatment Emergency Reuse System (IWATERS) was developed. IWATERS consists of three operations: washing contaminated surfaces with an ionic wash solution, collecting, and treating the contaminated wash solution on-site to remove contaminants, and reusing the treated solution throughout operations to preserve the clean water resource. This study develops a framework to simulate the logistics of IWATERS deployment, thereby gaining an understanding of the timeline for decontamination operations. For this purpose, the Analysis of Mobility Platform and GoldSim were leveraged for a hypothetical contamination scenario covering 65,200 m 2 of an urban center. The framework reveals that remediation progress is limited by several resources, notably the availability of vermiculite, a reactive clay that is required to treat the contaminated wash solution. Further, this study also presents how the simulation approach can be used to characterize alternatives to reduce the influence of limited resources on operational progress. Overall, this work lays the foundation for evaluating different decontamination methods through detailed logistics simulation, i.e., by refining simulation assumptions and expanding the range of scenarios the simulation can depict.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

DOE OSTI2020

Magnetic Navigation for GPS-Denied Airborne Applications

Most current flight systems are dependent on GPS for navigation. Recently, however, navigation in GPS-denied environments has become an area of intensive research. Additional navigation sensor data can be obtained from visual observations (stars or terrain), inertial measurement units, radar, measurements of the local magnetic field, or perhaps even gravity. Absolute and relative positioning via magnetic field measurements have been shown to be viable in many applications including ground navigation, low altitude aircraft flight, and spaceflight. There is greater variability in the magnetic field over shorter distances when flying at low altitude and in ground applications, leading to more accurate positioning. However, ground-based magnetic navigation is often heavily influenced by man-made structures, especially in urban environments. This is not the case for airborne magnetic navigation since the influence of buildings, roads, etc. is negligible for typical aircraft altitudes. For absolute magnetic navigation, the positioning accuracy decreases as altitude increases for a given vehicle velocity, but the observed time variability in the field can be reclaimed by traveling faster through the field. Thus, navigation accuracy becomes a balance of speed and altitude since the higher altitude can be counterbalanced by higher velocity. To understand these effects quantitatively, we explored various techniques to aid a simulated inertial measurement unit with magnetic information. Using a technique known as two-dimensional magnetic map matching, we simulated the performance of airborne magnetic navigation at fixed speed while varying the altitude, flight direction, magnetometer data collection time, reference magnetic map bias error, and type of trajectory (over land or over ocean).

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

WORKSHOP ON URBAN SCALE PROCESSES AND THEIR REPRESENTATION IN HIGH SPATIAL RESOLUTION EARTH SYSTEM MODELS

It is essential that numerical models used to study physics, chemistry, and biology affecting the Earth system at regional and global scales represent the effects of urban areas on climate and the effects of changing the climate on urban areas. At the same time, it is essential to develop state of the art, simple and accurate urban models to better understand the relevant processes and also toaddress issues related to urban security against the spectra of chemical, biological and radiological (CBR) hazards. Towards bringing these communities together, a 2.5-day international workshop was held at Argonne National Laboratory (ANL) in the Chicago area on May 22-24, 2019. This workshop brought together national and international experts to develop a roadmap for a better understanding of the issues associated with urban areas and at enhancing the capabilities of regional and global Earth System models (ESMs) in representing the atmospheric dynamics and chemistry, unique aspects of the biosphere and land use, and human dimensions of the urban environment. This workshop was especially important to those developing very high-resolution versions of regional and global models. The workshop also discussed existing datasets, including in situ and satellite observations, and the emerging smart city sensing technologies and their possible use in model development (e.g., the NSF-funded Array of Things network currently operating in Chicago and expanding to other cities).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Protection and restoration of coastal habitats yield multiple benefits for urban residents as sea levels rise

Globally, rising seas threaten massive numbers of people and significant infrastructure. Adaptation strategies increasingly incorporate nature-based solutions. New science can illuminate where these solutions are appropriate in urban environments and what benefits they provide to people. Together with stakeholders in San Mateo County, California, USA, we co-developed nature-based solutions to support adaptation planning. We created six guiding principles to shape planning, summarized vulnerability to sea-level rise and opportunities for nature-based solutions, created three adaptation scenarios, and compared multiple benefits provided by each scenario. Adaptation scenarios that included investments in nature-based solutions deliver up to eight times the benefits of a traditionally engineered baseline as well as additional habitat for key species. The magnitude and distribution of benefits varied at subregional scales along the coastline. Our results demonstrate practical tools and engagement approaches to assessing the multiple benefits of nature-based solutions in an urban estuary that can be replicated in other regions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Applying Machine Learning and Bayesian Inference to Identify and Locate Moving Anthropogenic Sources Using Distributed Acoustic Sensing Data

Distributed acoustic sensing (DAS) systems, which use existing telecommunication fibers, offer high‐resolution capabilities ideal for recording anthropogenic sources. However, the complexity of urban environments and the large amount of data recorded by DAS require automated methods to efficiently detect and categorize anthropogenic sources. Here, we evaluate how well three machine learning models (k‐nearest neighbor [k‐NN], convolutional neural networks, and recurrent‐convolutional neural networks) can identify various anthropogenic sources recorded by DAS. Our findings reveal that both k‐NN and neural network methods perform well in high signal‐to‐noise ratio (SNR) settings. However, their accuracy decreases at SNRs <4. We also use Kalman filtering, a form of Bayesian inference, on backprojected locations of these sources to recover locations that generally fall within standard smartphone Global Positioning System errors. By combining machine learning and Kalman filter results, we calculate a multidimensional model of moving anthropogenic sources. These results demonstrate the potential of DAS data in urban seismology for accurately identifying and locating such sources. Depending on the research objectives, these sources can be further studied or filtered out to improve the quality of seismic data for earthquake studies. Such methods provide a valuable tool for urban seismology and seismic hazard analysis.

Luckie, Thomas William [Sandia National Laboratori↗

DOE OSTI2026

A hybrid CNN-LSTM surrogate model for hyper-resolution spatiotemporal flood forecasting in Norfolk, Virginia

Study region: Norfolk, Virginia, United States Study focus: Accurate and timely flood forecasting is essential for enhancing resilience in coastal urban areas in the context of increasing frequency and intensity of rainfall, sea level rise and urbanization. This study presents a hybrid deep learning-based surrogate model that integrates Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks to enable real-time spatiotemporal flood forecasting. The model leverages CNN to capture spatial features from inputs such as elevation and Topographic Wetness Index (TWI), while LSTM processes time-series inputs of rainfall and tide data to capture temporal features. New hydrologic insights for the region: The hybrid CNN-LSTM model was trained using the physics-based hydrodynamic model simulations obtained from the Two-dimensional Unsteady FLOW (TUFLOW) model for Norfolk, Virginia, and achieved high predictive accuracy across diverse flood-prone areas. The reduced computational time from four to six hours using TUFLOW to 3.2 min per event using CNN-LSTM enables rapid flood inundation mapping and early warning applications. The model effectively captured both spatial flood extents and their temporal evolution across different flooding scenarios, providing forecasts at a 2.5-m spatial resolution and 15-min temporal resolution and a one-hour-ahead prediction horizon. While challenges remain in terms of transferability to new regions and real-time data assimilation, this approach demonstrates strong potential for supporting operational flood risk management in coastal urban environments.

Coastal urban flooding↗

DOE OSTI2024

Computational Analysis of Hydraulic Efficiency of Michigan DOT Cover C

Drainage structures are used to capture stormwater runoff in streets and highways in urban environments. These drainage structures, which typically consist of catch basins with grates, inlets, or combination grates/inlets, collect stormwater runoff and discharge through buried conveyance systems. They are strategically placed for public safety in curb and gutter systems to provide efficient drainage of water from roadways and thus reduce the risk of hydroplaning. The performance of drainage structures is measured in terms of hydraulic efficiency, which is defined as the percentage of flow captured by the basin as compared to the total flow drainage to the structure. Understanding of the performance of these drainage structures helps designers properly space inlets to promote an economic design that ensures the safety of the traveling public. The current design methodology used to determine drainage structure follows guidelines established in the current Michigan Department of Transportation (MDOT) Drainage Manual (2006). The guidelines in the MDOT Drainage Manual were modeled after the Federal Highway Administration’s (FHWA) Hydraulic Engineering Circular 22 “Urban Drainage Design” (HEC-22). HEC-22 includes empirically derived equations to calculate the interception capacity of drainage structures for several commonly used grate configurations, such as the parallel bar, curved vane and tilt bar grates, which are based on a research study performed by Burgi et al. in the 1970s. MDOT uses several drainage structures to capture runoff that are detailed as Standard Plans. Many of these drainage structures utilize sinusoidal type grates that are not described in HEC-22. Physical modeling of these structures has been limited, posing the need to have them analyzed to verify their capture efficiency. Current MDOT practice is to assume a similar sized reticuline grate, as described in HEC-22, for capture efficiencies. Until recently, evaluating the hydraulic performance of drainage structures was limited to physical modeling in a hydraulics laboratory. With advances in engineering software and computing power, computational fluid dynamics (CFD) modeling has become a more cost-effective alternative. The Federal Highway Administration (FHWA) provides states the option to evaluate their drainage structures using CFD through the Transportation Pooled Fund Program. This study, “Computational Analysis of Hydraulic Efficiency of Michigan DOT Cover C,” was carried out using the pooled fund. MDOT’s Cover C was chosen as the first test candidate, given its similar sinusoidal pattern to other MDOT grates, but it is typically used for high-volume, higher speed applications. A similar version, Cover CX, is used on interstate highways but does not have traverse bars for bicycle safety. Additional grates may be considered for evaluation in the future.

42 ENGINEERING↗

DOE OSTI2026

Data & Code from Phoenix CPPP Phase 2 Analysis

This data and code package supports the analysis presented in “Beyond Surface Cooling: Comprehensive Field Assessment of Reflective Pavement Thermal Performance in Phoenix, Arizona” and provides fully reproducible workflows for evaluating the thermal performance of cool pavement treatments in a hot urban environment. The dataset integrates multi-modal field measurements collected across residential and nonresidential settings, including mobile air temperature traverses, stationary air temperature monitoring, residential mean radiant temperature (MRT) measurements, subsurface temperature profiles, and controlled testbed observations. The data package contains raw and processed datasets in comma-separated value (CSV) format, accompanying metadata files describing site characteristics and measurement protocols, and R scripts (.R files) used for data cleaning, time synchronization, spatial and temporal matching, quality control filtering, statistical comparison, and figure generation. All analyses were conducted using R (version ≥ 4.2.0) with commonly available packages (e.g., tidyverse, lubridate, data.table, ggplot2). No proprietary software is required to reproduce results. Field campaigns were designed to quantify the effects of high-reflectance pavement coatings on surface temperature, near-surface air temperature, subsurface heat propagation, and radiative heat exposure. Temporal alignment procedures include standardized timestamp conversion and nearest-neighbor matching of high-frequency sensor measurements to stop-based metadata within defined tolerance windows to ensure comparability across instruments. The workflows generate summary statistics, treatment–control contrasts, depth-dependent thermal gradients, and time-series visualizations used in the associated publication. By integrating mobile, stationary, radiative, and subsurface measurements within a unified and transparent processing framework, this package enables comprehensive evaluation of cool pavement performance across multiple thermal exposure pathways and supports reuse in future urban heat mitigation and climate resilience studies.

AIR TEMPERATURE↗

DOE OSTI2021

Strong influence of convective heat transfer efficiency on the cooling benefits of green roof irrigation

Abstract By enhancing evapotranspiration (ET), green roofs provide cooling benefits for the urban environment and are recognized as a promising heat mitigation strategy. The evaporative cooling effects of green roofs strongly depend on the soil moisture conditions and thus irrigation may be needed to sustain the cooling benefits. It has been shown that the magnitude of cooling benefits offered by green roof irrigation varies spatially, but its controlling factors remain elusive. In this study, we combine a surface energy balance (SEB) model with global simulations generated by an improved Earth System Model to illustrate the key factors controlling the cooling benefits of green roof irrigation. We employ a simple irrigation scheme, which is only active when there is no ice in soil layers and when the soil moisture is below field capacity. As a result, most of the irrigation water leaves the green roof system via ET. We find that the magnitude and also the spatial variability of the cooling benefits of green roof irrigation are controlled by the irrigation amount, and a surface energy redistribution factor that encodes the efficiencies of different SEB components in transferring heat. Further analysis indicates that the enhancement of latent heat flux due to irrigation is largely balanced by the reduction of sensible heat flux on green roofs. Therefore, the amount of irrigation needed per unit decrease of green roof surface temperature is mainly controlled by the convective heat transfer efficiency. A lower convective heat transfer efficiency (e.g. under a lower wind speed) helps reduce the amount of irrigation needed per unit decrease of green roof surface temperature. This study highlights the importance of SEB in constraining the cooling benefits of green roof irrigation and provides valuable guidance for urban planners and policy makers in terms of heat mitigation and sustainable water management.

Wang, Linying (ORCID:0000000308769220)↗

DOE OSTI2025

Exploring Micro-Environmental Conditions of Urban Agrivoltaics: Advancing Sustainable Green Spaces and Agriculture in Temperate Cities

Agrivoltaics, the integrated land use combining renewable energy production and agriculture, can potentially address key challenges faced by urban communities, including limited access to vacant land, fresh produce, and electricity. However, urban agrivoltaics has rarely been considered a viable solution, primarily due to a lack of experimental systems demonstrating the functionality of urban food production or green spaces alongside solar energy production. To evaluate the potential of solar photovoltaics to help mitigate heat stress on urban agriculture and green spaces in a temperate climate, we examined the microclimatic changes introduced by an urban agrivoltaics system (UrAV) when combined with vegetable crops and turfgrass, respectively. Accordingly, we installed an experimental setup instrumented with environmental sensors to compare full-sun conditions with those of an agrivoltaics system designed for urban environments. We found minimal differences for both land cover types between the control and agrivoltaics sites in air and soil temperature. However, during periods of intensified summer heat, temperatures beneath the panels cooled due to reductions in wind speed and relative humidity, which impeded the movement of hot, moist air and reduced reference evapotranspiration. Further, soil moisture in UrAV was highly spatially heterogeneous, influenced by the layout of the photovoltaic panels and their support structure, which redistributed rainfall and controlled where solar radiation could penetrate and drive evapotranspiration. Overall, our results suggest that PV-induced environmental changes in temperate climates are compatible with cultivating turfgrass or appropriate crops. These findings can help planners and designers integrate agrivoltaics into community gardens, farms, and green spaces in temperate cities.

14 SOLAR ENERGY↗

DOE OSTI2025

Reinforcement Learning-Based Oscillation Dampening: Scaling Up Single-Agent Reinforcement Learning Algorithms to a 100-Autonomous-Vehicle Highway Field Operational Test

In this article, we explore the technical details of the reinforcement learning (RL) algorithms that were deployed in the largest field test of automated vehicles designed to smooth traffic flow in history as of 2023, uncovering the challenges and breakthroughs that come with developing RL controllers for automated vehicles. We delve into the fundamental concepts behind RL algorithms and their application in the context of self-driving cars, discussing the developmental process from simulation to deployment in detail, from designing simulators to reward function shaping. We present the results in both simulation and deployment, discussing the flow-smoothing benefits of the RL controller. From understanding the basics of Markov decision processes to exploring advanced techniques such as deep RL, our article offers a comprehensive overview and deep dive of the theoretical foundations and practical implementations driving this rapidly evolving field. We also showcase real-world case studies and alternative research projects that highlight the impact of RL controllers in revolutionizing autonomous driving. From tackling complex urban environments to dealing with unpredictable traffic scenarios, these intelligent controllers are pushing the boundaries of what automated vehicles can achieve. Furthermore, we examine the safety considerations and hardware-focused technical details surrounding deployment of RL controllers into automated vehicles. As these algorithms learn and evolve through interactions with the environment, ensuring their behavior aligns with safety standards becomes crucial. Here, we explore the methodologies and frameworks being developed to address these challenges, emphasizing the importance of building reliable control systems for automated vehicles.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗