Search NASA⌕ Search

SEARCH · Search NASA

Results for “program evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87

ML-ACCEPT: Machine-Learning-enhanced Automated Circuit Configuration and Evaluation of Power Converters

This project, ML-ACCEPT, took a significant step toward achieving the first objective of the DIFFERENTIATE program: to help engineers to more rapidly and cost-effectively consider a wider range of more novel concepts before selecting an engineering-optimal architecture for high-fidelity detailed design and evaluation. Compared to existing methods, the ML-ACCEPT project investigated innovative technologies to make the design of power converters more cost-effective and time-efficient by i) integrating recent breakthroughs in ML, power electronics, simulation software, and optimization to research, develop, and developed a suite of ML-enhanced hypothesis generation tools for power converter design; and ii) facilitating the integration of the proposed software tools into existing power-converter design work-flows. Some existing tools for power-converter design have a certain level of intelligence to aid the design process, but to our knowledge none of them has ML-enhanced capability of automating the electrical circuit design process by selecting, configuring, and tailoring the individual components that enable available resources (e.g., high-voltage DC power) to be converted to the desired output (e.g., lower-voltage DC power with a desired voltage ripple), subject to application-specific (e.g., plasma generation and automotive applications) thermal and packaging considerations. The state-of-the-art circuit design of power converters is still heavily reliant on human experts to select the optimal topology and search for design parameters with human’s experience and intuitions, which can be very time-consuming, inefficient, and labor intensive. The team is composed of University of Michigan-Dearborn (UM-Dearborn), Lawrence Livermore National Laboratory (LLNL), Oak Ridge National Laboratory (ORNL), Modelon Inc., and lighthouse customers.

42 ENGINEERING↗

Test and Evaluation of Systems with Embedded Machine Learning Components

As Machine Learning (ML) continues to advance, it is being integrated into more systems. Often, the ML component represents a significant portion of the system that reduces the burden on the end user or significantly improves task performance. However, the ML component represents an unknown complex phenomenon that is learned from collected data without the need to be explicitly programmed. Despite the improvement in task performance, the models are often black boxes. Evaluating the credibility and the vulnerabilities of ML models poses a gap in current test and evaluation practice. For high consequence applications, the lack of testing and evaluation procedures represents a significant source of uncertainty and risk. To help reduce that risk, here we present considerations to evaluate systems embedded with an ML component within a red-teaming inspired methodology. We focus on (1) cyber vulnerabilities to an ML model, (2) evaluating performance gaps, and (3) adversarial ML vulnerabilities.

97 MATHEMATICS AND COMPUTING↗

Criticality Safety Evaluation for the Advanced Test Reactor U-Mo Demonstration Elements

The Reduced Enrichment Research Test Reactors (RERTR) fuel development program is developing a high uranium density fuel based on a (LEU) uranium-molybdenum alloy. Testing of prototypic RERTR fuel elements is necessary to demonstrate integrated fuel performance behavior and scale-up of fabrication techniques. Two RERTR-Full Size Demonstration fuel elements based on the ATR-Reduced YA elements (all but one plate fueled) are to be fabricated for testing in the Advanced Test Reactor (ATR). The two fuel elements will be irradiated in alternating cycles such that only one element is loaded in the reactor at a time. Existing criticality analyses have analyzed Standard (HEU) ATR elements (all plates fueled) from which controls have been derived. This criticality safety evaluation (CSE) documents analysis that determines the reactivity of the Demonstration fuel elements relative to HEU ATR elements and shows that the Demonstration elements are bound by the Standard HEU ATR elements and existing HEU ATR element controls are applicable to the Demonstration elements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Application of Proliferation Resistance Optimization (PRO-X) Methodology to a Generic Research Reactor

The Proliferation Resistance Optimization Program (PRO-X) has been established by the NNSA to provide a framework for evaluating and integrating proliferation resistance into nuclear reactor system (core, fuel, and auxiliary facilities) designs that also maintain the safety and peaceful use missions of those systems. The research reactor (PRO-RR) area is the component of PRO-X that supports the program objectives by applying state-of-the-art analysis methods to research reactor systems. This report details the results of using a defined set of analytical tools to evaluate the neutronics, thermal hydraulics and proliferation risk characteristics of a set of parametric cores based on a generic 10 MW materials test reactor that uses a plate-type low enriched uranium (LEU) fuel. The analysis shows that by suitable adjustment of the core size, reflector configuration and power level, mission performance and safety margins can be maintained or improved while reducing the potential for production of special nuclear material.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SU-D-201-07: A Survey of Radiation Oncology Residents’ Training and Preparedness to Lead Patient Safety Programs in Clinics

Purpose: Safety and quality has garnered increased attention in radiation oncology, and physicians and physicists are ideal leaders of clinical patient safety programs. However, it is not clear whether residency programs incorporate formal patient safety training and adequately equip residents to assume this leadership role. A national survey was conducted to evaluate medical and physics residents’ exposure to safety topics and their confidence with the skills required to lead clinical safety programs. Methods: Radiation oncology residents were identified in collaboration with ARRO and AAPM. The survey was released in February 2016 via email using REDCap. This included questions about exposure to safety topics, confidence leading safety programs, and interest in training opportunities (i.e. workshops). Residents rated their exposure, skills, and confidence on 4 or 5-point scales. Medical and physics residents responses were compared using chi-square tests. Results: Responses were collected from 56 of 248 (22%) physics and 139 of 690 (20%) medical residents. More than two thirds of all residents had no or only informal exposure to incident learning systems (ILS), root cause analysis (RCA), failure mode and effects analysis (FMEA), and the concept of human factors engineering (HFE). Likewise, 63% of residents had not heard of RO-ILS. Response distributions were similar, however more physics residents had formal exposure to FMEA (p<0.0001) and felt they were adequately trained to lead FMEAs in clinic (p<0.001) than medical residents. Only 36% of residents felt their patient safety training was adequate, and 58% felt more training would benefit their education. Conclusion: These results demonstrate that, despite increasing desire for patient safety training, medical and physics residents’ exposure to relevant concepts is low. Physics residents had more exposure to FMEA than medical residents, and were more confident in leading FMEA. This suggests that increasing resident exposure to specific topics may increase their confidence.

60 APPLIED LIFE SCIENCES↗

REGAL International Program: Analysis of experimental data for depletion code validation

The Rod-Extremity and Gadolinia AnaLysis (REGAL) Program is a joint international effort to expand the nuclide inventory experimental data for irradiated nuclear fuel, with a specific focus on addressing two challenging needs associated with the characterization of modern, high duty, nuclear fuel. The first challenge is filling the gaps in experimental nuclide inventory data for gadolinia (UO 2 –Gd 2 O 3 ) fuel rods. The huge absorption cross sections of Gd-155 and Gd-157 in the Gd dopant in these rods lead to atypical spatial self-shielding patterns and have an impact on the neutronic environment within the fuel assembly compared to regular UO 2 fuel rods. Additionally, the second challenge is investigating the impact of burnup gradients at rod extremities on fuel composition and neutron leakage, to provide relevant experimental data for assessing computational capabilities to model such impact. A benchmark has been defined as a first step in the development of best-estimate models in the preliminary phase of the experimental data evaluation. Comparison of experimental results obtained in Phase I of the program for two measured pressurized water reactor (PWR) samples, one UO 2 and one UO 2 –Gd 2 O 3 sample, with calculated results obtained with different computational tools based on the defined benchmark are presented and discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Sandia Dynamic Materials Program Strategic Plan.

Materials in nuclear and conventional weapons can reach multi-megabar pressures and 1000s of degree temperatures on timescales ranging from microseconds to nanoseconds. Understanding the response of complex materials under these conditions is important for designing and assessing changes to nuclear weapons. In the next few decades, a major concern will be evaluating the behavior of aging materials and remanufactured components. The science to enable the program to underwrite decisions quickly and confidently on use, remanufacturing, and replacement of these materials will be critical to NNSA’s new Stockpile Responsiveness Program. Material response is also important for assessing the risks posed by adversaries or proliferants. Dynamic materials research, which refers to the use of high-speed experiments to produce extreme conditions in matter, is an important part of NNSA’s Stockpile Stewardship Program.

36 MATERIALS SCIENCE↗

Clinical evaluations of an amplitude-based binning algorithm for 4DCT reconstruction in radiation therapy

Purpose: Phase-binning algorithms are commonly utilized in 4DCT image reconstruction for characterization of tumor or organ shape and respiration motion, but breathing irregularities occurring during 4DCT acquisition can cause considerable image distortions. Recently, amplitude-binning algorithms have been evaluated as a potential improvement to phase-binning algorithms for 4DCT image reconstruction. The purpose of this study was to evaluate the performance of the first commercially available on-line retrospective amplitude-binning algorithm for comparison to the traditional phase-binning algorithm. Methods: Both phantom and clinical data were used for evaluation. A phantom of known geometry was mounted on a 4D motion platform programmed with seven respiratory waves (two computer generated and five patient trajectories) and scanned with a Philips Brilliance Big bore 16-slice CT simulator. 4DCT images were reconstructed using commercial amplitude- and phase-binning algorithms. Image quality of the amplitude- and phase-binned image sets was compared by evaluation of shape and volume distortions in reconstructed images. Clinical evaluations were performed on 64 4DCT patient image sets in a blinded review process. The amplitude- and phase-binned 4DCT maximum intensity projection (MIP) images were further evaluated for 28 stereotactic body radiation therapy (SBRT) cases of total 64 cases. A preliminary investigation of the effects of respiratory amplitude and pattern irregularities on motion artifact severity was conducted. Results: The phantom experiments illustrated that, as expected, maximum inhalation occurred at the 0% amplitude and maximum exhalation occurred at the 50% amplitude of the amplitude-binned 4DCT image sets. The phantom shape distortions were more severe in the images reconstructed from the phase-binning algorithm. In the clinical study, compared to the phase-binning algorithm, the amplitude-binning algorithm yielded fewer or less severe motion artifacts in 37.5% of the cases (24/64), comparable artifacts in 54.7% of the cases (35/64), and slightly greater artifacts in 7.8% of the cases (5/64). Evaluation of SBRT cases demonstrated that the reconstructed tumor sizes and locations were comparable in 96% (1/28) of the MIP image pairs generated from both amplitude- and phase-binning algorithms. In this case the amplitude-binned image set rendered a smaller tumor size, which was likely due to very shallow respiratory amplitudes occurring over several breathing cycles. Conclusions: Overall, the amplitude-binning algorithm for 4DCT reconstruction reduced the severity of tumor distortion and image artifacts compared to the phase-binning algorithm. However, the full range of motion may not be characterized using amplitude-binning algorithms. Despite superior performance, amplitude binning can still be susceptible to motion artifacts caused by large variations in amplitude of respiratory waves.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

The Oncor Geodatabase for the Columbia Estuary Ecosystem Restoration Program: Handbook of Data Reduction Procedures, Workbooks, and Exchange Templates

This Handbook of Data Reduction Procedures, Workbooks, and Exchange Templates is designed to support the Oncor geodatabase for the Columbia Estuary Ecosystem Restoration Program (CEERP). The following data categories are covered: water-surface elevation and temperature, sediment accretion rate, photo points, herbaceous wetland vegetation cover, tree plots and site summaries, fish catch and density, fish size, fish diet, fish prey, and Chinook salmon genetic stock identification. The handbook is intended for use by scientists collecting monitoring and research data for the CEERP. The ultimate goal of Oncor is to provide quality, easily accessible, geospatial data for synthesis and evaluation of the collective performance of CEERP ecosystem restoration actions at a program scale.

54 ENVIRONMENTAL SCIENCES↗

American Recovery and Reinvestment Act of 2009. Experiences from the Consumer Behavior Studies on Engaging Customers

One of the most important aspects for the successful implementation of customer-facing programs is to better understand how to engage and communicate with consumers. Customer-facing programs include time-based rates, information and feedback, load management, and energy efficiency. This report presents lessons learned by utilities through consumer behavior studies (CBS) conducted as part of the Department of Energy’s (DOE) Smart Grid Investment Grant (SGIG) program. The SGIG CBS effort presents a unique opportunity to advance the understanding of consumer behaviors in terms of customer acceptance and retention, and electricity consumption and peak demand impacts. The effort includes eleven comprehensive studies with the aim of evaluating the response of residential and small commercial customers to time-based rate programs implemented in conjunction with advanced metering infrastructure and customer systems such as in-home displays, programmable communicating thermostats, and web portals. DOE set guidelines and protocols that sought to help the utilities design studies that would rigorously test and more precisely estimate the impact of time-based rates on customers’ energy usage patterns, as well as identify the key drivers that motivate behavioral changes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Development and experimental qualification of a calculation scheme for the evaluation of gamma heating in experimental reactors. Application to MARIA and Jules Horowitz (JHR) MTR Reactors

Precise computational determination of nuclear heating which consists predominantly of gamma heating (more than 80 %) is one of the challenges in material testing reactor exploitation. Due to sophisticated construction and conditions of experimental programs planned in JHR it became essential to use most accurate and precise gamma heating model. Before the JHR starts to operate, gamma heating evaluation methods need to be developed and qualified in other experimental reactor facilities. This is done inter alia using OSIRIS, MINERVE or EOLE research reactors in France. Furthermore, MARIA - Polish material testing reactor - has been chosen to contribute to the qualification of gamma heating calculation schemes/tools. This reactor has some characteristics close to those of JHR (beryllium usage, fuel element geometry). To evaluate gamma heating in JHR and MARIA reactors, both simulation tools and experimental program have been developed and performed. For gamma heating simulation, new calculation scheme and gamma heating model of MARIA have been carried out using TRIPOLI4 and APOLLO2 codes. Calculation outcome has been verified by comparison to experimental measurements in MARIA reactor. To have more precise calculation results, model of MARIA in TRIPOLI4 has been made using the whole geometry of the core. This has been done for the first time in the history of MARIA reactor and was complex due to cut cone shape of all its elements. Material composition of burnt fuel elements has been implemented from APOLLO2 calculations. An experiment for nuclear heating measurements and calculation verification has been done in September 2014. This involved neutron, photon and nuclear heating measurements at selected locations in MARIA reactor using in particular Rh SPND, Ag SPND, Ionization Chamber (all three from CEA), KAROLINA calorimeter (NCBJ) and Gamma Thermometer (CEA/SCK CEN). Measurements were done in forty points using four channels. Maximal nuclear heating evaluated from measurements is of the order of 2.5 W/g at half of the possible MARIA power - 15 MW. The approach and the detailed program for experimental verification of calculations will be presented. The following points will be discussed: - Development of a gamma heating model of MARIA reactor with TRIPOLI 4 (coupled neutron-photon mode) and APOLLO2 model taking into account the key parameters like: configuration of the core, experimental loading, control rod location, reactor power, fuel depletion); - Design of specific measurement tools for MARIA experiments including for instance a new single-cell calorimeter called KAROLINA calorimeter; - MARIA experimental program description and a preliminary analysis of results; - Comparison of calculations for JHR and MARIA cores with experimental verification analysis, calculation behavior and n-γ 'environments'. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

China Green Low-Carbon City Index: Report on the Performance of 100+ Cities (2010-2015)

The main purpose of the new China Green Low-Carbon City Index (CGLCI, or City Index ) is to evaluate the status of green and low-carbon development for a large number of Chinese cities. Chinese cities are formulating plans and implementing programs to address national initiatives, especially the national low-carbon pilot program for 36 cities and six provinces. However, there is not yet an established framework for measuring, reporting, or evaluating low-carbon progress across Chinese cities, despite the development of a number of Chinese and international city indicator systems. The new China City Index highlights energy use and carbon emissions of Chinese cities, along with environmental and socio-economic indicators. We selected metrics (indicators) that have data available in China’s statistical system, are commonly used internationally, and reflect Chinese policy goals. (See Table ES-1.) We then benchmarked and ranked Chinese cities in terms of their status and progress, identified potential areas for improvement, and identified top-runners. By “low-carbon” we mean reducing emissions of carbon dioxide (CO 2 ) and methane (CH 4 ), with a focus on energy-related CO 2 . The term “carbon” is used as short-hand for these GHGs throughout the report. By “green” we recognize multiple environmental parameters related to urbanization and climate change: air quality, water use, solid waste, transport networks, and urban green space. In early 2017, China expanded its low-carbon pilot cities program, adding 45 more cities.

54 ENVIRONMENTAL SCIENCES↗

State Policies on Access to Vaccination Services for Low-Income Adults

Importance State vaccination benefits coverage and access for adult Medicaid beneficiaries vary substantially. Multiple studies have documented lower vaccination uptake in publicly insured adults compared with privately insured adults. Objective To evaluate adult Medicaid beneficiaries’ access to adult immunization services through review of vaccination benefits coverage in Medicaid programs across the 50 states and the District of Columbia. Design, Setting, and Participants A public domain document review with supplemental semistructured telephone survey was conducted between June 1, 2018, and June 14, 2019, to evaluate vaccination services benefits in fee-for-service and managed care organization arrangements for adult Medicaid beneficiaries in the 50 states and the District of Columbia (total, 51 Medicaid programs). Exposures Document review of benefits coverage for adult immunization services and supplemental survey with validation of document review findings. Main Outcomes and Measures Benefits coverage for adult Medicaid beneficiaries and reimbursement amounts for vaccine purchase and administration. Results Public domain document review was completed for all 51 jurisdictions. Among these, 44 Medicaid programs (86%) validated document review findings and completed the survey. Only 22 Medicaid programs (43%) covered all 13 Advisory Committee on Immunization Practices–recommended adult immunizations under both fee-for-service and managed care organization arrangements. Most fee-for-service arrangements (37 of 49) reimbursed health care professionals using any of the 4 approved vaccine administration codes; however, 8 of 49 programs did not separately reimburse for vaccine administration to adult Medicaid beneficiaries. Depending on administration route, median reimbursement for adult vaccine administration ranged from $\$9.81$ to $\$13.98$ per dose. Median per-dose reimbursement for adult vaccine purchase was highest for 9-valent human papillomavirus vaccine ($\$204.87$) and lowest for Haemophilus influenzae type b vaccine ($\$18.09$). Median reimbursement was below the private sector price for 7 of the 13 included vaccines. Conclusions and Relevance Even in programs with complete vaccination benefits coverage, reimbursement amounts to health care professionals for vaccine purchase and administration may not fully cover vaccination provision costs. Reimbursement amounts below costs may reduce incentives for health care professionals to vaccinate low-income adults and thereby limit Medicaid adult beneficiary access to vaccination.

60 APPLIED LIFE SCIENCES↗

COMPACTION OF FIBERBOARD OVERPACK MATERIALS IN A 9975 SHIPPING PACKAGE

Compaction of lower layers in the 9975 fiberboard overpack has been observed in packages that contain excess moisture. Dynamic loading of the package during transportation may also contribute to compaction of the fiberboard. This condition is being tested and analyzed to better understand these compaction mechanisms and provide a basis from which to evaluate their impact to the safety basis for transportation (Safety Analysis Report for Packaging) and storage (facility Design Safety Analysis) at the Savannah River Site (SRS). A test program has been developed and is being implemented to identify the extent of the compaction as a function of fiberboard moisture and typical transport dynamic loadings. Test conditions will be compared to regulatory requirements for dynamic loading. Characterization of the recovery of short-term compaction following the application of dynamic loading is also being evaluated. Interim results from this test program will be summarized.

42 ENGINEERING↗

Measuring the effectiveness of high-performance Co-Optima biofuels on suppressing soot formation at high temperature

Soot emissions in combustion are unwanted consequences of burning hydrocarbon fuels. The presence of soot during and following combustion processes is an indication of incomplete combustion and has several negative consequences including the emission of harmful particulates and increased operational costs. Efforts have been made to reduce soot production in combustion engines through utilizing oxygenated biofuels in lieu of traditional nonoxygenated feedstocks. The ongoing Co-Optimization of Fuels and Engines (Co-Optima) initiative from the US Department of Energy (DOE) is focused on accelerating the introduction of affordable, scalable, and sustainable biofuels and high-efficiency, low-emission vehicle engines. The Co-Optima program has identified a handful of biofuel compounds from a list of thousands of potential candidates. In this study, a shock tube was used to evaluate the performance of soot reduction of five high-performance biofuels downselected by the Co-Optima program. Current experiments were performed at test conditions between 1,700 and 2,100 K and 4 and 4.7 atm using shock tube and ultrafast, time-resolve laser absorption diagnostic techniques. The combination of shock heating and nonintrusive laser detection provides a state-of-the-art test platform for high-temperature soot formation under engine conditions. Soot reduction was found in ethanol, cyclopentanone, and methyl acetate; conversely, an α-diisobutylene and methyl furan produced more soot compared to the baseline over longer test times. For each biofuel, several reaction pathways that lead towards soot production were identified. The data collected in these experiments are valuable information for the future of renewable biofuel development and their applicability in engines.

09 BIOMASS FUELS↗

Evaluating the PD-1 Axis and Immune Effector Cell Infiltration in Oropharyngeal Squamous Cell Carcinoma

Programmed death-1 (PD-1) inhibitors are approved for the treatment of patients with recurrent and metastatic squamous cell carcinoma of the head and neck (SCCHN). Ongoing and planned randomized phase 3 trials are testing the benefit of combining PD-1/programmed death-ligand 1 (PD-L1) inhibitors with chemoradiation for patients with locoregionally confined SCCHN. Few studies have investigated relationships among potential predictive pathologic biomarkers such as PD-L1, PD-L2, and PD-1 in this population and associations between these markers and clinical characteristics.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Evaluating the Performance of Integer Sum Reduction in SYCL on GPUs

SYCL is a promising programming model for heterogeneous computing—allowing a single-source code to target devices from multiple vendors. One significant task performed on these accelerators is a primitive operation for integer sum reduction. This paper presents several SYCL implementations of integer sum reduction—using atomic functions, shared local memory, vectorized memory accesses and parameterized workload sizes—to compare the performance and maturity of SYCL against open-source vendor-specific implementations of the same reduction. For a sufficiently large number of integers, tuning the parameters of our SYCL implementations achieves 1.4X speedup over the open-source implementations on an Intel UHD630 integrated GPU. The SYCL reduction is 3% faster than the templated reduction in Thrust, and 0.3% faster than the device reduction in CUB on an Nvidia P100 GPU. The SYCL reduction is 1.9% faster than the templated reduction in Thrust, and 0.4% faster than the device reduction in CUB on an Nvidia V100 GPU.

Jin, Zheming↗

Dynamic Time-Variant Connection Management for PGAS Models on InfiniBand

InfiniBand (IB) has established itself as a promising network infrastructure for high-end cluster computing systems as evidenced by its usage in the Top500 supercomputers today. While the IB standard describes multiple communication models (including reliable-connection (RC), and unreliable datagram (UD)), most of its promising features such as remote direct memory access (RDMA), hardware atomics and network fault tolerance are only available for the RC model which requires connections between communicating process pairs. In the past, several researchers have proposed on-demand connection management techniques that establish connections when there is a need to communicate, and not before. While such techniques work well for algorithms and applications that only communicate with a small set of processes in their life-time, there exists a broad set of applications that do not follow this trend. For example, applications that perform dynamic load balancing and adaptive work stealing have a small set of communicating neighbors at any given time, but over time the total number of neighbors can be very high; in some cases, equal to the entire system size. In this paper, we present a dynamic time-variant connection management approach that establishes connections on-demand like previous approaches, but further intelligently tears down some of the unused connections as well. While connection tear-down itself is relevant for any programming model, different models have different complexities. In this paper, we study the Global Arrays (GA) PGAS model for two reasons: (1) the simple one-sided communication primitives provided by GA and other PGAS models ensure that connection requests are always initiated by the origin process without explicit synchronization with the target process---this makes connection tear-down simpler to handle; and (2) GA supports several applications that demonstrate this behavior making it an obvious first target for the proposed enhancements. We evaluate our proposed approach using several micro-benchmarks as well as the NWChem computational chemistry application on more than 6000 processes, and show that our approach can significantly reduce the memory requirements of the communication library while maintaining its performance. To the best of our knowledge, this is the first design, implementation and evaluation of connection tear-down protocols over InfiniBand.

99 GENERAL AND MISCELLANEOUS↗