Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

An eigensystem realization algorithm for modal parameter identification and model reduction

A method called the eigensystem realization algorithm is developed for modal parameter identification and model reduction of dynamic systems from test data. A new approach is introduced in conjunction with the singular-value decomposition technique to derive the basic formulation of minimum order realization which is an extended version of the Ho-Kalman algorithm. The basic formulation is then transformed into modal space for modal parameter identification. Two accuracy indicators are developed to quantitatively identify the system and noise modes. For illustration of the algorithm, an example is shown using experimental data from the Galileo spacecraft.

Juang, J.-N.↗

Particle and flow field holography: A critical survey

A brief background is provided for the fields of particle and flow visualization holography. A summary of methods currently in use is given, followed by a discussion of more recent and unique applications. The problem of data reduction is discussed. A state of the art summary is then provided with a prognosis of the future of the field. Particle and flow visualization holography are characterized as powerful tools currently in wide use and with significant untapped potential.

Trolinger, James D.↗

Tilt rotor aircraft aeroacoustics

This paper studies the state of knowledge and the needed improvement in noise methodology and measurements for tilt rotor aircraft. Similarities and differences between tilt rotor aeroacoustic conditions and helicopter and propeller experience are identified. A discussion of the possible principal noise mechanisms throughout the flight envelope shows a need for further experimental and analytical investigations to develop an adequate understanding of the important sources and influencing factors. Existing experimental data from flight tests suggest terminal area noise reduction by operating within certain portions of the conversion flight envelope. Prediction methods are found to provide approximate indications only for low frequency harmonic and broadband noise for several of the tilt rotor's operating conditions. The acoustic effects of the hover case 'fountain' flow are pronounced and need further research. Impulsive noise and high frequency harmonic noise remain problems, as on helicopters, pending major improvements in wake, unsteady aerodynamics, and acoustics methodology.

George, Albert R.↗

Thermodynamic Oxidation and Reduction Potentials of Photocatalytic Semiconductors in Aqueous Solution

An approach is introduced to calculate the thermodynamic oxidation and reduction potentials of semiconductors in aqueous solution. Here, by combining a newly developed ab initio calculation method for compound formation energy and band alignment with electrochemistry experimental data, this approach can be used to predict the stability of almost any compound semiconductor in aqueous solution. Thirty photocatalytic semiconductors have been studied, and a graph (a simplified Pourbaix diagram) showing their valence/conduction band edges and oxidation/reduction potentials relative to the water redox potentials is produced. On the basis of this graph, the thermodynamic stabilities and trends against the oxidative and reductive photocorrosion for compound semiconductors are analyzed, which shows the following: (i) some metal oxides can be resistant against the oxidation by the photogenerated holes when used as the n-type photoanodes; (ii) all the nonoxide semiconductors are susceptible to oxidation, but they are resistant to the reduction by the photogenerated electrons and thus can be used as the p-type photocathodes if protected from the oxidation; (iii) doping or alloying the metal oxide with less electronegative anions can decrease the band gap but also degrade the stability against oxidation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The possible modifications of the HISSE model for pure LANDSAT agricultural data

A method for relaxing the assumption of class conditional independence of LANDSAT spectral measurements within the same patch (field) is discussed. Theoretical arguments are given which show that any significant refinement of the model beyond this proposal will not allow the reduction, essential to HISSE, of the pure data to patch summary statistics. A slight alteration of the new model is shown to be a reasonable approximation to the model which describes pure data elements from the same patch as jointly Gaussian with a covariance function which exhibits exponential decay with respect to spatial separation.

Peters, C.↗

Cone-beam breast computed tomography with a displaced flat panel detector array

Purpose: In cone-beam computed tomography (CBCT), and in particular in cone-beam breast computed tomography (CBBCT), an important issue is the reduction of the image artifacts produced by photon scatter and the reduction of patient dose. In this work, the authors propose to apply the detector displacement technique (also known as asymmetric detector or ''extended view'' geometry) to approach this goal. Potentially, this type of geometry, and the accompanying use of a beam collimator to mask the unirradiated half-object in each projection, permits some reduction of radiation dose with respect to conventional CBBCT and a sizeable reduction of the overall amount of scatter in the object, for a fixed contrast-to-noise ratio (CNR). Methods: The authors consider a scan configuration in which the projection data are acquired from an asymmetrically positioned detector that covers only one half of the scan field of view. Monte Carlo simulations and measurements, with their CBBCT laboratory scanner, were performed using PMMA phantoms of cylindrical (70-mm diameter) and hemiellipsoidal (140-mm diameter) shape simulating the average pendant breast, at 80 kVp. Image quality was evaluated in terms of contrast, noise, CNR, contrast-to-noise ratio per unit of dose (CNRD), and spatial resolution as width of line spread function for high contrast details. Results: Reconstructed images with the asymmetric detector technique deviate less than 1% from reconstruction with a conventional symmetric detector (detector view) and indicate a reduction of the cupping artifact in CT slices. The maximum scatter-to-primary ratio at the center of the phantom decreases by about 50% for both small and large diameter phantoms (e.g., from 0.75 in detector view to 0.40 in extended view geometry at the central axis of the 140-mm diameter PMMA phantom). Less cupping produces an increase of the CT number accuracy and an improved image detail contrast, but the associated increase of noise observed may produce a decrease of detail CNR. By simulating the energy deposited inside the phantoms, the authors evaluated a maximum 50% reduction of the absorbed dose at the expense of a decrease of CNR, for the half beam irradiation of the object performed with the displaced detector technique with respect to full beam irradiation. The decrease in CNR, and in absorbed dose as well, translates into a detail CNRD showing values comparable to or higher than the ones obtained for a conventional symmetric detector technique, attributed to the effect of decreased scatter in particular at the axis of the irradiated object. An estimate is provided (about 12%) for the average dose reduction possible in CBBCT at constant CNR for the average uncompressed breast (14 cm diameter, 50% glandularity), in case of minimum image overlapping in extended view. Conclusions: Simulations and experiments show that CBCT reconstructions with the displaced detector technique and with a half beam collimator are less affected by scatter artifacts, which could lead to some decrease of the radiation dose to the irradiated object with respect to a conventional reconstruction. This dose reduction is associated with increase of noise, decrease of CNR, but equal or improved CNRD values. The use of a small area detector would allow also to reduce the apparatus cost and to improve the data transfer speed with a corresponding increment of frame rate.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Operational Data Reduction Procedure for Determining Density and Vertical Structure of the Martian Upper Atmosphere from Mars Global Surveyor Accelerometer Measurements

The success of aerobraking by the Mars Global Surveyor (MGS) spacecraft was partly due to the analysis of MGS accelerometer data. Accelerometer data was used to determine the effect of the atmosphere on each orbit, to characterize the nature of the atmosphere, and to predict the atmosphere for future orbits. To interpret the accelerometer data, a data reduction procedure was developed to produce density estimations utilizing inputs from the spacecraft, the Navigation Team, and pre-mission aerothermodynamic studies. This data reduction procedure was based on the calculation of aerodynamic forces from the accelerometer data by considering acceleration due to gravity gradient, solar pressure, angular motion of the MGS, instrument bias, thruster activity, and a vibration component due to the motion of the damaged solar array. Methods were developed to calculate all of the acceleration components including a 4 degree of freedom dynamics model used to gain a greater understanding of the damaged solar array. The total error inherent to the data reduction procedure was calculated as a function of altitude and density considering contributions from ephemeris errors, errors in force coefficient, and instrument errors due to bias and digitization. Comparing the results from this procedure to the data of other MGS Teams has demonstrated that this procedure can quickly and accurately describe the density and vertical structure of the Martian upper atmosphere.

Cancro, George J.↗

Iterative metal artifact reduction for x-ray computed tomography using unmatched projector/backprojector pairs

Purpose: Metal artifact reduction (MAR) is a major problem and a challenging issue in x-ray computed tomography (CT) examinations. Iterative reconstruction from sinograms unaffected by metals shows promising potential in detail recovery. This reconstruction has been the subject of much research in recent years. However, conventional iterative reconstruction methods easily introduce new artifacts around metal implants because of incomplete data reconstruction and inconsistencies in practical data acquisition. Hence, this work aims at developing a method to suppress newly introduced artifacts and improve the image quality around metal implants for the iterative MAR scheme. Methods: The proposed method consists of two steps based on the general iterative MAR framework. An uncorrected image is initially reconstructed, and the corresponding metal trace is obtained. The iterative reconstruction method is then used to reconstruct images from the unaffected sinogram. In the reconstruction step of this work, an iterative strategy utilizing unmatched projector/backprojector pairs is used. A ramp filter is introduced into the back-projection procedure to restrain the inconsistency components in low frequencies and generate more reliable images of the regions around metals. Furthermore, a constrained total variation (TV) minimization model is also incorporated to enhance efficiency. The proposed strategy is implemented based on an iterative FBP and an alternating direction minimization (ADM) scheme, respectively. The developed algorithms are referred to as “iFBP-TV” and “TV-FADM,” respectively. Two projection-completion-based MAR methods and three iterative MAR methods are performed simultaneously for comparison. Results: The proposed method performs reasonably on both simulation and real CT-scanned datasets. This approach could reduce streak metal artifacts effectively and avoid the mentioned effects in the vicinity of the metals. The improvements are evaluated by inspecting regions of interest and by comparing the root-mean-square errors, normalized mean absolute distance, and universal quality index metrics of the images. Both iFBP-TV and TV-FADM methods outperform other counterparts in all cases. Unlike the conventional iterative methods, the proposed strategy utilizing unmatched projector/backprojector pairs shows excellent performance in detail preservation and prevention of the introduction of new artifacts. Conclusions: Qualitative and quantitative evaluations of experimental results indicate that the developed method outperforms classical MAR algorithms in suppressing streak artifacts and preserving the edge structural information of the object. In particular, structures lying close to metals can be gradually recovered because of the reduction of artifacts caused by inconsistency effects.

60 APPLIED LIFE SCIENCES↗

SnowPac : a multiscale cubic B-spline wavelet compressor for astronomical images

ABSTRACT As more advanced and complex survey telescopes are developed, the size and scale of data being captured grows at increasing rates. Across various domains, data compression through wavelets has enabled the reduction of data size and increase in computation efficiency. In this paper, we provide qualitative and quantitative tests of a new wavelet-based image compression method compared against the current standard for astronomical images. The analysis is improved by making use of state-of-the-art object detection systems to accurately measure the impact of the compression. We find that a combination of lossy wavelet-based methods, efficient quantization, and lossless dictionary compressors can preserve up to 98 per cent of astronomical objects at a 10:1 compression ratio. This significant reduction in file size also preserves astronomical object properties better than existing methods. These methods help further reduce future workloads for image-heavy processing pipelines.

Pulido, Jesus↗

Decoding the Pair Distribution Function of Uranium in Molten Fluoride Salts from X-Ray Absorption Spectroscopy Data by Machine Learning

Thermal properties of actinides in molten salts are linked to the strongly disordered local environment of actinide ions. Here, we illustrate both the limitations of the commonly used fitting method for analysis of extended X-ray absorption fine structure (EXAFS) spectra in molten UF 4 and a possible solution using an "objective neural network - EXAFS" (ONNE) method. ONNE provides both extraction of the pair distribution function, as validated by its application to the EXAFS spectra calculated on molecular dynamics trajectory, and the EXAFS data reconstruction. The ONNE analysis of the molten UF4 has revealed reduction of the first nearest neighbor U-F coordination number, expansion of the U-F bond length and smaller contribution to the second shell compared to its crystalline counterpart. This method is therefore an attractive alternative to conventional EXAFS analysis and molecular dynamics simulations for studies of disordered environment of actinides in molten salts.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Comparison of Likelihood Methods for Generalized Linear Mixed Models with Application to Quiet Supersonic Flights 2018 Data

Repeated measurement will be a feature of the survey data collected during the Quesst missionX-59 community response tests (CRT). Since each participant will report his or her categorical level of annoyance in response to multiple events, the responses from any single individual may be correlated with one another. Several models within the class of generalized linear mixed models (GLMM) are pertinent to the analysis of correlated categorical outcomes; the random intercept logistic regression model is one example. Both Bayesian and frequentist methods for fitting these models are available, with frequentist methods relying on some form of approximation (of either an integral or the integrand) that appears in the marginal likelihood function. Given several anticipated similarities of the X-59 CRT data to data collected during a past risk reduction, Quiet Supersonic Flights 2018 (QSF18), this short note is intended to create awareness. It documents an instance in which a reported population average dose-response relationship derived from QSF18 single event data was distorted by the integral approximation applied in likelihood-based methods. We review some of the available literature on the topic, compare the outputs of several different computational approaches implemented in available statistical software, and present simple corrective actions that may be useful during the Quesst mission.

dose-response model↗

Quantifying market volume sensitivity to material property modifications in polyhydroxybutyrate: A parametric analysis approach

Polyhydroxybutyrate (PHB), a biodegradable biopolymer, represents a promising alternative to petroleum-based thermoplastics. However, despite consistent market growth, PHB faces persistent commercialization challenges that limit widespread adoption. Existing research has focused predominantly on optimizing PHB production processes, leaving a critical gap in understanding which material property modifications would most effectively enhance market competitiveness. This study addresses this gap by systematically analyzing the relationship between polymer material properties and market performance using U.S. market data from 2008 to 2021 for 21 thermoplastic polymers across 19 material properties. We employed principal component regression to identify property modifications that could maximize market volume while reducing CO 2 emissions. Our parametric analysis revealed that two specific material properties – Hardness Shore A and Sheet Extrusion Temperature – significantly influence PHB marketability across different price points. Market simulations demonstrated that a 10% increase in Hardness Shore A could increase PHB market volume by 431.5 million kg while reducing emissions by 188.7 kg CO 2 . A similar 10% increase to Sheet Extrusion Temperature could yield a 297.5 million kg volume increase and a 99.2 kg CO 2 reduction in emissions. Critically, this approach is agnostic to the specific methods required to achieve these property changes, instead providing material scientists with quantitative, data-driven targets for R&D prioritization. Here, this framework offers a novel methodology for evaluating biopolymer competitiveness and supporting strategic decisions to accelerate PHB market adoption and contribute to decarbonization of the plastics industry.

09 BIOMASS FUELS↗

Incorporating residential AC load control into ancillary service markets: Measurement and settlement

Many pre-existing air conditioner load control programs can provide valuable operational flexibility but have not been incorporated into electricity ancillary service markets or grid operations. Multiple demonstrations have shown that residential air conditioner (AC) response can deliver resources quickly and can provide contingency reserves. A key policy hurdle to be overcome before AC load control can be fully incorporated into markets is how to balance the accuracy, cost, and complexity of methods available for the settlement of load curtailment. Overcoming this hurdle requires a means for assessing the accuracy of shorter-term AC load control demand reduction estimation approaches in an unbiased manner. This paper applies such a method to compare the accuracy of approaches varying in cost and complexity ? including regression analysis, load matching and control group approaches ? using feeder data, household data and AC end-use data. We recommend a practical approach for settlement, relying on an annually updated set of tables, with pre-calculated reduction estimates. These tables allow users to look up the demand reduction per device based on daily maximum temperature, geographic region and hour of day, simplifying settlement and providing a solution to the policy problem presented in this paper.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Effect of Carbon Deposition on the Oxidation Rate of Copper/Bentonite in the Chemical Looping Process

The presented work is part of the Industrial Carbon Management Initiative (ICMI) on the development of metal oxide oxygen carriers for use in the chemical looping combustion process. An oxygen carrier, CuO/bentonite (60:40%), was reacted with methane gas and then oxidized in air. The change in weight and reaction gas concentrations were measured using a thermogravimetric analyzer (TGA) equipped with a real-time gas analyzer. The reduction–oxidation cycle was conducted within the temperature range of 750–900 °C for 10 cycles, using 20, 50, and100% CH{sub 4} concentrations in N{sub 2} for the reduction segment and dry air for the oxidation segment. Several analysis methods were evaluated to fit the oxidation of reduced CuO (i.e., Cu) data over the complete conversion range with suitable rate expressions derived from existing models for oxidation, including the shrinking core model (diffusion and reaction control), first- and second-order reaction rates, parallel and series reaction mechanisms, and Johnson–Mehl–Avrami (JMA) rate. The best agreement between the experimental data and the models of the Cu oxidation was accomplished using the JMA model. The reactivity of the oxygen carrier during the oxidation reactions was affected by the CH{sub 4} concentration as well as the temperature. The rate of fractional uptake of oxygen onto the carrier decreased as the temperature increased, contrary to expectations and indicative that the mechanism is changing during the test. Analysis of the exit gas provided evidence of carbon deposition on the reduced sorbent particle and resulted in the CO{sub 2} product upon oxidation. The oxidation of this carbon releases significant heat that is capable of changing the particle morphology (Zhu, Y.; Mimura, K.; Isshiki, M. Oxid. Met. 2004, 62, 207-222). On the basis of experimental results, the overall reaction process in the fuel reactor may be considered to consist of the decomposition of CH{sub 4} into C and H{sub 2} and reduction of CuO/bentonite by the resulting H{sub 2} and the parallel reaction of CH{sub 4} with CuO/bentonite. The extent of carbon deposition in the carrier particle increased with an increasing temperature and CH{sub 4} concentration. This deposited carbon not only leads to CO{sub 2} release from the oxidation reactor but, more importantly, causes degredation of the carrier capacity and its reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Functional Data Analysis Applied to Modeling of Severe Acute Mucositis and Dysphagia Resulting From Head and Neck Radiation Therapy

Purpose: Current normal tissue complication probability modeling using logistic regression suffers from bias and high uncertainty in the presence of highly correlated radiation therapy (RT) dose data. This hinders robust estimates of dose-response associations and, hence, optimal normal tissue–sparing strategies from being elucidated. Using functional data analysis (FDA) to reduce the dimensionality of the dose data could overcome this limitation. Methods and Materials: FDA was applied to modeling of severe acute mucositis and dysphagia resulting from head and neck RT. Functional partial least squares regression (FPLS) and functional principal component analysis were used for dimensionality reduction of the dose-volume histogram data. The reduced dose data were input into functional logistic regression models (functional partial least squares–logistic regression [FPLS-LR] and functional principal component–logistic regression [FPC-LR]) along with clinical data. This approach was compared with penalized logistic regression (PLR) in terms of predictive performance and the significance of treatment covariate–response associations, assessed using bootstrapping. Results: The area under the receiver operating characteristic curve for the PLR, FPC-LR, and FPLS-LR models was 0.65, 0.69, and 0.67, respectively, for mucositis (internal validation) and 0.81, 0.83, and 0.83, respectively, for dysphagia (external validation). The calibration slopes/intercepts for the PLR, FPC-LR, and FPLS-LR models were 1.6/−0.67, 0.45/0.47, and 0.40/0.49, respectively, for mucositis (internal validation) and 2.5/−0.96, 0.79/−0.04, and 0.79/0.00, respectively, for dysphagia (external validation). The bootstrapped odds ratios indicated significant associations between RT dose and severe toxicity in the mucositis and dysphagia FDA models. Cisplatin was significantly associated with severe dysphagia in the FDA models. None of the covariates was significantly associated with severe toxicity in the PLR models. Dose levels greater than approximately 1.0 Gy/fraction were most strongly associated with severe acute mucositis and dysphagia in the FDA models. Conclusions: FPLS and functional principal component analysis marginally improved predictive performance compared with PLR and provided robust dose-response associations. FDA is recommended for use in normal tissue complication probability modeling.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Combining Deep Learning and scatterControl for High-Throughput X-ray CT Based Non-Destructive Characterization of Large-Scale Casted Metallic Components

X-ray computed tomography (XCT) is essential for nondestructive evaluation and quality control of large-scale metal components. XCT imaging, however, faces significant challenges from metal artifacts, particularly those caused by Compton scattering, which degrade image quality and obscure critical details. Hardware-based solutions (e.g. scatterControl) offer advancements by intercepting scattered photons and reducing artifacts, but they can be time-consuming and require additional processing. Here, we propose modifying and leveraging a novel deep learning (DL) framework, Simurgh, to enhance and accelerate scatter correction in XCT. By combining scatterControl with DL-based artifact removal, we demonstrate significant reduction in scan time while producing high-quality reconstructions. Through extensive evaluation on industrial XCT data, we show that our methods reduce scan time by up to more than 10 x while preserving flaw detectability. Quantitative analysis across multiple segmentation techniques confirms that Simurgh-based reconstructions consistently outperform traditional Feldkamp-Davis-Kress, model-based iterative reconstruction, and commercial DL models in both pixel-level and task-specific evaluations, enabling scalable, high-throughput XCT workflows for characterization of large scale components in applications such as casting and metal additive manufacturing.

Complex metal parts↗

Clinical evaluation of a commercial orthopedic metal artifact reduction tool for CT simulations in radiation therapy

Purpose: Severe artifacts in kilovoltage-CT simulation images caused by large metallic implants can significantly degrade the conspicuity and apparent CT Hounsfield number of targets and anatomic structures, jeopardize the confidence of anatomical segmentation, and introduce inaccuracies into the radiation therapy treatment planning process. This study evaluated the performance of the first commercial orthopedic metal artifact reduction function (O-MAR) for radiation therapy, and investigated its clinical applications in treatment planning. Methods: Both phantom and clinical data were used for the evaluation. The CIRS electron density phantom with known physical (and electron) density plugs and removable titanium implants was scanned on a Philips Brilliance Big Bore 16-slice CT simulator. The CT Hounsfield numbers of density plugs on both uncorrected and O-MAR corrected images were compared. Treatment planning accuracy was evaluated by comparing simulated dose distributions computed using the true density images, uncorrected images, and O-MAR corrected images. Ten CT image sets of patients with large hip implants were processed with the O-MAR function and evaluated by two radiation oncologists using a five-point score for overall image quality, anatomical conspicuity, and CT Hounsfield number accuracy. By utilizing the same structure contours delineated from the O-MAR corrected images, clinical IMRT treatment plans for five patients were computed on the uncorrected and O-MAR corrected images, respectively, and compared. Results: Results of the phantom study indicated that CT Hounsfield number accuracy and noise were improved on the O-MAR corrected images, especially for images with bilateral metal implants. The {gamma} pass rates of the simulated dose distributions computed on the uncorrected and O-MAR corrected images referenced to those of the true densities were higher than 99.9% (even when using 1% and 3 mm distance-to-agreement criterion), suggesting that dose distributions were clinically identical. In all patient cases, radiation oncologists rated O-MAR corrected images as higher quality. Formerly obscured critical structures were able to be visualized. The overall image quality and the conspicuity in critical organs were significantly improved compared with the uncorrected images: overall quality score (1.35 vs 3.25, P= 0.0022); bladder (2.15 vs 3.7, P= 0.0023); prostate and seminal vesicles/vagina (1.3 vs 3.275, P= 0.0020); rectum (2.8 vs 3.9, P= 0.0021). The noise levels of the selected ROIs were reduced from 93.7 to 38.2 HU. On most cases (8/10), the average CT Hounsfield numbers of the prostate/vagina on the O-MAR corrected images were closer to the referenced value (41.2 HU, an average measured from patients without metal implants) than those on the uncorrected images. High {gamma} pass rates of the five IMRT dose distribution pairs indicated that the dose distributions were not significantly affected by the CT image improvements. Conclusions: Overall, this study indicated that the O-MAR function can remarkably reduce metal artifacts and improve both CT Hounsfield number accuracy and target and critical structure visualization. Although there was no significant impact of the O-MAR algorithm on the calculated dose distributions, we suggest that O-MAR corrected images are more suitable for the entire treatment planning process by offering better anatomical structure visualization, improving radiation oncologists' confidence in target delineation, and by avoiding subjective density overrides of artifact regions on uncorrected images.

61 RADIATION PROTECTION AND DOSIMETRY↗

Modeling, Analysis, and Control of Demand Response Resources

While the traditional goal of an electric power system has been to control supply to fulfill demand, the demand-side can plan an active role in power systems via Demand Response (DR), defined by the Department of Energy (DOE) as “a tariff or program established to motivate changes in electric use by end-use customers in response to changes in the price of electricity over time, or to give incentive payments designed to induce lower electricity use at times of high market prices or when grid reliability is jeopardized” [29]. DR can provide a variety of benefits including reducing peak electric loads when the power system is stressed and fast timescale energy balancing. Therefore, DR can improve grid reliability and reduce wholesale energy prices and their volatility. This dissertation focuses on analyzing both recent and emerging DR paradigms. Recent DR programs have focused on peak load reduction in commercial buildings and industrial facilities (C&I facilities). We present methods for using 15-minute-interval electric load data, commonly available from C&I facilities, to help building managers understand building energy consumption and ‘ask the right questions’ to discover opportunities for DR. Additionally, we present a regression-based model of whole building electric load, i.e., a baseline model, which allows us to quantify DR performance. We use this baseline model to understand the performance of 38 C&I facilities participating in an automated dynamic pricing DR program in California. In this program, facilities are expected to exhibit the same response each DR event. We find that baseline model error makes it difficult to precisely quantify changes in electricity consumption and understand if C&I facilities exhibit event-to-event variability in their response to DR signals. Therefore, we present a method to compute baseline model error and a metric to determine how much observed DR variability results from baseline model error rather than real variability in response. We find that, in general, baseline model error is large. Though some facilities exhibit real DR variability, most observed variability results from baseline model error. In some cases, however, aggregations of C&I facilities exhibit real DR variability, which could create challenges for power system operation. These results have implications for DR program design and deployment. Emerging DR paradigms focus on faster timescale DR. Here, we investigate methods to coordinate aggregations of residential thermostatically controlled loads (TCLs), including air conditioners and refrigerators, to manage frequency and energy imbalances in power systems. We focus on opportunities to centrally control loads with high accuracy but low requirements for sensing and communications infrastructure. Specifically, we compare cases when measured load state information (e.g., power consumption and temperature) is 1) available in real time; 2) available, but not in real time; and 3) not available. We develop Markov Chain models to describe the temperature state evolution of heterogeneous populations of TCLs, and use Kalman filtering for both state and joint parameter/state estimation. We present a look-ahead proportional controller to broadcast control signals to all TCLs, which always remain in their temperature dead-band. Simulations indicate that it is possible to achieve power tracking RMS errors in the range of 0.26–9.3% of steady state aggregated power consumption. Results depend upon the information available for system identification, state estimation, and control. We find that, depending upon the performance required, TCLs may not need to provide state information to the central controller in real time or at all. We also estimate the size of the TCL potential resource; potential revenue from participation in markets; and break-even costs associated with deploying DR-enabling technologies. We find that current TCL energy storage capacity in California is 8–11 GWh, with refrigerators contributing the most. Annual revenues from participation in regulation vary from $10 to $220 per TCL per year depending upon the type of TCL and climate zone, while load following and arbitrage revenues are more modest at $2 to $35 per TCL per year. These results lead to a number of policy recommendations that will make it easier to engage residential loads in fast timescale DR.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗