Research Papers

How Baseline Model Implementation Choices Affect Demand Response Assessments

[+] Author and Article Information
Nathan J. Addy

2557 Glen Ave.,
Berkeley, CA 94709
e-mail: nathan.addy@gmail.com

Sila Kiliccote

Environmental Energy Technologies Division,
Lawrence Berkeley National Laboratory,
1 Cyclotron Rd., MS 90R1121,
Berkeley, CA 94720
e-mail: skiliccote@lbl.gov

Duncan S. Callaway

Assistant Professor
Energy and Resources Group,
University of California, Berkeley,
310 Barrows Hall,
Berkeley, CA 94720-3050
e-mail: dcal@berkeley.edu

Johanna L. Mathieu

Assistant Professor
Department of Electrical Engineering
and Computer Science,
1301 Beal Ave.,
University of Michigan,
Ann Arbor, MI 48109
e-mail: jlmath@umich.edu

1N. J. Addy was formally with the Environmental Energy Technologies Division at Lawrence Berkeley National Laboratory, which is where the majority of this work was conducted.

2Corresponding author.

Contributed by the Solar Energy Division of ASME for publication in the JOURNAL OF SOLAR ENERGY ENGINEERING: INCLUDING WIND ENERGY AND BUILDING ENERGY CONSERVATION. Manuscript received June 6, 2014; final manuscript received August 22, 2014; published online September 30, 2014. Assoc. Editor: Gregor P. Henze. The United States Government retains, and by accepting the article for publication, the publisher acknowledges that the United States Government retains, a non-exclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this work, or allow others to do so, for United States government purposes.

J. Sol. Energy Eng 137(2), 021008 (Sep 30, 2014) (6 pages) Paper No: SOL-14-1171; doi: 10.1115/1.4028478 History: Received June 06, 2014; Revised August 22, 2014

The performance of buildings participating in demand response (DR) programs is usually evaluated with baseline models, which predict what electric demand would have been if a DR event had not been called. Different baseline models produce different results. Moreover, modelers implementing the same baseline model often make different model implementation choices producing different results. Using real data from a DR program in CA and a regression-based baseline model, which relates building demand to time of week, outdoor air temperature, and building operational mode, we analyze the effect of model implementation choices on DR shed estimates. Results indicate strong sensitivities to the outdoor air temperature data source and bad data filtration methods, with standard deviations of differences in shed estimates of ≈20–30 kW, and weaker sensitivities to demand/temperature data resolution, data alignment, and methods for determining when buildings are occupied, with standard deviations of differences in shed estimates of ≈2–5 kW.

Copyright © 2015 by ASME
Your Session has timed out. Please sign back in to continue.


Callaway, D., and Hiskens, I., 2011, “Achieving Controllability of Electric Loads,” Proc. IEEE, 99(1), pp. 184–199. [CrossRef]
DOE, 2006, “Benefits of Demand Response in Electricity Markets and Recommendations for Achieving Them,” Department of Energy Report to the U.S. Congress.
Borenstein, S., Jaske, M., and Rosenfeld, A., 2002, “Dynamic Pricing, Advanced Metering and Demand Response in Electricity Markets,” Technical Report No. CSEMWP-105, University of California Energy Institute: Center for the Study of Energy Markets.
Fels, M., 1986, “PRISM: An Introduction,” Energy Build., 9(1–2), pp. 5–18. [CrossRef]
Katipamula, S., Reddy, T., and Claridge, D., 1998, “Multivariate Regression Modeling,” ASME J. Sol. Energy Eng., 120(3), pp. 177–184. [CrossRef]
Kissock, J., Reddy, T., and Claridge, D., 1998, “Ambient-Temperature Regression Analysis for Estimating Retrofit Savings in Commercial Buildings,” ASME J. Sol. Energy Eng., 120(3), pp. 168–176. [CrossRef]
Kissock, J., and Eger, C., 2008, “Measuring Industrial Energy Savings,” Appl. Energy, 85(5), pp. 347–361. [CrossRef]
Ruch, D., Kissock, J., and Reddy, T., 1999, “Prediction Uncertainty of Linear Building Energy Use Models With Autocorrelated Residuals,” ASME J. Sol. Energy Eng., 121(1), pp. 63–68. [CrossRef]
Yang, J., Rivard, H., and Zmeureanu, R., 2005, “On-Line Building Energy Prediction Using Adaptive Artificial Neural Networks,” Energy Build., 37(12), pp. 1250–1259. [CrossRef]
Coughlin, K., Piette, M., Goldman, C., and Kiliccote, S., 2009, “Statistical Analysis of Baseline Load Models for Non-Residential Buildings,” Energy Build., 41(4), pp. 374–381. [CrossRef]
Goldberg, M., and Agnew, G., 2003, “Protocol Development for Demand Response Calculation–Findings and Recommendations,” Technical Report No. CEC 400-02-017F, California Energy Commission (KEMA-XENERGY).
Kozikowski, D., Breidenbaugh, A., and Potter, M., 2006, “The Demand Response Baseline, v.1.75,” EnerNOC OPS Publication.
Wi, Y.-M., Kim, J.-H., Joo, S.-K., Park, J.-B., and Oh, J.-C., 2009, “Customer Baseline Load (CBL) Calculation Using Exponential Smoothing Model With Weather Adjustment,” Transmission Distribution Conference Exposition: Asia and Pacific, Seoul, Korea, Oct. 26–30, pp. 1–4. [CrossRef]
Mathieu, J., Price, P., Kiliccote, S., and Piette, M., 2011, “Quantifying Changes in Building Electricity Use, With Application to Demand Response,” IEEE Trans. Smart Grid, 2(3), pp. 507–518. [CrossRef]
Addy, N., Mathieu, J., Kiliccote, S., and Callaway, D., 2013, “Understanding the Effect of Baseline Modeling Implementation Choices on Analysis of Demand Response Performance,” ASME Paper No. IMECE2012-86973. [CrossRef]
Mathieu, J. L., Callaway, D. S., and Kiliccote, S., 2011, “Variability in Automated Responses of Commercial Buildings and Industrial Facilities to Dynamic Electricity Prices,” Energy Build., 43(12), pp. 3322–3330. [CrossRef]
National Oceanic and Atmospheric Administration, 2009, “National Climatic Data Center,” Available at: http://www7.ncdc.noaa.gov/CDO/dataproduct
The Weather Channel LLC, 2012, “Weather Underground,” Available at: http://weatherunderground.com
Price, P., 2010, “Methods for Quantifying Electric Load Shape and Its Variability,” Technical Report No. LBNL-3713E, Lawrence Berkeley National Laboratory.
Pacific Gas and Electric Company, 2010, “General Schedule A-10,” Available at: http://www.pge.com/tariffs/tm2/pdf/ELEC_SCHEDS_A-10.pdf


Grahic Jump Location
Fig. 4

Effect of data alignment. Base: 15-min offset, variant: no offset. Std dev.: 4.59 kW.

Grahic Jump Location
Fig. 5

Effect of power outage filter. Base: original filter, variants: no filter and sensitive filter. Std dev.: 30.08 and 18.55 kW

Grahic Jump Location
Fig. 6

Box plot of the mismatch in each variant case

Grahic Jump Location
Fig. 3

Effect of method to detect occupied/unoccupied mode transitions. Base: manual selection, variant: automated algorithm. Std dev.: 2.39 kW.

Grahic Jump Location
Fig. 2

Effect of data resolution. Base: 15-min interval data, variants: 30 - and 60-min data. Std dev.: 2.22 and 4.59 kW.

Grahic Jump Location
Fig. 1

Effect of outdoor air temperature data source. Base: NCDC data, variant: weather underground data. Std. dev.: 23.36 kW.




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In