Operation Planning of Reserve in Microgrid Considering Market Participation and Energy Storage System

  • Lee, Si Young (Dept. of Electrical and Computer Engineering, Seoul National University) ;
  • Jin, Young Gyu (Dept. of Electrical and Computer Engineering, Seoul National University) ;
  • Kim, Sun Kyo (KEPCO Economy and Management Research Institute) ;
  • Yoon, Yong Tae (Dept. of Electrical and Computer Engineering, Seoul National University)
  • 투고 : 2013.11.25
  • 심사 : 2014.03.07
  • 발행 : 2014.05.01


Innumerable microgrids would be operated independently by individual operators in a future smart grid. This kind of decentralized power system requires entirely different operation scheme in the actual power system and electricity market operation. Especially, frequency regulation is very important for successive energy trade in this multi-microgrid circumstance. This paper presents an optimal energy and reserve market participation strategy and operation strategy of energy storage system (ESS) by a microgrid operator (MGO). For definite evaluation of the proposed strategy, we postulate that the MGO should participate in the Power Exchange for Frequency Control (PXFC) market, which was devised by Maria Ilic and her coworkers and is suitable to the decentralized operation circumstances. In particular, optimal reserve capacity of the frequency control market and optimal market participation ratio of ESS between frequency control market and energy market are derived theoretically and evaluated by simulations utilizing Nordic Pool Elspot price data.


Ancillary service market;Decentralized operation;Electricity market deregulation;Energy storage system;Multi-microgrid operation

1. Introduction

Distributed generators (DGs) have been growing their portion in the distribution system more and more [1-2]. Although these kinds of resources, which are represented by renewable generators like wind turbines and photovoltaic systems, are more environmentally friendly and economical than traditional fossil fuel, it has been pointed out that there may be a problem in the appearance of the decentralized generation by many DGs [3]. It is microgrid concept that is intensively studied nowadays to handle this decentralized operation circumstances [4-6]. A microgrid is an electric distribution system which consists of small subsystems with many generation facilities and associate loads, and energy storage system (ESS). It could be operated intentionally in the islanded mode, disconnecting from the main grid and securing energy by running its own DGs or ESS and issuing demand response or load shedding programs.

As electricity market has been established and expanded its domain into ancillary service market like automatic generation control (AGC), market diversity in multimicrogrid circumstance would increase much more. And roles, responsibilities, and rights of a MGO would be much larger than that of load serving entity (LSE), who is a decentralized market agent in the present power system operation [7-9]. In a normal condition of being connected to the main grid, a MGO could get the energy from the main grid and sell the extra power generated by renewable resources to increase the benefit from the market. In the islanded operation mode, however, MGO must supply the demand by itself and maintain some proper level of reliability of its system. For this reason, the role of ESS in microgrid has been emphasized in many researches [10].

This paper focuses on the operation planning of reserve in microgrid considering market participation and ESS operation. The objective is to minimize the total operation cost. In particular, optimal participation ratio between ancillary service market and energy market is derived with the optimal microgrid operation scheme theoretically and evaluated by a simulation. For the definite evaluation of the proposed strategy, the Power Exchange for Frequency Control (PXFC) market, which was devised by Maria Ilic and her coworkers [11] and appropriate for the multimicrogrid circumstances, is postulated as a mandatory market in this paper. This market consists of two submarkets: a primary energy market for supplying the demand and a frequency control market for ensuring that frequency fluctuation remains within the limits as load and renewable power deviate from its anticipated value.

This paper is structured as follows. Section 2 explains the postulated market scheme, PXFC, and the decision variable of MGO in the PXFC market. Section 3 details the proposed optimal operation strategy of MGO. Its simulation and verification is presented in section 4 with the conclusion drawn in section 5.


2. Decentralized Operation Circumstances

In several recent references [12-14], it has been suggested that each system participants, like generation owners (GOs) and load serving entities (LSEs), should control their own frequency and only minimal frequency control have to be provided by independent system operator (ISO). The condition would become more serious in the decentralized operation circumstances, in which various types of agents including many MGOs exist. PXFC satisfies the above condition and is appropriate for the decentralized power system operation concept of multimicrogrid [11]. In the following subsections, more details about PXFC and decision variables given to MGO in PXFC are handled.

2.1 Power exchange for frequency control

In the PXFC, all the contracts on the daily market should specify the two quantities; the anticipated demand, , as a function of time, and an estimation of the maximum deviation from the anticipated value. Fig. 1 shows a representative contract curve in PXFC. Each participant would specify a non-zero band Pband, i and ISO or a coordinator of the PXFC estimate the maximum cumulative power mismatch by using this information. By this estimation ISO can decide how much power to purchase for frequency control from the generators participating in frequency control service.

The maximum cumulative imbalance on the system can be estimated by

where Pimb is the total cumulative imbalance on the system. A simple and safe strategy for ISO is to purchase Pmax,imb , which is sufficient even in the worst case scenario, but a smart ISO could decrease the purchase quantity by considering the participants’ characteristics. If the unit clearing price for frequency control is given by λFC and

Fig. 1.Proposed structure of a contract in PXFC market

there are m contracts, the reasonable charge to each participant for frequency control will be proportional to the size of Pband, i and given by

This charge is imposed on each participant, and the total amount of money paid to the coordinator of PXFC is

This value is equal to the amount paid by the PXFC coordinator to the AGC generator owner.

2.2 Decision variable of MGO in PXFC

The incurred cost in PXFC market consists of three parts: the energy cost in the primary market, the band cost in frequency control market, and the penalty cost related with band contract. Each MGO will make a decision to minimize its operation cost from these three parts. However, there is no clear answer in [9] and it just mentions the necessity of penalty in the case of violation that actual deviation exceeds the contracted band capacity. For evaluating the operation cost of participant, the penalty cost λp ⋅ Ep is imposed to each violator in this paper. λp may be the unit penalty price, which should be included in the contraction of PXFC market. Ep is the statistical data related with the accumulation of exceeded capacity and duration. A detailed method of calculating the penalty cost will be discussed in section 3.

Therefore MGO could determine the optimal band capacity to minimize the operation cost, which include the band purchase cost and expected penalty cost. And if MGO have ESSs in its grid, then they can participate in both the primary electricity market and the frequency control market. In each case ESS can change the value of or Pband , and affect the total operation cost. So MGO could determine the optimal participation ratio of ESS between these two markets considering with the optimal band capacity.


3. Optimal Operation Strategy by MGO

3.1 Determination of optimal band capacity

As mentioned in the subsection 2.2, a MGO should calculate the expected value of penalty cost first to determine the optimal band capacity of minimizing its operation cost. And variability model of the microgrid have to be built to formulate and analyze the penalty cost. Therefore, MGO not only forecasts the quantity of load and renewable generation to bid optimally in the primary energy market, but also analyzes the uncertainty of them to bid optimally in the frequency control market. For example, the MGO could predict the quantity and variability of wind generation using well-known Weibull distribution in Fig. 2 [15]. Variability model could be formulated as follows

where ∆PLoad(t), ∆PWT(t), ∆PPV(t) are uncertainties from load, wind and PV generators. ∆P(t) is the total uncertainty, which denotes the difference between actual value and anticipated value. Therefore the expected value of penalty cost can be calculated as follows

where Cp is the expected penalty cost, PDF is the probability density function (PDF) of ∆P , Pband is the purchased band capacity, and λP is the penalty cost per unit [$/MW]. Multiplying 2 by the integration means that violation could happen in both up and down direction. Fig. 3 shows probabilistic meaning of Eq. (5).

To analyze the optimal band capacity, total cost can be calculated by adding the penalty cost and the band cost FC as below

Fig. 2.Weibull distribution utilized in weather forecasting

Fig. 3.Variability distribution curve with frequency control band and expected penalty probability

Then, optimal band capacity can be calculated by differentiating the Ctot, i by Pband, i . If the MGO would have forecasted the quantity of demand and renewable generation well, then it is reasonable to assume that the PDF have the mean value of zero. Actually differentiating Ctot, i by Pband, i is a laborious task, since PDF follows the probability distribution with complicated form. For the sake of calculation simplicity, optimal band capacity condition using the normal Gaussian distribution function is given in Eq. (7). However, this equation will also derive a very complex solution form of Gaussian error function even in the case of simple normal Gaussian distribution function.

3.2 Optimal operation of ESS in energy market

Mathematical models for ESS operation are selected from [16] to analyze the operation cost and the sequential quadratic programming (SQP) method is applied to achieve the maximum benefit. Used model and assumptions are described in the following.

3.2.1 ESS model and assumption

If the output power of ESS is selected as a state variable, then the stored energy could be calculated from the sum of that output power. Since it is generally assumed that hourly spot price is given, time step used in the operation of ESS is one hour. The stored energy can be expressed as

where Pt is the output power of ESS at hour t, η is the efficiency of charging/discharging, and Et is the stored energy in ESS at hour t. Some assumptions related with the ESS are below.

There are maximum charging/discharging power and maximum energy capacity of ESS.

The stored energy in the ESS at 00:00 hour is the same with the stored energy at 24:00 hour.

The hourly system price is not changed by the operation of the ESS.

3.2.2 Problem formulation

Since the hourly day-ahead system price is given, MGO can decide the charging schedule in order to maximize the profit. The profit in a day can be calculated as follows

where PF is the profit of the ESS, and λDAt is the given hourly day-ahead price. Therefore, the objective function for the maximum profit scheduling of ESS can be written as

3.3 Optimal operation strategy considering both band capacity and ESS capacity

In subsection 3.2 MGO could get the profit by ESS scheduling, as considering the hourly system price. However, ESS also could have a role of Pband in subsection 3.1 and this could decrease the band cost and expected penalty cost. Therefore, MGO should determine the optimal participating ratio of ESS between energy market and frequency control market as below

where Pbid is the ESS capacity of participating in energy market and α is the ratio of it, and Pbd, ESS is the ESS capacity of participating in frequency control market. In this case, final objective function can be expressed by adding Eq. (6) by Eq. (11) as follows

Final optimal solution of Pband and α, or Pbid and Pbd, ESS , can be calculated by differentiate the Eq. (13). However, the solution will have more complex form than Eq. (7), and formulation of this equation is very hard to find any meaning on it. Therefore, iteration between the optimizing method in subsection 3.1 and 3.2 is utilized to get the optimal solution of Pband and Pbid. Flow chart of the utilized iteration method, which is based on the bisection method, is represented in Fig. 4.

Fig. 4.Flow chart of the iteration method


4. Simulation and Verification

4.1 Simulation settings

The proposed optimal strategies by MGO are simulated and verified by Matlab/Simulink. Elspot system prices of Nordic Pool on 01-04-2013 and 26-04-2013 are selected for the hourly day-ahead system price, which is necessary for the optimal scheduling of ESS. Furthermore several assumptions are added to support yet non-existent PXFC Market and simplify the problem. The coefficients or unit prices of band purchase cost, FCi , are assumed to have the average value of the Elspot system prices and there is no price difference between up band and down band. And unit price of penalty cost is assumed to be a constant, which is about 5 to 10 times of Elspot prices. Because AGC prices have positive correlation with the system marginal price and penalty price would happen only when there is some faults in the system, these two assumptions

are reasonable to some extent. In addition to this, PDF , the probability density function (PDF) of ∆P , is assumed to follows the Gaussian distribution with the mean value of zero and the standard deviation of it is to be 10 MW. Elspot system price data is in Fig. 5 and used setting values including load deviation model and ESS characteristics are in Table 1.

Fig. 5.Hourly system prices of Elspot on 02-04-2013 and 26-04-2013

Table 1.Simulation setting data

4.2 Optimal band capacity without ESS

The simulation results of optimal band capacity without ESS are shown in Table 2. The optimal band capacity is calculated from Eq. (7). Since case 1 has larger average price, the unit price of band on 02-04-2013 is higher than that on 26-04-2013. As a result, MGO can purchase larger band at cheaper price and have less expected penalty cost on 26-04-2013. To check the optimality of the results in case 2, two more cases are simulated. Results of case 3 have lower band cost, but have higher expected penalty cost. This is because band capacity is not enough and means that MGO would have more probability to pay large penalty cost than case 2. On the contrary to this, results of case 4 have higher band cost and lower expected penalty cost. This means that MGO will overpay the band cost.

Table 2.Optimal band capacity without ESS

4.3 Optimal band capacity with considering the operation strategy of ESS

Applying the iteration method in subsection 3.3, final optimal solution of Pband and Pbid can be calculated. Table 3 shows the optimal solutions of case 1 and 2. All of the ESS capacity in case 1 participate in the primary energy market and the MGO has negative total cost, or produces a profit by ESS. This is because the peak price on that day is very severe. For this case, frequency control is conducted by only Pband . Fig. 6 shows the hourly system price and state of charge of ESS in case 1.

In case 2, only 15% of ESS capacity participate in the primary energy market and the remaining 85% play a role like frequency control band. As a result band cost in frequency control market is smaller than that of case 1. It is the difference of system price pattern that makes totally different bidding strategy. In other words, as system price of case 2 has flatter shape and larger average value or unit price of band, arbitrage trading of ESS in case 2 shows lower profit margin. And the reduction in expenditure is much more effective than the increase in income in minimizing the total operation cost.

Results above show that the optimal operation of MGO should be changed to maximize its benefit if the system or market condition varies. Therefore proposed operation strategy could be applied to numerous MGOs in decentralized and deregulated market condition and give some flexibility to them.

Table 3.Optimal band capacity and operation strategy of ESS minimizing total operation cost

Fig. 6.Hourly system price and SOC of ESS on 02-04-2013


5. Conclusion

Deregulation and decentralization in the power system inevitably require new operation scheme, and microgrid concept would be a proper solution. Innumerable microgrid operators would share their roles, rights and respobsibilities with ISO in many parts of system operation. And ESS, which can play many important roles in the grid, would demonstrate its ability increasingly in this circumstance.

This paper focuses on the method for minimizing the operation cost of MGO in decentralized operation scheme of PXFC market. For this purpose, optimal band capacity is acquired by calculating the expected penalty cost and band purchase cost, and optimal market participation of ESS is attained by using the SQP method. By the proposed method, MGO could develop an optimal operation strategy considering daily system condition such as system marginal price and load deviation and renewable uncertainty characteristics. And this is demonstrated by using the Elspot system price data of Nordic Pool in section 4. Different operation strategies are compared on two days in which system price shows totally different pattern.

Further researches are necessary to handle more realistic market circumstances, in which unit band price and penalty price have time varying characteristics.


  1. Smith, J.C, et al., "Utility Wind Integration and Operation Impact State of the Art," IEEE Transactions on Power Systems, vol. 22, issue 3, pp.900-908, 2007.
  2. W. T. Jewell, R. Ramakumar, and S.R. Hill, "A study of dispersed photovoltaic generation on the PSO system," IEEE Transactions on Energy Conversion, vol. 3, no. 3, pp. 437-478, September 1998.
  3. E. J. Coster, J. M. A. Myrzik, B. Kruimer, and W. L. Kling, "Integration Issues of Distributed Generation in Distribution Grids," in Proceeding of the IEEE, vol. 99, no. 1, pp. 28-39.
  4. A. Dimeas and N. D. Hatziagyriou, "A Multiagent system for Micro-grids," in Proceeding of the IEEE Power Engineering Society General Meeting, Denver, US, June, 2004.
  5. R. H. Lasseter, and P. Piagi, "MicroGrid: a conceptual solution," PESC 2004.
  6. R. H. Lasseter, "Micro Grids," IEEE Power Engineering Society,2002.
  7. Farid Katiraei, et al., Microgrids MAnagement: IEEE power and energy magzine, 2008, p.54-65.
  8. Yanyi He, Sharma, R., and Xianjun Zhang, "Microgrid operator's capacity and storage investment strategies under environmental regulations," in IEEE Power Engineering Society innovative Smart Grid Technologies, Columbia, US, January 2012.
  9. Jin. Y.G., Lee, S.Y., Kim, S.W., Yoon, Y.T., "Designing Rule for Price-Based Operation With Reliability Enhancement by Reducing the Frequency Deviation," IEEE Transactions on Power System, vol. 28, Issue. 4, pp. 4365-4372.
  10. Barton, J.P, and Infield, D.G., "Energy storage and its use with intermittent renewable energy," IEEE Transactions on Energy Conversion, vol. 19, Issue. 2, pp. 441-448, 2004.
  11. M. Ilic, P. Skantze, C.N. Yu, L. Fink, and J. Cardell, "Power Exchange for Frequency Control (PXFC)," in Power Engineering Society 1999 Winter Meeting, IEEE, New York City, US, January 1999.
  12. J.V. Seguro, and T.W. Lambert, "Modern estimation of the parameters of the Weibull wind speed distribution for wind energy analysis," Journal of Wind Engineering and Industrial Aerodynamics, vol. 85, Issue 1, pp. 75-84.
  13. Fink, L., "New control paradigms for deregulation," in Electric Power Systems Restructuring: Engineering and Economics, Kluwer Academic Publishers, 1998, pp. 405-450.
  14. Ilic, M., Yu, C-N., "Minimal system regulation and its value in a changing industry," in Proceeding of the IEEE Conference on Control Applications, Dearborn, MI, September 1996.
  15. Lee. S.Y., Kim, S.K., Jin, Y.G., and Yoon, Y.T., "Optimal Operation Strategy of Energy Storage System by Microgrid Operator Considering Market Participation," in International Smart Grid Conference & Exhibition, Jeju, Korea, July 2013, pp. 12-17.
  16. Weihao Hu, Zhe Chen, and Bak-Jensen, B., "Optimal operation strategy of battery energy storage system to real-time electricity price in Denmark," in IEEE Power and Energy

피인용 문헌

  1. Determining the Optimal Reserve Capacity in a Microgrid With Islanded Operation vol.31, pp.2, 2016,
  2. Determining Operating Reserve Requirement in a Competitive Market Using Dynamic Approach vol.4, pp.1, 2016,