DOI QR코드

DOI QR Code

Self-organized Spectrum Access in Small-cell Networks with Dynamic Loads

  • Wu, Ducheng (PLA University of Science and Technology) ;
  • Wu, Qihui (PLA University of Science and Technology) ;
  • Xu, Yuhua (PLA University of Science and Technology)
  • Received : 2015.08.18
  • Accepted : 2016.01.10
  • Published : 2016.05.31

Abstract

This paper investigates the problem of co-tier interference mitigation for dynamic small- cell networks, in which the load of each small-cell varies with the number of active associated small-cell users (SUs). Due to the fact that most small-cell base stations (SBSs) are deployed in an ad-hoc manner, the problem of reducing co-tier interference caused by dynamic loads in a distributed fashion is quite challenging. First, we propose a new distributed channel allocation method for small-cells with dynamic loads and define a dynamic interference graph. Based on this approach, we formulate the problem as a dynamic interference graph game and prove that the game is a potential game and has at least one pure strategy Nash equilibrium (NE) point. Moreover, we show that the best pure strategy NE point minimizes the expectation of the aggregate dynamic co-tier interference in the small-cell network. A distributed dynamic learning algorithm is then designed to achieve NE of the game, in which each SBS is unaware of the probability distributions of its own and other SBSs' dynamic loads. Simulation results show that the proposed approach can mitigate dynamic co-tier interference effectively and significantly outperform random channel selection.

Keywords

1. Introduction

Small-cell base stations (SBSs) are low-power short-range base stations that provide wireless services to users. Small-cell technologies can greatly improve radio resource reuse efficiency and are seen as one of the most promising solutions for the rapid growth of wireless data services and which could prove useful in satisfying the requirement of ubiquitous access [1-4]. When the number of SBSs in a given area is increased, a need arises for the mitigation of co-tier interference to exploit the benefits promised this technology [5,6]. However, as most SBSs are deployed with minimum intervention from end users and service providers, centralized resource allocation is difficult to achieve. In this paper, we focus on self-organizing spectrum allocation for small-cell networks under the constraint of mitigating co-tier interference.

There are some existing distributed spectrum allocation solutions, using e.g., reinforcement-learning based approaches [7], hierarchical dynamical games [8] and evolutionary games [9]. However, most existing works assume that there is only one terminal user associated with each small-cell and the user remains in contact with its associated SBS all the time. In practice, in small-cell networks, more than one user can associate with each SBS and may connect or disconnect with their corresponding SBSs according to their specific service demand at non-deterministic moments in time [10]. Thus, the loads (number of active SUs) of small-cells may change dynamically and vary widely within certain (short) time periods . This paper focuses on the intractable problem of spectrum allocation for different and dynamic loads of small-cells.

In this paper, we resort to a game theory-based self-organizing approach to allocate channels among the SBSs. This approach is based on the following assumptions: first, there is no centralized controller and, second, the small-cells make decisions selfishly and autonomously. Due to the dynamics of the loads, the existing fixed- channel allocation method, in which each SU is allocated a fixed channel for each small-cell, is not applicable when the number of users is larger than the number of dedicated channels. What's more, considering the dynamics of SU loads , channels with low interference will not be used efficiently when the SUs who occupy these channels are inactive. Thus, we propose a new distributed channel allocation method with different channel priorities, which can be apllied in overload situations without regard to serving queues and buffers. In the proposed channel allocation method, channels are not allocated to specific SUs, and channels with lower interference are given a higher priority for use by active SUs. With this approach, the self-organized spectrum access with dynamic loads can be modeled as a sequential channel set selection problem. Therewith, we employ a dynamic interference graph to analyze the dynamic interference that occurs among the small-cells when the proposed channel allocation methods are applied . Subsequently, a dynamic interference graph game is formulated to mitigate the dynamic co-tier interference. In the proposed game, each player (SBS) tries to minimize the expectation of the received interference in selected channels.

Our main contributions can be summarized as follows:

The rest of this article is organized as follows. In Section 2, we review the related work. In Section 3, we present the system model and problem formulation. In Section 4, we propose a dynamic interference graph game and analyze the existence of Nash equilibria. In Section 5, we propose a distributed dynamic learning algorithm and present simulation results. Finally, Section 6 presents our conclusions and summarizes our findings

 

2. Related Work

The problem of resource allocation and co-tier interference mitigation in small-cell networks has been investigated widely [11-14]. In many existing works [15-17], a central management system or controller is necessary for handling resource allocation and interference mitigation, which leads to significant signaling overhead between the controller and the small-cells. In [15], the authors utilized a femtocell management system to avoid co-channel and co-tier interference. In [16], the authors proposed a semi-centralized interference management scheme, which was based on joint clustering and resource allocation for small-cells. However, it is difficult to implement centralized controlling or planning to allocate resources because most small-cells are deployed in an ad-hoc manner with minimum intervention from the end users and the service providers.

Some researchers applied different game models to solve this problem in a distributed manner, e.g., coalition games [18,19], evolutionary games [20], Bargaining games [21] and graphical games [22-25]. In [18], a coalition game model was used to enable small-cells to cooperate with each other for sharing resources and managing interference. In [22], the authors applied a graph-based model to characterize the MAC-layer interference relationship among the cells. In [23], the authors proposed two special cases of local cooperative game to study the problem of opportunistic spectrum access, in which the users need to exchange information with their neighboring users. In [24], the authors investigated the problem of channel selection for MAC-layer interference mitigation with a proposed dynamic graphic game in the dynamic and distributed environment. However, in [22-25] , they assumed that one cell can only select one channel to transmit. Moreover, the proposed MAC-layer interference is not suitable for the small-cell networks without the multiple access control mechanisms, such as CSMA and Aloha.

All the aforementioned works have paid less attention on the dynamic loads of small-cells. It should be pointed out that [10,26,27] have conducted some preliminary researches on load-aware spectrum access for small-cell networks. However, even in [10,26], it is assumed that the loads of small-cells are static and unchanged. In [27], the authors resorted to a convex optimization approach to maximise the energy efficiency of dynamic wireless networks. In practice, in small-cell networks, the loads and channels requested of the cells change dynamically and may vary widely during a particular (short) time period. In this paper, we propose a fully distributed and self-organizing spectrum access approach with dynamic loads in small-cell networks.

 

3. System Model and Problem Formulation

3.1 System model

Let us consider a small-cell network (SCN), where small-cell base stations (SBSs) are independently deployed in random locations. Small-cells transmit on orthogonal channels compared to macro-cells, thus cross-tier interference is avoided in such networks. In this paper, we will only consider co-tier interference. It is assumed that there are N small-cells, i.e. N = {1,2,...,N}, and there are M dedicated channels available for each small-cell to transmit, i.e. M = {1,...,M}. Each cell n offers traffic services to Kn small-cell users (SUs). It is assumed that the transmission link between SBS n and a SU only occupies one channel at each (short) time period. In this paper, we only consider downlink transmission.

It is assumed that each SU may be in one of two states, namely "Active" (A) and "Sleep" (S). In the "Active" state, a SU receives data from its associated small-cell, while, in the "Sleep" state, the SU has no communication demand and does not occupy any channels to communicate with the associated small-cell . The "Active-Sleep" model can be represented by a simple two-state Markov chain. Taking an arbitrary chosen SU as an example, its two-state Markov chain is shown in Fig. 1. The state transition probabilities (pAA, pAS, pSA, pSS) of each SU are different and fixed. Thus, it can be concluded that the probabilities of each SU in each small-cell being active (α) or sleep (β) are fixed and different, with α + β = 1.

Fig. 1.Two-state Markov chain of an arbitrary chosen SU.

Because the probability of a SU being active is fixed, we can conclude that the probability of the event, in which a small-cell n serves h active SUs and requires h channels to meet the instantaneous load, is fixed. The corresponing probability θnh can be expressed as

where is the active SU set in small-cell n and is the sleeping SU set, and suni is the ith small-cell user associated with small-cell n. It is clear that

Considering that the load in each small-cell n changes dynamically according to{θnh}, we propose a distributed channel allocation method for small-cells with dynamic loads. In this method, each small-cell n selects a sequential channel set to transmit, which can be expressed as

where Zn = min{Kn,M}, and cnk ∈M, 0 < k ≤ Zn. Small-cell n will prioritize these Zn selected dedicated channels. At any moment, each active SU can occupy an idle channel in the ordered channel set Cn instead of occupying a particular channel in each time period.

More specifically, for channels k and k′ belonging to the Zn selected channels available for the small-cell n, if k < k′, we say that for the cell n, cnk has a higher priority to be used for transmission than cnk′. In other words, with i active SUs in small-cell n at a particular time period, the first i channels in Cn, i.e. the i channels with the highest priority, will be picked out for transmission. Thus, to achieve good performance, channels with lower interference should be given a higher priority. The distribute channel allocation needs temporary access control provided by SBSs when the loads change.

Then, we can conclude that the probability of channel cnk being used to transmit by small-cell n is given by:

It is clear that 1 ≥ ϑn1 ≥ ... ≥ ϑnKn. The ordering of the transmission probability of each channel is consistent with the corresponding priorities. In particular, when Cnk = m(m ∈ M), we set For a small-cell n, the probability set of each channel cnk (cnk ∈ Cn) being occupied for transmission is represented as

With the sequential channel set of each small-cell selected, we can examine how the interference among the small-cells varies with the dynamic loads. The statistical dynamic interference relationship can be depicted using a dynamic interference graph. Such a graph of a small-cell network with three small-cells is shown in Fig. 2. It is noted from Fig. 2 that, small-cells 1 and 3 will only interfere with each other when they both transmit information in channel 3 simultaneously. For example, the probability that small-cell 1 and 3 interfere with each other in channel 3 is

Fig. 2.An dynamic interference graph of the considered small-cell network with three small-cells.

To take a simple specific example, we assume that the distance between any two small-cells and the SBSs’ transmission power in Fig. 2 are the same. Thus, when any two small-cells transmit in the same channel simultaneously, the received interference in both these small-cells is the same and can be denoted as I . Let us assume that the active probabilities of SUs in these 3 small-cells are {α11 = 0.6, α12 = 0.4}, {α21 = 0.6, α22 = 0.5, α23 = 0.4} and {α31 = 0.8, α32 = 0.5} . Then, based on (3), we have Θ1 = {0.76, 0.24}, Θ2 = {0.88, 0.38, 0.12} and Θ3 = {0.9, 0.4}. With the channel sets for cells 1 and 3 being {c11 = 1, c12 = 3} and {c31 = 3, c32 = 2} respectively, the interference probability in channel 3 between small-cell 1 and small-cell 3 is 0.24 × 0.9 = 0.216. The average interference affecting SBS 2 in channels 1, 2 and 3 are then calculated as {0.76I, 0.4I, 1.14I}.

Thus, the sequential channel set of small-cell 2 should be {c21 = 2, c22 = 1, c23 = 3}. For small-cell 2, a diagram illustrating the dynamic load and the channel selection based on that load is shown in Fig. 3. The loads of small-cell 2 in six time periods are assumed to be {1, 2, 2, 3, 2, 1}. As seen in the diagram, the utilization of channel 2 is the highest, while the utilization of channel 3 is the lowest. That is because the interference in channel 2 is the lowest, while the interference in channel 3 is the highest. Considering the dynamics of loads in small-cells, instead of allocating fixed channels to certain SUs, the proposed distributed channel allocation method with different channel priority will make most use of the channels that have low interference.

Fig. 3.An diagram illustrating dynamic load and channel selection based on that load..

According to the dynamic interference graph, the interference can be quantified in a statistical manner, and the average interference among small-cells can be calculated. This will be further elaborated in the following subsection.

3.2 Problem formulation

Customarily, channel allocation is performed according to the detected instantaneous channel gains of the SUs. However, due to the mobility and activity of SUs, this assumption is performed. Also, the monitoring of instantaneous channel gains of the SUs will lead to extensive signaling and huge amount of information transmission overhead. In our model, the average channel gains measured by SBSs are used for channel allocation, similar to [15]. Each small-cell performs downlink measurements of interference signal and noise power levels in each available channel. Since SUs are usually located very closely to the serving SBSs and can move around the serving SBSs, it can be assumed that the average channel gain between a SBS n and a SU sun′, served by another SBS n′, can be approximated by the channel gain between the two SBSs (n and n′), i.e. [15]. Following this assumption, it can be deduced that channel gains are symmetric, i.e. for two SBSs n, n′ and two SUs sun, sun′.

Let us assumed that the channel subset being occupied by SBS n at time t is denoted as Cn(t) = {cn1,cn2,...,cnl}, Cn(t) ⊂ Cn. The instantaneous received interference signal power1 by SBS n in each channel m(m ∈ Cn(t)) can be approximated by:

where represents the average channel gain between SBS i and n in channel m, pim represents the transmission power of SBS i, and δim(t) is the following interference indicator function:

Following many previous studies which focus on small-cell networks, we consider to be mainly determined by the transmission distance, in which case To facilitate the analysis, we do not consider power control and assume that the transmission power of the SBSs in each channel is the same, i.e. pim = p. The proposed approach can also be applied in cases where the transmission transmit power is arbitrary and fixed.

The achieved instantaneous throughput of SBS n in channel m is

where gn(t) is the instantaneous channel gain between SBS n and the active SU at time t, σ2 is the background noise, and B0 is the bandwidth of each channel. Due to the mobility and activity of SUs, it is too hard to monitor the instantaneous channel gain gn(t). What's more, considering the received instantaneous interference, it is also difficult to calculate the instantaneous throughput or the average throughput. On the other hand, it is feasible to calculate the average interference of SBS n in each channel over a relatively long period of time. It is clear that each SBS will prefer to give higher priority to channels with lower average interference in order to increase its servicing capacity.

Suppose that (Cn, C−n) is the sequential channel set selection profile of the small-cell network, where C−n is the sequential channel set selection profile of other SBSs. The average interference by SBS n in channel m can be described as:

It can be assumed that for each SBS i with channel m' ∈ {M - Ci}, we will have Thus, (8) can be rewritten as:

Because the probability that SBS n occupies channel m = cnk to transmit its signal is ϑnk the received average aggregate interference of n, when having a candidate channel set Cn can be expressed as:

The optimization goal for each small-cell is to minimize its average aggregate interference. Accordingly, a quantitative expression of the average network interference level is given by the following equation:

The average network interference level reflects the expectation of the aggregate dynamic co-tier interference of the network. Thus, the global objective is as follows:

This is challenging to achieve due to the dynamics of the small-cells’ loads and the incomplete information constraint, i.e. i) the total number of SUs associated with each SBS is fixed, but the number of active SUs (the instantaneous load) is time-varying and the probability distribution of the dynamic load of each SBS is unknown, ii) there is no central controller and information exchange among the SBSs, which leads to each SBS not being aware of the chosen sequential channel sets and the probability distributions of loads of other SBSs. Without centralized management, we propose a distributed approach with incomplete information to solve this problem.

 

4. A Dynamic Interference Graph Game Approach for Sequential Channel Set Selection

Game theory is a potentially effective distributed approach towards handling the above problem without a central controller and complete global information. In this paper, we formulate this problem as a dynamic interference graph game, in which each player (i.e. each SBS) forms its spectrum access strategy in a distributed and autonomous manner.

4.1 Game model

We shall denote the dynamic interference graph game as GI = {N, (An)n∈N, (un)n∈N}, where N = {1,2...,N} is the set of SBSs, An is the strategy space of SBS n, with Cn ∈ An. un is the utility function of each player n, which is the inverse of the received average aggregate interference of SBS n, and can be expressed as:

Then the noncooperative dynamic interference graph game is expressed as follows:

According to (14), it is expected that each SBS prefers to choose the channels with the lowest average interference to maximize the capacity of the small-cell. In other words, we can get Zn channels with the lowest average interference for each SBS n by solving (14), i.e. minimizing SBS n's received average aggregate interference in all selected channels. Let us consider a scenario where the sequential channel set selection profile of other players C−n is fixed, in which case we have the following theorem.

Theorem 1: For each SBS n withae fixed C−n, for where then we have

Proof: i) If we have which is obtained by exchanging the positions of there have and Then based on (10), we obtain:

However, due to it must hold that and thus assumption i) does not hold.

ii) If we have Similarly, for obtained by replacing with m′ in we would have This is contradictory with so assumption ii) does not hold.

Therefore, through minimizing the received average aggregate interference, each SBS n would get Zn channels with the minimum average interference. Moreover, the channel with the lowest interference would be selected with a highest priority for transmission. Theorem 1 is proved.

4.2 Analysis of NE

In this subsection, we examine whether Nash equilibrium (NE) of the dynamic interference graph game exist. For game GI, an action profile is a pure strategy NE if and only if no player can improve its utility by deviating unilaterally, i.e.

Theorem 2: GI is an exact potential game which has at least one pure strategy NE. The optimal solution of the network average interference minimization problem is a pure strategy NE of GI.

Proof: We construct the potential function as

We see that the potential function is equal to half of the average network interference.

Suppose that an arbitrary player n unilaterally changes its channel selection from

Because based on (9)-(13), un (Cn,C-n) can be rewritten as

Then the change in individual utility function caused by this unilateral change is given by

where is the special probability of SBS n transmitting in channel m out of a sequential channel candidate set

Based on (17) the change in the potential function caused by this unilateral change is given by

where denotes the utility of player i after the unilateral change of selection by player n.

Using (13) and (18), we obtain the following equation:

Then from (19)-(21), it can be concluded that

Thus, it is shown that GI is an exact potential game in accordance with the definition of exact potential games given in [29]. The most two important properties of potential games are the following: i) A potential game has at least one pure strategy NE. ii) Local or global maxima of the potential function constitutes a pure strategy NE.

Based on the above properties, Theorem 2 is proved.

 

5. Algorithm and Simulation

Up to this point, we have explored the equilibrium behavior within the theoretic formulation of the dynamic interference graph game for the distributed sequential channel set selection problem. The question that remains is how the autonomous small-cells can reach equilibrium in a distributed fashion.

It is well known that some learning algorithms, for example the best response, fictitious play, spatial adaptive and log-linear learning algorithms, can converge towards pure strategy NE points for an exact potential game.

However, these algorithms are designed for static game models, in which the utilities are static and can be calculated with information exchange among players, and therefore cannot be applied in the dynamic interference graph game.

5.1 Algorithm description

A distributed dynamic learning algorithm, motivated by the imitative Boltzman-Gibbs algorithm with multiplicative weights [30,31], is proposed to achieve the Nash equilibria of the dynamic interference graph game.

In the proposed algorithm, without information exchange, the utility of each player is considered to be the temporal aggregate interference varying with the dynamic load of each small-cell in each iteration. Moreover, in the proposed algorithm, the SBSs do not need to know the probability distribution of their dynamic load. Algorithm 1 elaborates on this approach.

Because the value of ZnImax is fixed, is equivalent to Moreover, even if we were to replace the utility un by rn, the properties of the game would not change.

Theorem 3: With sufficiently small values for λ and b, the distributed dynamic learning algorithm converges to the Nash equilibria of the potential game GI.

Proof: The detailed proof lines can be found in [28,29].

Based on Theorems 2 and 3, we see that the distributed dynamic learning algorithm converges to the Nash equilibria of the proposed dynamic interference graph game GI. Moreover, as discussed before, the potential function of the proposed game is equal to half of the average aggregate network interference. Thus, the proposed algorithm would achieve the desirable performance when convergence to Nash equilibria has been achieved.

5.2 Simulation results and discussion

In this section, we present simulations conducted for the evaluation of evaluate the performance of the proposed learning algorithm in a dynamic and distributed environment. The simulation settings were set as follows. The transmission power of each SBS in each channel was 40mW, the background noise was -174dBm/Hz. The channel bandwidth was B0 = 500kHz. The coverage radius of a small-cell was 10m. Like many previous studies [15], in order to simplify our analysis of the small-cell network, when modelling the propagation environment we only considered path loss. The path loss between two SBSs, was assumed equal to PL = 38.46 + 20log(dij), where dij is the distance between SBSs i and j.

1) Convergence behavior: We analyzed the convergence behavior of distributed channel allocation with the proposed dynamic learning algorithm. We considered a small-cell network with 20 small-cells in a square region of 100m×100m. All the small-cells were randomly located. The number of dedicated channels is M = 3 and there were 1-3 SUs for each small-cell, i.e. the number of the associated SUs (Kn) of each small-cell n was randomly selected from 1-3. The active probability of each SU was randomly selected from [0,1] and then the probability distribution of the dynamic load of each SU was determined. We set b = 0.2, and λ = 0.1.

The evolution of action probabilities of an arbitrary chosen small-cell are shown in Fig. 4. In this simulation, the number of SUs in the chosen small-cell is 2. Each selected sequential channel sets of this cell contains 2 of the 3 dedicated channels. Thus, the number of the available actions is 6. It noted from the figure that the cell converges to a pure strategy in about 80 iterations, and in this case stable sequential channel set is {2,3}.

Fig. 4.Evolution of action probabilities of an arbitrary chosen small-cell.

It is clear that each small-cell must select at least one channel to serve the SUs, which will be the channel with the highest transmission priority in the sequential channel set. The evolution of the number of users for which a particular channel is selected as the highest transmission priority channel is shown in Fig. 5. It is noted that the network converges in about 200 iterations.

Fig. 5.Number of small-cells choosing the channel with the highest priority.

2) Performance evaluation: First, we evaluate the interference performance assuming an identical “Active” probability α for all SUs. We varied α from 0.2 to 0.6 and set M = 4, Kn = 3. Specifically, we assumed that all small-cells were aware of all the necessary information of active probabilities and channel sets selection. The utilities of the small-cells were calculated using (18). Thus, the NE of the proposed game can be accurately achieved. The results were obtained by simulating 1000 independent trials. The interference performance for a the random channel allocation process, the best and worst NE of the proposed game are shown in Fig. 6. As shown in the figure, the NE solutions give rise to much less network interference than random allocation does.

Fig. 6.Average network interference levels with varying identical α from 0.2 to 0.6 and M = 4, Kn = 3.

Second, in order to further evaluate the interference performance and the fairness performance, we consider a special scenario where M = 4, Kn = 3, and αn1 = 0.6, αn2 = 0.4, αn3 = 0.2, n ∈ N. In the following section, we vary the the number of small-cells from 15 to 25, and present the performance evaluation results. In this scenario, the probability distributions of the cells’ dynamic loads are the same. If the probability distributions are different, the demanded channels by each small-cell are different, and fairness is hard to calculate under these conditions. The utilities of small-cells were calculated using (18). The interference performance for random allocation, the best and worst NE of the proposed game are shown in Fig. 7.

Fig. 7.Average network interference levels with M = 4, Kn = 3, and αn1 = 0.6, αn2 = 0.4, αn3 = 0.2, n ∈ N.

As shown in the figure, random allocation achieves the worst performance and the NE solutions fare much better. In addition, we can see that the performance gap between the best NE and the worst NE is very small, i.e. the performance of the NE solution is very stable.

We then proceed to calculate Jain's fairness index (JFI) [32] of the small-cell networks with each SBS's received aggregate interference (sn in (10)). The result is shown in Fig. 8. It is noted from the figure that the JFI value achieved by the NE is significantly higher than that of random allocation.

Fig. 8.JFI of small-cell networks with M = 4, Kn = 3, and αn1 = 0.6, αn2 = 0.4, αn3 = 0.2, n ∈ N.

Third, we evaluated interference and throughput performance in a more common scenario. We set M = 4, Kn was randomly selected from {1,2,3} and the active probabilities of SUs were randomly selected from [0,1] in each independent trial. Each SBS did not know the probability distributions of its own and other SBSs' dynamic loads. The utilities of small-cells were calculated using (23). We simulated 1000 independent trials and then calculated the average results. The average network interference levels when varying the number of small-cells are shown in Fig. 9. It can be noted from the figure that the proposed distributed channel allocation significantly outperforms the random allocation. As the number of small-cells in a given region increases, the average interference level increases.

Fig. 9.The average aggregate interference levels with M = 4, randomly selected Kn and active probabilities (1 ≤ Kn ≤ 3, 0 ≤ α ≤ 1).

The average achieved throughput of the network when varying the number of small-cells is shown in Fig. 10. In practice, due to restrictions on the capabilities (coding and modulation) of devices, the signal to interference plus noise ratio (SINR) must be greater than a predetermined threshold. We set the SINR threshold as 5dB and the transmission rate of each available channel at 1Mbps. For a given channel, a cell was allowed to transmit data with a rate of 1 Mbps only when the temporal SINR is greater than 5dB. It can be seen from the figure that the average throughput, which is achieved using the distributed channel allocation method, is much higher than the random allocation strategy. As the number of small-cells increases, the average achieved throughput decreases.

Fig. 10.The average achieved throughput of networks with M = 4, randomly selected Kn and active probabilities (1 ≤ Kn ≤ 3, 0 ≤ α ≤ 1).

Lastly, we consider three small-cell networks with i) M = 3, 1 ≤ Kn ≤ 3, ii) M = 4, 1 ≤ Kn ≤ 3, and iii) M = 3, 1 ≤ Kn ≤ 4, respectively. The comparison results obtained by distributed channel allocation with different dedicated channels and different SU numbers are shown in Fig. 11. It is noted from the figure that as the number of dedicated channels increases, the average interference decreases accordingly. It also noted from the figure that the number of SUs in each small-cell increases, the average interference increases. The average achieved throughput of these networks is shown in Fig. 12. It can be seen from Fig. 11 and Fig. 12 that the more abundant channel resources are, the lower network interference will be present and the higher the achieved throughput will be.

Fig. 11.Average network interference levels of small-cell networks with different numbers of dedicated channels and SUs per cell.

Fig. 12.The average achieved throughput of networks with different numbers of dedicated channels and SUs per cell.

 

6. Conclusion

In this paper, we focused on the mitigation of co-tier interference and studied the issue of distributed channel allocation in small-cell networks with dynamic loads. We proposed an allocation method for small-cells with dynamic loads. In particular, the distributed channel allocation method pertains to cases when the load was larger than the number of dedicated channels. In the absence of a central controller and information exchange between the cells, we defined a dynamic interference graph and formulated the problem as a dynamic interference graph game. We proved that the game is a potential game and has at least one pure strategy NE point. A distributed dynamic learning algorithm was then designed to achieve the NE of the game, in which each SBS doesn't know the probability distributions of its own and the others' dynamic loads. Simulation results showed that the proposed approach could mitigate dynamic co-tier interference effectively and outperform random selection significantly. In our future work, we aim to consider the distributed power control and channel allocation problem synthetically to meet the required transmission rates of users and reduce the aggregate power consumption.

References

  1. V. Chandrasekhar, J. Andrews, and A. Gatherer, “Femtocell networks: a survey,” IEEE Commun. Mag., vol. 46, no. 9, pp. 59–67, Sep. 2008. Article (CrossRef Link) https://doi.org/10.1109/MCOM.2008.4623708
  2. Y. Sun, R. CJover, and X. Wang, “Uplink interference mitigation for OFDMA femtocell networks,” IEEE Trans. Wireless Commun., vol. 11, no. 2, pp. 614–625, Feb. 2012. Article (CrossRef Link) https://doi.org/10.1109/TWC.2011.120511.101794
  3. C. X. Wang, F. Haider, X. Gao, et al.,“Cellular architecture and key technologies for 5G wireless communication networks,” IEEE Commun. Mag., vol. 52, no. 2, pp. 122–130, Feb. 2014. Article (CrossRef Link) https://doi.org/10.1109/MCOM.2014.6736752
  4. M. Jo, T. Maksymyuk, R. L. Batista, et al, “A Survey of Converging Solutions for Heterogeneous Mobile Networks, ” IEEE Wireless Communications, vol. 21, no. 8, pp.54-62, Dec, 2014. Article (CrossRef Link)
  5. V. Chandrasekhar and J. G. Andrews, “Uplink capacity and interference avoidance for two-tier femtocell networks,” IEEE Trans. Wireless Commun., vol. 8, no. 7, pp. 3498–3509, Jul. 2009. Article (CrossRef Link) https://doi.org/10.1109/TWC.2009.070475
  6. V. Chandrasekhar and J. G. Andrews, “Spectrum allocation in tiered cellular networks,” IEEE Trans. Commun., vol. 57, no. 10, pp. 3059–3068, Oct. 2009. Article (CrossRef Link) https://doi.org/10.1109/TCOMM.2009.10.080529
  7. M. Bennis, S. M. Perlaza, P. Blasco, et al, "Self-organization in small-cell networks: A reinforcement learning approach," IEEE Trans. Wireless Commun., vol. 12, no. 7, pp. 3202-3212, 2013. Article (CrossRef Link) https://doi.org/10.1109/TWC.2013.060513.120959
  8. C. Wang, et al, "Stackelberg game for spectrum reuse in the two-tier LTE femtocell network," in Proc. of IEEE WCNC 2013, 2013. Article (CrossRef Link)
  9. P. Semasinghe, E. Hossain and K. Zhu, “An evolutionary game for distributed resource allocation in self-organizing small-cells,” IEEE Trans. Commun., vol. 14, no. 2, pp. 274–287, 2014. Article (CrossRef Link)
  10. W. Ni, and I. B. Collings, “A new adaptive small-cell architecture,” IEEE J. Sel. Areas Commun., vol. 31, no. 5, pp. 829–839, Jun. 2013. Article (CrossRef Link) https://doi.org/10.1109/JSAC.2013.130502
  11. P. Kulkarni, W. H. Chin, and T. Farnham, “Radio resource management considerations for LTE Femto cells,” ACM SIGCOMM Comput. Commun., vol. 40, no. 1, pp. 26–30, Jan. 2010. Article (CrossRef Link) https://doi.org/10.1145/1672308.1672314
  12. S. Y. Lien, C. C. Tseng, K. C. Chen, and C. W. Su, "Cognitive radio resource management for QoS guarantees in autonomous femtocell networks," in Proc. of IEEE Int. Conf. Commun., pp. 1-6, May 2010. Article (CrossRef Link)
  13. H. C. Lee, D. C. Oh, and Y. H. Lee, "Mitigation of inter-femtocell interference with adaptive fractional frequency reuse," in Proc. of IEEE Int. Conf. Commun., pp. 1-5, May 2010. Article (CrossRef Link)
  14. K. Sundaresan and S. Rangarajan, "Efficient resource management in OFDMA femtocells," in Proc. of ACM Int. Symp. Mobile Ad Hoc Netw. Comput., pp. 33-42, May, 2009. Article (CrossRef Link)
  15. Y. S. Liang, et al. “Resource allocation with interference avoidance in OFDMA femtocell networks,” IEEE Transactions on Vehicular Technology, vol. 61, no. 5, pp. 2243–2255, 2012. Article (CrossRef Link) https://doi.org/10.1109/TVT.2012.2191164
  16. A. Abdelnasser, E. Hossain, and D. I. Kim, “Clustering and resource allocation for dense femtocells in a two-tier cellular OFDMA network,” IEEE Trans. Wireless Commun., vol. 13, no. 3, pp. 1628–1641, 2014. Article (CrossRef Link) https://doi.org/10.1109/TW.2014.011614.131163
  17. X. Kang, R. Zhang, and M. Motani, “Price-based resource allocation for spectrum-sharing femtocell networks: A stackelberg game approach,” IEEE J. Selected Areas in Commun., vol. 30, no. 3, pp. 538–549, Apr. 2012. Article (CrossRef Link) https://doi.org/10.1109/JSAC.2012.120404
  18. F. Pantisano, M. Bennis, W. Saad, M. Debbah,et al., "Coalition formation games for femtocell interference management: A recursive core approach," in Proc. of IEEE WCNC, pp. 1161-1166 ,2011. Article (CrossRef Link)
  19. F. Pantisano, M. Bennis, W. Saad, M. Debbah,et al., “Interference alignment for cooperative femtocell networks: A game-theoretic approach,” IEEE Trans. Commun., vol. 52, no. 5, pp. 61–67, 2014. Article (CrossRef Link)
  20. P. Semasinghe, E. Hossain and K. Zhu, “An evolutionary game for distributed resource allocation in self-organizing small-cells,” IEEE Trans. Commun., vol. 14, no. 2, pp. 274–287, 2014.
  21. Q. Ni, C. Zarakovitis, “Nash Bargaining Game Theoretic Scheduling for Joint Channel and Power Allocation in Cognitive Radio Systems,” IEEE Journal on Selected Areas in Communications, vol. 30, No. 1, pp. 70-81, 2012. Article (CrossRef Link) https://doi.org/10.1109/JSAC.2012.120107
  22. Y. H. Xu, Q. H. Wu, L. Shen, et al, “Opportunistic spectrum access with spatial reuse: Graphical game and uncoupled learning solutions,” IEEE Trans. Wireless Commun., vol. 12, no. 10, pp. 4814–4826, 2013. Article (CrossRef Link) https://doi.org/10.1109/TWC.2013.092013.120862
  23. Y. H. Xu, J. Wang, Q. H. Wu, et al, “Opportunistic spectrum access in cognitive radio networks: Global optimization using local interaction games,” IEEE Journal of Selected Topics in Signal Processing , vol. 6, No. 2, pp 180-194, 2012. Article (CrossRef Link) https://doi.org/10.1109/JSTSP.2011.2176916
  24. J. C. Zheng, Y. M. Cai, and Y. H. Xu, "MAC-layer interference mitigation in dynamic and distributed environment: dynamic graphic game with stochastic learning," in Proc. of 2014 5th International Conference on Game Theory for Networks (GAMENETS), IEEE, pp. 1-6, 2014. Article (CrossRef Link)
  25. Y. H. Xu, Q. H. Wu, and L. Shen et al, “Robust multiuser sequential channel sensing and access in dynamic cognitive radio networks: potential games and stochastic learning,” IEEE Transactions on Vehicular Technology, vol. 64, no. 8, pp. 3594 - 3607, 2015. Article (CrossRef Link) https://doi.org/10.1109/TVT.2014.2356554
  26. Y. H. Xu, C. G. Wang and J. H. Chen et al, “Load-aware dynamic spectrum access for small cell networks: A graphical game approach,” IEEE Transactions on Vehicular Technology, to appear. Article (CrossRef Link)
  27. C. Zarakovitis and Q. Ni, “Maximising Energy Efficiency in Multi-User Multi-Carrier Broadband Wireless Systems: Convex Relaxation and Global Optimisation Techniques,” IEEE Transactions on Vehicular Technology, to appear, 2015. Article (CrossRef Link)
  28. H. Pervaiz, L. Musavian and Q.Ni, et al “Energy and Spectrum Efficient Transmission Techniques under QoS Constraints towards Green Heterogeneous Networks,” IEEE Access Journal, vol. 3, pp. 1655-1671, Oct 2015. Article (CrossRef Link) https://doi.org/10.1109/ACCESS.2015.2479406
  29. S. Buzzi, G. Colavolpe, D. Saturnino, and A. Zappone, “Potential games for energy-efficient power control and subcarrier allocation in uplink multicell OFDMA systems,” IEEE J. Sel. Topics Signal Process., vol. 6, no. 2, pp. 89–103, Apr. 2012. Article (CrossRef Link) https://doi.org/10.1109/JSTSP.2011.2177069
  30. H. Tembine, Distributed strategic learning for wireless engineers, CRC Press, 2012. Article (CrossRef Link)
  31. Y. Xu, J. Wang and Q. Wu, et al., "Dynamic spectrum access with statistical QoS provisioning: A distributed learning approach beyond expectation optimization," available: http://arxiv.org/abs/1502.06672. Article (CrossRef Link)
  32. R. Jain, D. Chiu, and W. Haws, "A quantitative measure of fairness and discrimination for resource allocation in shared computer system," Technical Report, 1984. Article (CrossRef Link)