A novel dynamic Q-learning-based scheduler technique for LTE-advanced technologies using neural networks

Sorin Comsa, Ioan; Zhang, Sijing; Aydin, Mehmet; Kuonen, Pierre; Wagen, Jean Frederic

Abstract

The tradeoff concept between system capacity and user fairness attracts a big interest in LTE-Advanced resource allocation strategies. By using static threshold values for throughput or fairness, regardless the network conditions, makes the scheduler to be inflexible when different tradeoff levels are required by the system. This paper proposes a novel dynamic neural Q-learning-based scheduling technique that achieves a flexible throughput-fairness tradeoff by offering optimal solutions according to the Channel Quality Indicator (CQI) for different classes of users. The Q-learning algorithm is used to adopt different policies of scheduling rules, at each Transmission Time Interval (TTI). The novel scheduling technique makes use of neural networks in order to estimate proper scheduling rules for different states which have not been explored yet. Simulation results indicate that the novel proposed method outperforms the existing scheduling techniques by maximizing the system throughput when different levels of fairness are required. Moreover, the system achieves a desired throughput-fairness tradeoff and an overall satisfaction for different classes of users. © 2012 IEEE.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: Proceedings - Conference on Local Computer Networks, LCN
• Publication Date: Dec 1, 2012
• Peer Reviewed: Peer Reviewed
• Pages: 332-335
• Book Title: 37th Annual IEEE Conference on Local Computer Networks
• DOI: https://doi.org/10.1109/LCN.2012.6423642
• Keywords: long term evolution, learning (artificial intelligence),; neural nets, telecommunication computing, telecommunication traffic
• Public URL: https://uwe-repository.worktribe.com/output/944639
• Publisher URL: http://dx.doi.org/10.1109/LCN.2012.6423642
• Additional Information: Title of Conference or Conference Proceedings : 2012 IEEE 37th Conference on Local Computer Networks (LCN)