Journal of Beijing University of Posts and Telecommunications

  • EI核心期刊

JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM ›› 2007, Vol. 30 ›› Issue (4): 5-9.doi: 10.13190/jbupt.200704.5.zhangyj

• Papers • Previous Articles     Next Articles

Autonomic Joint Session Admission Control Using Reinforcement Learning

ZHANG Yongjing,TANG Tian,CHEN Jie   

  1. School of Telecommunication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
  • Received:2006-08-09 Revised:2006-09-13 Online:2007-08-30 Published:2007-08-30
  • Contact: ZHANG Yongjing

Abstract:

In this paper, a reinforcement learning based joint session admission control algorithm is proposed to realize the autonomic and distributed joint resource optimization between the heterogeneous radio access technologies (RAT) in a reconfigurable system. By introducing Q-learning into the admission control algorithm and adjusting the strength of the reinforcement signals for different types of sessions considering the inherent characteristics of different RATs, RATs are driven to absorb the suitable traffic for a proper service distribution, which improves the efficiency of resource utilization. The simulation results show that, through the “trial-and-error” on-line learning process, overlapping RATs can converge to the optimized admission control policies that reduce the overall blocking probability while achieve lower handover dropping probability as well as higher revenue.

Key words: reconfigurable, JOSAC, reinforcement learning, Q-learning, distributed, autonomic

CLC Number: