Abstract: In this paper, interference coordination between the macro cells and the small cells in future 5G heterogeneous cellular networks were studied by applying Stackelberg gaming model. Considering the network architecture, this study focused on the interference coordination problem where the decisions of resource allocation and power control are distributed. The joint resource allocation and power control problem was formulated into a two-step Stackelberg Game model. Firstly, in the follower game decided by the small cells, the transmitting power levels of the small cell links are calculated according to the cost parameters; secondly, in the leader game determined by the macro cells, an optimal matching algorithm is proposed to obtain the pairing and resource allocation of small cells and macro cells, based on the small cell power, cost parameters and channel parameters obtained in the previous step. Since the cost parameter is an important variable that affects the outcome of the game, a cost parameter evolved method based on reinforcement learning is proposed. The simulation results demonstrated that compared with the random-access algorithm and the greedy-access and fixed transmitting power algorithm, the proposed evolved Stackelberg Game based interference coordination algorithm can acquire obvious performance promotion.