There isn't really one specific method which makes any RL agent have faster learning. Rather there is a long list of methods which have shown to increase the speed of learning and they can sometimes play nicely with each other.
Some examples:
These are the most influential and promising methods I can think of but the list of techniques is not limited to these 3.