If you trust this link, click it to continue.
https://helloacm.com/deep-dive-into-reinforcement-learning-understanding-the-q-learning-algorithm/