Why does scaled dot-product attention divide query-key scores by the square root of the k…

Why does scaled dot-product attention divide query-key scores by the square root of the key dimension?

1. To keep large dot products from saturating softmax and producing very small gradients
2. To make every token receive exactly the same attention weight
3. To remove the need for learned query, key, and value projections