RSA [1] is directly based on the difficulty of factoring very large numbers where the factors of the number are also prime numbers.

[1] https://en.wikipedia.org/wiki/RSA_(cryptosystem)