Doesn't have to be just larger sites. If someone launched their basic website 5 years before you did it's going to be difficult to outrank them.