I know a lot of people who retired early and are not bored. I know other people who went back to work (not always the same job) just because they needed something to do. People are different. If you need a boss to keep you busy doing something then you shouldn't retire. If you can find plenty of things to do in life (hobbies, travel...) then you can retire. Without knowing you I can't say what is right.

Of course your job/boss matters. Some are worse than others.