You are correct but in the context of free software, the FSF has been explicit about this ("The freedom to run the program as you wish, for any purpose"). Publishing software under a FOSS license imply that you agree with this definition of freedom.

Have you actually read one a Free/Open-Source license? Like for example the MIT[1] license:

  Permission is hereby granted, free of charge, to any person obtaining a copy of this software [...] to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software [...]

  The freedom to run the program as you wish, for any purpose (freedom 0).

  5. No Discrimination Against Persons or Groups
  6. No Discrimination Against Fields of Endeavor

[1]: https://mit-license.org/ [2]: https://www.gnu.org/philosophy/free-sw.html#four-freedoms [3]: https://opensource.org/osd

I mean, not really...

That's like saying "I have the freedom to kill you".

Saying that you can create something, then you reserve the 'freedom' to limit what everyone else does for it really doesn't fall under the word freedom at all.