No you are not crazy. It's silly to try to use a raspberry pi 5 16GB (or equivalent priced product) as a desktop workstation with a GUI on it when much better actual x86-64 based workstations exist. Ones with real amounts of PCI-E lanes of I/O, NVME SSD interfaces on motherboard, multiple SATA3 interfaces on motherboard, etc. In very small form factors same as you'd see in any $bigcorp office cubicle.