That's exactly how it works. A plugin is just a folder that you can copy into the .obsidian/plugins folder within your vault.