I've fooled around with some vibe coding on several LLM's like Claude, Gemini, and ChatGPT with some pretty decent results.
Since I have a full Copilot license at my corporate day gig, I figured I would try using Copilot for a basic static site. Nothing too hard, and something that's been handled easily with the other LLM's.
The prompt was pretty basic just to get something to start working with. "Build a four page template. With a home or index page, two pages of content and a contact page with a responsive slide out menu from the left hand side of the page."
It ran and put everything in a folder. I open the home page and everything was broken. I opened the files in VS Code and saw this:
<ul class="drawer__list">
<li>index.htmlHome</a></li>
<li>services.htmlServices</a></li>
<li><a class="nav-linkeduling</a></li>
<li>contact.htmlContact</a></li>
</ul>
And then this: <head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<title>Home · Acme Web</title>
<meta name="description" content="Accessible, responsive starter template with a slide-out menu."/>
<linkts/css/styles.css
/assets/css/styles.css
</head>
I mean, if you can't even this right, I don't have much hope it can do anything more complicated. To say this was pretty sad is an understatement and clarified how far Microsoft is behind other LLM's.