GPT‑6 and Intelligent UI for everyone

I feel like I'm going mad looking at this page. The bike disassembly looks fake to me, like an alien would show presumed bike parts, but I can't tell why and don't know much about bikes. Maybe it's because there are no screws and nuts?

What is it supposed to demonstrate? That the model knows some kind of folk mereology?

I noticed this change too! It is really game changer - to me ChatGPT output has no rivals here.

I'm also building something similar for an internal project, based on the vercel's json-render design. It hasn't been too challenging, especially since the release of faster models like 5.6 Luna.

So I guess it's going to nail the bicycle the Pelican rides on, right?

A Chat AI creating on the fly UX widgets is like Amazon’s brick and mortar stores

Similar to https://www.monogram.ai/.

I guess the above is mostly mobile focused.

gemini app kind of had that for a while I feel?

Love it. I've been using $visualize a lot in the codex desktop app, and having even richer experiences will be sweet.

IIRC Google had an experimental project with this kind of stuff 2 years ago, but Google being Google...

Let's remember.. 'Climbers rescued from Mount Shasta after relying on ChatGPT for trip planning'

https://news.ycombinator.com/item?id=49542814

for the sunday lamb roast instructions, how much is 1500g of potatoes? What kind of potatoes?

> Also pick up garlic, rosemary, thyme, lemons, honey, almonds, olive oil, gravy ingredients, mint sauce, crumble topping and vanilla ice cream.

what??? how the hell are you supposed to remember all that. Even the before example tells you what kind of potatoes to get. tbh it would be cool if you could just click a button and get an order pre-filled out on a grocery delivery/pickup service. I really wonder who reviewed this post and if they cook, because imagining yourself in that scenario and reading those instructions falls apart very fast

Is it me or GPT-6 Instant food answer gives the vibe to check the hell out immediately? It's like the it will start to explain a sunny Sunday afternoon from 20 years ago for 5 full pages.

Instead of apps or websites merely APIs and intelligent UI in front. With the ability to render data gathered across multiple domains

Is there any relationship between this and AG-UI or A2UI?

Why show an intelligent UI within a chat interface. That’s pathetically lame. Better to go away from chat interfaces to rich visual interfaces. Doesn’t sound intelligent at all to me

I gotta admit, I love how their design system and how they market things. It looks so good. However the true state of their toolings is closer to a burning dumpster fire. If you look at Codex Github repo for example, the amount of existing issues and continuously new issues appearing while tagged releases is being spewed out. Its truly a nightmare. Their vscode extension has been broken for almost 1 week now, if not more. Its instead a community effort to repair it.

It's interesting how the bicycle is a fake example. You see Jony Ive level design, with a very complex 3d object seamlessly working, and then you see the basic HTML slop in other examples and you begin to wonder if that first one was fabeication.

sounds like JEV with extra steps

Written manuals/guides come with pictures. The ad is dishonest.

This seems like a nightmare for standardization and accessibility, no?

"If you call something intelligent you know what it isn't."

> We’ve trained GPT‑6 to compose responses using text, visuals and interactive elements, choosing how they fit together based on your question.

Ok so this is how you build a moat. Models are not a commodity and visualization isnt a purely harness problem.

> We expanded our training methods to help the model make thoughtful decisions about content, layout, visuals, and interaction. This included evaluating the interfaces it creates for clarity, usefulness, and completeness. GPT‑6 learned to use the component library and make good design decisions, including how to organize information clearly, when to use interactivity, and when a simple text response is enough.

Curious to know how they trained it produce appropriate visuals. And why that cant be done with propmt engineering.

I made a prediction last year that there'd be a new UI protocol (like HTML) but for agents. I believe that custom or personalised UI's are going to be the new browser interface. More radically, I think browsers can be completely replaced. My news feed can be personalised to me, based on what AI thinks might be important from all sources like Reddit, X, HN.

This looks bad, I want the output to be as much as text based so I can easily export it and further processing it, plus, this might make the resource-eating app even worse.

I read the comments here and I am really surprised by many people. One picture is worth a thousand words so with better UI you can make much better user experiences. This unlocks personal assistants to be better adopted by elderly or disabled people. I see so many benefits of it and having models which can do this (if they can do it constantly with good quality) is amazing. Much better products - I am really tired of dumb chatbot - if I can do something with one button or view the whole information in one diagram/image, this is amazing.

[dead]

"why do I need an Nvidia B300 to render the same webpage that ran fine on my Pentium with Windows 98?"