logoalt Hacker News

rahen • today at 1:49 PM • 2 replies • view on HN

Thanks for reposting! I'm the author of ATTN-11. Happy to answer any questions about the fixed-point arithmetic, the PDP-11 hardware, or the training process.

Replies

functional_dev • today at 2:34 PM

Incredible work! Fitting transformer into 32KB RAM is crazy

For those who read this project and do not know PDP-11 it could be hard to understand that working with these memory limits is difficult. Here is visual guide for PDP11 architecture - https://vectree.io/c/pdp-11-hardware-architecture

Thanks for this amazing project!

➕ show 1 reply
dare944 • today at 3:24 PM

Fun stuff! At one point I wondered about building something similar. But I lack the AI chops, and have too many other projects going on anyway.

I'm curious as to the type of memory in the 11/34. I also have a working PDP-11, an 11/05 with 32KW of actual core. I wonder what performance would be like with EIS emulation grafted in. Stunningly slow, I imagine.

Thanks for publishing this.