Looks like LM Studio just updated the MLX runtime, so there's compatibility now.
Yep! 60t/s on the 8 bit MLX on an M4 Pro with 64GB of RAM.
alt Hacker News
Yep! 60t/s on the 8 bit MLX on an M4 Pro with 64GB of RAM.