> However, such an approach has previously not really worked for C++ with LLVM offload. Why would it work for Rust?

They're very different languages, with different semantics. Without reading more than the synopsis of the paper, they're 100% leveraging the substructural type system and will have a really tight requirement for you to use a certain kind of Rust code at the CPU/GPU boundary.