The two people were Bob Reiter and Jerry Solinas. Jerry wrote in a 2015 email to Daniel Bernstein that he thought it was a hash of the passphrase. I corroborated that story with 4 people, including two ex-NSA folks off the record.

Everyone was wrong!

I wasn't able to reach Bob. He was working in private industry as of 2018, but never responded.