It depends on how many GPU you have. Considering Anthropic resources, I would expect not very long training duration. Less than 2 months.

But I may be wrong. I just checked. GPT-3 ~= 1 month / GPT-4 ~= 3 months. So yes, it doesn't seems to be absurd. I should have checked.

Xiaomi shared recently the duration of a part of they training process (the post-training). It was 5 days only. I through it was the full process.

https://mimo.xiaomi.com/rl/

At the same time I checked the entropy of a random file using `ent` (https://www.fourmilab.ch/random/, `./ent -c model-00666-of-00772.safetensors`)

    Entropy = 7.844396 bits per byte.

    Optimum compression would reduce the size
    of this 10004844496 byte file by 1 percent.

    Chi square distribution for 10004844496 samples is 2618826632.83, and randomly
    would exceed this value less than 0.01 percent of the times.

    Arithmetic mean value of data bytes is 119.4727 (127.5 = random).
    Monte Carlo value for Pi is 3.385923920 (error 7.78 percent).
    Serial correlation coefficient is 0.016723 (totally uncorrelated = 0.0).

Here is the result on Qwen3.8 Flash-Next (the first 10G of .rad from StillDeadCode):

./ent -c ~/QFN_10G

    Entropy = 6.526076 bits per byte.

    Optimum compression would reduce the size
    of this 10000000000 byte file by 18 percent.

    Chi square distribution for 10000000000 samples is 25277765746.85, and randomly
    would exceed this value less than 0.01 percent of the times.

    Arithmetic mean value of data bytes is 153.6153 (127.5 = random).
    Monte Carlo value for Pi is 2.967461156 (error 5.54 percent).
    Serial correlation coefficient is 0.009678 (totally uncorrelated = 0.0).

That suggest not random values and coherence with model weights.