Could be an avenue for synthetic continual learning? A powerful model could update its own weights manually given new training data.