https://simplyblock.io/blog/ai-training-checkpoint-model-registry-storage-kubernetes/