ingu627/gpt-transformers repository overview

Images for testing distributed deep learning, such as deepspeed, fairscale, etc.

Extended version from "deepspeed/deepspeed:latest_torch111".

You can use it right away without having to set up another environment!!!

numpy pandas sentencepiece tensorflow tensorflow-gpu boto3 regex seaborn matplotlib
tqdm transformers pytorch-lightning wandb fairscale six pybind11
datasets protobuf scikit-learn seqeval psutil sacrebleu rouge-score git-python==1.0.3
streamlit elasticsearch nltk fire pytest conllu jiwer librosa

This is an example of the experimental results in wandb comparing fairscale and deepspeed using a different number of gpu.

more info : https://wandb.ai/ingu627/huggingface/reports/KISTI-T5-Deepspeed-Fairscale---VmlldzoyMzUyMjU4⁠