Training large models on distributed setupts

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
configs		configs
.gitignore		.gitignore
Notes.md		Notes.md
README.md		README.md
Test.ipynb		Test.ipynb
dataset.py		dataset.py
new_chat_template.txt		new_chat_template.txt
poetry.lock		poetry.lock
poetry.toml		poetry.toml
pyproject.toml		pyproject.toml
train.py		train.py
train.sh		train.sh
train_old.py		train_old.py
train_unsloth_sft.py		train_unsloth_sft.py
utils.py		utils.py

Provide feedback