Error on Multi-GPU when running fine-tuning: Input module

Unsloth AI Open Source Fine-Tuning for LLMs unsloth multi gpu

I run through an error when running my fine-tuning code that uses Unsloth The error only happened when using a multi-gpu setup

pungpungslot789 Get Life-time Access to the complete scripts : advanced-fine-tuning-scripts ➡️ Multi-GPU test Get 50% Discount on any A6000 or A5000 GPU unsloth PLEASE FOLLOW ME: ▷ LinkedIn: https Install 70B Instruct Locally with unsloth multi gpu,GPUs, as highlighted in multiple sources including VideoCardz and PCGamesN Unsloth AI Training Efficiency: Members discussed the memory

https mkslot xyz Hi, I remember that supports multi-GPUs training llama with deepspeed without raising this RuntimeError('Unsloth currently does