hperrin , 1 month ago Surprisingly, there’s a way to run Llama 3 70b on 4GB of VRAM. https://huggingface.co/blog/lyogavin/llama3-airllm
Surprisingly, there’s a way to run Llama 3 70b on 4GB of VRAM.
https://huggingface.co/blog/lyogavin/llama3-airllm