Show HN: Finetune LLaMA-7B on commodity GPUs using your own text https://ift.tt/Z0xYjih

Show HN: Finetune LLaMA-7B on commodity GPUs using your own text I've been playing around with https://ift.tt/FnuBro4 and https://ift.tt/NI8uFnU , and wanted to create a simple UI where you can just paste text, tweak the parameters, and finetune the model quickly using a modern GPU. To prepare the data, simply separate your text with two blank lines. There's an inference tab, so you can test how the tuned model behaves. This is my first foray into the world of LLM finetuning, Python, Torch, Transformers, LoRA, PEFT, and Gradio. Enjoy! https://ift.tt/Xr3H8Kl March 22, 2023 at 09:45AM