PEFT How to use Nima-nlc/aya2-Lora_4K with PEFT:
from peft import PeftModel
from transformers import AutoModelForSeq2SeqLM
base_model = AutoModelForSeq2SeqLM.from_pretrained("CohereForAI/aya-101")
model = PeftModel.from_pretrained(base_model, "Nima-nlc/aya2-Lora_4K") 
