Instructions to use jmvcoelho/t5-base-marco-2048 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jmvcoelho/t5-base-marco-2048 with Transformers:
# Load model directly from transformers import AutoTokenizer, T5ModelRoPE tokenizer = AutoTokenizer.from_pretrained("jmvcoelho/t5-base-marco-2048") model = T5ModelRoPE.from_pretrained("jmvcoelho/t5-base-marco-2048") - Notebooks
- Google Colab
- Kaggle
Model fine-tuned on MS-MARCO for 4 epochs.
Starting model: jmvcoelho/t5-base-marco-crop-pretrain-2048
Training script: https://github.com/cxcscmu/LongEmbeddingAnalysis/blob/main/scripts/train_dr.sh
T5ForConditionalGenerationRoPE class: https://github.com/cxcscmu/LongEmbeddingAnalysis/blob/main/OpenMatch/src/openmatch/modeling/rope_t5.py
- Downloads last month
- 1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support