UltraBERT: Beyond the Limit of BERT Pre-Training. Pre-trained 150M/380M encoders and a text embedding model, English, 32K context.
Data Mining and Information Systems Lab
dmis-lab
AI & ML interests
None yet
Recent Activity
liked a model about 18 hours ago
dmis-lab/UltraBERT-Embed-150M liked a model about 18 hours ago
dmis-lab/UltraBERT-380M upvoted a collection about 18 hours ago
UltraBERTOrganizations
This collection hosts CVRR series introduced in paper, Reason Through the Latent! Making Latent Visual Reasoning Necessary
-
Reason Through the Latent! Making Latent Visual Reasoning Necessary
Paper • 2609.06746 • Published • 38 -
dmis-lab/Qwen2.5-VL-7B-CVRR
Visual Question Answering • Updated • 142 -
dmis-lab/Qwen3-VL-8B-CVRR
Visual Question Answering • Updated • 449 -
dmis-lab/Gemma3-4B-CVRR
Visual Question Answering • Updated • 288
UltraBERT: Beyond the Limit of BERT Pre-Training. Pre-trained 150M/380M encoders and a text embedding model, English, 32K context.
This collection hosts CVRR series introduced in paper, Reason Through the Latent! Making Latent Visual Reasoning Necessary
-
Reason Through the Latent! Making Latent Visual Reasoning Necessary
Paper • 2609.06746 • Published • 38 -
dmis-lab/Qwen2.5-VL-7B-CVRR
Visual Question Answering • Updated • 142 -
dmis-lab/Qwen3-VL-8B-CVRR
Visual Question Answering • Updated • 449 -
dmis-lab/Gemma3-4B-CVRR
Visual Question Answering • Updated • 288
models 73
dmis-lab/UltraBERT-Embed-150M
Sentence Similarity • 0.2B • Updated • 51 • 3
dmis-lab/UltraBERT-150M
Fill-Mask • 0.2B • Updated • 63 • 3
dmis-lab/UltraBERT-380M
Fill-Mask • 0.4B • Updated • 78 • 3
dmis-lab/InternVL3-38B-CVRR
Visual Question Answering • Updated • 298
dmis-lab/InternVL3-9B-CVRR
Visual Question Answering • Updated • 887
dmis-lab/Gemma4-31B-CVRR
Visual Question Answering • Updated • 319 • 1
dmis-lab/Gemma4-12B-CVRR
Visual Question Answering • Updated • 1.01k
dmis-lab/Gemma3-27B-CVRR
Visual Question Answering • Updated • 2
dmis-lab/Gemma3-12B-CVRR
Visual Question Answering • Updated • 83
dmis-lab/Gemma3-4B-CVRR
Visual Question Answering • Updated • 288
datasets 11
dmis-lab/ToxReason
Viewer • Updated • 35.6k • 65
dmis-lab/llama-3.1-medprm-reward-raw-test-set
Viewer • Updated • 5.47k • 25
dmis-lab/llama-3.1-medprm-reward-raw-training-set
Viewer • Updated • 11.7k • 44
dmis-lab/llama-3.1-medprm-reward-test-set
Updated • 77 • 2
dmis-lab/llama-3.1-medprm-reward-training-set
Viewer • Updated • 11.7k • 144 • 12
dmis-lab/TemporalHead
Viewer • Updated • 11 • 41 • 1
dmis-lab/meerkat-instructions
Viewer • Updated • 440k • 1.08k • 11
dmis-lab/RF-Collection
Preview • Updated • 127 • 1
dmis-lab/ChroKnowBench
Preview • Updated • 207 • 8
dmis-lab/ETHIC
Viewer • Updated • 1.99k • 106 • 7