Robotics
Transformers
Safetensors
English
qwen2_5_vl
image-text-to-text
RDT
rdt
RDT 2
Vision-Language-Action
Bimanual
Manipulation
Zero-shot
UMI
text-generation-inference
Instructions to use robotics-diffusion-transformer/RDT2-VQ with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use robotics-diffusion-transformer/RDT2-VQ with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("robotics-diffusion-transformer/RDT2-VQ") model = AutoModelForMultimodalLM.from_pretrained("robotics-diffusion-transformer/RDT2-VQ", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -23,7 +23,7 @@ tags:
|
|
| 23 |
It predicts a short-horizon **relative action chunk** (24 steps, 20 dims/step) from binocular wrist-camera RGB and a natural-language instruction.
|
| 24 |
Actions are discretized with a lightweight **Residual VQ (RVQ)** tokenizer, enabling robust zero-shot transfer across **unseen embodiments** for simple, open-vocabulary skills (e.g., pick, place, shake, wipe).
|
| 25 |
|
| 26 |
-
[**Home**](https://rdt-robotics.github.io/rdt2/) - [**Github**](https://github.com/thu-ml/RDT2/tree/main?tab=readme-ov-file) - [**Discord**](https://discord.gg/vsZS3zmf9A)
|
| 27 |
|
| 28 |
---
|
| 29 |
|
|
|
|
| 23 |
It predicts a short-horizon **relative action chunk** (24 steps, 20 dims/step) from binocular wrist-camera RGB and a natural-language instruction.
|
| 24 |
Actions are discretized with a lightweight **Residual VQ (RVQ)** tokenizer, enabling robust zero-shot transfer across **unseen embodiments** for simple, open-vocabulary skills (e.g., pick, place, shake, wipe).
|
| 25 |
|
| 26 |
+
[**Home**](https://rdt-robotics.github.io/rdt2/) - [**Github**](https://github.com/thu-ml/RDT2/tree/main?tab=readme-ov-file) - [**Discord**](https://discord.gg/vsZS3zmf9A) - [**Paper**](https://arxiv.org/abs/2602.03310)
|
| 27 |
|
| 28 |
---
|
| 29 |
|