Instructions to use Alibaba-NLP/Tongyi-DeepResearch-30B-A3B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Alibaba-NLP/Tongyi-DeepResearch-30B-A3B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Alibaba-NLP/Tongyi-DeepResearch-30B-A3B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Alibaba-NLP/Tongyi-DeepResearch-30B-A3B")
model = AutoModelForCausalLM.from_pretrained("Alibaba-NLP/Tongyi-DeepResearch-30B-A3B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Alibaba-NLP/Tongyi-DeepResearch-30B-A3B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Alibaba-NLP/Tongyi-DeepResearch-30B-A3B

SGLang

How to use Alibaba-NLP/Tongyi-DeepResearch-30B-A3B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Alibaba-NLP/Tongyi-DeepResearch-30B-A3B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Alibaba-NLP/Tongyi-DeepResearch-30B-A3B with Docker Model Runner:
```
docker model run hf.co/Alibaba-NLP/Tongyi-DeepResearch-30B-A3B
```

DeepResearch Source Code License

by jebbam - opened Sep 17, 2025

Discussion

jebbam

Sep 17, 2025

I see the Tongyi-DeepResearch-30B-A3B model on HF has an Apache 2.0 license.

But there is no license file for the source code:
https://github.com/Alibaba-NLP/DeepResearch

Can you please add a license, preferably also Apache 2.0, to the source code repo?

Thanks!

NLPblue

Alibaba-NLP org Sep 18, 2025

Hi jebbam,

Thanks a lot for pointing this out and for your attention to detail!

You are absolutely right. The source code is intended to be under the Apache 2.0 license, consistent with the model.

We will add the LICENSE file to the repository shortly.

Thanks again for helping us improve the project!

NLPblue changed discussion status to closed Sep 18, 2025

jebbam

Sep 21, 2025

I see there have been quite a few changes to the source code repository since this post, but the LICENSE file still has not been added.

Please add it.

Thank you!

callanwu

Alibaba-NLP org Sep 22, 2025

I see there have been quite a few changes to the source code repository since this post, but the LICENSE file still has not been added.

Please add it.

Thank you!

We have added the LICENSE file on the repo:)

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment