How to use yimingzhang/gemma-tokenizer-chatml-reset with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("yimingzhang/gemma-tokenizer-chatml-reset", dtype="auto")
