Text Generation
PEFT
Safetensors
English
lora
gemma4
guardrails
ai-agents
tool-calls
agent-security
prompt-injection
agent-safety
tool-calling
llm-security
Instructions to use BrejBala/gemma-toolcall-guard with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use BrejBala/gemma-toolcall-guard with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/tmp/base_model_dir/vertex-model-garden-restricted-us/gemma4/gemma-4-E4B-it") model = PeftModel.from_pretrained(base_model, "BrejBala/gemma-toolcall-guard") - Notebooks
- Google Colab
- Kaggle
Remove the private-repo login notes (the repos are public)
Browse files
README.md
CHANGED
|
@@ -168,7 +168,7 @@ CPU-only on Kaggle (a CUDA build of llama.cpp failed there), so GGUF speed on a
|
|
| 168 |
<summary><b>Full precision on CPU (tested)</b></summary>
|
| 169 |
|
| 170 |
Full precision on CPU (about 16 GB of RAM; tested from a clean Python 3.12 environment with only torch, transformers,
|
| 171 |
-
peft and accelerate from PyPI).
|
| 172 |
|
| 173 |
```python
|
| 174 |
import json, sys, torch
|
|
|
|
| 168 |
<summary><b>Full precision on CPU (tested)</b></summary>
|
| 169 |
|
| 170 |
Full precision on CPU (about 16 GB of RAM; tested from a clean Python 3.12 environment with only torch, transformers,
|
| 171 |
+
peft and accelerate from PyPI).
|
| 172 |
|
| 173 |
```python
|
| 174 |
import json, sys, torch
|