Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

mlx-community
/
Hermes-2-Pro-Mistral-7B-4bit

MLX
Safetensors
English
mistral
Mistral
instruct
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
function calling
json mode
Model card Files Files and versions
xet
Community

Instructions to use mlx-community/Hermes-2-Pro-Mistral-7B-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • MLX

    How to use mlx-community/Hermes-2-Pro-Mistral-7B-4bit with MLX:

    # Download the model from the Hub
    pip install huggingface_hub[hf_xet]
    
    huggingface-cli download --local-dir Hermes-2-Pro-Mistral-7B-4bit mlx-community/Hermes-2-Pro-Mistral-7B-4bit
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps
  • LM Studio
Hermes-2-Pro-Mistral-7B-4bit
4.27 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
muhtasham's picture
muhtasham
Upload folder using huggingface_hub
87b6804 verified about 2 years ago
  • .gitattributes
    1.52 kB
    initial commit about 2 years ago
  • README.md
    1.13 kB
    Upload folder using huggingface_hub about 2 years ago
  • added_tokens.json
    51 Bytes
    Upload folder using huggingface_hub about 2 years ago
  • config.json
    2.38 kB
    Upload folder using huggingface_hub about 2 years ago
  • model.safetensors
    4.26 GB
    xet
    Upload folder using huggingface_hub about 2 years ago
  • model.safetensors.index.json
    52.3 kB
    Upload folder using huggingface_hub about 2 years ago
  • special_tokens_map.json
    557 Bytes
    Upload folder using huggingface_hub about 2 years ago
  • tokenizer.json
    1.8 MB
    Upload folder using huggingface_hub about 2 years ago
  • tokenizer.model
    493 kB
    xet
    Upload folder using huggingface_hub about 2 years ago
  • tokenizer_config.json
    1.6 kB
    Upload folder using huggingface_hub about 2 years ago