LastKV-LLM-8B-Base / generation_config.json

Set final 8K checkpoint as default and document both final releases

c3c68a8 verified 18 days ago

169 Bytes

{
  "_from_model_config": true,
  "bos_token_id": 128000,
  "eos_token_id": 128001,
  "pad_token_id": 128001,
  "transformers_version": "4.57.6",
  "use_cache": false
}

	{
	"_from_model_config": true,
	"bos_token_id": 128000,
	"eos_token_id": 128001,
	"pad_token_id": 128001,
	"transformers_version": "4.57.6",
	"use_cache": false
	}