--- base_model: [] library_name: transformers tags: - mergekit - merge --- # BereavedCompound-v1.0-24b This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Notes This is a multi-stage merge. There's little method to my madness and I just stopped when I arrived at something that I liked. Starting point was [FlareRebellion/WeirdCompound-v1.7-24b](https://huggingface.co/FlareRebellion/WeirdCompound-v1.7-24b) ### Changelog v1.0 * /intermediate/model/A: replaced TheDrummer/Cydonia-24B-v4.2.0 with ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0 ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0](https://huggingface.co/ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0) as a base. This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method. This model was merged using the NuSLERP merge method using /intermediate/model/B as a base. ### Models Merged * [ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0](https://huggingface.co/ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0) * [aixonlab/Eurydice-24b-v3.5](https://huggingface.co/aixonlab/Eurydice-24b-v3.5) * [PocketDoc/Dans-PersonalityEngine-V1.3.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.3.0-24b) * [zerofata/MS3.2-PaintedFantasy-v2-24B](https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v2-24B) * [CrucibleLab/M3.2-24B-Loki-V1.3](https://huggingface.co/CrucibleLab/M3.2-24B-Loki-V1.3) * [Delta-Vector/Austral-24B-Winton](https://huggingface.co/Delta-Vector/Austral-24B-Winton) * [anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only) * /intermediate/model/A * /intermediate/model/B * /intermediate/model/C ### Configuration The following YAML configuration was used to produce this model: ```yaml base_model: ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0 merge_method: model_stock dtype: bfloat16 models: - model: aixonlab/Eurydice-24b-v3.5 # storytelling / RP - model: ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0 - model: PocketDoc/Dans-PersonalityEngine-V1.3.0-24b # Prompt Adherence - model: CrucibleLab/M3.2-24B-Loki-V1.3 # Loki - model: zerofata/MS3.2-PaintedFantasy-v2-24B # animu - model: Delta-Vector/Austral-24B-Winton # Adventure ``` → `/intermediate/model/A` → ```yaml merge_method: slerp dtype: bfloat16 base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only models: - model: /intermediate/model/A parameters: t: 0.45 ``` → `/intermediate/model/B` → ```yaml merge_method: nuslerp dtype: bfloat16 base_model: /intermediate/model/B models: - model: PocketDoc/Dans-PersonalityEngine-V1.3.0-24b parameters: weight: 0.4 - model: CrucibleLab/M3.2-24B-Loki-V1.3 parameters: weight: 0.6 ``` → `/intermediate/model/C` → ```yaml merge_method: slerp dtype: bfloat16 base_model: /intermediate/model/B models: - model: /intermediate/model/C parameters: t: 0.5 ``` → BereavedCompound-v1.0-24b