HauhauCS commited on
Commit
bdf7966
·
verified ·
1 Parent(s): 18b97f7

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +104 -0
README.md ADDED
@@ -0,0 +1,104 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - uncensored
5
+ - qwen3.5
6
+ - moe
7
+ - gguf
8
+ - vision
9
+ - multimodal
10
+ language:
11
+ - en
12
+ - zh
13
+ - multilingual
14
+ pipeline_tag: image-text-to-text
15
+ base_model: Qwen/Qwen3.5-35B-A3B
16
+ ---
17
+
18
+ # Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
19
+
20
+ Qwen3.5-35B-A3B uncensored by HauhauCS. **0/465 refusals.**
21
+
22
+ ## About
23
+
24
+ No changes to datasets or capabilities. Fully functional, 100% of what the original authors intended - just without the refusals.
25
+
26
+ These are meant to be the best lossless uncensored models out there.
27
+
28
+ ## Aggressive Variant
29
+
30
+ Stronger uncensoring — model is fully unlocked and won't refuse prompts. May occasionally append short disclaimers (baked into base model training, not refusals) but full content is always generated.
31
+
32
+ For a more conservative uncensor that keeps some safety guardrails, check the Balanced variant when it's available.
33
+
34
+ ## Downloads
35
+
36
+ | File | Quant | Size |
37
+ |------|-------|------|
38
+ | [Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-BF16.gguf](https://huggingface.co/HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-BF16.gguf) | BF16 | 65 GB |
39
+ | [Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q8_0.gguf](https://huggingface.co/HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q8_0.gguf) | Q8_0 | 35 GB |
40
+ | [Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q6_K.gguf](https://huggingface.co/HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q6_K.gguf) | Q6_K | 27 GB |
41
+ | [Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q5_K_M.gguf](https://huggingface.co/HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q5_K_M.gguf) | Q5_K_M | 24 GB |
42
+ | [Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf](https://huggingface.co/HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf) | Q4_K_M | 20 GB |
43
+ | [Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ4_XS.gguf](https://huggingface.co/HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ4_XS.gguf) | IQ4_XS | 18 GB |
44
+ | [Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q3_K_M.gguf](https://huggingface.co/HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q3_K_M.gguf) | Q3_K_M | 16 GB |
45
+ | [Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ3_M.gguf](https://huggingface.co/HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ3_M.gguf) | IQ3_M | 15 GB |
46
+ | [Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ2_M.gguf](https://huggingface.co/HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive/resolve/main/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ2_M.gguf) | IQ2_M | 11 GB |
47
+ | [mmproj-Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-f16.gguf](https://huggingface.co/HauhauCS/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive/resolve/main/mmproj-Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-f16.gguf) | mmproj (f16) | 858 MB |
48
+
49
+ All quants generated with importance matrix (imatrix) for optimal quality preservation on abliterated weights.
50
+
51
+ ## Specs
52
+
53
+ - 35B total parameters, ~3B active per forward pass (MoE)
54
+ - 256 experts, 8 routed + 1 shared per token
55
+ - Hybrid architecture: Gated DeltaNet linear attention + full softmax attention (3:1 ratio)
56
+ - 40 layers, pattern: 10 x (3 x DeltaNet-MoE + 1 x Attention-MoE)
57
+ - 262K native context (extendable to 1M with YaRN)
58
+ - Natively multimodal (text, image, video)
59
+ - Multi-token prediction (MTP) support
60
+ - 248K vocabulary, 201 languages
61
+ - Based on [Qwen/Qwen3.5-35B-A3B](https://huggingface.co/Qwen/Qwen3.5-35B-A3B)
62
+
63
+ ## Recommended Settings
64
+
65
+ From the official Qwen authors:
66
+
67
+ **Thinking mode (default):**
68
+ - General: `temperature=1.0, top_p=0.95, top_k=20, min_p=0, presence_penalty=1.5`
69
+ - Coding/precise tasks: `temperature=0.6, top_p=0.95, top_k=20, min_p=0, presence_penalty=0`
70
+
71
+ **Non-thinking mode:**
72
+ - General: `temperature=0.7, top_p=0.8, top_k=20, min_p=0, presence_penalty=1.5`
73
+ - Reasoning tasks: `temperature=1.0, top_p=1.0, top_k=40, min_p=0, presence_penalty=2.0`
74
+
75
+ **Important:**
76
+ - Keep at least 128K context to preserve thinking capabilities
77
+ - Use `--jinja` flag with llama.cpp for proper chat template handling
78
+ - Vision support requires the `mmproj` file alongside the main GGUF
79
+
80
+ ## Usage
81
+
82
+ Works with llama.cpp, LM Studio, Jan, koboldcpp, and other GGUF-compatible runtimes.
83
+
84
+ ```bash
85
+ # Text only
86
+ llama-cli -m Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf \
87
+ --jinja -c 131072 -ngl 99
88
+
89
+ # With vision
90
+ llama-cli -m Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf \
91
+ --mmproj mmproj-Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-f16.gguf \
92
+ --jinja -c 131072 -ngl 99
93
+ ```
94
+
95
+ **Note:** LM Studio may show `256x2.6B` in the params column instead of `35B-A3B` — this is a cosmetic metadata quirk, the model runs correctly.
96
+
97
+ ## Other Formats
98
+
99
+ - GGUF (this repo)
100
+ - GPTQ — coming soon
101
+
102
+ ## Other Models
103
+
104
+ - [Qwen3.5-27B-Uncensored-HauhauCS-Aggressive](https://huggingface.co/HauhauCS/Qwen3.5-27B-Uncensored-HauhauCS-Aggressive)