HuggingFaceTB/SmolLM2-360M-Instruct-GGUF
Parameters360M
Context–
Input → output–
Licenseapache-2.0
Precisiongguf
Architecture–
ReleasedOct 31, 2024
Downloads17.3K
Based on HuggingFaceTB/SmolLM2-360M-Instruct
Other sizes and formats in the family
| Model | Params | Precision | Downloads |
|---|---|---|---|
| HuggingFaceTB/SmolLM2-1.7B-Instructquantized | 1.7B | BF16 | 231.2K |
| HuggingFaceTB/SmolLM2-1.7B-Instruct-16k | 1.7B | BF16 | 611 |
| HuggingFaceTB/SmolLM2-1.7B-Instruct-Q8-mlxq8 | 1.7B | U32 | 233 |
| HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUFgguf | 1.7B | – | 10.2K |
| HuggingFaceTB/SmolLM2-360M | 362M | BF16 | 316.4K |
| HuggingFaceTB/SmolLM2-360M-Instructquantized | 362M | BF16 | 222.3K |
| HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlxq8 | 362M | U32 | 105 |
| HuggingFaceTB/SmolLM2-135M | 135M | BF16 | 1.7M |
| HuggingFaceTB/SmolLM2-135M-Instructquantized | 135M | BF16 | 1.4M |
| HuggingFaceTB/SmolLM2-135M-Instruct-Q8-mlxq8 | 135M | U32 | 156 |
This release in the news
No coverage of this exact release yet.
Recent news about SmolLM
- Oct 11, 2026 · Open-source releaseConverting dense models into Mixture-of-Experts
- Oct 10, 2026 · Research paperLinear-Time Non-Local Codec Placement for Machine Learning Model Compression
- Oct 7, 2026 · Research paperSemanticFold: Latent Sequence Compression SeparatesLanguage Modeling, Decodability, and Reasoning
- Oct 7, 2026 · Research paperBoT-GRPO: Efficient Process-Reward RL for Reasoning via Bag-of-Token Aggregation
- Oct 7, 2026 · Research paperEvaluating Trajectory Features for Routing Final-Layer Attention