HologramHologram
Models

LFM3-1.7B-GGUF

150k188

LiquidAI · 1.7B parameters · 13.6 GB · Custom licence

Address
liquidai/lfm3-1.7b-gguf
Held on
Get it
Status
Verified
Base model
…
Lineage
…
Unchanged from base
…
Trending
#25
Downloads, 30 days
150k
Weights
13.6 GB
Revision

Recommended sampling: temperature 0.1, topk 50, repeat penalty 1.1. For math and science: temperature 1.0, topp 0.95, topk 20.

At a glance

Task
Text generation
Input
text
Output
text
Parameters
1.7B
Architecture
Lfm3
Context
256K tokens
Format
GGUF
Library
gguf
License
other
Languages
en, ar, zh, fr, de, it, ja, ko +8
Base model
Quantized from LiquidAI/LFM3-1.7B
Released
Oct 2026
Updated
Oct 2026
Likes
115
Downloads, all time
18,165

Run it

Pinned to the indexed revision.

llama-server -hf LiquidAI/LFM3-1.7B-GGUF

Through the hub: the same tools, each file from a source that is up (Hugging Face, ModelScope, IPFS), at this revision. The second line checks every file against its address.

export HF_ENDPOINT=https://gethologram.ai
cd "$(hf download LiquidAI/LFM3-1.7B-GGUF --quiet)" && curl -s $HF_ENDPOINT/LiquidAI/LFM3-1.7B-GGUF/resolve/main/SHA256SUMS | sha256sum -c --quiet

Spaces

Used in 6 Spaces.

webml-community/LFM3-1.7B-WebGPU-Piapathy-exe/LFM3-1.7BTechnoBaptist/LFM3-1.7B-WebGPU-Pi
Read the full model card

Liquid AI

[![](https://huggingface.co/LiquidAI/LFM3-1.7B/resolve/main/assets/icons/api.svg)API](https://console.liquid.ai/dashboard)
[![](https://huggingface.co/LiquidAI/LFM3-1.7B/resolve/main/assets/icons/try.svg)Try](https://playground.liquid.ai/)
[![](https://huggingface.co/LiquidAI/LFM3-1.7B/resolve/main/assets/icons/docs.svg)Docs](https://docs.liquid.ai/lfm/getting-started/welcome)
[![](https://huggingface.co/LiquidAI/LFM3-1.7B/resolve/main/assets/icons/blog.svg)Blog](https://www.liquid.ai/blog/lfm3)

LFM3-1.7B-GGUF

GGUF version of LFM3-1.7B for local inference on CPUs and GPUs.

Find architecture and usage details in the original model card.

How to run LFM3-1.7B

Recommended sampling: temperature 0.1, top_k 50, repeat penalty 1.1. For math and science: temperature 1.0, top_p 0.95, top_k 20.

  • Llama.app (Use this model > Llama in the menu), for macOS and Windows. Requires llama.cpp version v0.8.0 or newer.
  • LM Studio (Use this model > LM Studio in the menu), for macOS, Windows and Linux. Requires LM Studio with llama.cpp engine 2.65.1 or newer.
  • Ollama (ollama run lfm3), for macOS. Requires Ollama version v0.40.12 or newer.

Use with llama.cpp

[!NOTE] Supported in llama.cpp b11960 (v0.8.0) and newer.

Add a quantization tag to pick a file.

llama-cli -hf LiquidAI/LFM3-1.7B-GGUF:Q4_K_M \
  --temp 0.1 --top-k 50 --repeat-penalty 1.1

For math and science, use --temp 1.0 --top-p 0.95 --top-k 20 instead. More options in the llama.cpp guide.

QAD Q4_0 GGUF

The Q4_0 build in this repository is the Quantization-Aware Distillation (QAD) checkpoint, LFM3-1.7B-QAD-Q4_0.gguf. It was trained to recover the accuracy lost to Q4_0 quantization.

Example usage with llama.cpp:

llama-cli -hf LiquidAI/LFM3-1.7B-GGUF \
  --hf-file LFM3-1.7B-QAD-Q4_0.gguf \
  --temp 0.1 --top-k 50 --repeat-penalty 1.1

Derived on Oct 29, 2026 from Hugging Face at revision bad5729b, README.md .