Hybrid Mamba-2 + Transformer 2.94B LLM (Nemotron-H style) — Korean 3B model pretrained from scratch on 7× NVIDIA B200 GPUs with SFT + DPO alignment
-
Updated
Mar 26, 2026 - Python
#
mamba2
Here are 9 public repositories matching this topic...
Hybrid SSM-Attention language model on Apple Silicon with MLX — interleaving Mamba-2 and Transformer for efficient inference
python machine-learning deep-learning transformer attention language-model ssm mamba hybrid-model mlx state-space-model apple-silicon llm mamba2
-
Updated
Mar 29, 2026 - Python
A 390M-parameter Mamba2 + Differential Attention hybrid language model
nlp deep-learning language-model hybrid-architecture mamba2 differential-attention pytorch-state-space-model
-
Updated
May 8, 2026 - Python
VerDee: Vertical Deep Network on Mamba-2 — staged LoRA (shallow/mid/deep), early-exit routing, and domain experts. Pilot on 370M; 16GB GPU friendly. Research/experiment repo.
lora state-space-model peft early-exit huggingface qlora llm-finetuning mamba2 vertical-deep-network
-
Updated
May 25, 2026 - Python
GLACIER: Mamba with infinite memory. This project integrates the Mamba SSM with ICE-Lite, a virtual memory engine, to solve context rot. By adding persistent, time-aware memory, GLACIER gives Mamba the long-term recall of a Transformer while retaining its $O(N)$ speed. Apache 2.0 licensed, by Dopove.
python nlp ai deep-learning postgresql persistent-memory glacier ssm mamba state-space-model vector-database llm long-context context-memory memory-augmented transformer-alternative mamba2 context-rot ice-lite dopove
-
Updated
May 22, 2026 - Python
Build Your Own Mamba — From Math to Metal
-
Updated
Apr 22, 2026 - Python
A simple, minimalistic, and explainable JAX implementation of Mamba 2 & Mamba 3
deep-learning neural-network transformer mamba jax llm mamba-state-space-models mamba-2 mamba2 mamba-ssm mamba-3
-
Updated
May 10, 2026 - Python
Improve this page
Add a description, image, and links to the mamba2 topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mamba2 topic, visit your repo's landing page and select "manage topics."