Rust-native MoE inference runtime with custom CUDA kernels for Blackwell GPUs. Includes DFlash speculative decoding, multi-tier Engram memory, and entropy-adaptive routing. Targets Qwen3.5-35B-A3B on a single RTX 5060 Ti 16GB.

Hybrid Mamba-2 + Transformer 2.94B LLM (Nemotron-H style) — Korean 3B model pretrained from scratch on 7× NVIDIA B200 GPUs with SFT + DPO alignment

Hybrid SSM-Attention language model on Apple Silicon with MLX — interleaving Mamba-2 and Transformer for efficient inference

[RWKV6/mamba2(parallel fusion)] SSM

This is a complete testing and construction project for a recurrent small-parameter language model based on the Mamba2 architecture.这是一个完整的基于mamba2架构的循环小参数语言模型的测试与构建项目.And it try to be built with a Mano Optimiters.Mano is a new Optimister

A 390M-parameter Mamba2 + Differential Attention hybrid language model

GLACIER: Mamba with infinite memory. This project integrates the Mamba SSM with ICE-Lite, a virtual memory engine, to solve context rot. By adding persistent, time-aware memory, GLACIER gives Mamba the long-term recall of a Transformer while retaining its $O(N)$ speed. Apache 2.0 licensed, by Dopove.

Build Your Own Mamba — From Math to Metal

llama.cpp fork with additional SOTA quants and improved performance

A research notebook on competing sequence modeling paradigms: implement, benchmark, and understand the architectural bets.

A simple, minimalistic, and explainable JAX implementation of Mamba 2 & Mamba 3

Runs a Rust inference server for hybrid State-Space and MoE language models with fast GPU throughput on consumer hardware