Skip to content

Open-source NPU (Neural Processing Unit) for LLM inference - runs GPT-2, LLaMA, Mistral, Qwen2

License

Notifications You must be signed in to change notification settings

hulohot/tiny-npu

Repository files navigation

Tiny NPU

A learning-focused SystemVerilog NPU prototype with Verilator-based regression tests.

GitHub Codespaces License: MIT

What is implemented today

Validated by CI/tests in sim/verilator:

  • RTL modules for MAC, systolic array, controller/memory/engines scaffolding
  • Verilator regression binaries:
    • test_mac_unit
    • test_systolic_array
    • test_npu_smoke
    • test_integration
    • test_gpt2_block
  • Deterministic output harness (make benchmark-deterministic)

What is roadmap (not yet production-complete)

  • Full end-to-end LLM inference fidelity/performance
  • Complete microcode/engine feature parity with architecture spec
  • FPGA timing/resource closure and hardware bring-up
  • Expanded lint/warning cleanup across all RTL modules

See docs/ARCHITECTURE.md and roadmap issues for details.

Quick Start

# Build simulation
cmake -S sim/verilator -B sim/verilator/build
cmake --build sim/verilator/build -j$(nproc)

# Run all tests
ctest --test-dir sim/verilator/build --output-on-failure

# Deterministic baseline harness
make benchmark-deterministic

CI

GitHub Actions runs three checks:

  • stable-regression
  • full-ctest
  • lint

Branch protection hardening guide: docs/CI_BRANCH_PROTECTION.md

Repository layout

tiny-npu/
├── rtl/                    # SystemVerilog RTL
├── sim/verilator/          # Verilator testbenches + CMake
├── python/                 # Model/data helper tooling
├── docs/                   # Architecture + process docs
├── benchmarks/             # Deterministic benchmark harness + baseline
└── .github/workflows/      # CI

Contributing

Read CONTRIBUTING.md before opening a PR.

License

MIT License - See LICENSE

About

Open-source NPU (Neural Processing Unit) for LLM inference - runs GPT-2, LLaMA, Mistral, Qwen2

Resources

License

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published