Skip to content

introduce g1u0 smoothquant int8 fused moe : fused_moe_gelu_sqi8#2730

Open
tingqli wants to merge 4 commits intoROCm:mainfrom
tingqli:moe-gelu-sqi8
Open

introduce g1u0 smoothquant int8 fused moe : fused_moe_gelu_sqi8#2730
tingqli wants to merge 4 commits intoROCm:mainfrom
tingqli:moe-gelu-sqi8

Conversation

@tingqli
Copy link
Copy Markdown

@tingqli tingqli commented Apr 14, 2026

Motivation

This PR adds a special implementation of fused_moe for BD: smoothquant INT8 g1u0 gelu

ticket: ROCM-21115

Technical Details

Test Plan

Test Result

Submission Checklist

Co-authored-by: luocheng25 <cheng.luo@amd.com>
@tingqli tingqli requested a review from a team April 14, 2026 06:40
@github-actions
Copy link
Copy Markdown
Contributor

🏷️ CI Guide

Runs automatically on every PR:

  • ✅ Pre-checks (submodule verification, code formatting)
  • ✅ Aiter op tests (gfx942 + gfx950)
  • ✅ Triton tests (only when aiter/ops/triton/** or related paths are changed)

Extended tests (opt-in via labels):

Label Tests
ci:triton-355 Run Triton tests on MI355 in addition to MI325
ci:sglang SGLang integration tests
ci:atom ATOM benchmark (DeepSeek-R1 + GPT-OSS)
ci:vllm vLLM benchmark
ci:all All of the above

Add labels via the sidebar or gh pr edit 2730 --add-label <label>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant