8000 [Issue]: Paged Attention Kernel Compilation Issue · Issue #577 · ROCm/aiter · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
[Issue]: Paged Attention Kernel Compilation Issue #577
Open
@tjtanaa

Description

@tjtanaa

Problem Description

Problem Description:

AITER commit: 7e32777

aiter/hsa/gfx942/pa/codegen.py line 13

Missing: #include <unordered_map>

Solution:

add

template = """// SPDX-License-Identifier: MIT
// Copyright (c) 2024, Advanced Micro Devices, Inc. All rights reserved.
#include <unordered_map>                                                    
#define ADD_CFG(q_type, kv_type, gqa, mtp, msk, hp, path, name, co)         \\
    {                                         \\
        name, { name, path co, q_type, kv_type, gqa, mtp, msk, hp }         \\
    }
…

Same changes are also needed in:

  • aiter/hsa/gfx942/fmoe_2stages/codegen.py
  • aiter/hsa/gfx942/pa/codegen.py
  • aiter/hsa/gfx950/fmoe_2stages/codegen.py

Run test_pa.py to verify build succeeds.

Operating System

Ubuntu 22.04.4 LTS (Jammy Jellyfish)

CPU

AMD EPYC 9474F 48-Core Processor

GPU

AMD Instinct MI300X

ROCm Version

ROCm 6.4

ROCm Component

No response

Steps to Reproduce

No response

(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support

No response

Additional Information

No response

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

    0