Skip to content

How to Integrate SCALE into Existing SGLang Containers for AMD MI308X Acceleration #50

Description

@Alan-D-Chen

Hi everyone, my name is Alan, a student from Tongji University.
I’ve gone through the official SCALE documentation at these links:

https://docs.scale-lang.com/1.7.1/manual/tutorials/how-to-install/
https://docs.scale-lang.com/1.7.1/contact/join-our-discord/
https://docs.scale-lang.com/1.7.1/manual/tutorials/how-to-use-with-docker/

Currently I have two SGLang Docker images for AMD MI308X hardware:
m.daocloud.io/docker.io/lmsysorg/sglang:v0.5.11-rocm720-mi30x
m.daocloud.io/docker.io/lmsysorg/sglang-rocm:v0.5.14-rocm720-mi30x-20260627

I’m reaching out to ask two key questions:
Inside containers created from the two SGLang images above, what step-by-step operations do I need to perform to install and activate SCALE for acceleration on AMD MI308X?
Are there any pre-built, ready-to-use complete Docker images of SGLang or vLLM that already come with SCALE fully integrated out of the box? If yes, could you share the image tags/pull links with me?

Thanks a lot for any guidance and resources you can provide!

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions