Skip to content

Conversation

@JannikSt
Copy link
Member

the current docker image does not seem to work on most of the machines without adjusting the underlying machine (which is not very useful for a decentralized use-case).

with the current image version primeintellect/genesys:commit-bc10edd the following error appears on the debug.conf:

/bin/sh: 1: /usr/local/cuda/bin/nvcc: not found

the current change solves this issue. I have pushed a sample to: jannikstprime/genesys:latest

@JannikSt JannikSt requested a review from samsja February 28, 2025 16:05
Copy link
Member

@samsja samsja left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm. Indeed we need devel for all the custom kernel in sglang

@samsja samsja merged commit 32e8ccc into main Feb 28, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants