Skip to content

Commit

Permalink
update refact to refact_v0.6.6.post1_2339d59
Browse files Browse the repository at this point in the history
  • Loading branch information
mitya52 committed Jan 13, 2025
1 parent 02f6782 commit 7037075
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion Dockerfile.base
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ RUN pip install --no-cache-dir xformers==v0.0.28.post2
RUN pip install ninja
RUN pip install setuptools_scm
ENV CMAKE_ARGS="-DLLAMA_CUBLAS=on -DCMAKE_CUDA_ARCHITECTURES=60;61;70;75;80;86;89;90+PTX"
RUN pip install -v --no-build-isolation git+https://github.com/smallcloudai/vllm@refact_v0.6.3_2adb440
RUN pip install -v --no-build-isolation git+https://github.com/smallcloudai/vllm@refact_v0.6.6.post1_2339d59

# there is no prebuild auto-gptq with torch 2.5.0 support
ENV TORCH_CUDA_ARCH_LIST="6.0;6.1;7.0;7.5;8.0;8.6;8.9;9.0+PTX"
Expand Down

0 comments on commit 7037075

Please sign in to comment.