Skip to content

Commit

Permalink
vLLM: Fix vLLM-CPU docker image (#12741)
Browse files Browse the repository at this point in the history
  • Loading branch information
xiangyuT authored Jan 24, 2025
1 parent 69f13c7 commit f924880
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docker/llm/serving/cpu/docker/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ RUN wget -qO /sbin/tini https://github.com/krallin/tini/releases/download/${TINI
cd ./vllm && \
git checkout v0.6.6.post1 && \
pip install cmake>=3.26 wheel packaging ninja "setuptools-scm>=8" numpy && \
pip uninstall intel-extension-for-pytorch && \
pip install -v -r requirements-cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu && \
VLLM_TARGET_DEVICE=cpu python3 setup.py install && \
pip install ray
Expand Down

0 comments on commit f924880

Please sign in to comment.