Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update python dependencies for neuronx 2.1.2 #4480

Merged
merged 36 commits into from
Jan 7, 2025
Merged
Changes from all commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
e254d09
Patch image CVEs
kc1998dp Dec 24, 2024
ba3da24
Update ['dlc_developer_config.toml']
kc1998dp Dec 24, 2024
21748a0
Revert "Update ['dlc_developer_config.toml']"
kc1998dp Dec 24, 2024
4e25d77
Merge branch 'aws:master' into master
kc1998dp Dec 27, 2024
eb64e33
Patch CVEs
kc1998dp Dec 27, 2024
bf2be3b
Update ['dlc_developer_config.toml']
kc1998dp Dec 27, 2024
2defc96
Revert "Update ['dlc_developer_config.toml']"
kc1998dp Dec 27, 2024
5a5d67c
Merge branch 'aws:master' into master
kc1998dp Dec 30, 2024
384dca4
patch CVE
kc1998dp Dec 30, 2024
752a58f
Update ['dlc_developer_config.toml']
kc1998dp Dec 30, 2024
12bbbdc
Revert "Update ['dlc_developer_config.toml']"
kc1998dp Dec 30, 2024
110413b
update python scan allowlist
kc1998dp Jan 6, 2025
0df86cf
Update ['dlc_developer_config.toml']
kc1998dp Jan 6, 2025
3fa270a
Merge branch 'aws:master' into master
kc1998dp Jan 6, 2025
6a0313f
add missing commas
kc1998dp Jan 6, 2025
5bf1783
pin boto3 version to working one for pinned awscli version
kc1998dp Jan 6, 2025
995f774
pin botocore version and revert previous commit
kc1998dp Jan 6, 2025
551305b
pin botocore version in test requirements.txt
kc1998dp Jan 6, 2025
c7456c6
fix equality sign for pinning botocore version from prev commit
kc1998dp Jan 6, 2025
505b3df
pin botocore version in src requirements.txt
kc1998dp Jan 6, 2025
a042197
pin botocore version to 1.35.19
kc1998dp Jan 6, 2025
0d1e0cd
pin botocore back to 1.34.94 bc it's required by awscli 1.32.94
kc1998dp Jan 6, 2025
b23aa00
remove version pinning and install botocore after boto3 with awscli t…
kc1998dp Jan 6, 2025
e624c3a
pin botocore to 1.35.19
kc1998dp Jan 6, 2025
db6cce7
pin botocore to 1.35.19 version
kc1998dp Jan 7, 2025
f5e222b
remove erroneous update to neuronx inference
kc1998dp Jan 7, 2025
3a176b0
revert py scan allowlist changes
kc1998dp Jan 7, 2025
f70e406
try updating Jinja2, mflow, and tornado
kc1998dp Jan 7, 2025
0cd3df1
fix typo in neuronx inf file
kc1998dp Jan 7, 2025
abe351f
fix neuronx py scan allowlist
kc1998dp Jan 7, 2025
515159c
pin googleauth and botocore versions
kc1998dp Jan 7, 2025
3681ac6
add missing '-' from google-auth dependency
kc1998dp Jan 7, 2025
f02da82
update tensorboard and add explicit updates for awscli, boto3, and bo…
kc1998dp Jan 7, 2025
25ee2a0
unpin google-auth version and let it auto-resolve
kc1998dp Jan 7, 2025
48ed2b7
Merge branch 'master' into master
kc1998dp Jan 7, 2025
e9451a8
Revert "Update ['dlc_developer_config.toml']"
kc1998dp Jan 7, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,6 @@ ARG OPTIMUM_NEURON_VERSION=0.0.25
ARG TRANSFORMERS_VERSION
ARG DATASETS_VERSION
ARG GEVENT_VERSION=24.10.3
ARG GAUTH_VERSION=1.35.0
ARG PYTHON=python3

# install Hugging Face libraries and its dependencies
Expand All @@ -24,16 +23,23 @@ RUN pip install --no-cache-dir \
datasets==${DATASETS_VERSION} \
optimum-neuron==${OPTIMUM_NEURON_VERSION} \
peft \
google-auth==${GAUTH_VERSION} \
gevent==${GEVENT_VERSION}

# Pin numpy to version required by neuronx-cc
# Update Pillow and urllib version to fix high and critical vulnerabilities
RUN pip install -U \
"tensorboard>=2.11.0" \
"numpy>=1.24.3,<=1.25.2" \
"numba==0.58.1" \
"Pillow==10.3.0" \
"requests<2.32.0" \
Jinja2 \
mlflow \
tornado \
"awscli<2" \
boto3 \
botocore \
google-auth \
"urllib3>=1.26.17,<1.27"

RUN apt-get update \
Expand Down
Loading