Skip to content

Issues: aws/sagemaker-pytorch-inference-toolkit

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

25 Open 12 Closed
25 Open 12 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Zombie process exception
#165 opened May 29, 2024 by 5agado
4
ModuleNotFoundError: Sagemaker only copies entry_point file to /opt/ml/code/ instead of the holy-cloned source code
#156 opened Oct 15, 2023 by celsofranssa
Documentation for inference.py transform_fn
#142 opened Mar 22, 2023 by david-waterworth
Incorrect reporting of memory utilisation
#141 opened Mar 22, 2023 by david-waterworth
Prepend code_dir to sys.path rather than append
#137 opened Feb 17, 2023 by davidthomas426
Specify batch size for MME
#134 opened Nov 23, 2022 by austinmw
[Question] Using model.mar with built-in handler script
#133 opened Nov 22, 2022 by austinmw
Is this Dockerfile compatible with sagemaker elastic inference
#128 opened Sep 3, 2022 by fymaterials98
how to use gpu in sagemaker instance
#126 opened May 31, 2022 by haiderasad
1
using cuda enabled pytorch image
#125 opened May 31, 2022 by haiderasad
Document how to locally run the container
#124 opened May 25, 2022 by ManuelVs
2
add environment variable "OMP_NUM_THREADS"
#123 opened May 20, 2022 by lxning
Batch Inference does not work when using the default handler
#121 opened May 11, 2022 by nikhil-sk
Launch TorchServe without repackaging model contents
#117 opened Mar 15, 2022 by fm1ch4
5
Need for a minimum reproducible example in readme.md
#113 opened Nov 22, 2021 by mohamed-ali
Serving a model using custom container, instance run of disk
#112 opened Nov 19, 2021 by HamidShojanazeri
4
How do I access Custom Attributes from the model during inference?
#111 opened Nov 5, 2021 by bml1g12
1
MultiDataModel fails at installing requirements.txt
#105 opened Jul 23, 2021 by EliasWiegandt
Support Elastic Inference for PyTorch 1.5.1
#101 opened May 28, 2021 by TheissHe
JVM detect the CPU count as 1 when more CPUs are available for the container.
#99 opened Apr 23, 2021 by zoran-hristov
3
MultiDataModel error during prediction: Please provide a model_fn implementation.
#92 opened Feb 2, 2021 by pashasensi
1
Endpoint dependencies error
#91 opened Jan 31, 2021 by rodrigoheck
1
renaming of mxnet-model-server in sagemaker-inference package 1.5.3 causing entrypoint with command serve to fail type: bug
#88 opened Dec 4, 2020 by RZachLamberty
1
BERT model loading not working with pytorch 1.3.1-eia container type: question
#87 opened Nov 29, 2020 by rucha3
6
Cannot change the CloudWatch log level contributions welcome type: enhancement
#83 opened Aug 31, 2020 by oonisim
6
ProTip! Follow long discussions with comments:>50.