Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Unable to run ai_unetr_seg_app due to missing traced model #511

Open
kavmar opened this issue Jan 6, 2025 · 1 comment
Open

[BUG] Unable to run ai_unetr_seg_app due to missing traced model #511

kavmar opened this issue Jan 6, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@kavmar
Copy link

kavmar commented Jan 6, 2025

Hi,

it is not possible to run the ai_unetr_seg_app example, because provided model is not traced. When I get the model from Model Zoo large_files.yml:

"https://developer.download.nvidia.com/assets/Clara/monai/tutorials/model_zoo/model_swin_unetr_btcv_segmentation_v1.pt"

I am hitting an exception:

monai.deploy.exceptions.ItemNotExistsError: A predictor of the model is not set.

Please kindly provide a TorchScript model to test the application.

Thanks

@kavmar kavmar added the bug Something isn't working label Jan 6, 2025
@MMelQin
Copy link
Collaborator

MMelQin commented Jan 6, 2025

This example app is fairly old now, I recall there was an issue when scripting/tracing the model and maybe the reason why a TorchScript model file is no in the MONAI Model Zoo.

We have two options:

  • Try to trace/script the model again
  • Create a custom inference operator based off of the base class, and explicitly loads up the Torch model in the application code (the built-in Model Factory is limited to loading the TrochScript models and model folder for the Triton Inference service)

Loading Torch model is straightforward, and I will look to expand the supported Model format in the Model Factory.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants