I am trying to deploy a multi model endpoint on aws sagemaker. However some of my models have additional dependencies. I am following the huggingface's documentationon creating user-defined-code and requirements.
My zipped artifacts have a code directory with requirements.txt and yet when I deploy the model and try invoking it with the python aws sdk. I get ModuleNotFound errors during my imports.
I know its finding my inference.py file since its failing to find those modules that I import.
It should be noted that these models I am deploying are trained and made outside of sagemaker and I am trying to bring them into sagemaker.
The container image I am using is'763104351884.dkr.ecr.ca-central-1.amazonaws.com/huggingface-pytorch-inference:2.1.0-transformers4.37.0-cpu-py310-ubuntu22.04'