Sample failing for SD 15 runway version 4

[zebraben]

Operating System

Windows

Version Information

azure ml
runwayml-stable-diffusion-v1-5
version 4

Steps to reproduce

I m trying to run the sample : https://ml.azure.com/models/runwayml-stable-diffusion-v1-5/version/4/catalog/registry/azureml?wsid=/subscriptions/7b07e1b7-2db4-4efa-960a-a6bdae9ac3a0/resourceGroups/zebra-ml/providers/Microsoft.MachineLearningServices/workspaces/zebra-ml&tid=16532403-b132-4712-aec2-0955d08dbc1a#overview

using version 4 of model runwayml-stable-diffusion-v1-5 as I only have Standard_NC8as_T4_v3 machines

but it is failing when trying to deploy it.

Expected behavior

model deployed

Actual behavior

got his error when deploying the model:

Instance status:
SystemSetup: Succeeded
UserContainerImagePull: Succeeded
ModelDownload: Succeeded
UserContainerStart: InProgress

Container events:
Kind: Pod, Name: LivenessProbeFailed, Type: Warning, Time: 2024-11-12T13:55:18.532067Z, Message: Liveness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: ReadinessProbeFailed, Type: Warning, Time: 2024-11-12T13:55:20.601054Z, Message: Readiness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: LivenessProbeFailed, Type: Warning, Time: 2024-11-12T13:55:28.532007Z, Message: Liveness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: ReadinessProbeFailed, Type: Warning, Time: 2024-11-12T13:55:30.419036Z, Message: Readiness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: LivenessProbeFailed, Type: Warning, Time: 2024-11-12T13:55:38.531969Z, Message: Liveness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: ReadinessProbeFailed, Type: Warning, Time: 2024-11-12T13:55:40.418949Z, Message: Readiness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: LivenessProbeFailed, Type: Warning, Time: 2024-11-12T13:55:48.532033Z, Message: Liveness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: ReadinessProbeFailed, Type: Warning, Time: 2024-11-12T13:55:50.419015Z, Message: Readiness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: LivenessProbeFailed, Type: Warning, Time: 2024-11-12T13:55:58.532062Z, Message: Liveness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: ReadinessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:00.418994Z, Message: Readiness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: LivenessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:08.532045Z, Message: Liveness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: ReadinessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:10.419008Z, Message: Readiness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: LivenessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:18.532038Z, Message: Liveness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: ReadinessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:20.419054Z, Message: Readiness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: LivenessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:28.532Z, Message: Liveness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: ReadinessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:30.418975Z, Message: Readiness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: LivenessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:38.532059Z, Message: Liveness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: ReadinessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:40.418861Z, Message: Readiness probe failed: HTTP probe failed with statuscode: 502
Kind: Pod, Name: LivenessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:48.531599Z, Message: Liveness probe failed: Get http://10.66.0.2:5001/: dial tcp 10.66.0.2:5001: connect: connection refused
Kind: Pod, Name: ReadinessProbeFailed, Type: Warning, Time: 2024-11-12T13:56:50.418679Z, Message: Readiness probe failed: Get http://10.66.0.2:5001/: dial tcp 10.66.0.2:5001: connect: connection refused

Container logs:
2024-11-12T13:54:38,142544407+00:00 - rsyslog/run
2024-11-12T13:54:38,143725197+00:00 - nginx/run
nginx: [warn] the "user" directive makes sense only if the master process runs with super-user privileges, ignored in /etc/nginx/nginx.conf:1
2024-11-12T13:54:38,147950701+00:00 - gunicorn/run
2024-11-12T13:54:38,149515344+00:00 | gunicorn/run |
2024-11-12T13:54:38,151072759+00:00 | gunicorn/run | ###############################################
2024-11-12T13:54:38,152527844+00:00 | gunicorn/run | AzureML Container Runtime Information
2024-11-12T13:54:38,154184566+00:00 | gunicorn/run | ###############################################
2024-11-12T13:54:38,155649847+00:00 | gunicorn/run |
2024-11-12T13:54:38,157333244+00:00 | gunicorn/run |
2024-11-12T13:54:38,160292517+00:00 | gunicorn/run | AzureML image information: mlflow-ubuntu20.04-py38-cpu-inference:20241003.v1
2024-11-12T13:54:38,161766234+00:00 | gunicorn/run |
2024-11-12T13:54:38,163297298+00:00 | gunicorn/run |
2024-11-12T13:54:38,164778960+00:00 | gunicorn/run | PATH environment variable: /opt/miniconda/envs/amlenv/bin:/opt/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-11-12T13:54:38,166288867+00:00 | gunicorn/run | PYTHONPATH environment variable:
2024-11-12T13:54:38,167773069+00:00 | gunicorn/run |
2024-11-12T13:54:39,223496014+00:00 | gunicorn/run | CONDAPATH environment variable: /opt/miniconda

/opt/miniconda/lib/python3.9/site-packages/conda/base/context.py:982: FutureWarning: Adding 'defaults' to the channel list implicitly is deprecated and will be removed in 25.3.

To remove this warning, please choose a default channel explicitly via 'conda config --add channels ', e.g. 'conda config --add channels defaults'.
deprecated.topic(

conda environments:

base /opt/miniconda
amlenv /opt/miniconda/envs/amlenv

2024-11-12T13:54:39,991428523+00:00 | gunicorn/run |
2024-11-12T13:54:39,992968990+00:00 | gunicorn/run | Pip Dependencies (before dynamic installation)

annotated-types==0.7.0
azure-core==1.31.0
azure-identity==1.18.0
azureml-inference-server-http==1.3.2
blinker==1.8.2
cachetools==5.5.0
certifi==2024.8.30
cffi==1.17.1
charset-normalizer==3.3.2
click==8.1.7
cryptography==43.0.1
Flask==2.3.2
Flask-Cors==4.0.2
google-api-core==2.20.0
google-auth==2.35.0
googleapis-common-protos==1.65.0
gunicorn==22.0.0
idna==3.10
importlib_metadata==8.5.0
inference-schema==1.8
itsdangerous==2.2.0
Jinja2==3.1.4
MarkupSafe==2.1.5
msal==1.31.0
msal-extensions==1.2.0
opencensus==0.11.4
opencensus-context==0.1.3
opencensus-ext-azure==1.1.13
packaging==24.1
portalocker==2.10.1
proto-plus==1.24.0
protobuf==5.28.2
psutil==6.0.0
pyasn1==0.6.1
pyasn1_modules==0.4.1
pycparser==2.22
pydantic==2.7.4
pydantic-settings==2.5.2
pydantic_core==2.18.4
PyJWT==2.9.0
python-dateutil==2.9.0.post0
python-dotenv==1.0.1
pytz==2024.2
requests==2.32.3
rsa==4.9
six==1.16.0
typing_extensions==4.12.2
urllib3==2.2.3
Werkzeug==3.0.4
wrapt==1.16.0
zipp==3.20.2

2024-11-12T13:54:41,017286928+00:00 | gunicorn/run |
2024-11-12T13:54:41,018843155+00:00 | gunicorn/run | Entry script directory: /var/mlflow_resources/.
2024-11-12T13:54:41,020356529+00:00 | gunicorn/run |
2024-11-12T13:54:41,021914960+00:00 | gunicorn/run | ###############################################
2024-11-12T13:54:41,023486086+00:00 | gunicorn/run | Dynamic Python Package Installation
2024-11-12T13:54:41,024994971+00:00 | gunicorn/run | ###############################################
2024-11-12T13:54:41,026516245+00:00 | gunicorn/run |
2024-11-12T13:54:41,028293289+00:00 | gunicorn/run | Updating conda environment from /var/azureml-app/azureml-models/runwayml-stable-diffusion-v1-5/4/mlflow_model_folder/conda.yaml !
/opt/miniconda/lib/python3.9/argparse.py:1935: FutureWarning: remote_definition is deprecated and will be removed in 25.9. Use conda env create --file=URL instead.
action(self, namespace, argument_values, option_string)
/opt/miniconda/lib/python3.9/site-packages/conda/base/context.py:982: FutureWarning: Adding 'defaults' to the channel list implicitly is deprecated and will be removed in 25.3.

To remove this warning, please choose a default channel explicitly via 'conda config --add channels ', e.g. 'conda config --add channels defaults'.
deprecated.topic(
Retrieving notices: ...working... done
/opt/miniconda/lib/python3.9/site-packages/conda/base/context.py:982: FutureWarning: Adding 'defaults' to the channel list implicitly is deprecated and will be removed in 25.3.

To remove this warning, please choose a default channel explicitly via 'conda config --add channels ', e.g. 'conda config --add channels defaults'.
deprecated.topic(
Channels:

• anaconda
• pytorch
• conda-forge
• defaults
  Platform: linux-64
  Collecting package metadata (repodata.json): ...working... done
  Solving environment: ...working... done

==> WARNING: A newer version of conda exists. <==
current version: 24.9.1
latest version: 24.9.2

Please update conda by running

$ conda update -n base -c conda-forge conda

Downloading and Extracting Packages: ...working... done
Preparing transaction: ...working... done
Verifying transaction: ...working... done
Executing transaction: ...working... done
Installing pip dependencies: ...working... Ran pip subprocess with arguments:
['/opt/miniconda/envs/userenv/bin/python', '-m', 'pip', 'install', '-U', '-r', '/tmp/condaenv.8uj0f1gw.requirements.txt', '--exists-action=b']
Pip subprocess output:
Collecting mlflow==2.6.0
Downloading mlflow-2.6.0-py3-none-any.whl (18.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18.3/18.3 MB 77.2 MB/s eta 0:00:00
Collecting torch==1.13.1
Downloading torch-1.13.1-cp38-cp38-manylinux1_x86_64.whl (887.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 887.4/887.4 MB 2.4 MB/s eta 0:00:00
Collecting transformers==4.33.2
Downloading transformers-4.33.2-py3-none-any.whl (7.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.6/7.6 MB 107.2 MB/s eta 0:00:00
Collecting diffusers==0.20.0
Downloading diffusers-0.20.0-py3-none-any.whl (1.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 98.1 MB/s eta 0:00:00
Collecting accelerate==0.22.0
Downloading accelerate-0.22.0-py3-none-any.whl (251 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 251.2/251.2 kB 67.5 MB/s eta 0:00:00
Collecting azure-ai-mlmonitoring
Downloading azure_ai_mlmonitoring-0.1.0a3-py3-none-any.whl (17 kB)
Collecting azure-identity==1.13.0
Downloading azure_identity-1.13.0-py3-none-any.whl (151 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.6/151.6 kB 51.5 MB/s eta 0:00:00
Collecting azure-mgmt-cognitiveservices==13.4.0
Downloading azure_mgmt_cognitiveservices-13.4.0-py3-none-any.whl (134 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 134.1/134.1 kB 51.7 MB/s eta 0:00:00
Collecting azure-ai-contentsafety==1.0.0b1
Downloading azure_ai_contentsafety-1.0.0b1-py3-none-any.whl (57 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.6/57.6 kB 24.9 MB/s eta 0:00:00
Collecting aiolimiter
Downloading aiolimiter-1.1.0-py3-none-any.whl (7.2 kB)
Collecting pyarrow<13,>=4.0.0
Downloading pyarrow-12.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (39.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 39.0/39.0 MB 53.9 MB/s eta 0:00:00
Collecting scikit-learn<2
Downloading scikit_learn-1.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.1/11.1 MB 82.5 MB/s eta 0:00:00
Collecting markdown<4,>=3.3
Downloading Markdown-3.7-py3-none-any.whl (106 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 106.3/106.3 kB 41.9 MB/s eta 0:00:00
Collecting sqlalchemy<3,>=1.4.0
Downloading SQLAlchemy-2.0.36-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 108.4 MB/s eta 0:00:00
Collecting databricks-cli<1,>=0.8.7
Downloading databricks_cli-0.18.0-py2.py3-none-any.whl (150 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 150.3/150.3 kB 54.8 MB/s eta 0:00:00
Collecting scipy<2
Downloading scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34.5/34.5 MB 63.0 MB/s eta 0:00:00
Collecting alembic!=1.10.0,<2
Downloading alembic-1.14.0-py3-none-any.whl (233 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 233.5/233.5 kB 64.9 MB/s eta 0:00:00
Collecting entrypoints<1
Downloading entrypoints-0.4-py3-none-any.whl (5.3 kB)
Collecting docker<7,>=4.0.0
Downloading docker-6.1.3-py3-none-any.whl (148 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 148.1/148.1 kB 50.4 MB/s eta 0:00:00
Collecting importlib-metadata!=4.7.0,<7,>=3.7.0
Downloading importlib_metadata-6.11.0-py3-none-any.whl (23 kB)
Collecting sqlparse<1,>=0.4.0
Downloading sqlparse-0.5.1-py3-none-any.whl (44 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.2/44.2 kB 19.5 MB/s eta 0:00:00
Collecting requests<3,>=2.17.3
Downloading requests-2.32.3-py3-none-any.whl (64 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.9/64.9 kB 26.3 MB/s eta 0:00:00
Collecting Jinja2<4,>=2.11
Downloading jinja2-3.1.4-py3-none-any.whl (133 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.3/133.3 kB 49.0 MB/s eta 0:00:00
Collecting matplotlib<4
Downloading matplotlib-3.7.5-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (9.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.2/9.2 MB 114.0 MB/s eta 0:00:00
Collecting protobuf<5,>=3.12.0
Downloading protobuf-4.25.5-cp37-abi3-manylinux2014_x86_64.whl (294 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 294.6/294.6 kB 70.8 MB/s eta 0:00:00
Collecting pandas<3
Downloading pandas-2.0.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.4/12.4 MB 109.3 MB/s eta 0:00:00
Collecting gunicorn<22
Downloading gunicorn-21.2.0-py3-none-any.whl (80 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80.2/80.2 kB 27.3 MB/s eta 0:00:00
Collecting packaging<24
Downloading packaging-23.2-py3-none-any.whl (53 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53.0/53.0 kB 23.4 MB/s eta 0:00:00
Collecting Flask<3
Downloading flask-2.3.3-py3-none-any.whl (96 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 96.1/96.1 kB 39.0 MB/s eta 0:00:00
Collecting numpy<2
Downloading numpy-1.24.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 9.7 MB/s eta 0:00:00
Collecting click<9,>=7.0
Downloading click-8.1.7-py3-none-any.whl (97 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 177.9 kB/s eta 0:00:00
Collecting pyyaml<7,>=5.1
Downloading PyYAML-6.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (746 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 746.5/746.5 kB 93.7 MB/s eta 0:00:00
Collecting querystring-parser<2
Downloading querystring_parser-1.2.4-py2.py3-none-any.whl (7.9 kB)
Collecting gitpython<4,>=2.1.0
Downloading GitPython-3.1.43-py3-none-any.whl (207 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 207.3/207.3 kB 61.3 MB/s eta 0:00:00
Collecting pytz<2024
Downloading pytz-2023.4-py2.py3-none-any.whl (506 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 506.5/506.5 kB 86.3 MB/s eta 0:00:00
Collecting cloudpickle<3
Downloading cloudpickle-2.2.1-py3-none-any.whl (25 kB)
Collecting nvidia-cudnn-cu11==8.5.0.96
Downloading nvidia_cudnn_cu11-8.5.0.96-2-py3-none-manylinux1_x86_64.whl (557.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 557.1/557.1 MB 2.9 MB/s eta 0:00:00
Collecting nvidia-cuda-nvrtc-cu11==11.7.99
Downloading nvidia_cuda_nvrtc_cu11-11.7.99-2-py3-none-manylinux1_x86_64.whl (21.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21.0/21.0 MB 90.7 MB/s eta 0:00:00
Collecting nvidia-cuda-runtime-cu11==11.7.99
Downloading nvidia_cuda_runtime_cu11-11.7.99-py3-none-manylinux1_x86_64.whl (849 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 849.3/849.3 kB 96.5 MB/s eta 0:00:00
Collecting nvidia-cublas-cu11==11.10.3.66
Downloading nvidia_cublas_cu11-11.10.3.66-py3-none-manylinux1_x86_64.whl (317.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 317.1/317.1 MB 7.1 MB/s eta 0:00:00
Collecting typing-extensions
Downloading typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Collecting regex!=2019.12.17
Downloading regex-2024.11.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 785.1/785.1 kB 93.2 MB/s eta 0:00:00
Collecting huggingface-hub<1.0,>=0.15.1
Downloading huggingface_hub-0.26.2-py3-none-any.whl (447 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 447.5/447.5 kB 80.5 MB/s eta 0:00:00
Collecting safetensors>=0.3.1
Downloading safetensors-0.4.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (436 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 436.1/436.1 kB 82.7 MB/s eta 0:00:00
Collecting filelock
Downloading filelock-3.16.1-py3-none-any.whl (16 kB)
Collecting tokenizers!=0.11.3,<0.14,>=0.11.1
Downloading tokenizers-0.13.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.8/7.8 MB 114.2 MB/s eta 0:00:00
Collecting tqdm>=4.27
Downloading tqdm-4.67.0-py3-none-any.whl (78 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.6/78.6 kB 33.1 MB/s eta 0:00:00
Collecting Pillow
Downloading pillow-10.4.0-cp38-cp38-manylinux_2_28_x86_64.whl (4.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 111.8 MB/s eta 0:00:00
Collecting psutil
Downloading psutil-6.1.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (287 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 287.3/287.3 kB 71.9 MB/s eta 0:00:00
Collecting six>=1.12.0
Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting msal<2.0.0,>=1.20.0
Downloading msal-1.31.0-py3-none-any.whl (113 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 113.1/113.1 kB 46.1 MB/s eta 0:00:00
Collecting cryptography>=2.5
Downloading cryptography-43.0.3-cp37-abi3-manylinux_2_28_x86_64.whl (4.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.0/4.0 MB 112.5 MB/s eta 0:00:00
Collecting msal-extensions<2.0.0,>=0.3.0
Downloading msal_extensions-1.2.0-py3-none-any.whl (19 kB)
Collecting azure-core<2.0.0,>=1.11.0
Downloading azure_core-1.32.0-py3-none-any.whl (198 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 198.9/198.9 kB 64.2 MB/s eta 0:00:00
Collecting azure-mgmt-core<2.0.0,>=1.3.2
Downloading azure_mgmt_core-1.5.0-py3-none-any.whl (30 kB)
Collecting azure-common~=1.1
Downloading azure_common-1.1.28-py2.py3-none-any.whl (14 kB)
Collecting msrest>=0.7.1
Downloading msrest-0.7.1-py3-none-any.whl (85 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85.4/85.4 kB 38.0 MB/s eta 0:00:00
Collecting isodate<1.0.0,>=0.6.1
Downloading isodate-0.7.2-py3-none-any.whl (22 kB)
Requirement already satisfied: setuptools in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch==1.13.1->-r /tmp/condaenv.8uj0f1gw.requirements.txt (line 2)) (75.1.0)
Requirement already satisfied: wheel in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch==1.13.1->-r /tmp/condaenv.8uj0f1gw.requirements.txt (line 2)) (0.44.0)
Collecting requests<3,>=2.17.3
Downloading requests-2.28.1-py3-none-any.whl (62 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.8/62.8 kB 27.3 MB/s eta 0:00:00
Collecting charset-normalizer<3,>=2
Downloading charset_normalizer-2.1.1-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Downloading idna-3.10-py3-none-any.whl (70 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 70.4/70.4 kB 33.5 MB/s eta 0:00:00
Collecting urllib3<1.27,>=1.21.1
Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 144.2/144.2 kB 53.7 MB/s eta 0:00:00
Collecting certifi>=2017.4.17
Downloading certifi-2024.8.30-py3-none-any.whl (167 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 167.3/167.3 kB 58.0 MB/s eta 0:00:00
Collecting Mako
Downloading Mako-1.3.6-py3-none-any.whl (78 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.6/78.6 kB 35.0 MB/s eta 0:00:00
Collecting importlib-resources
Downloading importlib_resources-6.4.5-py3-none-any.whl (36 kB)
Collecting cffi>=1.12
Downloading cffi-1.17.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (446 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 446.5/446.5 kB 82.6 MB/s eta 0:00:00
Collecting tabulate>=0.7.7
Downloading tabulate-0.9.0-py3-none-any.whl (35 kB)
Collecting pyjwt>=1.7.0
Downloading PyJWT-2.9.0-py3-none-any.whl (22 kB)
Collecting oauthlib>=3.1.0
Downloading oauthlib-3.2.2-py3-none-any.whl (151 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.7/151.7 kB 54.3 MB/s eta 0:00:00
Collecting websocket-client>=0.32.0
Downloading websocket_client-1.8.0-py3-none-any.whl (58 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.8/58.8 kB 28.2 MB/s eta 0:00:00
Collecting Werkzeug>=2.3.7
Downloading werkzeug-3.0.6-py3-none-any.whl (227 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 228.0/228.0 kB 68.1 MB/s eta 0:00:00
Collecting blinker>=1.6.2
Downloading blinker-1.8.2-py3-none-any.whl (9.5 kB)
Collecting itsdangerous>=2.1.2
Downloading itsdangerous-2.2.0-py3-none-any.whl (16 kB)
Collecting gitdb<5,>=4.0.1
Downloading gitdb-4.0.11-py3-none-any.whl (62 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.7/62.7 kB 29.3 MB/s eta 0:00:00
Collecting fsspec>=2023.5.0
Downloading fsspec-2024.10.0-py3-none-any.whl (179 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 179.6/179.6 kB 51.3 MB/s eta 0:00:00
Collecting zipp>=0.5
Downloading zipp-3.20.2-py3-none-any.whl (9.2 kB)
Collecting MarkupSafe>=2.0
Downloading MarkupSafe-2.1.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (26 kB)
Collecting pyparsing>=2.3.1
Downloading pyparsing-3.1.4-py3-none-any.whl (104 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.1/104.1 kB 42.0 MB/s eta 0:00:00
Collecting python-dateutil>=2.7
Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 229.9/229.9 kB 69.0 MB/s eta 0:00:00
Collecting kiwisolver>=1.0.1
Downloading kiwisolver-1.4.7-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 92.4 MB/s eta 0:00:00
Collecting contourpy>=1.0.1
Downloading contourpy-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (301 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 301.1/301.1 kB 71.4 MB/s eta 0:00:00
Collecting fonttools>=4.22.0
Downloading fonttools-4.54.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.7/4.7 MB 101.2 MB/s eta 0:00:00
Collecting cycler>=0.10
Downloading cycler-0.12.1-py3-none-any.whl (8.3 kB)
Collecting portalocker<3,>=1.4
Downloading portalocker-2.10.1-py3-none-any.whl (18 kB)
Collecting requests-oauthlib>=0.5.0
Downloading requests_oauthlib-2.0.0-py2.py3-none-any.whl (24 kB)
Collecting tzdata>=2022.1
Downloading tzdata-2024.2-py2.py3-none-any.whl (346 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 346.6/346.6 kB 78.3 MB/s eta 0:00:00
Collecting joblib>=1.1.1
Downloading joblib-1.4.2-py3-none-any.whl (301 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 301.8/301.8 kB 75.0 MB/s eta 0:00:00
Collecting threadpoolctl>=2.0.0
Downloading threadpoolctl-3.5.0-py3-none-any.whl (18 kB)
Collecting greenlet!=0.4.17
Downloading greenlet-3.1.1-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (605 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 606.0/606.0 kB 86.7 MB/s eta 0:00:00
Collecting pycparser
Downloading pycparser-2.22-py3-none-any.whl (117 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.6/117.6 kB 48.2 MB/s eta 0:00:00
Collecting smmap<6,>=3.0.1
Downloading smmap-5.0.1-py3-none-any.whl (24 kB)
Installing collected packages: tokenizers, pytz, azure-common, zipp, websocket-client, urllib3, tzdata, typing-extensions, tqdm, threadpoolctl, tabulate, sqlparse, smmap, six, safetensors, regex, pyyaml, pyparsing, pyjwt, pycparser, psutil, protobuf, portalocker, Pillow, packaging, oauthlib, nvidia-cuda-runtime-cu11, nvidia-cuda-nvrtc-cu11, nvidia-cublas-cu11, numpy, MarkupSafe, kiwisolver, joblib, itsdangerous, isodate, idna, greenlet, fsspec, fonttools, filelock, entrypoints, cycler, cloudpickle, click, charset-normalizer, certifi, blinker, aiolimiter, Werkzeug, sqlalchemy, scipy, requests, querystring-parser, python-dateutil, pyarrow, nvidia-cudnn-cu11, Mako, Jinja2, importlib-resources, importlib-metadata, gunicorn, gitdb, contourpy, cffi, torch, scikit-learn, requests-oauthlib, pandas, matplotlib, markdown, huggingface-hub, gitpython, Flask, docker, databricks-cli, cryptography, azure-core, azure-ai-mlmonitoring, alembic, transformers, msrest, mlflow, diffusers, azure-mgmt-core, azure-ai-contentsafety, accelerate, msal, azure-mgmt-cognitiveservices, msal-extensions, azure-identity
Successfully installed Flask-2.3.3 Jinja2-3.1.4 Mako-1.3.6 MarkupSafe-2.1.5 Pillow-10.4.0 Werkzeug-3.0.6 accelerate-0.22.0 aiolimiter-1.1.0 alembic-1.14.0 azure-ai-contentsafety-1.0.0b1 azure-ai-mlmonitoring-0.1.0a3 azure-common-1.1.28 azure-core-1.32.0 azure-identity-1.13.0 azure-mgmt-cognitiveservices-13.4.0 azure-mgmt-core-1.5.0 blinker-1.8.2 certifi-2024.8.30 cffi-1.17.1 charset-normalizer-2.1.1 click-8.1.7 cloudpickle-2.2.1 contourpy-1.1.1 cryptography-43.0.3 cycler-0.12.1 databricks-cli-0.18.0 diffusers-0.20.0 docker-6.1.3 entrypoints-0.4 filelock-3.16.1 fonttools-4.54.1 fsspec-2024.10.0 gitdb-4.0.11 gitpython-3.1.43 greenlet-3.1.1 gunicorn-21.2.0 huggingface-hub-0.26.2 idna-3.10 importlib-metadata-6.11.0 importlib-resources-6.4.5 isodate-0.7.2 itsdangerous-2.2.0 joblib-1.4.2 kiwisolver-1.4.7 markdown-3.7 matplotlib-3.7.5 mlflow-2.6.0 msal-1.31.0 msal-extensions-1.2.0 msrest-0.7.1 numpy-1.24.4 nvidia-cublas-cu11-11.10.3.66 nvidia-cuda-nvrtc-cu11-11.7.99 nvidia-cuda-runtime-cu11-11.7.99 nvidia-cudnn-cu11-8.5.0.96 oauthlib-3.2.2 packaging-23.2 pandas-2.0.3 portalocker-2.10.1 protobuf-4.25.5 psutil-6.1.0 pyarrow-12.0.1 pycparser-2.22 pyjwt-2.9.0 pyparsing-3.1.4 python-dateutil-2.9.0.post0 pytz-2023.4 pyyaml-6.0.2 querystring-parser-1.2.4 regex-2024.11.6 requests-2.28.1 requests-oauthlib-2.0.0 safetensors-0.4.5 scikit-learn-1.3.2 scipy-1.10.1 six-1.16.0 smmap-5.0.1 sqlalchemy-2.0.36 sqlparse-0.5.1 tabulate-0.9.0 threadpoolctl-3.5.0 tokenizers-0.13.3 torch-1.13.1 tqdm-4.67.0 transformers-4.33.2 typing-extensions-4.12.2 tzdata-2024.2 urllib3-1.26.20 websocket-client-1.8.0 zipp-3.20.2

done

To activate this environment, use

$ conda activate userenv

To deactivate an active environment, use

$ conda deactivate

WARNING: Package(s) not found: azureml-inference-server-http
2024-11-12T13:56:39,385402466+00:00 | gunicorn/run | Install azureml-inference-server-http version 1.3.2
Collecting azureml-inference-server-http==1.3.2
Downloading azureml_inference_server_http-1.3.2-py3-none-any.whl (42 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42.7/42.7 kB 2.8 MB/s eta 0:00:00
Collecting pydantic-settings
Downloading pydantic_settings-2.6.1-py3-none-any.whl (28 kB)
Collecting opencensus-ext-azure~=1.1.0
Downloading opencensus_ext_azure-1.1.13-py2.py3-none-any.whl (43 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.4/43.4 kB 10.7 MB/s eta 0:00:00
Requirement already satisfied: certifi>=2024.7.4 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from azureml-inference-server-http==1.3.2) (2024.8.30)
Collecting flask<=2.3.2
Downloading Flask-2.3.2-py3-none-any.whl (96 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 96.9/96.9 kB 11.2 MB/s eta 0:00:00
Collecting inference-schema~=1.8.0
Downloading inference_schema-1.8-py3-none-any.whl (21 kB)
Requirement already satisfied: werkzeug>=3.0.3 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from azureml-inference-server-http==1.3.2) (3.0.6)
Collecting gunicorn==22.0.0
Downloading gunicorn-22.0.0-py3-none-any.whl (84 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84.4/84.4 kB 28.4 MB/s eta 0:00:00
Collecting flask-cors~=4.0.1
Downloading Flask_Cors-4.0.2-py2.py3-none-any.whl (14 kB)
Collecting pydantic~=2.7.1
Downloading pydantic-2.7.4-py3-none-any.whl (409 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 409.0/409.0 kB 24.3 MB/s eta 0:00:00
Requirement already satisfied: packaging in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from gunicorn==22.0.0->azureml-inference-server-http==1.3.2) (23.2)
Requirement already satisfied: itsdangerous>=2.1.2 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from flask<=2.3.2->azureml-inference-server-http==1.3.2) (2.2.0)
Requirement already satisfied: importlib-metadata>=3.6.0 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from flask<=2.3.2->azureml-inference-server-http==1.3.2) (6.11.0)
Requirement already satisfied: Jinja2>=3.1.2 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from flask<=2.3.2->azureml-inference-server-http==1.3.2) (3.1.4)
Requirement already satisfied: blinker>=1.6.2 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from flask<=2.3.2->azureml-inference-server-http==1.3.2) (1.8.2)
Requirement already satisfied: click>=8.1.3 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from flask<=2.3.2->azureml-inference-server-http==1.3.2) (8.1.7)
Collecting wrapt<=1.16.0,>=1.14.0
Downloading wrapt-1.16.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (83 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.4/83.4 kB 32.2 MB/s eta 0:00:00
Requirement already satisfied: python-dateutil>=2.5.3 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from inference-schema~=1.8.0->azureml-inference-server-http==1.3.2) (2.9.0.post0)
Requirement already satisfied: pytz>=2017.2 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from inference-schema~=1.8.0->azureml-inference-server-http==1.3.2) (2023.4)
Collecting opencensus<1.0.0,>=0.11.4
Downloading opencensus-0.11.4-py2.py3-none-any.whl (128 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 128.2/128.2 kB 49.8 MB/s eta 0:00:00
Requirement already satisfied: azure-core<2.0.0,>=1.12.0 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (1.32.0)
Requirement already satisfied: psutil>=5.6.3 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (6.1.0)
Requirement already satisfied: requests>=2.19.0 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (2.28.1)
Requirement already satisfied: azure-identity<2.0.0,>=1.5.0 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (1.13.0)
Requirement already satisfied: typing-extensions>=4.6.1 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from pydantic~=2.7.1->azureml-inference-server-http==1.3.2) (4.12.2)
Collecting pydantic-core==2.18.4
Downloading pydantic_core-2.18.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 68.8 MB/s eta 0:00:00
Collecting annotated-types>=0.4.0
Downloading annotated_types-0.7.0-py3-none-any.whl (13 kB)
Requirement already satisfied: MarkupSafe>=2.1.1 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from werkzeug>=3.0.3->azureml-inference-server-http==1.3.2) (2.1.5)
Collecting python-dotenv>=0.21.0
Downloading python_dotenv-1.0.1-py3-none-any.whl (19 kB)
Requirement already satisfied: six>=1.11.0 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from azure-core<2.0.0,>=1.12.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (1.16.0)
Requirement already satisfied: msal-extensions<2.0.0,>=0.3.0 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from azure-identity<2.0.0,>=1.5.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (1.2.0)
Requirement already satisfied: msal<2.0.0,>=1.20.0 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from azure-identity<2.0.0,>=1.5.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (1.31.0)
Requirement already satisfied: cryptography>=2.5 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from azure-identity<2.0.0,>=1.5.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (43.0.3)
Requirement already satisfied: zipp>=0.5 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from importlib-metadata>=3.6.0->flask<=2.3.2->azureml-inference-server-http==1.3.2) (3.20.2)
Collecting opencensus-context>=0.1.3
Downloading opencensus_context-0.1.3-py2.py3-none-any.whl (5.1 kB)
Collecting google-api-core<3.0.0,>=1.0.0
Downloading google_api_core-2.23.0-py3-none-any.whl (156 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.6/156.6 kB 53.1 MB/s eta 0:00:00
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from requests>=2.19.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (1.26.20)
Requirement already satisfied: idna<4,>=2.5 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from requests>=2.19.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (3.10)
Requirement already satisfied: charset-normalizer<3,>=2 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from requests>=2.19.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (2.1.1)
Requirement already satisfied: cffi>=1.12 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from cryptography>=2.5->azure-identity<2.0.0,>=1.5.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (1.17.1)
Collecting googleapis-common-protos<2.0.dev0,>=1.56.2
Downloading googleapis_common_protos-1.65.0-py2.py3-none-any.whl (220 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 220.9/220.9 kB 61.6 MB/s eta 0:00:00
Collecting google-auth<3.0.dev0,>=2.14.1
Downloading google_auth-2.36.0-py2.py3-none-any.whl (209 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 209.5/209.5 kB 56.3 MB/s eta 0:00:00
Collecting proto-plus<2.0.0dev,>=1.22.3
Downloading proto_plus-1.25.0-py3-none-any.whl (50 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.1/50.1 kB 22.0 MB/s eta 0:00:00
Requirement already satisfied: protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<6.0.0.dev0,>=3.19.5 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from google-api-core<3.0.0,>=1.0.0->opencensus<1.0.0,>=0.11.4->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (4.25.5)
Requirement already satisfied: PyJWT[crypto]<3,>=1.0.0 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from msal<2.0.0,>=1.20.0->azure-identity<2.0.0,>=1.5.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (2.9.0)
Requirement already satisfied: portalocker<3,>=1.4 in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from msal-extensions<2.0.0,>=0.3.0->azure-identity<2.0.0,>=1.5.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (2.10.1)
Requirement already satisfied: pycparser in /opt/miniconda/envs/userenv/lib/python3.8/site-packages (from cffi>=1.12->cryptography>=2.5->azure-identity<2.0.0,>=1.5.0->opencensus-ext-azure~=1.1.0->azureml-inference-server-http==1.3.2) (2.22)
Collecting cachetools<6.0,>=2.0.0
Downloading cachetools-5.5.0-py3-none-any.whl (9.5 kB)
Collecting pyasn1-modules>=0.2.1
Downloading pyasn1_modules-0.4.1-py3-none-any.whl (181 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.5/181.5 kB 61.5 MB/s eta 0:00:00
Collecting rsa<5,>=3.1.4
Downloading rsa-4.9-py3-none-any.whl (34 kB)
Collecting pyasn1<0.7.0,>=0.4.6
Downloading pyasn1-0.6.1-py3-none-any.whl (83 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.1/83.1 kB 36.3 MB/s eta 0:00:00
Installing collected packages: opencensus-context, wrapt, python-dotenv, pydantic-core, pyasn1, proto-plus, gunicorn, googleapis-common-protos, cachetools, annotated-types, rsa, pydantic, pyasn1-modules, inference-schema, flask, pydantic-settings, google-auth, flask-cors, google-api-core, opencensus, opencensus-ext-azure, azureml-inference-server-http
Attempting uninstall: gunicorn
Found existing installation: gunicorn 21.2.0
Uninstalling gunicorn-21.2.0:
Successfully uninstalled gunicorn-21.2.0
Attempting uninstall: flask
Found existing installation: Flask 2.3.3
Uninstalling Flask-2.3.3:
Successfully uninstalled Flask-2.3.3
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mlflow 2.6.0 requires gunicorn<22; platform_system != "Windows", but you have gunicorn 22.0.0 which is incompatible.
Successfully installed annotated-types-0.7.0 azureml-inference-server-http-1.3.2 cachetools-5.5.0 flask-2.3.2 flask-cors-4.0.2 google-api-core-2.23.0 google-auth-2.36.0 googleapis-common-protos-1.65.0 gunicorn-22.0.0 inference-schema-1.8 opencensus-0.11.4 opencensus-context-0.1.3 opencensus-ext-azure-1.1.13 proto-plus-1.25.0 pyasn1-0.6.1 pyasn1-modules-0.4.1 pydantic-2.7.4 pydantic-core-2.18.4 pydantic-settings-2.6.1 python-dotenv-1.0.1 rsa-4.9 wrapt-1.16.0
2024-11-12T13:56:45,344865348+00:00 | gunicorn/run |
2024-11-12T13:56:45,346643023+00:00 | gunicorn/run | ###############################################
2024-11-12T13:56:45,348265677+00:00 | gunicorn/run | Checking if the Python package azureml-inference-server-http is installed
2024-11-12T13:56:45,349891019+00:00 | gunicorn/run | ###############################################
2024-11-12T13:56:45,351562528+00:00 | gunicorn/run |
2024-11-12T13:56:46,778380722+00:00 | gunicorn/run |
2024-11-12T13:56:46,780018968+00:00 | gunicorn/run | ###############################################
2024-11-12T13:56:46,781815374+00:00 | gunicorn/run | AzureML Inference Server
2024-11-12T13:56:46,783467130+00:00 | gunicorn/run | ###############################################
2024-11-12T13:56:46,785156044+00:00 | gunicorn/run |
2024-11-12T13:56:46,786934486+00:00 | gunicorn/run | Starting AzureML Inference Server HTTP.
2024-11-12 13:56:46,923 I [10] azmlinfsrv - Loaded logging config from /opt/miniconda/envs/userenv/lib/python3.8/site-packages/azureml_inference_server_http/logging.json
2024-11-12 13:56:46,942 I [10] gunicorn.error - Starting gunicorn 22.0.0
2024-11-12 13:56:46,942 I [10] gunicorn.error - Listening at: http://0.0.0.0:31311 (10)
2024-11-12 13:56:46,942 I [10] gunicorn.error - Using worker: sync
2024-11-12 13:56:46,944 I [211] gunicorn.error - Booting worker with pid: 211

Azure ML Inferencing HTTP server v1.3.2

Server Settings

Entry Script Name: /var/mlflow_resources/mlflow_score_script.py
Model Directory: /var/azureml-app/azureml-models/runwayml-stable-diffusion-v1-5/4
Config File: None
Worker Count: 1
Worker Timeout (seconds): 300
Server Port: 31311
Health Port: 31311
Application Insights Enabled: false
Application Insights Key: None
Inferencing HTTP server version: azmlinfsrv/1.3.2
CORS for the specified origins: None
Create dedicated endpoint for health: None

Server Routes

Liveness Probe: GET 127.0.0.1:31311/
Score: POST 127.0.0.1:31311/score

2024-11-12 13:56:47,043 W [211] azmlinfsrv - Found extra keys in the config file that are not supported by the server.
Extra keys = ['AZUREML_ENTRY_SCRIPT', 'AZUREML_MODEL_DIR', 'HOSTNAME']
/opt/miniconda/envs/userenv/lib/python3.8/site-packages/pydantic/_internal/fields.py:160: UserWarning: Field "model_dc_storage_enabled" has conflict with protected namespace "model".

You may be able to resolve this warning by setting model_config['protected_namespaces'] = ('settings_',).
warnings.warn(
2024-11-12 13:56:47,272 I [211] azmlinfsrv - AML_FLASK_ONE_COMPATIBILITY is set. Patched Flask to ensure compatibility with Flask 1.
Initializing logger
2024-11-12 13:56:47,273 I [211] azmlinfsrv - Starting up app insights client
2024-11-12 13:56:47,813 E [211] azmlinfsrv - Traceback (most recent call last):
File "/opt/miniconda/envs/userenv/lib/python3.8/site-packages/azureml_inference_server_http/server/user_script.py", line 77, in load_script
main_module_spec.loader.exec_module(user_module)
File "", line 843, in exec_module
File "", line 219, in _call_with_frames_removed
File "/var/mlflow_resources/mlflow_score_script.py", line 5, in
import mlflow
File "/opt/miniconda/envs/userenv/lib/python3.8/site-packages/mlflow/init.py", line 247, in
from mlflow import gateway # noqa: F401
File "/opt/miniconda/envs/userenv/lib/python3.8/site-packages/mlflow/gateway/init.py", line 1, in
from mlflow.gateway.fluent import get_route, search_routes, query, create_route, delete_route
File "/opt/miniconda/envs/userenv/lib/python3.8/site-packages/mlflow/gateway/fluent.py", line 4, in
from mlflow.gateway.client import MlflowGatewayClient
File "/opt/miniconda/envs/userenv/lib/python3.8/site-packages/mlflow/gateway/client.py", line 8, in
from mlflow.gateway.config import Route
File "/opt/miniconda/envs/userenv/lib/python3.8/site-packages/mlflow/gateway/config.py", line 66, in
class OpenAIConfig(ConfigModel):
File "/opt/miniconda/envs/userenv/lib/python3.8/site-packages/mlflow/gateway/config.py", line 79, in OpenAIConfig
@root_validator(pre=False)
File "/opt/miniconda/envs/userenv/lib/python3.8/site-packages/pydantic/deprecated/class_validators.py", line 249, in root_validator
raise PydanticUserError(
pydantic.errors.PydanticUserError: If you use @root_validator with pre=False (the default) you MUST specify skip_on_failure=True. Note that @root_validator is deprecated and should be replaced with @model_validator.

For further information visit https://errors.pydantic.dev/2.7/u/root-validator-pre-skip

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/opt/miniconda/envs/userenv/lib/python3.8/site-packages/azureml_inference_server_http/server/aml_blueprint.py", line 91, in setup
self.user_script.load_script(config.app_root)
File "/opt/miniconda/envs/userenv/lib/python3.8/site-packages/azureml_inference_server_http/server/user_script.py", line 79, in load_script
2024-11-12 13:56:47,813 I [211] gunicorn.error - Worker exiting (pid: 211)
raise UserScriptImportException(ex) from ex
azureml_inference_server_http.server.user_script.UserScriptImportException: Failed to import user script because it raised an unhandled exception

2024-11-12 13:56:47,960 E [10] gunicorn.error - Worker (pid:211) exited with code 3
2024-11-12 13:56:47,960 E [10] gunicorn.error - Shutting down: Master
2024-11-12 13:56:47,960 E [10] gunicorn.error - Reason: Worker failed to boot.

Azure ML Inferencing HTTP server v1.3.2

Server Settings

Entry Script Name: /var/mlflow_resources/mlflow_score_script.py
Model Directory: /var/azureml-app/azureml-models/runwayml-stable-diffusion-v1-5/4
Config File: None
Worker Count: 1
Worker Timeout (seconds): 300
Server Port: 31311
Health Port: 31311
Application Insights Enabled: false
Application Insights Key: None
Inferencing HTTP server version: azmlinfsrv/1.3.2
CORS for the specified origins: None
Create dedicated endpoint for health: None

Server Routes

Liveness Probe: GET 127.0.0.1:31311/
Score: POST 127.0.0.1:31311/score

2024-11-12T13:56:47,986589074+00:00 - gunicorn/finish 3 0
2024-11-12T13:56:47,988009778+00:00 - Exit code 3 is not normal. Killing image.

Addition information

No response