Skip to content

Commit

Permalink
chore: separate CT2 environment variables
Browse files Browse the repository at this point in the history
  • Loading branch information
winstxnhdw committed Dec 3, 2023
1 parent 68b0177 commit 494d6b8
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@ FROM ghcr.io/winstxnhdw/llm-api:main

ENV SERVER_PORT 5000
ENV APP_PORT 7860

ENV OMP_NUM_THREADS 8
ENV CT2_USE_EXPERIMENTAL_PACKED_GEMM 1
ENV CT2_FORCE_CPU_ISA AVX512
Expand Down

0 comments on commit 494d6b8

Please sign in to comment.