-
Im running text-generation-webui locally already with xformers, but when I chose to modify the command line argumetns installing through XGiXT for launching text-generation-webui it did so without actually trying to install xformers as it does in the oobabooga setup... Im not very good with docker, and I can see the CLI_ARGS but dont see an option for changing them, and I cant launch the containter beccause of the failed argument. Id like it to run with xformers to increase the token count, could someone kindly push me in the right direction, or even unkindly... only the right direction is necessary. :) |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 1 reply
-
Option 3 means Nvidia with Docker, right? |
Beta Was this translation helpful? Give feedback.
-
and editing the .env file was a good answer thanks |
Beta Was this translation helpful? Give feedback.
Option 3 means Nvidia with Docker, right?
If so and CLI_ARGS are bad defined initially, you could edit .env file present in the AGiXT root folder.