tp=6 can work on vLLM when padding model architecture numbers to be divisible by six

vLLM's tensor parallel requires that several of the model architecture numbers be evenly divisible by the number of GPUs selected for tensor parallel. This usually means that you can only use a number of GPUs that is...