We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
python -m lightllm.server.api_server --model_dir /root/autodl-tmp/Qwen2-7B-Instruct --host 0.0.0.0 --port 8000 --trust_remote_code --model_name Qwen2-7B-Instruct --data_type=bfloat16 --eos_id 151643 --tokenizer_mode fast ,通过以上命令启动服务正常,但是发送openai格式的请求后,报以下输入类型错误。请问如何解决
The text was updated successfully, but these errors were encountered:
@xiaoshizijiayou openai 兼容接口维护得不是特别充分,我们会定期修复一下。
Sorry, something went wrong.
大概什么时候可以修复,需要验证一个问题
No branches or pull requests
python -m lightllm.server.api_server --model_dir /root/autodl-tmp/Qwen2-7B-Instruct --host 0.0.0.0 --port 8000 --trust_remote_code --model_name Qwen2-7B-Instruct --data_type=bfloat16 --eos_id 151643 --tokenizer_mode fast ,通过以上命令启动服务正常,但是发送openai格式的请求后,报以下输入类型错误。请问如何解决
The text was updated successfully, but these errors were encountered: