Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

运行api_server正常,但是发送正常openai请求报错,说输入类型错误 #545

Open
xiaoshizijiayou opened this issue Sep 26, 2024 · 2 comments

Comments

@xiaoshizijiayou
Copy link

python -m lightllm.server.api_server --model_dir /root/autodl-tmp/Qwen2-7B-Instruct --host 0.0.0.0 --port 8000 --trust_remote_code --model_name Qwen2-7B-Instruct --data_type=bfloat16 --eos_id 151643 --tokenizer_mode fast ,通过以上命令启动服务正常,但是发送openai格式的请求后,报以下输入类型错误。请问如何解决
image

@hiworldwzj
Copy link
Collaborator

@xiaoshizijiayou openai 兼容接口维护得不是特别充分,我们会定期修复一下。

@xiaoshizijiayou
Copy link
Author

@xiaoshizijiayou openai 兼容接口维护得不是特别充分,我们会定期修复一下。

大概什么时候可以修复,需要验证一个问题

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants