Replies: 1 comment
-
|
尝试安装gpu版的torch |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
我在本地跑了一个0.5b的qwen模型，但是好像每次都是用cpu推理的，所以我想问问怎么改成gpu推理，从哪里可以设置？我想试试我这张老显卡的极限是哪里。。
Beta Was this translation helpful? Give feedback.
All reactions