安装xinference[transformers]报错 课程是:43-24.12.3-实战:实时网页信息爬取+RAG的问答系统搭建及发布 #417
Labels
No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
No Milestone
No project
No Assignees
2 Participants
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: HswOAuth/llm_course#417
Loading…
Reference in New Issue
Block a user
No description provided.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
如图,前面的下载都正常,到这里就出错了,用的autodl实例。改虚拟环境也报一样的错
这个是由于AutoGPTQ不兼容python3.12导致的,这个包目前没有在python3.12上发布,具体原因见这个链接:https://github.com/AutoGPTQ/AutoGPTQ/issues/730

解决办法:在autodl上使用版本低的镜像容器,如下图所示选择pytorch2.1.2、python3.10即可安装成功
根据老师解答,已解决,谢谢