HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

有关xinference #418

New Issue
Open
opened 2024-12-09 14:49:18 +08:00 by 11384878062cs · 2 comments
11384878062cs commented 2024-12-09 14:49:18 +08:00
Copy Link

如何将自己微调过的模型接入xinference做推理，不是在ui界面上使用而是用图片中的方式接入

如何将自己微调过的模型接入xinference做推理，不是在ui界面上使用而是用图片中的方式接入
image.png
133 KiB
d22938d902945b96e64de68a937697f.png
139 KiB
image.png d22938d902945b96e64de68a937697f.png
12019701659cs commented 2024-12-09 21:42:30 +08:00
Copy Link

图片的方式应该是推理已经部署的模型，如果你说的是命令行部署，可以参考：

  1. https://inference.readthedocs.io/zh-cn/latest/models/custom.html
  2. https://blog.csdn.net/orientharp/article/details/139884688
图片的方式应该是推理已经部署的模型，如果你说的是命令行部署，可以参考： 1. https://inference.readthedocs.io/zh-cn/latest/models/custom.html 2. https://blog.csdn.net/orientharp/article/details/139884688
11384878062cs commented 2024-12-10 15:33:50 +08:00
Author
Copy Link

已解决，谢谢老师

已解决，谢谢老师
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#418
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?