HswOAuth/llm_share
3
0
Fork 0
Code Issues 90 Pull Requests Actions Packages Projects Releases Wiki Activity

【作业贴】2025-03-11 function call多机多卡（上） #87

New Issue
Open
opened 2025-03-18 15:56:47 +08:00 by 12380616348cs · 0 comments
12380616348cs commented 2025-03-18 15:56:47 +08:00
Copy Link

1、使用fastchat部署vicuna-7b-v1.5模型
2、本地docker 安装fastgpt
3、auto上部署xinference ，隧道到本机，使用xinference 部署运行qwen2.5-instruct

1、使用fastchat部署vicuna-7b-v1.5模型 2、本地docker 安装fastgpt 3、auto上部署xinference ，隧道到本机，使用xinference 部署运行qwen2.5-instruct
WechatIMG1446.png
519 KiB
WechatIMG1447.png
688 KiB
WechatIMG1450.png
199 KiB
WechatIMG1449.png
356 KiB
WechatIMG1451.png
420 KiB
WechatIMG1446.png WechatIMG1447.png WechatIMG1450.png WechatIMG1449.png WechatIMG1451.png
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
No items
No Label
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_share#87
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?