HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

北京-刘洋-13-24.9.5 私有化LLM仿OpenAI API接口的高可用实践-课后作业 #23

New Issue
Open
opened 2024-09-06 17:29:10 +08:00 by 11256832216cs · 0 comments
11256832216cs commented 2024-09-06 17:29:10 +08:00
Copy Link

分别完成GPU和CPU的代码启动模型

img_v3_02ef_43dbbd00-e0ca-4dae-98fb-9639f907297g
img_v3_02ef_66698b3a-a2d8-472b-94aa-517af1a589cg

oneapi配置

img_v3_02ef_49444bf0-013e-49a7-bb9d-7b9978d96b2g
img_v3_02ef_508303e8-ab16-4461-90fd-c84525fe700g

NextChat配置及测试

img_v3_02ef_fe4f68fe-cc78-447a-9434-74b2d31cadcg
img_v3_02ef_6d9efa39-4d9a-4433-94d5-49e6710d745g

故障切换测试，关闭GPU端口服务，再测试输出变慢，CPU用量增加

img_v3_02ef_6b7a2db8-2b9c-40e8-81aa-316448e62c6g
img_v3_02ef_4c61b32b-d82b-402b-90fc-dc16202b18cg
img_v3_02ef_85570b4e-9b2d-42c0-a275-545705fabf9g

恢复GPU端口服务，再测试输出正常，GPU用量上升

img_v3_02ef_a9b0a43e-9b2d-4c83-9540-2dd820907e9g
img_v3_02ef_4596081a-ff0c-4248-8256-13f6c2a8004g

# 分别完成GPU和CPU的代码启动模型 ![img_v3_02ef_43dbbd00-e0ca-4dae-98fb-9639f907297g](/attachments/491ee416-d610-49d4-acaf-d152a4e3f008) ![img_v3_02ef_66698b3a-a2d8-472b-94aa-517af1a589cg](/attachments/234b7595-1288-4e48-bc4f-e77f4fa7231d) # oneapi配置 ![img_v3_02ef_49444bf0-013e-49a7-bb9d-7b9978d96b2g](/attachments/570c2308-d56e-44a8-841c-f9a429557e6a) ![img_v3_02ef_508303e8-ab16-4461-90fd-c84525fe700g](/attachments/67357d48-a8b3-4f9f-951f-9bed2d12098f) # NextChat配置及测试 ![img_v3_02ef_fe4f68fe-cc78-447a-9434-74b2d31cadcg](/attachments/4d407b98-41af-498a-a6a1-dde9c477eed6) ![img_v3_02ef_6d9efa39-4d9a-4433-94d5-49e6710d745g](/attachments/d7d11185-b756-430f-831d-f694cb5c5961) # 故障切换测试，关闭GPU端口服务，再测试输出变慢，CPU用量增加 ![img_v3_02ef_6b7a2db8-2b9c-40e8-81aa-316448e62c6g](/attachments/1d18b9cd-7ce2-4337-9989-4b3ad08f9075) ![img_v3_02ef_4c61b32b-d82b-402b-90fc-dc16202b18cg](/attachments/2d467848-c9f9-402e-b8e3-989e40723416) ![img_v3_02ef_85570b4e-9b2d-42c0-a275-545705fabf9g](/attachments/ee3fc376-f685-4753-ae35-80aaf4c8e2a3) # 恢复GPU端口服务，再测试输出正常，GPU用量上升 ![img_v3_02ef_a9b0a43e-9b2d-4c83-9540-2dd820907e9g](/attachments/f805287a-baa3-42e0-b010-a2645c835315) ![img_v3_02ef_4596081a-ff0c-4248-8256-13f6c2a8004g](/attachments/bba3fcd3-e8ea-4983-b3aa-039fa1c7779f)
img_v3_02ef_43dbbd00-e0ca-4dae-98fb-9639f907297g.jpg
309 KiB
img_v3_02ef_66698b3a-a2d8-472b-94aa-517af1a589cg.jpg
327 KiB
img_v3_02ef_49444bf0-013e-49a7-bb9d-7b9978d96b2g.jpg
321 KiB
img_v3_02ef_508303e8-ab16-4461-90fd-c84525fe700g.jpg
269 KiB
img_v3_02ef_fe4f68fe-cc78-447a-9434-74b2d31cadcg.jpg
117 KiB
img_v3_02ef_6d9efa39-4d9a-4433-94d5-49e6710d745g.jpg
115 KiB
img_v3_02ef_6b7a2db8-2b9c-40e8-81aa-316448e62c6g.jpg
652 KiB
img_v3_02ef_4c61b32b-d82b-402b-90fc-dc16202b18cg.jpg
171 KiB
img_v3_02ef_85570b4e-9b2d-42c0-a275-545705fabf9g.jpg
193 KiB
img_v3_02ef_4596081a-ff0c-4248-8256-13f6c2a8004g.jpg
159 KiB
img_v3_02ef_a9b0a43e-9b2d-4c83-9540-2dd820907e9g.jpg
193 KiB
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#23
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?