HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

deepseek-r1部署问题 #555

New Issue
Open
opened 2025-02-16 22:49:18 +08:00 by 11587504121cs · 1 comment
11587504121cs commented 2025-02-16 22:49:18 +08:00
Copy Link

如果想在汇视威AI训练平台尝试部署一下deepseek-r1 671B的模型，大概需要多少显存（github上看模型好像是用的FP8，这样的话是不是700G显存就够），需要多少机时（在模型调试创建资源池那里看，是64G/8机时）才能部署成功

如果想在汇视威AI训练平台尝试部署一下deepseek-r1 671B的模型，大概需要多少显存（github上看模型好像是用的FP8，这样的话是不是700G显存就够），需要多少机时（在模型调试创建资源池那里看，是64G/8机时）才能部署成功
rayhsw commented 2025-02-17 18:24:47 +08:00
Copy Link

可以参考下面的图：
image

可以参考下面的图： <img width="457" alt="image" src="/attachments/5b5fbb83-794b-47a3-97eb-d6b1627e5ca1">
image.png
48 KiB
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#555
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?