HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

关于DeepSeek蒸馏公司的模型 #545

New Issue
Open
opened 2025-02-13 21:47:00 +08:00 by 12754933808cs · 1 comment
12754933808cs commented 2025-02-13 21:47:00 +08:00
Copy Link

老师，我目前通过Ollama部署了一个DeepSeek R1-32b模型，有一些公司内部文档数据，想用自己资料数据通过这个蒸馏一个小模型，我不太会做蒸馏模型和微调模型，老师能给一些思路或建议吗？

老师，我目前通过Ollama部署了一个DeepSeek R1-32b模型，有一些公司内部文档数据，想用自己资料数据通过这个蒸馏一个小模型，我不太会做蒸馏模型和微调模型，老师能给一些思路或建议吗？
12019701659cs commented 2025-02-14 17:19:53 +08:00
Copy Link

首先ollama本身不支持微调，如果需要微调，可以学习下llama factory之类的微调架构，通过sft进行微调。

首先ollama本身不支持微调，如果需要微调，可以学习下llama factory之类的微调架构，通过sft进行微调。
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#545
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?