HswOAuth/llm_course
19
16
Fork 0
Code Issues 633 Pull Requests Actions Packages Projects Releases Wiki Activity

ollama内的模型如何微调？ #437

New Issue
Open
opened 2024-12-21 13:43:07 +08:00 by 11735802362cs · 1 comment
11735802362cs commented 2024-12-21 13:43:07 +08:00
Copy Link

比如在ollma内支持的模型lamma3，我想进行微调，该如何操作？ 假设我不用ollama内置的微调框架，采用huggingface或者其他微调框架， 首先ollama的模型格式都是UUGF,其次是训练完成后如何与ollama兼容呢？

比如在ollma内支持的模型lamma3，我想进行微调，该如何操作？ 假设我不用ollama内置的微调框架，采用huggingface或者其他微调框架， 首先ollama的模型格式都是UUGF,其次是训练完成后如何与ollama兼容呢？
12019701659cs commented 2024-12-23 14:10:25 +08:00
Copy Link
  1. Ollama 没有微调功能，只能使用其他工具进行微调。
  2. ollama的模型格式是GGUF，可以使用 llama.cpp 将模型转换为 GGUF 格式。
    https://github.com/ggerganov/llama.cpp
1. Ollama 没有微调功能，只能使用其他工具进行微调。 2. ollama的模型格式是GGUF，可以使用 llama.cpp 将模型转换为 GGUF 格式。 https://github.com/ggerganov/llama.cpp
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#437
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?