HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

LLaMA factory 模型微调出错 #275

New Issue
Closed
opened 2024-10-23 13:51:06 +08:00 by sinbaqyj · 1 comment
sinbaqyj commented 2024-10-23 13:51:06 +08:00
Copy Link

按照老师介绍流程微调时，开始试时，调参学习率5e-5， 6次，后对话发现未改变，后继续调参学习率5e-4， 轮次6次， 和 学习率5*e-3，轮次 3次，chat时不成功，或者不干脆出现错误缺损的对话内容，具体参见附件

按照老师介绍流程微调时，开始试时，调参学习率5*e-5， 6次，后对话发现未改变，后继续调参学习率5*e-4， 轮次6次， 和 学习率5*e-3，轮次 3次，chat时不成功，或者不干脆出现错误缺损的对话内容，具体参见附件
ac9da51b61a9b5c440af55d378b613a.png
155 KiB
大模型微调出错2024.10.22.png
155 KiB
ac9da51b61a9b5c440af55d378b613a.png 大模型微调出错2024.10.22.png
sinbaqyj commented 2024-10-23 14:21:37 +08:00
Author
Copy Link

重新调参后已重现老师结果，结果已附word截图

重新调参后已重现老师结果，结果已附word截图
调参设置和结果 2024.10.23.docx
1.1 MiB
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#275
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?