HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

微调大模型的时候，训练集损失函数没有下降趋势，但是验证集损失函数一直下降，这种情况应该还不算是过拟合现象吧？ #253

New Issue
Open
opened 2024-10-21 18:51:36 +08:00 by XPH · 1 comment
XPH commented 2024-10-21 18:51:36 +08:00
Copy Link
No description provided.
399GJG0~6G6$HJ`G$1Y3D3I.png
73 KiB
399GJG0~6G6$HJ`G$1Y3D3I.png
best_newnew commented 2024-10-22 17:26:58 +08:00
Copy Link

这应该不算是过拟合。不过这个现象好奇怪，我认为这种情况已经算是收敛了，虽然这里面验证集损失在下降，但是真的下降的太少了，这都不能算下降了吧

这应该不算是过拟合。不过这个现象好奇怪，我认为这种情况已经算是收敛了，虽然这里面验证集损失在下降，但是真的下降的太少了，这都不能算下降了吧
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#253
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?