HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

工作中的大模型微调不准确问题--需要远程指导--林希老师 #629

New Issue
Open
opened 2025-03-19 20:11:00 +08:00 by hanson666 · 0 comments
hanson666 commented 2025-03-19 20:11:00 +08:00
Copy Link

用了公司的私有数据，是docx文档，里面每个标题下面都有具体说明，总共有13类内容。例如：1.名称：xxx，2.坐标：xxx，3.基本情况：xxx。可以转换为结构化的json格式，尝试之后转为alpaca格式，用deepseek-r1微调，效果很不好，之后又用glm4微调，效果好些，不过回答的也不准确并且回答太少了，之后微调了学习率等参数，回答的又太多了，还是不准确，需要老师远程指导一下。

用了公司的私有数据，是docx文档，里面每个标题下面都有具体说明，总共有13类内容。例如：1.名称：xxx，2.坐标：xxx，3.基本情况：xxx。可以转换为结构化的json格式，尝试之后转为alpaca格式，用deepseek-r1微调，效果很不好，之后又用glm4微调，效果好些，不过回答的也不准确并且回答太少了，之后微调了学习率等参数，回答的又太多了，还是不准确，需要老师远程指导一下。
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#629
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?