HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

作业：如何使用量化技术训练，上课日期：24-10-20 #291

New Issue
Open
opened 2024-10-25 16:56:40 +08:00 by guowenlong · 1 comment
guowenlong commented 2024-10-25 16:56:40 +08:00
Copy Link

使用Qwen-7B-Chat 进行实验过程见附件。
1.基座模型加载和问答
2.指令微调后的模型加载和问答，回答符合预期。
3.量化后微调的加载和问答，回答符合预期。
4.以api形式启动微调后的调用
q6.png
q7.png

使用Qwen-7B-Chat 进行实验过程见附件。 1.基座模型加载和问答 2.指令微调后的模型加载和问答，回答符合预期。 3.量化后微调的加载和问答，回答符合预期。 4.以api形式启动微调后的调用 ![q6.png](/attachments/2a5bfc66-7574-419a-8e03-11bfa22f1c3f) ![q7.png](/attachments/36ce145d-3c17-4a51-a941-f655e864bc3a)
使用Qwen微调过程.zip
1.1 MiB
q6.png
324 KiB
q7.png
354 KiB
👍 2
guowenlong commented 2024-10-25 16:57:28 +08:00
Author
Copy Link

关联我之前实验发生问题的issue #273

关联我之前实验发生问题的issue #273
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#291
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?