【求助帖】10/20 大模型初探-基于LLaMA-Factory的模型微调训练 #242

New Issue

Open

opened 2024-10-20 22:21:59 +08:00 by rebibabo · 3 comments

rebibabo commented 2024-10-20 22:21:59 +08:00

Copy Link

为什么我开始微调之后先是报错

然后训练过程中梯度一直是nan，降低学习率、降低max_grad_norm、设置为f32精度，还是这样，请问怎么解决呢

为什么我开始微调之后先是报错  然后训练过程中梯度一直是nan，降低学习率、降低max_grad_norm、设置为f32精度，还是这样，请问怎么解决呢 

image.png

46 KiB

image.png

19 KiB

HswOAuth commented 2024-10-22 21:14:11 +08:00

Owner

Copy Link

是否是按上课时一幕一样操作？所使用的环境能否告知一下？比如说autodl租用，还是自己私有化服务器？

是否是按上课时一幕一样操作？所使用的环境能否告知一下？比如说autodl租用，还是自己私有化服务器？

rebibabo commented 2024-10-25 11:28:59 +08:00

Author

Copy Link

是autodl租用的，操作都是按照老师的一步一步来

是autodl租用的，操作都是按照老师的一步一步来

GANGUAGUA commented 2024-10-25 11:59:00 +08:00

Copy Link

请将LLaMA-Factory放置在/root/目录下，也就是：/root/LLaMA-Factory，然后再重复做一次实验

请将LLaMA-Factory放置在/root/目录下，也就是：/root/LLaMA-Factory，然后再重复做一次实验 

image.png

79 KiB

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

No results found.

Labels

Clear labels   

bug

Something is not working

  

duplicate

This issue or pull request already exists

  

enhancement

New feature

  

help wanted

Need some help

  

invalid

Something is wrong

  

question

More information is needed

  

wontfix

This won't be fixed

No Label

bug

duplicate

enhancement

help wanted

invalid

question

wontfix

Milestone

Clear milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

No Assignees

3 Participants

Notifications

Subscribe

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#242

No description provided.