xtuner训练llama3.2_3B的脚本应该怎么改 #420

New Issue

11587504121cs · 2024-12-10T23:20:44+08:00

11587504121cs commented

之间用llama的脚本会报错

之间用llama的脚本会报错![image](/attachments/711f6b10-056c-4e4e-890a-badf5763f46e)

64 KiB

11587504121cs commented

升级transformers到4.43.0后报这个错

升级transformers到4.43.0后报这个错 ![image](/attachments/74448171-9618-4d4f-8d7c-fdc386bdff06)

102 KiB

11587504121cs changed title from ~~xtuner训练llama3.2_8B的脚本应该怎么改~~ to xtuner训练llama3.2_3B的脚本应该怎么改

2024-12-11 00:13:34 +08:00

11587504121cs commented

脚本文件

7.1 KiB

21970855250cs commented

看了下xtuner还没有支持llama3.2，最近社区貌似不是特别活跃了。
可以试下其他工具，比如看到一个：https://github.com/pytorch/torchtune

看了下xtuner还没有支持llama3.2，最近社区貌似不是特别活跃了。可以试下其他工具，比如看到一个：https://github.com/pytorch/torchtune

11587504121cs commented

多谢我看看

11587504121cs closed this issue

Sign in to join this conversation.

No Label

No Milestone

No project

No Assignees

2 Participants

Notifications

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#420