llm3-chinese部署后提示这个警告, 该如何处理呢。 #496

Open
opened 2025-02-04 18:06:51 +08:00 by flyfarther · 1 comment

2025-02-03 12:25:36,627 - INFO - Uvicorn running on http://0.0.0.0:19327 (Press CTRL+C to quit)
2025-02-03 12:28:05,921 - INFO - 192.168.3.47:64363 - "POST /v1/chat/completions HTTP/1.1" 200
The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's attention_mask to obtain reliable results.

2025-02-03 12:25:36,627 - INFO - Uvicorn running on http://0.0.0.0:19327 (Press CTRL+C to quit) 2025-02-03 12:28:05,921 - INFO - 192.168.3.47:64363 - "POST /v1/chat/completions HTTP/1.1" 200 The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.

警告应该是不影响整个功能运行的。

警告应该是不影响整个功能运行的。
Sign in to join this conversation.
No Milestone
No project
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#496
No description provided.