HswOAuth/llm_share
3
0
Fork 0
Code Issues 90 Pull Requests Actions Packages Projects Releases Wiki Activity

【作业贴】20250124 - 私有化LLM仿OpenAI API接口的高可用工程实践 #73

New Issue
Open
opened 2025-02-17 17:53:32 +08:00 by 21682554008cs · 0 comments
21682554008cs commented 2025-02-17 17:53:32 +08:00
Copy Link

1：curl调用本地接口: http://0.0.0.0:19327
8015fcf245a4e8ca8bd1c4633a7a247.png

2: curl调用接口：询问1+1 = ?
299234db35a2cd54f31f6747a4ad134.png

3: curl调用接口：询问今年有多少天？
0284e4b6d6c854447712300ef7ae31e.png

4:GPU使用情况
33253a59c06a891fff18438b4ef39a0.png

备注：
使用本地virtubox中运行的虚拟机，采用cpu模式，内存不足，最后还是重新用算力平台上的资源部署完成
78d6f8a7520e8c94bdc28719675ced3.png

1：curl调用本地接口: http://0.0.0.0:19327 ![8015fcf245a4e8ca8bd1c4633a7a247.png](/attachments/c4be84f1-c3b3-48c9-8cd5-6fa0b61587e8) 2: curl调用接口：询问1+1 = ? ![299234db35a2cd54f31f6747a4ad134.png](/attachments/4321dbd6-f519-4128-a13b-ac69ccd8c556) 3: curl调用接口：询问今年有多少天？ ![0284e4b6d6c854447712300ef7ae31e.png](/attachments/7e6d0041-eb5d-47be-877d-f4ad29214464) 4:GPU使用情况 ![33253a59c06a891fff18438b4ef39a0.png](/attachments/13b38890-ac96-4511-a2c4-7331b3308472) 备注： 使用本地virtubox中运行的虚拟机，采用cpu模式，内存不足，最后还是重新用算力平台上的资源部署完成 ![78d6f8a7520e8c94bdc28719675ced3.png](/attachments/7345ad17-7477-4042-898d-6df12fd3455e)
8015fcf245a4e8ca8bd1c4633a7a247.png
57 KiB
8015fcf245a4e8ca8bd1c4633a7a247.png
57 KiB
299234db35a2cd54f31f6747a4ad134.png
14 KiB
0284e4b6d6c854447712300ef7ae31e.png
19 KiB
33253a59c06a891fff18438b4ef39a0.png
25 KiB
78d6f8a7520e8c94bdc28719675ced3.png
933 KiB
8015fcf245a4e8ca8bd1c4633a7a247.png
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
No items
No Label
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_share#73
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?