HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

本地服务器用gpu创建ollama容器报错 #468

New Issue
Open
opened 2025-01-09 12:49:01 +08:00 by txg0612 · 4 comments
txg0612 commented 2025-01-09 12:49:01 +08:00
Copy Link

老师你好，我用一台本地带gpu的服务器（系统为ubuntu22.04），性能如下：
image
用gpu创建ollama容器报错如下：
image
CUDN和cudnn都已经安装（是跟着官网分别下载下来安装的），验证命令截图如下
image
image
请问这是什么原因呢？是我这种方式安装CUDN和cudnn的方式不对吗？

老师你好，我用一台本地带gpu的服务器（系统为ubuntu22.04），性能如下： ![image](/attachments/31a47848-e8a4-496e-b5c2-ec7fe17ecdb7) 用gpu创建ollama容器报错如下： ![image](/attachments/549a9a87-40a5-4c4d-82e6-6b4348bb5832) CUDN和cudnn都已经安装（是跟着官网分别下载下来安装的），验证命令截图如下 ![image](/attachments/9e3710fe-b3f2-4692-a488-ad2eafa69e9f) ![image](/attachments/241bae14-83f0-4c0f-8cb4-4f994c38a94d) 请问这是什么原因呢？是我这种方式安装CUDN和cudnn的方式不对吗？
image.png
128 KiB
image.png
128 KiB
image.png
274 KiB
image.png
146 KiB
txg0612 commented 2025-01-09 12:59:15 +08:00
Author
Copy Link

补充：我创建了一个conda环境，作了如下测试，不知能否给老师排错提供帮助
image

补充：我创建了一个conda环境，作了如下测试，不知能否给老师排错提供帮助 ![image](/attachments/21a5367f-b8d2-4330-9d5c-f4fe4e21f226)
image.png
414 KiB
12019701659cs commented 2025-01-09 15:11:07 +08:00
Copy Link

参考：https://blog.csdn.net/qq_38628046/article/details/136312844，可能需要安装NVIDIA Container Toolkit

参考：https://blog.csdn.net/qq_38628046/article/details/136312844，可能需要安装NVIDIA Container Toolkit
txg0612 commented 2025-01-09 21:34:08 +08:00
Author
Copy Link

还真是这个原因，谢谢老师！现在需要解决ollama容器中不能拉取模型的问题。因为这是一台安装ubuntu22.04的服务器，怎么给它配置科学上网呢？

还真是这个原因，谢谢老师！现在需要解决ollama容器中不能拉取模型的问题。因为这是一台安装ubuntu22.04的服务器，怎么给它配置科学上网呢？
12019701659cs commented 2025-01-13 15:16:57 +08:00
Copy Link

这个需要你自己八仙过海各显神通了

这个需要你自己八仙过海各显神通了
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#468
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?