HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

dify如何加载本地下载的大模型 #482

New Issue
Closed
opened 2025-01-20 10:07:52 +08:00 by malone · 2 comments
malone commented 2025-01-20 10:07:52 +08:00
Copy Link

之前课程中用到的bge-large-zh-v1.5 bge-reranker-large希望能在dify中加载，但是dify只支持一些模型提供商里面的，比如ollama里面少量模型等，如果配置后让dify可以加载任意从网上下载的模型

之前课程中用到的bge-large-zh-v1.5 bge-reranker-large希望能在dify中加载，但是dify只支持一些模型提供商里面的，比如ollama里面少量模型等，如果配置后让dify可以加载任意从网上下载的模型
12019701659cs commented 2025-01-20 17:02:51 +08:00
Copy Link

可以部署到xinference里面，在dify中调用xinference的模型

可以部署到xinference里面，在dify中调用xinference的模型
malone commented 2025-01-23 10:25:03 +08:00
Author
Copy Link

好的 谢谢

好的 谢谢
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#482
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?