HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

RAG-含有图片的文档读取 #371

New Issue
Open
opened 2024-11-12 09:47:25 +08:00 by PeterWang · 2 comments
PeterWang commented 2024-11-12 09:47:25 +08:00
Copy Link

含有图片的PDF/Word/Excel应该怎么进行处理？

含有图片的PDF/Word/Excel应该怎么进行处理？
12019701659cs commented 2024-11-12 21:40:17 +08:00
Copy Link
  1. 使用多模态嵌入模型来嵌入图像和文本以进行答案合成。
  2. 使用多模态LLM从图像生成文本摘要，然后嵌入和检索文本，将文本块传递给LLM以进行答案合成。
  3. 使用OCR技术提取成文本。
1. 使用多模态嵌入模型来嵌入图像和文本以进行答案合成。 2. 使用多模态LLM从图像生成文本摘要，然后嵌入和检索文本，将文本块传递给LLM以进行答案合成。 3. 使用OCR技术提取成文本。
12019701659cs commented 2024-11-12 21:40:51 +08:00
Copy Link

或者只处理文本，去掉图片。

或者只处理文本，去掉图片。
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#371
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?