HswOAuth/llm_course
19
16
Fork 0
Code Issues 608 Pull Requests Actions Packages Projects Releases Wiki Activity

求助实战：实时网页信息爬取+RAG的问答系统搭建及发布-24.12.11 爬取天眼数据是取不到数据 #432

New Issue
Open
opened 2024-12-20 16:04:42 +08:00 by 21587535723cs · 2 comments
21587535723cs commented 2024-12-20 16:04:42 +08:00
Copy Link

登录了天眼，换了cookie值，还是去爬不到数据image
image

登录了天眼，换了cookie值，还是去爬不到数据![image](/attachments/5cd24500-92bb-4710-ba3e-f75b70ab94ee) ![image](/attachments/1135356d-d780-4c51-ad96-c2da7191d4b4)
image.png
340 KiB
image.png
278 KiB
linhui commented 2024-12-20 17:52:22 +08:00
Copy Link

这个是天眼查的限制，可以先从浏览器登录，然后会出现一个确认按钮，点击这个按钮就行

这个是天眼查的限制，可以先从浏览器登录，然后会出现一个确认按钮，点击这个按钮就行
21587535723cs commented 2024-12-23 09:38:24 +08:00
Author
Copy Link

已经从浏览器登录了，取的session然后爬取数据的时候还是取不到数据？image

已经从浏览器登录了，取的session然后爬取数据的时候还是取不到数据？![image](/attachments/538e5998-f8fc-4601-ab3b-e93ef2660bc3)
image.png
1.4 MiB
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: HswOAuth/llm_course#432
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?