2024/spider/aijuke_spider.git - Gitblit

2024 / spider/aijuke_spider

使用scrapy采集社交媒体的公开信息

description	使用scrapy采集社交媒体的公开信息
owners	yellow_dog , admin , chen.silu , chenxixi , lxw , scott , zhb
last change	Saturday, November 9, 2024 21:50 +0800
size	1,013 KB
stats	147 commits and 0 tags in 4 months metrics
repository url	URL Rhttp://118.89.113.119:8060/r/2024/spider/aijuke_spider.git Rgit://118.89.113.119/2024/spider/aijuke_spider.git http://118.89.113.119:8060/r/2024/spider/aijuke_spider.git R Git Git a fast, open-source, distributed VCS released under the GPLv2 open source license Rgit clone http://118.89.113.119:8060/r/2024/spider/aijuke_spider.git Rgit clone git://118.89.113.119/2024/spider/aijuke_spider.git

2024-11-09

dy_v_user_profile_spider修改2

HEAD master

diff | tree

2024-11-09

dy_v_user_profile_spider修改

diff | tree

2024-09-20

feat:新增小红书根据时间停止采集条件

diff | tree

2024-09-20

refactor:去除根据点赞数的过滤

diff | tree

2024-09-19

refactor:增加小红书对注销用户的处理

diff | tree

2024-09-18

refactor:修改小红书xpath

diff | tree

2024-09-10

refactor:修改回调接口

diff | tree

2024-09-10

feat:增加回调拓展

diff | tree

2024-09-10

refactor:优化项目结构

diff | tree

2024-09-10

feat:增加发布配置(IDE)

diff | tree

2024-09-10

feat:运行完成保存日志，新增BaseSpider，TaskLog类，新增TaskLogExtension拓展，爬虫新增task_type属性，继承...

diff | tree

2024-09-09

fix:修复关键词分割bug

diff | tree

2024-09-09

实现快手大V信息完善

diff | tree

2024-09-09

refactor:当运行平台不是快手时，不使用代理

diff | tree

2024-09-09

refactor:记录执行日志时，添加执行状态

diff | tree

2024-09-09

refactor:记录执行日志时，添加结束时间

diff | tree

more commits...