2024/spider/aijuke-crawler.git

chenxixi

2024-07-18 9d98cc4242fb53ac02e59e8203ed86f363e0ba24

refs	HEAD master
author	chenxixi <2323561904@qq.com>
	Thursday, July 18, 2024 17:23 +0800
committer	chenxixi <2323561904@qq.com>
	Thursday, July 18, 2024 17:23 +0800
commit	9d98cc4242fb53ac02e59e8203ed86f363e0ba24
tree	e4cb2dd57d16509d212edadbd57702d128de6be5 tree \| zip \| gz
parent	2d8d32cc5e33016d6236368b0c3bf3bc756cdacd view \| diff ccd354ec9f6372726622a97ac7476d50f8b0cb5a view \| diff

初始化合并

129 files added

2 files modified

	.gitattributes	3 ●●●●● diff \| view \| raw \| blame \| history
	.github/workflows/main.yaml	17 ●●●●● diff \| view \| raw \| blame \| history
	.gitignore	128 ●●●●● diff \| view \| raw \| blame \| history
	LICENSE	28 ●●●●● diff \| view \| raw \| blame \| history
	README.md	405 ●●●●● diff \| view \| raw \| blame \| history
	async_db.py	96 ●●●●● diff \| view \| raw \| blame \| history
	base/__init__.py	diff \| view \| raw \| blame \| history
	base/base_crawler.py	71 ●●●●● diff \| view \| raw \| blame \| history
	cache/__init__.py	diff \| view \| raw \| blame \| history
	cache/abs_cache.py	42 ●●●●● diff \| view \| raw \| blame \| history
	cache/cache_factory.py	29 ●●●●● diff \| view \| raw \| blame \| history
	cache/local_cache.py	120 ●●●●● diff \| view \| raw \| blame \| history
	cache/redis_cache.py	76 ●●●●● diff \| view \| raw \| blame \| history
	cmd_arg/__init__.py	1 ●●●●● diff \| view \| raw \| blame \| history
	cmd_arg/arg.py	40 ●●●●● diff \| view \| raw \| blame \| history
	config/__init__.py	2 ●●●●● diff \| view \| raw \| blame \| history
	config/base_config.py	136 ●●●●● diff \| view \| raw \| blame \| history
	config/db_config.py	40 ●●●●● diff \| view \| raw \| blame \| history
	config/db_config.toml	13 ●●●●● diff \| view \| raw \| blame \| history
	dao/dy/dy_video_id.py	71 ●●●●● diff \| view \| raw \| blame \| history
	db.py	117 ●●●●● diff \| view \| raw \| blame \| history
	docs/STZHONGS.TTF	diff \| view \| raw \| blame \| history
	docs/hit_stopwords.txt	768 ●●●●● diff \| view \| raw \| blame \| history
	docs/代理使用.md	47 ●●●●● diff \| view \| raw \| blame \| history
	docs/关于词云图相关操作.md	58 ●●●●● diff \| view \| raw \| blame \| history
	docs/常见问题.md	31 ●●●●● diff \| view \| raw \| blame \| history
	docs/手机号登录说明.md	20 ●●●●● diff \| view \| raw \| blame \| history
	docs/项目代码结构.md	38 ●●●●● diff \| view \| raw \| blame \| history
	libs/douyin.js	578 ●●●●● diff \| view \| raw \| blame \| history
	libs/stealth.min.js	7 ●●●●● diff \| view \| raw \| blame \| history
	main.py	52 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/__init__.py	diff \| view \| raw \| blame \| history
	media_platform/bilibili/__init__.py	6 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/bilibili/client.py	287 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/bilibili/core.py	302 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/bilibili/exception.py	14 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/bilibili/field.py	34 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/bilibili/help.py	70 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/bilibili/login.py	107 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/douyin/__init__.py	1 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/douyin/client.py	291 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/douyin/core.py	270 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/douyin/exception.py	9 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/douyin/field.py	23 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/douyin/login.py	254 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/__init__.py	2 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/client.py	307 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/core.py	288 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/exception.py	9 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/field.py	1 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/graphql.py	22 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/graphql/comment_list.graphql	39 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/graphql/search_query.graphql	111 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/graphql/video_detail.graphql	80 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/graphql/vision_profile.graphql	27 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/graphql/vision_profile_photo_list.graphql	110 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/graphql/vision_profile_user_list.graphql	16 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/graphql/vision_sub_comment_list.graphql	22 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/kuaishou/login.py	102 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/weibo/__init__.py	7 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/weibo/client.py	206 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/weibo/core.py	283 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/weibo/exception.py	14 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/weibo/field.py	19 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/weibo/help.py	25 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/weibo/login.py	137 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/xhs/__init__.py	2 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/xhs/client.py	402 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/xhs/core.py	279 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/xhs/exception.py	9 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/xhs/field.py	72 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/xhs/help.py	287 ●●●●● diff \| view \| raw \| blame \| history
	media_platform/xhs/login.py	186 ●●●●● diff \| view \| raw \| blame \| history
	model/__init__.py	diff \| view \| raw \| blame \| history
	model/model.py	56 ●●●●● diff \| view \| raw \| blame \| history
	model/sqlalchemy_config.py	19 ●●●●● diff \| view \| raw \| blame \| history
	mypy.ini	9 ●●●●● diff \| view \| raw \| blame \| history
	proxy/__init__.py	5 ●●●●● diff \| view \| raw \| blame \| history
	proxy/base_proxy.py	63 ●●●●● diff \| view \| raw \| blame \| history
	proxy/providers/__init__.py	6 ●●●●● diff \| view \| raw \| blame \| history
	proxy/providers/jishu_http_proxy.py	87 ●●●●● diff \| view \| raw \| blame \| history
	proxy/providers/kuaidl_proxy.py	135 ●●●●● diff \| view \| raw \| blame \| history
	proxy/proxy_ip_pool.py	110 ●●●●● diff \| view \| raw \| blame \| history
	proxy/types.py	23 ●●●●● diff \| view \| raw \| blame \| history
	recv_sms.py	68 ●●●●● diff \| view \| raw \| blame \| history
	requirements.txt	18 ●●●●● diff \| view \| raw \| blame \| history
	schema/tables.sql	208 ●●●●● diff \| view \| raw \| blame \| history
	static/images/11群二维码.JPG	diff \| view \| raw \| blame \| history
	static/images/IP_提取图.png	diff \| view \| raw \| blame \| history
	static/images/img.png	diff \| view \| raw \| blame \| history
	static/images/img_1.png	diff \| view \| raw \| blame \| history
	static/images/img_2.png	diff \| view \| raw \| blame \| history
	static/images/img_3.png	diff \| view \| raw \| blame \| history
	static/images/img_4.png	diff \| view \| raw \| blame \| history
	static/images/relakkes_weichat.JPG	diff \| view \| raw \| blame \| history
	static/images/wechat_pay.jpeg	diff \| view \| raw \| blame \| history
	static/images/xingqiu.jpg	diff \| view \| raw \| blame \| history
	static/images/zfb_pay.png	diff \| view \| raw \| blame \| history
	static/images/代理IP 流程图.drawio.png	diff \| view \| raw \| blame \| history
	static/images/修改代理密钥.png	diff \| view \| raw \| blame \| history
	store/__init__.py	4 ●●●●● diff \| view \| raw \| blame \| history
	store/bilibili/__init__.py	82 ●●●●● diff \| view \| raw \| blame \| history
	store/bilibili/bilibili_store_impl.py	206 ●●●●● diff \| view \| raw \| blame \| history
	store/bilibili/bilibili_store_sql.py	102 ●●●●● diff \| view \| raw \| blame \| history
	store/douyin/__init__.py	161 ●●●●● diff \| view \| raw \| blame \| history
	store/douyin/douyin_store_impl.py	266 ●●●●● diff \| view \| raw \| blame \| history
	store/douyin/douyin_store_sql.py	150 ●●●●● diff \| view \| raw \| blame \| history
	store/kuaishou/__init__.py	97 ●●●●● diff \| view \| raw \| blame \| history
	store/kuaishou/kuaishou_store_impl.py	219 ●●●●● diff \| view \| raw \| blame \| history
	store/kuaishou/kuaishou_store_sql.py	102 ●●●●● diff \| view \| raw \| blame \| history
	store/weibo/__init__.py	97 ●●●●● diff \| view \| raw \| blame \| history
	store/weibo/weibo_store_image.py	53 ●●●●● diff \| view \| raw \| blame \| history
	store/weibo/weibo_store_impl.py	208 ●●●●● diff \| view \| raw \| blame \| history
	store/weibo/weibo_store_sql.py	102 ●●●●● diff \| view \| raw \| blame \| history
	store/xhs/__init__.py	125 ●●●●● diff \| view \| raw \| blame \| history
	store/xhs/xhs_store_impl.py	246 ●●●●● diff \| view \| raw \| blame \| history
	store/xhs/xhs_store_sql.py	148 ●●●●● diff \| view \| raw \| blame \| history
	test/__init__.py	1 ●●●●● diff \| view \| raw \| blame \| history
	test/test_expiring_local_cache.py	39 ●●●●● diff \| view \| raw \| blame \| history
	test/test_proxy_ip_pool.py	19 ●●●●● diff \| view \| raw \| blame \| history
	test/test_redis_cache.py	40 ●●●●● diff \| view \| raw \| blame \| history
	test/test_utils.py	10 ●●●●● diff \| view \| raw \| blame \| history
	tools/__init__.py	diff \| view \| raw \| blame \| history
	tools/crawler_util.py	135 ●●●●● diff \| view \| raw \| blame \| history
	tools/dy_transform_video_id.py	103 ●●●●● diff \| view \| raw \| blame \| history
	tools/easing.py	70 ●●●●● diff \| view \| raw \| blame \| history
	tools/slider_util.py	164 ●●●●● diff \| view \| raw \| blame \| history
	tools/time_util.py	106 ●●●●● diff \| view \| raw \| blame \| history
	tools/utils.py	31 ●●●●● diff \| view \| raw \| blame \| history
	tools/words.py	70 ●●●●● diff \| view \| raw \| blame \| history
	var.py	14 ●●●●● diff \| view \| raw \| blame \| history