This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
1.本代码基于excel的宏录制和VBA功能 | |
2.主要使用的功能有,打开文件,复制内容,粘贴内容,去重,筛选,取消合并单元格,添加公式等常用excel操作, | |
3.相当于把手动excel操作封装成为代码,这样就可以把原来30min左右制作报表时间,直接缩短到了3min之内。 | |
4.本代码仅供交流学习,请勿商用。 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
本爬虫可以爬取几个著名互联网平台如小赢理财,爱钱进,玖富普惠,积木盒子,等平台P2P产品的产品名,期限,利息和加息等信息 | |
主要使用的方法是request获取网页信息,再用bs4、lxml(xpath),pyquery(query)等select选择器筛选定位所需信息,或者直接通过json读取相应接口内容,再numpy的array暂存数组,最后用pandas保存到csv里面,以供继续分析 | |
相关网页链接主要通过谷歌浏览器抓包获得,APP相关网页信息接口主要通过stream平台获得 | |
本爬虫仅供技术交流,请勿商用 | |
如有问题,欢迎随时给我留言 |