Python实战视频1.4 如何获取网页中的动态数据（爬取KnewOne网站）

目的：使用爬虫抓取网站异步加载数据

part1：什么是异步加载？

异步加载即网页上没有页码跳转按钮，鼠标往下滚即可继续加载数据。（打开网页时，只加载一部分数据）

此为往下滚时加载的内容

part2：如何抓取异步加载数据？

（一）任务内容：爬取网页上的图片、标题和跳转链接


点击图片会有跳转链接

（二）最终成果展示：

E:\python3.5.1\python.exe E:/我的实战代码/myvedio1.4/vedio4.py

{'img': 'https://making-photos.b0.upaiyun.com/photos/dfaec1d3ba6df86562f9699869ababd4.jpg!thing.fixed.big', 'link': '/things/osmo-er-tong-you-xi-tao-jian', 'title': 'Osmo 儿童游戏套件'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/d0877ed9dfa2cd855aa5acfd32cdcc62.jpg!thing.fixed.big', 'link': '/things/le-shi-a200', 'title': '乐事 A200'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/46b8cdbf2053b87d8c4c8d275b3d5b05.jpg!thing.fixed.big', 'link': '/things/bang-and-olufsen-beoplay-h4', 'title': 'Bang & Olufsen Beoplay H4'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/0f48595529627efd5ed58d5791385a63.jpg!thing.fixed.big', 'link': '/things/zhui-qiu-ke-ji-zq16-yi-zhu-qian-ming-ban', 'title': '追求科技 ZQ16 艺术签名版'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/d342b49d8effb9f3e60258c39e9193f1.jpeg!thing.fixed.big', 'link': '/things/philips-she4205bk', 'title': 'Philips SHE4205BK'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/6bccdd5c134977ca5149fc0101862340.jpg!thing.fixed.big', 'link': '/things/humanscale-word-chair', 'title': 'Humanscale word chair'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/0d55169f38de18740eb9e4fdc5c76865.jpg!thing.fixed.big', 'link': '/things/cutipol-duna-gold', 'title': 'Cutipol DUNA Gold'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/2194ed37ca0092372763cd9ee2d490e3.jpg!thing.fixed.big', 'link': '/things/dunoon-xiang-ri-kui-ma-ke-bei', 'title': 'Dunoon 向日葵马克杯'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/819bc7954c54311c88952b956fca4901.jpg!thing.fixed.big', 'link': '/things/zhi-zao-xing-qiu-bei', 'title': '质造 星球杯'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/92e24be87f0b44a9faddf2796e34709e.jpg!thing.fixed.big', 'link': '/things/s2c-ao-su-da', 'title': 'S2c 澳速达'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/a673a04e1f0f35281a84ae21b7656de3.jpg!thing.fixed.big', 'link': '/things/brinno-tlc-n130', 'title': 'Brinno TLC-N130'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/79dccc1362fa40686133e04e70d775ec.jpg!thing.fixed.big', 'link': '/things/ji-mi-h1s', 'title': '极米 H1s'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/533ec6018d50daf53cdbfe2e85e06707.jpg!thing.fixed.big', 'link': '/things/steelseries-apex-m400', 'title': 'STEELSERIES APEX M400'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/283b54cb7ba7df686cfcb5e0e32ed521.jpg!thing.fixed.big', 'link': '/things/akg-n25', 'title': 'AKG N25'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/160e1f32aa3e7cb9f3de26e4d3709c7f.jpg!thing.fixed.big', 'link': '/things/paiyon-a61', 'title': 'PAIYON A61'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/41248197d87b3f2936ec718ec1ce5ed8.jpg!thing.fixed.big', 'link': '/things/muko-gd760', 'title': 'MUKO GD760'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/a55c1158aedc8f60ccf7c73c78b193f1.jpg!thing.fixed.big', 'link': '/things/ivvi-k5', 'title': 'ivvi k5'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/e3321e885d996471091a34fe63610627.jpg!thing.fixed.big', 'link': '/things/colorfly-c200', 'title': 'Colorfly c200'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/10ad929e954c51982f01e60962ae227b.jpg!thing.fixed.big', 'link': '/things/bubm-switchshou-na-bao', 'title': 'BUBM switch收纳包'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/2883a5c06b4da12a0cde1b7dff26b104.jpg!thing.fixed.big', 'link': '/things/tbot', 'title': 'TBot'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/d347ad8c63bc4c788b8532446999565d.jpg!thing.fixed.big', 'link': '/things/sevenhugs-smart-remote-the-first-remote-for-everything', 'title': 'Sevenhugs Smart Remote: The First Remote for Everything'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/d3598e1d08d3bb6bc145fc6766aed240.jpg!thing.fixed.big', 'link': '/things/cutipol-goa-lan-jin-xi-lie', 'title': 'Cutipol GOA 蓝金系列'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/5e6c626e33640f2504cfc5774200259d.jpg!thing.fixed.big', 'link': '/things/marimekko-hong-se-yuan-dian-ma-ke-bei', 'title': 'Marimekko 红色圆点马克杯'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/482f9f20e396e6c3eacdab7a6cc03757.jpg!thing.fixed.big', 'link': '/things/tredy-hd8', 'title': 'Tredy HD8'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/dd36d6878f00964981985615467b4a66.jpg!thing.fixed.big', 'link': '/things/barsetto-bac006n', 'title': 'Barsetto BAC006N '}

{'img': 'https://making-photos.b0.upaiyun.com/photos/f8bf1e043b31efe625a42b7f75d01f9a.jpg!thing.fixed.big', 'link': '/things/zhi-zao-zhi-bei', 'title': '质造 执杯'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/6aff9a37dafe040f8a8205f40f57b611.jpg!thing.fixed.big', 'link': '/things/creative-katana', 'title': 'Creative katana '}

{'img': 'https://making-photos.b0.upaiyun.com/photos/0ce030985dce2dc28ab0964c85ae5ba2.jpg!thing.fixed.big', 'link': '/things/hui-wei-m1a', 'title': '惠威 M1A '}

{'img': 'https://making-photos.b0.upaiyun.com/photos/f58a4303d59bdc5cb9d071495777a2bd.jpg!thing.fixed.big', 'link': '/things/oneup-hai-dao-h5', 'title': 'ONEUP 海盗 H5 '}

{'img': 'https://making-photos.b0.upaiyun.com/photos/c51ed8faffad947c2938e49ff58dea20.jpg!thing.fixed.big', 'link': '/things/cherry-mx-board9-dot-0', 'title': 'Cherry MX-Board9.0 '}

{'img': 'https://making-photos.b0.upaiyun.com/photos/29fee3e8549b194ae802de887b15f721.jpg!thing.fixed.big', 'link': '/things/jvc-ha-fx77x', 'title': 'JVC HA-FX77X'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/c4a35b36246400b1ac3e1271eb602948.jpg!thing.fixed.big', 'link': '/things/shen-hua-tt-p', 'title': '神画 TT-P'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/256e1de1c140a63d7d3047b7f47eba21.jpg!thing.fixed.big', 'link': '/things/mo-bao-ck103', 'title': '摩豹 CK103 '}

{'img': 'https://making-photos.b0.upaiyun.com/photos/581757761c2697a0720d0f121827ac32.png!thing.fixed.big', 'link': '/things/yeecook-zhi-neng-men-shao-slash-bing-zhen-hu', 'title': 'YEECOOK 智能焖烧/冰镇壶'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/cd523e05d92536168eddf59348fc2ece.jpg!thing.fixed.big', 'link': '/things/cutipol-goa-black', 'title': 'Cutipol GOA Black '}

{'img': 'https://making-photos.b0.upaiyun.com/photos/17fb446326937182ef5a0f3d3a0693c3.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-jia-ke-chong-zhan-li-shi-shu-zhuang-tai-1', 'title': '壹佰木 甲壳虫站立式梳妆台'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/46bbaf2ec6160013d8beb2e1e5cef390.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-more-90-degrees-yi-mao-jia', 'title': '壹佰木 more 90°衣帽架'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/3678211621549b47810c7aba99f90fbb.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-yan-jiao-shu-jia', 'title': '壹佰木 檐角书架'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/f90db605dcc69e80ec6f477a3758f35b.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-tao-tong-chuang', 'title': '壹佰木 套筒床'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/0347b32ea2fac18c86b17ea7aec991fc.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-mo-shao-quan-yi', 'title': '壹佰木 末梢圈椅'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/353dbd66d3ecdc5ab4d16eeb742773a4.jpg!thing.fixed.big', 'link': '/things/cutipol-rondo-matt-gold', 'title': 'Cutipol Rondo matt Gold'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/2b6ad21c4297832d43f2b89e0cd6e76b.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-xie-jiao-shu-zhuo', 'title': '壹佰木 斜角书桌'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/3b7798fab1d72004c8f3a8fa93582cfb.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-duo-li-ke-cha-ji', 'title': '壹佰木 多立克茶几'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/c44a747e0c39a58a636717f780c0f497.jpg!thing.fixed.big', 'link': '/things/barsetto-jia-yong-bian-xi-yi-shi-xiao-nang-ka-pei-ji', 'title': 'Barsetto 家用便携意式胶囊咖啡机'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/39f525cf94b87637fe4f660d40ed397b.jpg!thing.fixed.big', 'link': '/things/barsetto-ka-pei-xiao-nang', 'title': 'barsetto 咖啡胶囊'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/11344c67cb48576a435bb91ca8d42b2a.jpg!thing.fixed.big', 'link': '/things/barsetto-zhen-kong-bao-wen-bei', 'title': 'barsetto 真空保温杯'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/d82679418c77093aaa67361da3413cad.jpg!thing.fixed.big', 'link': '/things/barsetto-zhen-kong-bu-xiu-gang-bian-xi-bao-wen-bei', 'title': 'Barsetto 真空不锈钢便携保温杯'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/d8dfbf75efd47ddfad22a5358d99adc4.jpg!thing.fixed.big', 'link': '/things/barsetto-bian-xi-shi-yi-shi-xiao-nang-ka-pei-ji', 'title': 'Barsetto 便携式意式胶囊咖啡机'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/2b806e53b0269ff6d247cbc22a6d3240.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-wei-yuan-xiao-bian-ji', 'title': '壹佰木 围圆小边几'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/963946dad6a83e34c117889b6e3d8cec.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-wei-yuan-xiao-bian-ji-1', 'title': '壹佰木 围圆小边几'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/dcb08ed1015eaf0122ad56941c9b7f2a.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-hui-yuan-bian-ji', 'title': '壹佰木 回垣边几'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/9fc0b8387f218105807289ebc03d5487.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-chang-jing-lu-gao-jia', 'title': '壹佰木 长颈鹿高架'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/e5a2001527dbb350d46d198eda199f1f.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-xiao-man-tiao-deng', 'title': '壹佰木 小蛮条凳'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/e1fef037e8a73c7bd4e6ca8e2d931ca7.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-ba-shan-can-bian-ju', 'title': '壹佰木 跋山餐边柜'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/aa883d5ca2df165ac80e12283ad58a21.jpg!thing.fixed.big', 'link': '/things/eporas-ping-di-guo', 'title': 'EPORAS 平底锅'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/c18404a8528b700086e81442842dc9a3.jpg!thing.fixed.big', 'link': '/things/coswheel-pro-1', 'title': 'COSWHEEL PRO-1'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/0764770e4343e4da91be9c33c5721716.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-yan-jiao-shu-ju', 'title': '壹佰木 檐角书柜'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/f21fdcb6200e1cf8c8636598459e04c4.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-zhe-ying-sha-fa', 'title': '壹佰木 哲影沙发'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/8f39d85570efae4f0244381252adac08.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-wei-yuan-chuang', 'title': '壹佰木 围圆床'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/97ce125c7df982a4f1f37c937ba0dbd3.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-ping-xing-can-zhuo', 'title': '壹佰木 平行餐桌'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/478f6332d7f8dbbc337bd6b19271fd00.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-zu-he-bu-yi-sha-fa', 'title': '壹佰木 组合布艺沙发'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/75ad5a28e82673093dd60d5ace114dea.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-bu-yi-sha-fa', 'title': '壹佰木 布艺沙发'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/69ac7e26c99dc37efb7958556c4e5d6d.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-wu-hou-cha-ji', 'title': '壹佰木 午后茶几'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/69bd480439227d27d899c5e9b15441c1.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-bai-xiang-mu-chuang', 'title': '壹佰木 白橡木床'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/b67960ee418822580a26f6171c7298ff.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-ba-shan-chuang-tou-ju', 'title': '壹佰木 跋山床头柜'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/0b79fcb7b7aab8dc02419ff78d5d9ad9.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-ba-shan-bian-zhuo', 'title': '壹佰木 跋山边桌'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/709829b3c7c2c6d29cbcef8009d62753.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-ba-zi-yi-mao-jia', 'title': '壹佰木 八字衣帽架'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/16ac421114cbcba33ea30274e9504800.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-ji-jian-dian-shi-ju', 'title': '壹佰木 极简电视柜'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/87d85e2fea3668da3bff73f6dc6224d6.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-yue-guang-ying-chuang-tou-ju', 'title': '壹佰木  月光影床头柜'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/5d8f5c798bac2bcfcb413dba1ed65f39.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-xuan-hu-shu-zhuang-tai', 'title': '壹佰木 悬弧梳妆台'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/2693028cd21057c4d7a7e1f43d76d2ae.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-yan-wei-chuang', 'title': '壹佰木 燕尾床'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/f4ecd9e598205782ad62dc999952743b.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-ji-jian-tou-qi-zu-he-xie-ju', 'title': '壹佰木 极简透气组合鞋柜'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/a21ab8f4d9b11607f754df663d9bcc12.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-yuan-wei-shou-na-cha-shui-ju', 'title': '壹佰木 鸢尾收纳茶水柜'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/e3a8ac64aed64b2bece1a4fc7b080fb0.jpg!thing.fixed.big', 'link': '/things/selah-pad', 'title': 'Selah pad'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/431b5290c39535bc154014bc9db4a6d8.png!thing.fixed.big', 'link': '/things/arabia-1873-paratiisi', 'title': 'ARABIA 1873  Paratiisi '}

{'img': 'https://making-photos.b0.upaiyun.com/photos/3c3ae371470ac61309bed5582bb75033.jpg!thing.fixed.big', 'link': '/things/boe-igallery-dian-zi-xiang-kuang', 'title': 'BOE iGallery 电子相框'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/4fa7a4701ebfe1c5a4bc324486b0f6c8.jpg!thing.fixed.big', 'link': '/things/derm-institute-sos-kang-yang-bao-shi-bu-shui-dong-mo', 'title': 'DERM iNSTITUTE SOS 抗氧保湿补水冻膜'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/bb01f4fffb6d3cc9e8e8e52d346195d7.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-dian-shi-ju', 'title': '壹佰木 电视柜'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/6bc5b528dcd60c6918be18f8867e693e.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-ka-pei-zhuo', 'title': '壹佰木 咖啡桌'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/24f26ae28d511e6c2ba99d205ee6bbc5.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-jian-cang-shu-zhuo', 'title': '壹佰木 简藏书桌'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/b5d443144f4f96a93e5139ec2028efcb.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-wo-yi-san-ren-wei-sha-fa', 'title': '壹佰木 喔依三人位沙发'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/085ff12334a47f6459ad4983f19797fe.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-xiang-can-zhuo', 'title': '壹佰木 橡餐桌'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/528edec371948c49c94734d040e12a57.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-ba-shan-wu-dou-ju', 'title': '壹佰木 跋山五斗柜'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/a5c433e043d32681936b16417b1e0a35.jpg!thing.fixed.big', 'link': '/things/yi-bai-mu-xie-jiao-can-zhuo', 'title': '壹佰木 斜角餐桌'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/aaeb7de0751ebc627c0971deb633b265.jpg!thing.fixed.big', 'link': '/things/olloclip-si-he-she-xiang-jing-tou-iphone-6-slash-6-plus-ban', 'title': 'olloclip 四合一摄像镜头 iPhone 6/6 Plus 版'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/35505a63968dda0581cc970efe62563b.jpg!thing.fixed.big', 'link': '/things/fei-mi-yi-yao-ji-ji-jing-mian-tiao', 'title': '非秘 医药级洁净棉条'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/1395e25a7f9deb4f0a9c1ba9f54c1d7c.jpg!thing.fixed.big', 'link': '/things/xiao-ji-minij', 'title': '小吉 miniJ'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/9fd4df10bb8b2ce44b970230f28db55e.jpg!thing.fixed.big', 'link': '/things/ergotron-45-241-026', 'title': 'Ergotron 45-241-026'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/2cbe294a6dcc68b770d3b3fe67043b46.jpg!thing.fixed.big', 'link': '/things/xax-air-funk', 'title': 'XAX Air Funk'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/d5c56fb4a128fb56efc1bdf59e4313cc.jpg!thing.fixed.big', 'link': '/things/shapton-ren-zhi-hei-mu', 'title': 'SHAPTON 刃之黑幕'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/9ef3f4c70651576374561a9982161f1f.jpg!thing.fixed.big', 'link': '/things/mo-bao-k87s', 'title': '摩豹 K87s'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/6f2d2dfa9141bd599e55b14d1a5debbc.jpg!thing.fixed.big', 'link': '/things/ai-wei-ma-mi-zhi-neng-ti-wen-ji', 'title': '爱微 妈咪智能体温计'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/6bd1533853fbc8ace376a0ae0cc24df8.jpg!thing.fixed.big', 'link': '/things/roome-lan-ya-zhi-neng-wan-an-deng', 'title': 'Roome 蓝牙智能晚安灯'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/8153daee2b68c1679ef3c5d04b576e27.png!thing.fixed.big', 'link': '/things/nintendo-switch', 'title': 'Nintendo Switch'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/3062351bb68c9153b3788d7fcea7ca1b.jpg!thing.fixed.big', 'link': '/things/ggmm-e5', 'title': 'GGMM E5'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/b2b28e451e6876c33bdd00d6c9446c22.png!thing.fixed.big', 'link': '/things/peng-bo-shi-kong-qi-jian-ce-yi', 'title': '鹏博士 空气检测仪'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/1e746e806fa50609e94193ec38af8c16.jpg!thing.fixed.big', 'link': '/things/creative-outlier-sports', 'title': 'Creative Outlier Sports'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/6902e4438c5a1bea196e792efde5a5c3.png!thing.fixed.big', 'link': '/things/muko-gd330', 'title': 'MUKO GD330'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/001e19c07e025b87168a60dafffda302.jpg!thing.fixed.big', 'link': '/things/cayin-n3', 'title': 'cayin N3'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/631e09d96fc83aef153042fece2f99a6.jpg!thing.fixed.big', 'link': '/things/jvc-kenwood-kh-crz700', 'title': 'JVC KENWOOD KH-CRZ700'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/8fdbdec9ac3523c890f52fa65d2c8aa1.png!thing.fixed.big', 'link': '/things/daart-canary', 'title': 'DAART CANARY'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/55c59023d9664987b4a63232ae4a67c3.jpg!thing.fixed.big', 'link': '/things/muko-gd780', 'title': 'MUKO GD780'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/44e37f4a6266ed253591d9e138445640.jpg!thing.fixed.big', 'link': '/things/simgot-en700-bass', 'title': 'SIMGOT EN700-BASS'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/c15684156553f5c2a5c411df9e16f7b4.jpg!thing.fixed.big', 'link': '/things/you-bai-na-optimallife', 'title': '优百纳 optimallife'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/5507764294c79354ff6cc6f55c058a90.jpg!thing.fixed.big', 'link': '/things/akko-x-ducky-one87pbt', 'title': 'Akko X Ducky One87PBT'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/370908b163206d94591ca5aaa17a865b.jpg!thing.fixed.big', 'link': '/things/jin-shi-dun-hyperx-alloy', 'title': '金士顿 HyperX Alloy'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/c0b9b23022f3a6462d848e9cea98f3b0.jpg!thing.fixed.big', 'link': '/things/ganss-gs87-gs104', 'title': 'GANSS GS87 GS104'}

{'img': 'https://making-photos.b0.upaiyun.com/photos/b445ed97d59989fbaaa4ac6565ca368d.png!thing.fixed.big', 'link': '/things/netgear-orbi', 'title': 'Netgear Orbi '}

Process finished with exit code 0

（三）我的代码



构造函数实现获取多页数的请求，控制获取的页数数量，做时间上的保护

(四)代码分析：

1.注意抓取路径怎么写：便签.class的内容

2.格式问题：soup.select('     ')

    data = { 'img':img.get('src')}

3.if data == None

4.代码步骤：引用beautifulsoup和request   抓取信息  将数据装起来 构造函数实现多页数的请求   控制获取的页数数量 做时间上的保护 调用函数并获取数据

最后编辑于 ：
©著作权归作者所有,转载或内容合作请联系作者
  • 人面猴
    序言：七十年代末，一起剥皮案震惊了整个滨河市，随后出现的几起案子，更是在滨河造成了极大的恐慌，老刑警刘岩，带你破解...
    沈念sama阅读 159,117评论 4赞 362
  • 死咒
    序言：滨河连续发生了三起死亡事件，死亡现场离奇诡异，居然都是意外死亡，警方通过查阅死者的电脑和手机，发现死者居然都...
    沈念sama阅读 67,328评论 1赞 293
  • 救了他两次的神仙让他今天三更去死
    文/潘晓璐 我一进店门，熙熙楼的掌柜王于贵愁眉苦脸地迎上来，“玉大人，你说我怎么就摊上这事。” “怎么了？”我有些...
    开封第一讲书人阅读 108,839评论 0赞 243
  • 道士缉凶录：失踪的卖姜人
    文/不坏的土叔 我叫张陵，是天一观的道长。 经常有香客问我，道长，这世上最难降的妖魔是什么？ 我笑而不...
    开封第一讲书人阅读 44,007评论 0赞 206
  • 港岛之恋（遗憾婚礼）
    正文 为了忘掉前任，我火速办了婚礼，结果婚礼上，老公的妹妹穿的比我还像新娘。我一直安慰自己，他们只是感情好，可当我...
    茶点故事阅读 52,384评论 3赞 287
  • 恶毒庶女顶嫁案：这布局不是一般人想出来的
    文/花漫 我一把揭开白布。 她就那样静静地躺着，像睡着了一般。 火红的嫁衣衬着肌肤如雪。 梳的纹丝不乱的头发上，一...
    开封第一讲书人阅读 40,629评论 1赞 219
  • 城市分裂传说
    那天，我揣着相机与录音，去河边找鬼。 笑死，一个胖子当着我的面吹牛，可吹牛的内容都是我干的。 我是一名探鬼主播，决...
    沈念sama阅读 31,880评论 2赞 313
  • 双鸳鸯连环套：你想象不到人心有多黑
    文/苍兰香墨 我猛地睁开眼，长吁一口气：“原来是场噩梦啊……” “哼！你这毒妇竟也来了？” 一声冷哼从身侧响起，我...
    开封第一讲书人阅读 30,593评论 0赞 198
  • 万荣杀人案实录
    序言：老挝万荣一对情侣失踪，失踪者是张志新（化名）和其女友刘颖，没想到半个月后，有当地人在树林里发现了一具尸体，经...
    沈念sama阅读 34,313评论 1赞 243
  • 护林员之死
    正文 独居荒郊野岭守林人离奇死亡，尸身上长有42处带血的脓包…… 初始之章·张勋 以下内容为张勋视角 年9月15日...
    茶点故事阅读 30,575评论 2赞 246
  • 白月光启示录
    正文 我和宋清朗相恋三年，在试婚纱的时候发现自己被绿了。 大学时的朋友给我发了我未婚夫和他白月光在一起吃饭的照片。...
    茶点故事阅读 32,066评论 1赞 260
  • 活死人
    序言：一个原本活蹦乱跳的男人离奇死亡，死状恐怖，灵堂内的尸体忽然破棺而出，到底是诈尸还是另有隐情，我是刑警宁泽，带...
    沈念sama阅读 28,392评论 2赞 253
  • 日本核电站爆炸内幕
    正文 年R本政府宣布，位于F岛的核电站，受9级特大地震影响，放射性物质发生泄漏。R本人自食恶果不足惜，却给世界环境...
    茶点故事阅读 33,052评论 3赞 236
  • 男人毒药：我在死后第九天来索命
    文/蒙蒙 一、第九天 我趴在偏房一处隐蔽的房顶上张望。 院中可真热闹，春花似锦、人声如沸。这庄子的主人今日做“春日...
    开封第一讲书人阅读 26,082评论 0赞 8
  • 一桩弑父案，背后竟有这般阴谋
    文/苍兰香墨 我抬头看了看天上的太阳。三九已至，却和暖如春，着一层夹袄步出监牢的瞬间，已是汗流浃背。 一阵脚步声响...
    开封第一讲书人阅读 26,844评论 0赞 195
  • 情欲美人皮
    我被黑心中介骗来泰国打工， 没想到刚下飞机就差点儿被人妖公主榨干…… 1. 我叫王不留，地道东北人。 一个月前我还...
    沈念sama阅读 35,662评论 2赞 274
  • 代替公主和亲
    正文 我出身青楼，却偏偏与公主长得像，于是被迫代替她去往敌国和亲。 传闻我的和亲对象是个残疾皇子，可洞房花烛夜当晚...
    茶点故事阅读 35,575评论 2赞 270

推荐阅读更多精彩内容

  • 2003-2014考研真题
    **2014真题Directions:Read the following text. Choose the be...
    又是夜半惊坐起阅读 8,578评论 0赞 23
  • 浅谈庄子（二）
    上回讲到庄子去监河侯那里借米，监河侯很热情，要给他三百金。庄子一听，却气得不行，叫做“忿然作色”。于是就给监河侯讲...
    悟予阅读 550评论 0赞 0
  • 小红花
    今天上午我得了一朵小红花，因为我的坐姿比要端正，今天下午六得了一朵小红花，因为作业写得比较工整，谢谢老师我会一直保...
    王云汉1阅读 104评论 0赞 0
  • 2017-08-13
    欢迎我媳妇儿阅读 158评论 0赞 0