Fiddler抓包---手機APP--python爬蟲 基本設定和操作

水木本源發表於2018-10-24

目錄

Fiddler安裝

手機wife設定

解析包資訊

 python爬取程式碼:


Fiddler安裝

下載:https://www.telerik.com/download/fiddler

安裝

配置選項

 

 這個很必要,電腦否則不能上網

 

用谷歌瀏覽器訪問,獲取證照  http://localhost:8888/

手機電腦瀏覽器都要裝,發給手機並安裝,點下面的安卓機器人

 

手機wife設定

手機要使用電腦的ip做代理,這樣手機的資料才會被fiddler抓到,手機電腦用同一個wife

手機wife高階設定如下,埠要沒被佔用的

解析包資訊

安裝結束,使用手機訪問網路,Fillder就會獲取到資料包,如果手機沒網路,就重啟Fillder

獲取資料包與網頁無異,補全頭資訊即可

比如這個資料包

 python爬取程式碼:

import urllib2
import requests
import json
url = "https://api.jingchengcaidian.com/api/Category/getCategoryName?pid=4&page=1&sessionId=c4faa1982c906a380e4fd09248428bd2"
headers = {
            'charset': 'utf-8',
            'Accept-Encoding': 'gzip',
            'referer': 'https://servicewechat.com/wx2911548a18ed7d95/40/page-frame.html',
            'content-type': 'application/json',
            'User-Agent': 'Mozilla/5.0 (Linux; Android 7.0; FRD-AL10 Build/HUAWEIFRD-AL10; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/62.0.3202.84 Mobile Safari/537.36 MicroMessenger/6.7.3.1360(0x26070336) NetType/WIFI Language/zh_CN Process/appbrand0',
            'Host': 'api.jingchengcaidian.com',
            'Connection': 'Keep-Alive'
            }
req = requests.get(url=url, headers=headers).json()
print json.dumps(req,ensure_ascii=False)
{"message": "列表獲取成功", "code": 1, "data": [{"timelable": "", "lable": "超值特惠", "name": "煙臺鮮活港灣扇貝27-39個約(0.9kg-1kg)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-12/1539339177.jpg", "amount": 67, "isvideo": "0", "market_price": "15.80", "buynum": "0", "group_price": "9.90", "smallpromotion": "肉質肥美,鮮嫩", "cateid": 470, "id": 11063, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "煙臺梭子蟹約1kg5-6只", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-22/9491540172318.jpg", "amount": 44, "isvideo": "0", "market_price": "100.00", "buynum": 85, "group_price": "85.00", "smallpromotion": "八成肥,保鮮不保活", "cateid": 470, "id": 11103, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "煙臺鮮小黃花魚20-24條約(0.9kg-1kg)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-12/1539352456.jpg", "amount": 93, "isvideo": "0", "market_price": "36.80", "buynum": "0", "group_price": "25.80", "smallpromotion": "純野生,味道鮮美", "cateid": 470, "id": 11065, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "煙臺鮮平魚8-10條約(0.9kg-1kg)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-12/1539334316.jpg", "amount": 127, "isvideo": "0", "market_price": "55.00", "buynum": "0", "group_price": "35.00", "smallpromotion": "未浸泡淡水,味道鮮美", "cateid": 470, "id": 11056, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "渤海灣鮮鮁魚2條約(0.9kg-1kg)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-22/3961540171948.jpg", "amount": 139, "isvideo": "0", "market_price": "45.00", "buynum": "0", "group_price": "39.80", "smallpromotion": "未浸泡淡水,味道鮮美", "cateid": 470, "id": 11050, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "渤海灣鮮帶魚4-5條約(0.9kg-1kg)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-23/351540261202.jpg", "amount": 15, "isvideo": "0", "market_price": "55.00", "buynum": "0", "group_price": "39.80", "smallpromotion": "未浸泡淡水,味道鮮美", "cateid": 470, "id": 11055, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券588型5對10只(公3兩/只 母2兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534921365.jpg", "amount": 17, "isvideo": "0", "market_price": "280.00", "buynum": "0", "group_price": "258.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10307, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券688型4對8只(公3.5兩/只 母2.5兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922338.jpg", "amount": 10, "isvideo": "0", "market_price": "308.00", "buynum": "0", "group_price": "288.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10308, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券888型5對10只(公3.5兩/只 母2.5兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/331534922488.jpg", "amount": 15, "isvideo": "0", "market_price": "378.00", "buynum": "0", "group_price": "338.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10309, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券1088型4對8只(公4兩/只 母2.8兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922578.jpg", "amount": 20, "isvideo": "0", "market_price": "428.00", "buynum": "0", "group_price": "388.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10310, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券1368型5對10只(公4兩/只 母2.8兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922666.jpg", "amount": 16, "isvideo": "0", "market_price": "538.00", "buynum": "0", "group_price": "488.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10311, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券1388型4對8只(公4.5兩/只 母3.2兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922765.jpg", "amount": 18, "isvideo": "0", "market_price": "648.00", "buynum": "0", "group_price": "558.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10312, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券1688型5對10只(公4.5兩/只 母3.2兩隻)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922864.jpg", "amount": 19, "isvideo": "0", "market_price": "788.00", "buynum": "0", "group_price": "688.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10313, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券2088型4對8只(公5兩/只 母3.6兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922938.jpg", "amount": 20, "isvideo": "0", "market_price": "1108.00", "buynum": "0", "group_price": "928.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10314, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券2588型5對10只(公5兩/只 母3.6兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534923022.jpg", "amount": 19, "isvideo": "0", "market_price": "1308.00", "buynum": "0", "group_price": "1138.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10315, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "野漁江湖-冰鮮野生小鯽魚一斤5條左右-500克/袋", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-09-05/1536121055.jpg", "amount": 58, "isvideo": "1", "market_price": "35.00", "buynum": "0", "group_price": "25.00", "smallpromotion": "水庫野生淨膛冰鮮口感佳安全健康", "cateid": 824, "id": 10543, "desc": "取貨時間:10月27日 16:00"}, {"timelable": "", "lable": "", "name": "野漁江湖-冰鮮水庫魚頭-1000克/份", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-09-05/1536121995.jpg", "amount": 95, "isvideo": "1", "market_price": "90.00", "buynum": "0", "group_price": "70.00", "smallpromotion": "水庫胖頭魚頭 淨膛 冰鮮送達", "cateid": 824, "id": 10544, "desc": "取貨時間:10月27日 16:00"}, {"timelable": "", "lable": "", "name": "野漁江湖-水庫冰鮮草魚-1000克/份", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-09-05/1536122888.jpg", "amount": 94, "isvideo": "1", "market_price": "90.00", "buynum": "0", "group_price": "65.00", "smallpromotion": "水庫野生草魚淨膛真空包裝冰鮮送達", "cateid": 824, "id": 10545, "desc": "取貨時間:10月27日 16:00"}, {"timelable": "", "lable": "", "name": "野漁江湖-水庫野生黑魚-500克/條", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-09-25/1537847141.jpg", "amount": 21, "isvideo": "0", "market_price": "40.00", "buynum": "0", "group_price": "35.00", "smallpromotion": "野生黑魚肉質細嫩刺少安全美味", "cateid": 824, "id": 10767, "desc": "取貨時間:10月27日 16:00"}, {"timelable": "", "lable": "", "name": "野漁江湖-水庫野生小銀魚-500克/袋", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-07/1538885315.jpg", "amount": 25, "isvideo": "0", "market_price": "40.00", "buynum": "0", "group_price": "34.00", "smallpromotion": "新鮮銀魚無刺高蛋白老少皆宜", "cateid": 824, "id": 10841, "desc": "取貨時間:10月27日 16:00"}], "page": 2}

*url中的sessionid是加密過的,這個以後在研究

相關文章