Fiddler抓包---手機APP--python爬蟲 基本設定和操作
目錄
Fiddler安裝
下載:https://www.telerik.com/download/fiddler
安裝
配置選項
這個很必要,電腦否則不能上網
用谷歌瀏覽器訪問,獲取證照 http://localhost:8888/
手機電腦瀏覽器都要裝,發給手機並安裝,點下面的安卓機器人
手機wife設定
手機要使用電腦的ip做代理,這樣手機的資料才會被fiddler抓到,手機電腦用同一個wife
手機wife高階設定如下,埠要沒被佔用的
解析包資訊
安裝結束,使用手機訪問網路,Fillder就會獲取到資料包,如果手機沒網路,就重啟Fillder
獲取資料包與網頁無異,補全頭資訊即可
比如這個資料包
python爬取程式碼:
import urllib2
import requests
import json
url = "https://api.jingchengcaidian.com/api/Category/getCategoryName?pid=4&page=1&sessionId=c4faa1982c906a380e4fd09248428bd2"
headers = {
'charset': 'utf-8',
'Accept-Encoding': 'gzip',
'referer': 'https://servicewechat.com/wx2911548a18ed7d95/40/page-frame.html',
'content-type': 'application/json',
'User-Agent': 'Mozilla/5.0 (Linux; Android 7.0; FRD-AL10 Build/HUAWEIFRD-AL10; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/62.0.3202.84 Mobile Safari/537.36 MicroMessenger/6.7.3.1360(0x26070336) NetType/WIFI Language/zh_CN Process/appbrand0',
'Host': 'api.jingchengcaidian.com',
'Connection': 'Keep-Alive'
}
req = requests.get(url=url, headers=headers).json()
print json.dumps(req,ensure_ascii=False)
{"message": "列表獲取成功", "code": 1, "data": [{"timelable": "", "lable": "超值特惠", "name": "煙臺鮮活港灣扇貝27-39個約(0.9kg-1kg)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-12/1539339177.jpg", "amount": 67, "isvideo": "0", "market_price": "15.80", "buynum": "0", "group_price": "9.90", "smallpromotion": "肉質肥美,鮮嫩", "cateid": 470, "id": 11063, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "煙臺梭子蟹約1kg5-6只", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-22/9491540172318.jpg", "amount": 44, "isvideo": "0", "market_price": "100.00", "buynum": 85, "group_price": "85.00", "smallpromotion": "八成肥,保鮮不保活", "cateid": 470, "id": 11103, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "煙臺鮮小黃花魚20-24條約(0.9kg-1kg)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-12/1539352456.jpg", "amount": 93, "isvideo": "0", "market_price": "36.80", "buynum": "0", "group_price": "25.80", "smallpromotion": "純野生,味道鮮美", "cateid": 470, "id": 11065, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "煙臺鮮平魚8-10條約(0.9kg-1kg)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-12/1539334316.jpg", "amount": 127, "isvideo": "0", "market_price": "55.00", "buynum": "0", "group_price": "35.00", "smallpromotion": "未浸泡淡水,味道鮮美", "cateid": 470, "id": 11056, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "渤海灣鮮鮁魚2條約(0.9kg-1kg)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-22/3961540171948.jpg", "amount": 139, "isvideo": "0", "market_price": "45.00", "buynum": "0", "group_price": "39.80", "smallpromotion": "未浸泡淡水,味道鮮美", "cateid": 470, "id": 11050, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "渤海灣鮮帶魚4-5條約(0.9kg-1kg)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-23/351540261202.jpg", "amount": 15, "isvideo": "0", "market_price": "55.00", "buynum": "0", "group_price": "39.80", "smallpromotion": "未浸泡淡水,味道鮮美", "cateid": 470, "id": 11055, "desc": "取貨時間:10月26日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券588型5對10只(公3兩/只 母2兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534921365.jpg", "amount": 17, "isvideo": "0", "market_price": "280.00", "buynum": "0", "group_price": "258.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10307, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券688型4對8只(公3.5兩/只 母2.5兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922338.jpg", "amount": 10, "isvideo": "0", "market_price": "308.00", "buynum": "0", "group_price": "288.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10308, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券888型5對10只(公3.5兩/只 母2.5兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/331534922488.jpg", "amount": 15, "isvideo": "0", "market_price": "378.00", "buynum": "0", "group_price": "338.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10309, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券1088型4對8只(公4兩/只 母2.8兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922578.jpg", "amount": 20, "isvideo": "0", "market_price": "428.00", "buynum": "0", "group_price": "388.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10310, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券1368型5對10只(公4兩/只 母2.8兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922666.jpg", "amount": 16, "isvideo": "0", "market_price": "538.00", "buynum": "0", "group_price": "488.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10311, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券1388型4對8只(公4.5兩/只 母3.2兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922765.jpg", "amount": 18, "isvideo": "0", "market_price": "648.00", "buynum": "0", "group_price": "558.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10312, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券1688型5對10只(公4.5兩/只 母3.2兩隻)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922864.jpg", "amount": 19, "isvideo": "0", "market_price": "788.00", "buynum": "0", "group_price": "688.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10313, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券2088型4對8只(公5兩/只 母3.6兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534922938.jpg", "amount": 20, "isvideo": "0", "market_price": "1108.00", "buynum": "0", "group_price": "928.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10314, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "陽澄湖大閘蟹禮券2588型5對10只(公5兩/只 母3.6兩/只)", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-08-22/1534923022.jpg", "amount": 19, "isvideo": "0", "market_price": "1308.00", "buynum": "0", "group_price": "1138.00", "smallpromotion": "個體肥大、肉滿黃肥、鮮嫩多汁", "cateid": 820, "id": 10315, "desc": "取貨時間:10月25日 16:00"}, {"timelable": "", "lable": "", "name": "野漁江湖-冰鮮野生小鯽魚一斤5條左右-500克/袋", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-09-05/1536121055.jpg", "amount": 58, "isvideo": "1", "market_price": "35.00", "buynum": "0", "group_price": "25.00", "smallpromotion": "水庫野生淨膛冰鮮口感佳安全健康", "cateid": 824, "id": 10543, "desc": "取貨時間:10月27日 16:00"}, {"timelable": "", "lable": "", "name": "野漁江湖-冰鮮水庫魚頭-1000克/份", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-09-05/1536121995.jpg", "amount": 95, "isvideo": "1", "market_price": "90.00", "buynum": "0", "group_price": "70.00", "smallpromotion": "水庫胖頭魚頭 淨膛 冰鮮送達", "cateid": 824, "id": 10544, "desc": "取貨時間:10月27日 16:00"}, {"timelable": "", "lable": "", "name": "野漁江湖-水庫冰鮮草魚-1000克/份", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-09-05/1536122888.jpg", "amount": 94, "isvideo": "1", "market_price": "90.00", "buynum": "0", "group_price": "65.00", "smallpromotion": "水庫野生草魚淨膛真空包裝冰鮮送達", "cateid": 824, "id": 10545, "desc": "取貨時間:10月27日 16:00"}, {"timelable": "", "lable": "", "name": "野漁江湖-水庫野生黑魚-500克/條", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-09-25/1537847141.jpg", "amount": 21, "isvideo": "0", "market_price": "40.00", "buynum": "0", "group_price": "35.00", "smallpromotion": "野生黑魚肉質細嫩刺少安全美味", "cateid": 824, "id": 10767, "desc": "取貨時間:10月27日 16:00"}, {"timelable": "", "lable": "", "name": "野漁江湖-水庫野生小銀魚-500克/袋", "image": "http://checkmall.oss-cn-beijing.aliyuncs.com//Uploads/Picture/2018-10-07/1538885315.jpg", "amount": 25, "isvideo": "0", "market_price": "40.00", "buynum": "0", "group_price": "34.00", "smallpromotion": "新鮮銀魚無刺高蛋白老少皆宜", "cateid": 824, "id": 10841, "desc": "取貨時間:10月27日 16:00"}], "page": 2}
*url中的sessionid是加密過的,這個以後在研究
相關文章
- Fiddler(三)Fiddler設定手機抓包
- 用fiddler實現手機抓包
- 如何使用Fiddler抓包操作?
- fiddler 電腦 手機 連線抓包
- 【爬蟲】網頁抓包工具--Fiddler爬蟲網頁
- Python 爬蟲、抓包Python爬蟲
- fiddler抓包代理設定問題(PC端)
- Fiddler 安卓手機抓包教程安卓
- 如何對手機http進行抓包?Fiddler工具超好用HTTP
- 使用Fiddler對iPhone蘋果手機進行資料抓包分析iPhone蘋果
- fiddler5+雷電模擬器4.0對app抓包設定APP
- Fiddler抓包和修改WebSocket資料,支援wssWeb
- Fiddler 抓包詳細使用教程
- 【工具】Fiddler抓包使用筆記筆記
- 爬蟲分析利器:谷歌Chrome F12抓包分析爬蟲谷歌Chrome
- Fiddler(8)設定網路丟包和延遲
- Android 使用Fiddler4抓包Android
- Fiddler抓包一鍵生成程式碼
- APP爬蟲-雙向認證抓包的兩種方法APP爬蟲
- mac ---Charles抓包---ios蘋果手機MaciOS蘋果
- Python爬蟲:HTTPS請求與響應,以及抓包工具Fiddler的使用Python爬蟲HTTP
- Wireshark抓包過濾器設定過濾器
- 淺析手機抓包方法實踐
- 手機資料抓包入門教程
- 手機資料抓包以及wireshark技巧
- 使用whistle軟體對手機抓包
- 抓包軟體 Fiddler 瞭解一下?
- fiddler 實現 微信(PC端)小程式抓包
- 抓包整理外篇fiddler————瞭解工具欄[一]
- 手機通過 fiddler 抓包,有些請求為什麼就得不到返回資料了
- Android系統手機端抓包方法Android
- 手機抓包+注入黑科技HttpCanary——最強大的Android抓包注入工具HTTPPCAAndroid
- Python爬蟲(1.爬蟲的基本概念)Python爬蟲
- 基本的爬蟲工作原理爬蟲
- Android利用Fiddler進行網路資料抓包Android
- 小程式抓包實戰:Fiddler配置與使用詳細
- 我就想學介面測試,為什麼還要學 Fiddler 抓包,抓包是什麼鬼?
- Python爬蟲技巧---設定代理IPPython爬蟲