[問題] 網頁爬蟲問題

看板C_Sharp (C#)作者ntasop (kuli)時間7年前 (2017/11/11 12:28)推噓3(3推 0噓 3→)

留言6則, 5人參與討論串1/1

請問大家用post方式抓網頁資料，同樣方式加request header和json資料， python可以正常抓到網路資料，但C#沒辦法，請問大家有甚麼地方還需要注意，非常謝謝。 C#版本: HttpClient httpClient = new HttpClient(); httpClient.DefaultRequestHeaders.Accept.Add(new MediaTypeWithQualityHeaderValue("application/json")); httpClient.DefaultRequestHeaders.Add("referer", "https://shopee.tw/jeanch911"); httpClient.DefaultRequestHeaders.Add("user-agent", "Chrome/61.0.3163.100 Safari/537.36"); httpClient.DefaultRequestHeaders.Add("x-csrftoken", "iGwDsBPnVwMlr68yxp23vxYB3N53gMRH"); httpClient.DefaultRequestHeaders.Add("cookie", "略過太長...."); httpClient.BaseAddress = new Uri("https://shopee.tw/"); string str = "{\"shop_ids\":[6550848]}; JObject jsonObject = JObject.Parse(str); var content = new StringContent(jsonObject.ToString(), Encoding.UTF8, "application/json"); var respone = await httpClient.PostAsync("api/v1/shops", content); System.Console.WriteLine(respone.Content.ReadAsStringAsync().Result); python版本: headers = { 'Cookie':'.......略過太長', 'Referer':'https://shopee.tw/trc.tw', 'User-Agent':'Chrome/61.0.3163.100 Safari/537.36', 'X-CSRFToken':'3EwwiZKHrh74ZjKB1oHycwOgS6COQNon'} jd = json.loads('{"shop_ids":[24550283]}') response = requests.post('https://shopee.tw/api/v1/shops/', json = jd, headers = headers) print(response.text.encode('utf-8').decode('unicode_escape')) -- ※ 發信站: 批踢踢實業坊(ptt.cc), 來自: 175.180.200.197 ※ 文章網址: https://www.ptt.cc/bbs/C_Sharp/M.1510374513.A.15E.html