TA的每日心情 | 开心 2018-5-12 15:02 |
---|
签到天数: 7 天 [LV.3]偶尔看看II
|
发表于 2018-4-3 13:24:18
|
显示全部楼层
python爬虫 post方式爬取搜狗翻译8 y; s+ t# [4 c
https://www.jianshu.com/p/884117620067( e# u& V; G7 p$ k
~~
' \! Y; u" w& Y; T* K6 g% ~' ]( T p( q2 g% T
, x. B+ \0 G5 c' c5 @#!/usr/bin/python) W8 `9 f& N0 i1 s3 C
# -*- coding: UTF-8 -*-, y: q% w- m l7 ^
! L* h9 D9 n' u' @
import urllib2$ ?$ q9 i0 s0 N. A3 K
import urllib
0 W, I, \0 R1 W; ]. n8 q! S
/ f0 u0 A8 B; O1 D# 基础url
7 D) i8 x7 l5 m* D9 t$ C4 vbaseUrl = 'http://fanyi.sogou.com/reventondc/translate' d6 E, g5 ?% O; p4 k6 O- }( O
* q/ g' O" [4 F$ o1 P5 V+ v# 设置header
0 J6 G; m0 f% \" ~3 t8 ~header = {'User-Agent':'Mozilla/5.0'}
/ G L7 G! `# K9 }7 }( b/ D: ?3 W- D% [: F! e' t* S0 e" u
search_word = raw_input('请输入需要翻译的内容(english):')
2 i6 | ^) I& i+ @: w; A& t( A
0 K5 P$ i7 n& \2 a/ U# 设置post请求参数, Q9 r) F: J8 ?. i8 q2 B* @
dataDict = {
$ s. m) E) c5 h* F) s, H9 ^" P 'from' : 'auto',
, k% \" y. v4 w0 }5 c 'to' : 'zh-CHS',
3 V, v# m7 A. h 'text' : search_word,
' M; @# q, x# Y' _4 m3 S 'client' : 'wap',& l. ?8 E' q% X" H6 e% B8 {9 f! C1 c3 w3 r
'useDetect' : 'on',
1 G9 P* r( g2 k" Y 'useDetectResult' : 'on',+ F# O7 L2 N1 f
'needQc' : '1',- \; N& e. B& V+ T/ ?/ @/ R
'uuid' : '550f1fc5-2e5e-4c10-8b70-29f4255b11ff',- d2 w- ~! F1 w: V; s4 E
}
+ O0 }! F; |$ ^% a1 f+ Q. Q0 R! U
# post参数转码
& A+ z4 p' A1 \9 v4 u9 G2 [data = urllib.urlencode(dataDict): i5 q& ^: e% D) o9 b- G
print data
% Z" O! b6 g! |: K# [+ t
' g% [. c* t* }+ G9 @, N! _# 构造request. c2 |$ z4 E E( V4 P R
request = urllib2.Request(baseUrl, data=data, headers=header)$ K# s; t9 |5 y5 g
/ a" m. a3 _: ?
# 构造response
2 w, `) H+ l4 ^& o7 L- l7 H$ ]1 b1 Q1 Cresponse = urllib2.urlopen(request)
: s; c' i& l' m$ T' f, O
4 I4 e2 k& {- L( N) c# 返回结果& F% {+ V4 ^* E
result = response.read(); y: S+ x c& `5 k! A8 K
$ M- P4 y7 m" w+ A0 b" e
print result;, s9 E' S- K2 S% \5 s* M7 ?
, Q7 E7 K" `1 C: O
# 将结果存入文件
; b+ E, V. R% M" K' g9 d0 twith open('post.json', 'w') as f:
3 b) O% z) j) e4 {+ V, p4 @ f.write(result)6 {& c, b7 c5 O5 a
$ T. |3 ~; i5 S# b8 W作者:sunner_chen
1 _- L5 [* {8 f4 L/ E& J# C链接:https://www.jianshu.com/p/8841176200677 t# q! e; }& Y( e. J
來源:简书5 p2 _% z$ q9 @ J2 k7 M/ p! J& r
著作权归作者所有。商业转载请联系作者获得授权,非商业转载请注明出处。 |
|