Re: [問題] 如何抓下一頁

看板Perl作者時間16年前 (2009/04/04 10:45), 編輯推噓1(102)
留言3則, 2人參與, 最新討論串2/2 (看更多)
※ 引述《yingwan (yingwan)》之銘言: : 不好意思,這問題也許有點基本,還請大家見諒 : 我用WWW::Mechanize 去抓網頁,可是一次只能抓一頁 (ex: get第一頁,get第二頁) : 有沒有高手知道怎麼一次抓很多頁啊? : 謝謝 之前是用 use Google::Search; my $root='www.msn.com'; my $key='';#----自己申請一個key來查詢 my $referer = "http://www.mysite.com/index.html"; my $search = Google::Search->Web(q => $root, key => $key, referer => $referer); my $result = $search->first; while ($result) { my $no = $result->number; my $url = $result->uri; print $no,"\t",$url, "\n"; #---一次印出60筆 $result = $result->next; } 把結果存下來,再餵給WWW::Mechanize應該就可以了吧 #------------------結果----------------- 0 http://www.msn.com/ 1 http://www.hotmail.com/ 2 http://weather.msn.com/ 3 http://webmessenger.msn.com/ 4 http://realestate.msn.com/ 5 http://malaysia.msn.com/ 6 http://www.live.com/ 7 http://www.msn.com/Worldwide.aspx 8 http://ninemsn.com.au/ 9 http://entertainment.in.msn.com/ 10 http://www.greetings.msn.com/ 11 http://cars.uk.msn.com/ 12 http://messenger.live.com/ 13 http://www.mapblast.com/ 14 http://news.uk.msn.com/ 15 http://games.msn.com/ 16 http://moneycentral.msn.com/ 17 http://tech.uk.msn.com/ 18 http://news.moneycentral.msn.com/ 19 http://style.uk.msn.com/ 20 http://uk.msn.com/ 21 http://weather.msn.com/region.aspx?wealocations=asia 22 http://in.msn.com/ 23 http://en.wikipedia.org/wiki/MSN 24 http://calendar.msn.com/ 25 http://sg.msn.com/ 26 http://msn.foxsports.com/ 27 http://homepage.msn.com/MSNMakeYourHP.htm 28 http://homepage.msn.com/MSNMakeYourHP.htm 29 http://za.msn.com/ 30 http://sympatico.msn.ca/ 31 http://entertainment.msn.com/ 32 http://lifestyle.msn.com/ 33 http://advertising.microsoft.com/ 34 http://ie.msn.com/ 35 http://health.msn.com/ 36 http://entertainment.uk.msn.com/music/ 37 http://info.mobile.msn.com/en-us/default.aspx 38 http://shopping.msn.com/ 39 http://lifestyle.msn.com/your-life/bigger-picture/staticslideshowoprah.aspx?cp-documentid=8318097 40 http://ph.msn.com/ 41 http://music.msn.com/ 42 http://mobile.msn.com/ 43 http://election.msn.com/ 44 http://autos.msn.com/ 45 https://accountservices.msn.com/ 46 http://latino.msn.com/ 47 http://id.msn.com/ 48 http://encarta.msn.com/ 49 http://encarta.msn.com/encnet/features/mapcenter/map.aspx 50 http://music.msn.com/music/artist/madonna.2/ 51 http://resor.se.msn.com/ 52 http://msn.careerbuilder.com/Article/MSN-1809-Job-Search-The-Full-Time-Job-of-Finding-a-Job/ 53 http://astrocenter.astrology.msn.com/msn/DeptHoroscope.aspx 54 http://3c.msn.com.tw/mobile/ 55 http://ve.msn.com/ 56 http://toolbar.msn.com/ 57 http://cityguides.msn.com/ 58 http://careers.msn.com/ 59 http://moneycentral.msn.com/investor/research/welcome.asp -- ※ 發信站: 批踢踢實業坊(ptt.cc) ◆ From: 59.116.3.235

04/04 10:45, , 1F
每次search結果會略有不同
04/04 10:45, 1F

04/08 02:34, , 2F
我發現只要超過500筆就會開始慢了...
04/08 02:34, 2F

04/08 11:49, , 3F
正常...查詢的模組好像都會這樣..
04/08 11:49, 3F
文章代碼(AID): #19ricu97 (Perl)
討論串 (同標題文章)
本文引述了以下文章的的內容:
完整討論串 (本文為第 2 之 2 篇):
文章代碼(AID): #19ricu97 (Perl)