yahoo:Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
baidu:"Baiduspider+(+http://www.baidu.com/search/spider.htm)
baidu代码:Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322, Baidu-Transcoder/1.0.6.0, gate.baidu.com)
msn:msnbot/1.1 (+http://search.msn.com/msnbot.htm)
Yahoo中国:Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)
sogou:Sogou Orion spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
sogou2:Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
QQsoso图片:Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)
还有个超长的:Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; QQDownload 1.7; WPS; Mozilla/4.0(Compatible Mozilla/4.0(Compatible-EmbeddedWB 14.59 http://bsalsa.com/ EmbeddedWB- 14.59 from: http://bsalsa.com/ ; Mozilla/4.0(Compatible Mozilla/4.0EmbeddedWB- 14.59 from: http://bsalsa.com/ ; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; .NET CLR 3.0.04506)
Yaodao其它:Mozilla/5.0 (compatible;YodaoBot-Reader/1.0;http://www.yodao.com/help/webmaster/spider/;1 subscriber;)
其它待补充,以上都是最新日志里面搜索得来,保证最新,还有些没有挖掘。
評論