python - PhantomJS no more loading GooglePlus pages -
i'm using phantomjs
2.1.1 (on ubuntu server 16.04.1 , mac os x 10.12.2) python selenium webdriver
.
phantomjs seems no more able load googleplus pages few days now. loads 404
error page. trying load same page firefox jeckodriver
loads right page; pasting url on safari, firefox or chrome.
what going wrong between googleplus , phantomjs?
sample code:
#!/usr/bin/env python selenium import webdriver import time driver = webdriver.phantomjs() word = "rock" driver.get("https://plus.google.com/s/%s/top" % word) time.sleep(7) f = open('googleplus-test-search.html','w') f.write( driver.page_source.encode('utf-8') ) f.close() driver.quit() exit(0)
loaded page:
<!doctype html> <html lang="en"> <head> <meta charset="utf-8"> <meta name="viewport" content="initial-scale=1, minimum-scale=1, width=device-width"> <title> error 404 (non trovato)!!1</title> <style> *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{color:#222;text-align:unset;margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px;}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}pre{white-space:pre-wrap;}ins{color:#777;text-decoration:none}a img{border:0}@media screen , (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media screen , (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media screen , (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}</style> </head> <body> <div id="af-error-container"> <a href="//www.google.com/"> <span id="logo" aria-label="google"> </span> </a> <p> <b> 404.</b> <ins> errore.</ins> </p> <p> impossibile trovare l'url richiesto su questo server. <ins> nessun'altra informazione disponibile.</ins> </p> </div> </body> </html>
i fixed setting custom useragent
phantomjs.
from selenium.webdriver.common.desired_capabilities import desiredcapabilities dcap = dict(desiredcapabilities.phantomjs) dcap["phantomjs.page.settings.useragent"] = ( "mozilla/5.0 (macintosh; intel mac os x 9_1_3) applewebkit/602.3.12 " "(khtml, gecko) version/10.0.2 safari/602.3.12" ) browser = webdriver.phantomjs(desired_capabilities=dcap)
Comments
Post a Comment