python - Scraping using Beautiful Soup leads to error only in a particular section (NullType object encountered) -


i'm trying list of injuries of particular team (liverpool in case) following website

http://www.physioroom.com/news/english_premier_league/epl_injury_table.php

it works fine teams(swansea), exits following errors (liverpool, everyon)

typeerror: can't convert 'nonetype' object str implicitly

here code using. 

from bs4 import beautifulsoup import urllib.request   url = "http://www.physioroom.com/news/english_premier_league/epl_injury_table.php" html = urllib.request.urlopen(url).read() soup = beautifulsoup(html, "html.parser") #lp = soup.find(alt="liverpool away shirt").parent.parent.parent.next_sibling.next_sibling lp = soup.find(alt="swansea city away shirt").parent.parent.parent.next_sibling.next_sibling player_info = "" player_list = []  while true:     if(lp.has_attr('id')):             break     else:             tdlist = lp.find_all('td')#     player_info = tdlist[0].string+"\t"+tdlist[1].string+"\t"+tdlist[3].string             #print(tdlist[0].find('a').string.strip() + "\t" + tdlist[1].string.strip() + "\t" + tdlist[3].string.strip())             print(tdlist[0].string + "\t" + tdlist[1].string + "\t" + tdlist[3].string)             lp=lp.findnext('tr')

please let me know how can fix this.

from bs4 import beautifulsoup import requests   url = "http://www.physioroom.com/news/english_premier_league/epl_injury_table.php" r = requests.get(url) soup = beautifulsoup(r.text, "lxml") table = soup.find('table', id='epl-table') tr in table('tr', id=none):     print(tr.get_text('\t', strip=true))

out:

player  condition   latest news expected return available? d meyler    knock   no return date  slight doubt s maloney   ear infection   no return date  slight doubt m henriksen shoulder separation april 1, 2017   major doubt mcgregor  fitness no return date  major doubt w keane acl knee injury no return date m odubajo   patella fracture    may 1, 2017 g luer  knee injury february 1, 2017

get_text()

if want text part of document or tag, can use get_text() method. returns text in document or beneath tag, single unicode string:

you can specify string used join bits of text together

you can tell beautiful soup strip whitespace beginning , end of each bit of text


-

Comments

Post a Comment

Popular posts from this blog

python - How to insert QWidgets in the middle of a Layout? -

Image
i'm using qt framework build graphical user interface. use qgridlayout position qwidgets neatly. gui looks this: my application regularly adds new widgets gui @ runtime. these new widgets not added @ end of qlayout, somewhere in middle. the procedure bit cumbersome. applied on figure above, need take out widg_c , widg_d , ... qgridlayout. next, add widg_x and widg_y , , put other widgets again. how remove widgets qgridlayout: for in reversed(range(mygridlayout.count())): self.itemat(i).widget().setparent(none) ### as long you're dealing small amount of widgets, procedure not disaster. in application display lot of small widgets - perhaps 50 or more! application freezes second while procedure ongoing, annoying user. there way insert widgets somewhere in qlayout, without need take out other widgets? edit: apparently solution qvboxlayout simple. use function insertwidget(..) instead of addwidget(..) . docs can found link: http://doc.qt.io/qt-5/qboxlayou
Read more

python - serve multiple gunicorn django instances under nginx ubuntu -

i need serve 2 webs apps (django) on gunicorn under different domain names using nginx on ubuntu. started using tutorial: https://www.digitalocean.com/community/tutorials/how-to-set-up-django-with-postgres-nginx-and-gunicorn-on-ubuntu-16-04 it worked fine 1 using that. tried same thing second gives me 502 gateway second domain. tried following tutorial: http://michal.karzynski.pl/blog/2013/10/29/serving-multiple-django-applications-with-nginx-gunicorn-supervisor/ i'm @ part run gunicorn start script: sudo bin/gunicorn_start i response: starting webuildblack root traceback (most recent call last): file "/home/devin/webuildblack/bin/gunicorn", line 7, in <module> gunicorn.app.wsgiapp import run importerror: no module named 'gunicorn.app'; 'gunicorn' not package you have named program gunicorn.py gunicorn -package. rename file , remove gunicorn.pyc file.
Read more

module - Prestashop displayPaymentReturn hook url -

i new prestashop developer , trying create paymentmodule. have got show payment method can not proceed purchase because not know hot works. does know should redirect run hooddisplaypaymentreturn method? i happy if explain me complete navigation map make purchase. anyway, can find relation between hooks , pages? when have new module payment rely on simplest provided prestashop: bankwire. inside can find 3 hooks. hookpayment: public function hookpayment($params) { if (!$this->active) return; if (!$this->checkcurrency($params['cart'])) return; $this->smarty->assign(array( 'this_path' => $this->_path, 'this_path_bw' => $this->_path, 'this_path_ssl' => tools::getshopdomainssl(true, true).__ps_base_uri__.'modules/'.$this->name.'/' )); return $this->display(__file__, 'payment.tpl'); } hookdisplaypaymenteu: public fun
Read more