python - Scraping using Beautiful Soup leads to error only in a particular section (NullType object encountered) -


i'm trying list of injuries of particular team (liverpool in case) following website

http://www.physioroom.com/news/english_premier_league/epl_injury_table.php

it works fine teams(swansea), exits following errors (liverpool, everyon)

typeerror: can't convert 'nonetype' object str implicitly

here code using. 

from bs4 import beautifulsoup import urllib.request   url = "http://www.physioroom.com/news/english_premier_league/epl_injury_table.php" html = urllib.request.urlopen(url).read() soup = beautifulsoup(html, "html.parser") #lp = soup.find(alt="liverpool away shirt").parent.parent.parent.next_sibling.next_sibling lp = soup.find(alt="swansea city away shirt").parent.parent.parent.next_sibling.next_sibling player_info = "" player_list = []  while true:     if(lp.has_attr('id')):             break     else:             tdlist = lp.find_all('td')#     player_info = tdlist[0].string+"\t"+tdlist[1].string+"\t"+tdlist[3].string             #print(tdlist[0].find('a').string.strip() + "\t" + tdlist[1].string.strip() + "\t" + tdlist[3].string.strip())             print(tdlist[0].string + "\t" + tdlist[1].string + "\t" + tdlist[3].string)             lp=lp.findnext('tr')

please let me know how can fix this.

from bs4 import beautifulsoup import requests   url = "http://www.physioroom.com/news/english_premier_league/epl_injury_table.php" r = requests.get(url) soup = beautifulsoup(r.text, "lxml") table = soup.find('table', id='epl-table') tr in table('tr', id=none):     print(tr.get_text('\t', strip=true))

out:

player  condition   latest news expected return available? d meyler    knock   no return date  slight doubt s maloney   ear infection   no return date  slight doubt m henriksen shoulder separation april 1, 2017   major doubt mcgregor  fitness no return date  major doubt w keane acl knee injury no return date m odubajo   patella fracture    may 1, 2017 g luer  knee injury february 1, 2017

get_text()

if want text part of document or tag, can use get_text() method. returns text in document or beneath tag, single unicode string:

you can specify string used join bits of text together

you can tell beautiful soup strip whitespace beginning , end of each bit of text


-

Comments

Post a Comment

Popular posts from this blog

python - Error importing VideoFileClip from moviepy : AttributeError: 'PermissionError' object has no attribute 'message' -

i'm using jupyter notebook. have tried anaconda console well. tried importing both ways shown below from moviepy.editor import videofileclip moviepy.video.io.videofileclip import videofileclip both of them gave me same error. full trace below attributeerror traceback (most recent call last) <ipython-input-10-9afa9d6e87c4> in <module>() 6 import glob 7 import math ----> 8 moviepy.editor import videofileclip 9 moviepy.video.io.videofileclip import videofileclip c:\program files\anaconda3\lib\site-packages\moviepy\editor.py in <module>() 20 # clips 21 ---> 22 .video.io.videofileclip import videofileclip 23 .video.io.imagesequenceclip import imagesequenceclip 24 .video.io.downloader import download_webfile c:\program files\anaconda3\lib\site-packages\moviepy\video\io\videofileclip.py in <module>() 1 import os 2 ----> 3 moviepy.video.videoclip import videoclip ...
Read more

java - is not an enclosing class / new Intent Cannot Resolve Constructor -

thanks checking out question! i have relativly ismple loop add onclicklistener each imageview add layout, when trying add new intent it, gives me 1 of following errors: string[] imageurls = imageurlsstring.split("/"); (int = 0; < imageurls.length; i++){ imageview image = new imageview(this); image.setlayoutparams(new android.view.viewgroup.layoutparams(getpx(182),getpx(256))); image.setpadding(getpx(3),getpx(3),getpx(3),getpx(3)); final string imageurl = ".../images/" + imageurls[i]; picasso.with(this).load(imageurl).into(image); image.setonclicklistener(new view.onclicklistener() { @override public void onclick(view view) { intent intent; intent = new intent(this, imageactivity.class); intent.putextra("url", imageurl); startactivity(intent); } }); linearlayout.addview(image)...
Read more

qt - QML MouseArea onWheel event not working properly when inside QML Scrollview -

i have mousearea inside scrollview inside rectangle . implemented zoom feature zooms in/out when pressing ctrl , scrolling mouse wheel. however, zooms in when scrollview way @ top, , zooms out when scrollview way @ bottom. there additional logic handle external drag , drop of files. issue should able replicated long text inside textedit big enough scrollview . apparently bug before, can't work properly. tried solution in following link: qtquick2: handle onwheel event inside of scrollview rectangle { id: palgenrectangle layout.minimumwidth: 50 property string display //width:800 color: "white" scrollview { id: palgentextscrollview anchors.fill: parent mousearea { id: mousearea anchors.fill: parent onwheel: { if (wheel.modifiers & qt.controlmodifier){ if (wheel.angledelta.y > 0) { mainte...
Read more