I am trying to change the query to scrape all rental ads, it will obviously take some time to go through ~233 pages, however while this is happening, some ads will be deleted, now the program is not able to handle such exception and it gets stuck forever. For instance, it's now stuck at: https://www.blocket.se/kalmar/Lagenhet_centralt_Oskarshamn_73194093.htm?ca=11&w=3
Error message attached:
I'm using the following scrapping query: 'https://www.blocket.se/bostad/uthyres?sort=&ss=&se=&ros=&roe=&bs=&be=&mre=&q=&q=&q=&save_search=1&l=0&md=th&o=' + page + '&f=b&ca=11&w=3'
I am trying to change the query to scrape all rental ads, it will obviously take some time to go through ~233 pages, however while this is happening, some ads will be deleted, now the program is not able to handle such exception and it gets stuck forever. For instance, it's now stuck at: https://www.blocket.se/kalmar/Lagenhet_centralt_Oskarshamn_73194093.htm?ca=11&w=3
Error message attached:
I'm using the following scrapping query: 'https://www.blocket.se/bostad/uthyres?sort=&ss=&se=&ros=&roe=&bs=&be=&mre=&q=&q=&q=&save_search=1&l=0&md=th&o=' + page + '&f=b&ca=11&w=3'