(07-30-2019, 06:47 AM)Ulthor_31 Wrote: I have trying Rapsberry Pi3+ and an Odroid XU4 to scrap more 10000 web site.
Pi3+ : it's scraps 100 webpage/H
XU4 : 360 webpage/H
The goal is to get 600webpage/H![]()
I ran your code on a pristine buster install of armbian and it output the following:
Code:
# python3 test.py
test.py:11: DeprecationWarning: use options instead of chrome_options
driver = webdriver.Chrome(chrome_options=chrome_options)
-----------> https://www.amazon.fr/dp/B07SJFD9N4
-----> BS4 OK
-----------> https://www.amazon.fr/dp/B07S6FB64X
-----> BS4 OK
-----------> https://www.amazon.fr/dp/B07Q2J5NCZ
-----> BS4 OK
-----------> https://www.amazon.fr/dp/B07QR9MDXS
-----> BS4 OK
-----------> https://www.amazon.fr/dp/B07Q2LSS1P
-----> BS4 OK
-----------> https://www.amazon.fr/dp/B07RBTKJ7H
-----> BS4 OK
-----------> https://www.amazon.fr/dp/B07PZFNG1F
-----> BS4 OK
-----------> https://www.amazon.fr/dp/B07HG3XG7Q
-----> BS4 OK
-----------> https://www.amazon.fr/dp/B07DDFC9B9
-----> BS4 OK
-----------> https://www.amazon.fr/dp/B07Q4216T1
-----> BS4 OK
102.66483640670776
There is a few things to note, firstly I was ssh'd into the system, so the gui was forwarded over X. I'm in Australia so .fr lookups may faster if you are in France