08-01-2019, 03:51 AM
Thanks very much EvilBunny 
Can you try again with this Python, I modify just with com.au
---------------PYTHON CODE------------
from selenium import webdriver
import time
from urllib.request import urlopen
from bs4 import BeautifulSoup
#---CHROME OPTION AND OPEN DRIVER---
chrome_options = webdriver.ChromeOptions()
prefs = {"profile.managed_default_content_settings.images": 2}
chrome_options.add_experimental_option("prefs", prefs)
#driver = webdriver.Chrome('/usr/lib/chromium-browser/chromedriver',chrome_options=chrome_options)
driver = webdriver.Chrome(chrome_options=chrome_options)
driver.set_window_size(2000, 1000)
#---LIST of WEBPAGE---
list=['https://www.amazon.com.au/dp/B07HPKWGJH','https://www.amazon.com.au/dp/B07FTN21JL','https://www.amazon.com.au/dp/B07HPCDHQS','https://www.amazon.com.au/dp/B07FTN21JL','https://www.amazon.com.au/dp/B079DQ7JK6','https://www.amazon.com.au/dp/B07CBPS16T','https://www.amazon.com.au/dp/B07CBP38HS','https://www.amazon.com.au/dp/B073R3MJ87','https://www.amazon.com.au/dp/B01LZG4KPC','https://www.amazon.com.au/dp/B077DX1NFH']
#---START TIME---
start = time.time()
#---Show WEBPAGE---
h='url'
for h in list:
driver.get(h)
driver.execute_script('window.scrollBy(0,10000);')
print('-----------> '+str(h))
time.sleep(1)
html = driver.page_source
soup = BeautifulSoup(html, 'html.parser')
print('-----> BS4 OK')
#---END TIME---
end = time.time()
#---ELAPSED---
elapsed = end - start
print (elapsed)
-----
Thanks you again

Can you try again with this Python, I modify just with com.au
---------------PYTHON CODE------------
from selenium import webdriver
import time
from urllib.request import urlopen
from bs4 import BeautifulSoup
#---CHROME OPTION AND OPEN DRIVER---
chrome_options = webdriver.ChromeOptions()
prefs = {"profile.managed_default_content_settings.images": 2}
chrome_options.add_experimental_option("prefs", prefs)
#driver = webdriver.Chrome('/usr/lib/chromium-browser/chromedriver',chrome_options=chrome_options)
driver = webdriver.Chrome(chrome_options=chrome_options)
driver.set_window_size(2000, 1000)
#---LIST of WEBPAGE---
list=['https://www.amazon.com.au/dp/B07HPKWGJH','https://www.amazon.com.au/dp/B07FTN21JL','https://www.amazon.com.au/dp/B07HPCDHQS','https://www.amazon.com.au/dp/B07FTN21JL','https://www.amazon.com.au/dp/B079DQ7JK6','https://www.amazon.com.au/dp/B07CBPS16T','https://www.amazon.com.au/dp/B07CBP38HS','https://www.amazon.com.au/dp/B073R3MJ87','https://www.amazon.com.au/dp/B01LZG4KPC','https://www.amazon.com.au/dp/B077DX1NFH']
#---START TIME---
start = time.time()
#---Show WEBPAGE---
h='url'
for h in list:
driver.get(h)
driver.execute_script('window.scrollBy(0,10000);')
print('-----------> '+str(h))
time.sleep(1)
html = driver.page_source
soup = BeautifulSoup(html, 'html.parser')
print('-----> BS4 OK')
#---END TIME---
end = time.time()
#---ELAPSED---
elapsed = end - start
print (elapsed)
-----
Thanks you again
