Web Scraping Using Selenium - Navigation

Selenium Navigation - driver.get

Navigations in selenium can be done in different ways. In this tutorial, we will use the driver.get functionality.

But before that, please make sure you have read the first blog on this series to do the prerequisites.

Selenium Navigation Code Using driver.get

1. Create a file seleniumnav.py and paste the following codes

   from selenium import webdriver
   import time
   

   The codes above imports the required library that we will use.
2. Add this line

   driver = webdriver.Firefox(executable_path="geckodriver.exe")
   

   The code above will create a webdriver instance for Firefox.
3. Add this line

   driver.get("https://www.google.com")
   

   The line will got to the website (https://www.google.com).
4. Add this line

   time.sleep(10)
   

   We will pause the program for 10 seconds.
5. Add this line

   driver.get("https://slackingslacker.github.io/seleniumindex")
   

   The line will got to the website (https://slackingslacker.github.io/seleniumindex). This is way to navigate to different pages of the site or different websites.
6. Add this line

   time.sleep(10)
   

   We will pause the program for 10 seconds.
7. Add this line

   driver.close()
   

   The line will close the webdriver as well as the browser.
8. Run the seleniumnav.py. It should do the following:
   • Open the firefox browser
   • Browser goes to www.google.com
   • Halts for 10 seconds
   • Browser goes to https://slackingslacker.github.io/seleniumindex
   • Halts for 10 seconds
   • Closes the browser

 

Final Selenium Code

from selenium import webdriver
import time

driver = webdriver.Firefox(executable_path="geckodriver.exe")
driver.get("https://www.google.com")
time.sleep(10)

driver.get("https://slackingslacker.github.io/seleniumindex")
time.sleep(10)

driver.close()

 

Conclusion

Navigation from page to page or website to website can be done using driver.get functionality