Basic Web Scraping Using Python - A Beginner's Guide to using Requests and Selenium

Beginner Guide to Web Scraping Using Python For Requests and Selenium (Live Examples)

 

Web scraping is gathering data from websites for later processing. You can do it manually or automated using softwares like selenium and can be written in different languages.

 

We will try to do web scraping and these set of blogs are for step by step learning on how to scrape data. I divided the blogs into pieces so that you will not have information overload and can learn the different codes to gather data from a website. The website that we are going to scrape is the HTML sample that I uploaded for learning purposes. You can access the following html samples:

• Basic HTML
• Basic HTML tags
• CSS Selectors

 

The codes can be accessed here:

• Python Scraper Codes

 

Python Request with Beautifulsoup - A Beginners Guide Series:

• Web Scraping Using Requests - Intro
• Web Scraping Using Requests - Beautifulsoup Intro
• Web Scraping Using Requests - Beautifulsoup Tag Class
• Web Scraping Using Requests - Searching Through Document
• Web Scraping Using Requests - Query Selectors/CSS Selectors

 

Python Selenium - A Beginners Guide Series:

• Web Scraping Using Selenium - Intro
• Web Scraping Using Selenium - Navigations
  • Web Scraping Using Selenium - driver.get
  • Web Scraping Using Selenium - Navigation with Anchor Element
  • Web Scraping Using Selenium - Navigation Using Form Submit
  • Web Scraping Using Selenium - Navigation Using Script Execution
  • Web Scraping Using Selenium - Navigation Using Browser History
• Web Scraping Using Selenium - Waits
  • Web Scraping Using Selenium - Implicit Wait
  • Web Scraping Using Selenium - Explicit Wait
  • Web Scraping Using Selenium - Explicit Wait For Alert
  • Web Scraping Using Selenium - Explicit Wait For Clickable Element
  • Web Scraping Using Selenium - Explicit Wait For Element To Be Selected
  • Web Scraping Using Selenium - Explicit Wait For Element To Be Selected Using Locator
  • Web Scraping Using Selenium - Explicit Wait For Element Selection
  • Web Scraping Using Selenium - Explicit Wait For Element Selection Using Locator
  • Web Scraping Using Selenium - Explicit Wait For Presence of Any Elements
  • Web Scraping Using Selenium - Explicit Wait For Presence of An Element
  • Web Scraping Using Selenium - Explicit Wait For Element Text
  • Web Scraping Using Selenium - Explicit Wait For Element Text Value
  • Web Scraping Using Selenium - Explicit Wait For Title
  • Web Scraping Using Selenium - Explicit Wait For Title Contains Words
  • Web Scraping Using Selenium - Explicit Wait For Visibility of Elements
  • Web Scraping Using Selenium - Explicit Wait For Visibility of an Element
  • Web Scraping Using Selenium - Explicit Wait For Visibility of Any Element
  • Web Scraping Using Selenium - Explicit Wait For Visibility of All Elements

 

Hope you learn and enjoy this series!