Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Web Scrapping Content #7

Open
wants to merge 18 commits into
base: main
Choose a base branch
from
34 changes: 34 additions & 0 deletions Web Scarping/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
# Web Scraping using Python
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All the modules should start with, what we are going to study, why we are going to study, and in the end, wrap up.

## Course Outline
### Introduction
- Introduction
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add Reason as to Why we need to do scrapping, in fact, add it to all other places too

- Library for scraping: BeautifulSoup, Selenium, Scrapy
- Types of HTTP Status Codes
- HTML for Web Scraping: Tags & Elements
- HTML for web scraping: Tree Structure
### Introduction to BeautifulSoup
- Installation & Basics of BeautifulSoup
- Intro to Requests
- Get html form website and html parser
- Scrape Single page
- Scrape multiple page
- Exporting data to CSV file
### XPath & CSS Selector
- XPath Systax, Functions and Operators
- CSS Selector
- Test Your XPath
- Navigation using XPath(going up and down)
- Special Characters and Systax
### Introduction to Selenium
- How to Identify Java Script Drived Websites
- Installation & Chrome Driver
- Chrome Driver Options and Creating the driver
- How to Find Elements with Selenium
- Clicking Button
- Extracting Data from Table
- Selecting Elements within a Dropdown
### Project #1: Twitter Bot
- How to Login to Websites
- Building a Function
- Infinite Scrolling
- Scraping the website with infinite Scrolling
1 change: 1 addition & 0 deletions Web Scarping/Web Scarping.ipynb
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
print("Hello Python")