Web scraping with Scrapy a workshop with Tomáš Bartek

This workshop focuses on a web scraping project called Scrapy. After the workshop, you will have your own working Scrapy project and will be ready to use it as a starting point for scraping whatever web page you will want.

First, we'll give you a short overview of scraping possibilities in Python. We will introduce the Scrapy open-source project as a more advanced and powerful tool than requests library or Beautiful Soup and we will make a short tour through the Scrapy architecture.

After that, we will show you how to start your own project in various ways: from the cloud, as a local machine process, or as a call from another python script. Then you will choose one web page suitable for scraping and write your simple spider with overcoming common problems as following links and pagination.

We will prepare GitHub repo for necessary infrastructure pieces/skeleton code, so you can focus only on coding the web-specific parts. The workshop will be suitable for both beginners and advanced Pythonistas.