Skip to content

Commit 8396760

Browse files
committed
fix: introduce Crawlee
1 parent 338f9b6 commit 8396760

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

sources/academy/webscraping/scraping_basics_javascript2/12_framework.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@ Before rewriting our code, let's point out several caveats in our current soluti
2222
- _Browser means rewrite:_ We got lucky extracting variants. If the website didn't include a fallback, we might have had no choice but to spin up a browser instance and automate clicking on buttons. Such a change in the underlying technology would require a complete rewrite of our program.
2323
- _No error handling:_ The scraper stops if it encounters issues. It should allow for skipping problematic products with warnings or retrying downloads when the website returns temporary errors.
2424

25-
In this lesson, we'll tackle all the above issues while keeping the code concise thanks to a scraping framework.
25+
In this lesson, we'll address all of the above issues while keeping the code concise with the help of a scraping framework. We'll use [Crawlee](https://crawlee.dev/), not just because we created it, but because it's the most popular JavaScript framework for web scraping.
2626

2727
## Starting with Crawlee
2828

sources/academy/webscraping/scraping_basics_python/12_framework.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ Before rewriting our code, let's point out several caveats in our current soluti
2121
- _Browser means rewrite:_ We got lucky extracting variants. If the website didn't include a fallback, we might have had no choice but to spin up a browser instance and automate clicking on buttons. Such a change in the underlying technology would require a complete rewrite of our program.
2222
- _No error handling:_ The scraper stops if it encounters issues. It should allow for skipping problematic products with warnings or retrying downloads when the website returns temporary errors.
2323

24-
In this lesson, we'll tackle all the above issues while keeping the code concise thanks to a scraping framework.
24+
In this lesson, we'll address all of the above issues while keeping the code concise with the help of a scraping framework. We'll use [Crawlee](https://crawlee.dev/), not only because we created it, but also because we believe it's the best tool for the job.
2525

2626
:::info Why Crawlee and not Scrapy
2727

0 commit comments

Comments
 (0)