Skip to content

feat: publish new JS course #1907

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 9 commits into
base: master
Choose a base branch
from
Draft

feat: publish new JS course #1907

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
208dc16
refactor: put old course to legacy folder, put new course to the JS f…
honzajavorek Sep 8, 2025
9e5c305
chore: prepare redirects
honzajavorek Sep 8, 2025
f50f6bc
feat: put the new course to the /scraping-basics-javascript/ URL
honzajavorek Sep 8, 2025
43e9745
fix: edit links to the JS course
honzajavorek Sep 8, 2025
faa0b0a
feat: change URLs of the legacy JS course
honzajavorek Sep 8, 2025
ff71f80
fix: leftover, correct URL for the course root
honzajavorek Sep 8, 2025
4a6d4a3
feat: redirects from original URLs to the new JS course's lessons, wi…
honzajavorek Sep 8, 2025
d468b8e
feat: set new sidebar position
honzajavorek Sep 8, 2025
ce75785
feat: unlist the legacy JS course
honzajavorek Sep 8, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 31 additions & 3 deletions nginx.conf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -306,11 +306,39 @@ server {

# Rename output schema to dataset schema
rewrite ^/platform/actors/development/actor-definition/output-schema$ /platform/actors/development/actor-definition/dataset-schema permanent;
rewrite ^academy/deploying-your-code/output-schema$ /academy/deploying-your-code/dataset-schema permanent;
rewrite ^/academy/deploying-your-code/output-schema$ /academy/deploying-your-code/dataset-schema permanent;

# Academy restructuring
rewrite ^academy/advanced-web-scraping/scraping-paginated-sites$ /academy/advanced-web-scraping/crawling/crawling-with-search permanent;
rewrite ^academy/php$ /academy/php/use-apify-from-php redirect; # not permanent in case we want to reuse /php in the future
rewrite ^/academy/advanced-web-scraping/scraping-paginated-sites$ /academy/advanced-web-scraping/crawling/crawling-with-search permanent;
rewrite ^/academy/php$ /academy/php/use-apify-from-php redirect; # not permanent in case we want to reuse /php in the future

# Academy: replacing the 'Web Scraping for Beginners' course
rewrite ^/academy/web-scraping-for-beginners/best-practices$ /academy/scraping-basics-javascript?legacy-js-course=/legacy/best-practices permanent;
rewrite ^/academy/web-scraping-for-beginners/introduction$ /academy/scraping-basics-javascript?legacy-js-course=/legacy/introduction permanent;
rewrite ^/academy/web-scraping-for-beginners/challenge/initializing-and-setting-up$ /academy/scraping-basics-javascript?legacy-js-course=/legacy/challenge/initializing-and-setting-up permanent;
rewrite ^/academy/web-scraping-for-beginners/challenge/modularity$ /academy/scraping-basics-javascript?legacy-js-course=/legacy/challenge/modularity permanent;
rewrite ^/academy/web-scraping-for-beginners/challenge/scraping-amazon$ /academy/scraping-basics-javascript?legacy-js-course=/legacy/challenge/scraping-amazon permanent;
rewrite ^/academy/web-scraping-for-beginners/challenge$ /academy/scraping-basics-javascript?legacy-js-course=/legacy/challenge permanent;
rewrite ^/academy/web-scraping-for-beginners/crawling/exporting-data$ /academy/scraping-basics-javascript/framework?legacy-js-course=/legacy/crawling/exporting-data permanent;
rewrite ^/academy/web-scraping-for-beginners/crawling/filtering-links$ /academy/scraping-basics-javascript/getting-links?legacy-js-course=/legacy/crawling/filtering-links permanent;
rewrite ^/academy/web-scraping-for-beginners/crawling/finding-links$ /academy/scraping-basics-javascript/getting-links?legacy-js-course=/legacy/crawling/finding-links permanent;
rewrite ^/academy/web-scraping-for-beginners/crawling/first-crawl$ /academy/scraping-basics-javascript/crawling?legacy-js-course=/legacy/crawling/first-crawl permanent;
rewrite ^/academy/web-scraping-for-beginners/crawling/headless-browser$ /academy/scraping-basics-javascript?legacy-js-course=/legacy/crawling/headless-browser permanent;
rewrite ^/academy/web-scraping-for-beginners/crawling/pro-scraping$ /academy/scraping-basics-javascript/framework?legacy-js-course=/legacy/crawling/pro-scraping permanent;
rewrite ^/academy/web-scraping-for-beginners/crawling/recap-extraction-basics$ /academy/scraping-basics-javascript/extracting-data?legacy-js-course=/legacy/crawling/recap-extraction-basics permanent;
rewrite ^/academy/web-scraping-for-beginners/crawling/relative-urls$ /academy/scraping-basics-javascript/getting-links?legacy-js-course=/legacy/crawling/relative-urls permanent;
rewrite ^/academy/web-scraping-for-beginners/crawling/scraping-the-data$ /academy/scraping-basics-javascript/scraping-variants?legacy-js-course=/legacy/crawling/scraping-the-data permanent;
rewrite ^/academy/web-scraping-for-beginners/crawling$ /academy/scraping-basics-javascript/crawling?legacy-js-course=/legacy/crawling permanent;
rewrite ^/academy/web-scraping-for-beginners/data-extraction/browser-devtools$ /academy/scraping-basics-javascript/devtools-inspecting?legacy-js-course=/legacy/data-extraction/browser-devtools permanent;
rewrite ^/academy/web-scraping-for-beginners/data-extraction/computer-preparation$ /academy/scraping-basics-javascript/downloading-html?legacy-js-course=/legacy/data-extraction/computer-preparation permanent;
rewrite ^/academy/web-scraping-for-beginners/data-extraction/devtools-continued$ /academy/scraping-basics-javascript/devtools-extracting-data?legacy-js-course=/legacy/data-extraction/devtools-continued permanent;
rewrite ^/academy/web-scraping-for-beginners/data-extraction/node-continued$ /academy/scraping-basics-javascript/extracting-data?legacy-js-course=/legacy/data-extraction/node-continued permanent;
rewrite ^/academy/web-scraping-for-beginners/data-extraction/node-js-scraper$ /academy/scraping-basics-javascript/downloading-html?legacy-js-course=/legacy/data-extraction/node-js-scraper permanent;
rewrite ^/academy/web-scraping-for-beginners/data-extraction/project-setup$ /academy/scraping-basics-javascript/downloading-html?legacy-js-course=/legacy/data-extraction/project-setup permanent;
rewrite ^/academy/web-scraping-for-beginners/data-extraction/save-to-csv$ /academy/scraping-basics-javascript/saving-data?legacy-js-course=/legacy/data-extraction/save-to-csv permanent;
rewrite ^/academy/web-scraping-for-beginners/data-extraction/using-devtools$ /academy/scraping-basics-javascript/devtools-locating-elements?legacy-js-course=/legacy/data-extraction/using-devtools permanent;
rewrite ^/academy/web-scraping-for-beginners/data-extraction$ /academy/scraping-basics-javascript/devtools-inspecting?legacy-js-course=/legacy/data-extraction permanent;
rewrite ^/academy/web-scraping-for-beginners$ /academy/scraping-basics-javascript?legacy-js-course=/legacy permanent;

# Removed pages
# GPT plugins were discontinued April 9th, 2024 - https://help.openai.com/en/articles/8988022-winding-down-the-chatgpt-plugins-beta
Expand Down
2 changes: 1 addition & 1 deletion sources/academy/homepage_content.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"Beginner courses": [
{
"title": "Web scraping basics for JavaScript devs",
"link": "/academy/web-scraping-for-beginners",
"link": "/academy/scraping-basics-javascript",
"description": "Learn how to use JavaScript to extract information from websites in this practical course, starting from the absolute basics.",
"imageUrl": "/img/academy/intro.svg"
},
Expand Down
2 changes: 1 addition & 1 deletion sources/academy/platform/expert_scraping_with_apify/actors_webhooks.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ Prior to moving forward, please read over these resources:

## Our task {#our-task}

In this task, we'll be building on top of what we already created in the [Web scraping basics for JavaScript devs](/academy/web-scraping-for-beginners/challenge) course's final challenge, so keep those files safe!
In this task, we'll be building on top of what we already created in the [Web scraping basics for JavaScript devs](/academy/scraping-basics-javascript/legacy/challenge) course's final challenge, so keep those files safe!

Once our Amazon Actor has completed its run, we will, rather than sending an email to ourselves, call an Actor through a webhook. The Actor called will be a new Actor that we will create together, which will take the dataset ID as input, then subsequently filter through all of the results and return only the cheapest one for each product. All of the results of the Actor will be pushed to its default dataset.

Expand Down
2 changes: 1 addition & 1 deletion sources/academy/webscraping/advanced_web_scraping/crawling/sitemaps-vs-search.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ sidebar_position: 1
slug: /advanced-web-scraping/crawling/sitemaps-vs-search
---

The core crawling problem comes to down to ensuring that we reliably find all detail pages on the target website or inside its categories. This is trivial for small sites. We just open the home page or category pages and paginate to the end as we did in the [Web scraping basics for JavaScript devs](/academy/web-scraping-for-beginners) course.
The core crawling problem comes to down to ensuring that we reliably find all detail pages on the target website or inside its categories. This is trivial for small sites. We just open the home page or category pages and paginate to the end.

Unfortunately, _most modern websites restrict pagination_ only to somewhere between 1 and 10,000 products. Solving this problem might seem relatively straightforward at first but there are multiple hurdles that we will explore in this lesson.

Expand Down
2 changes: 1 addition & 1 deletion sources/academy/webscraping/advanced_web_scraping/index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ category: web scraping & automation
slug: /advanced-web-scraping
---

In the [Web scraping basics for JavaScript devs](/academy/web-scraping-for-beginners) course, we have learned the necessary basics required to create a scraper. In the following courses, we learned more about specific practices and techniques that will help us to solve most of the problems we will face.
In the [Web scraping basics for JavaScript devs](/academy/scraping-basics-javascript) course, we have learned the necessary basics required to create a scraper. In the following courses, we learned more about specific practices and techniques that will help us to solve most of the problems we will face.

In this course, we will take all of that knowledge, add a few more advanced concepts, and apply them to learn how to build a production-ready web scraper.

Expand Down
2 changes: 1 addition & 1 deletion ...ics_javascript2/01_devtools_inspecting.md → ...sics_javascript/01_devtools_inspecting.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Inspecting web pages with browser DevTools
sidebar_label: "DevTools: Inspecting"
description: Lesson about using the browser tools for developers to inspect and manipulate the structure of a website.
slug: /scraping-basics-javascript2/devtools-inspecting
slug: /scraping-basics-javascript/devtools-inspecting
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...ascript2/02_devtools_locating_elements.md → ...vascript/02_devtools_locating_elements.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Locating HTML elements on a web page with browser DevTools
sidebar_label: "DevTools: Locating HTML elements"
description: Lesson about using the browser tools for developers to manually find products on an e-commerce website.
slug: /scraping-basics-javascript2/devtools-locating-elements
slug: /scraping-basics-javascript/devtools-locating-elements
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...avascript2/03_devtools_extracting_data.md → ...javascript/03_devtools_extracting_data.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Extracting data from a web page with browser DevTools
sidebar_label: "DevTools: Extracting data"
description: Lesson about using the browser tools for developers to manually extract product data from an e-commerce website.
slug: /scraping-basics-javascript2/devtools-extracting-data
slug: /scraping-basics-javascript/devtools-extracting-data
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...basics_javascript2/04_downloading_html.md → ..._basics_javascript/04_downloading_html.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Downloading HTML with Node.js
sidebar_label: Downloading HTML
description: Lesson about building a Node.js application for watching prices. Using the Fetch API to download HTML code of a product listing page.
slug: /scraping-basics-javascript2/downloading-html
slug: /scraping-basics-javascript/downloading-html
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...ing_basics_javascript2/05_parsing_html.md → ...ping_basics_javascript/05_parsing_html.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Parsing HTML with Node.js
sidebar_label: Parsing HTML
description: Lesson about building a Node.js application for watching prices. Using the Cheerio library to parse HTML code of a product listing page.
slug: /scraping-basics-javascript2/parsing-html
slug: /scraping-basics-javascript/parsing-html
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...asics_javascript2/06_locating_elements.md → ...basics_javascript/06_locating_elements.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Locating HTML elements with Node.js
sidebar_label: Locating HTML elements
description: Lesson about building a Node.js application for watching prices. Using the Cheerio library to locate products on the product listing page.
slug: /scraping-basics-javascript2/locating-elements
slug: /scraping-basics-javascript/locating-elements
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ..._basics_javascript2/07_extracting_data.md → ...g_basics_javascript/07_extracting_data.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Extracting data from HTML with Node.js
sidebar_label: Extracting data from HTML
description: Lesson about building a Node.js application for watching prices. Using string manipulation to extract and clean data scraped from the product listing page.
slug: /scraping-basics-javascript2/extracting-data
slug: /scraping-basics-javascript/extracting-data
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...ping_basics_javascript2/08_saving_data.md → ...aping_basics_javascript/08_saving_data.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Saving data with Node.js
sidebar_label: Saving data
description: Lesson about building a Node.js application for watching prices. Using the json2csv library to save data scraped from product listing pages in both JSON and CSV.
slug: /scraping-basics-javascript2/saving-data
slug: /scraping-basics-javascript/saving-data
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...ng_basics_javascript2/09_getting_links.md → ...ing_basics_javascript/09_getting_links.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Getting links from HTML with Node.js
sidebar_label: Getting links from HTML
description: Lesson about building a Node.js application for watching prices. Using the Cheerio library to locate links to individual product pages.
slug: /scraping-basics-javascript2/getting-links
slug: /scraping-basics-javascript/getting-links
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...craping_basics_javascript2/10_crawling.md → ...scraping_basics_javascript/10_crawling.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Crawling websites with Node.js
sidebar_label: Crawling websites
description: Lesson about building a Node.js application for watching prices. Using the Fetch API to follow links to individual product pages.
slug: /scraping-basics-javascript2/crawling
slug: /scraping-basics-javascript/crawling
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...asics_javascript2/11_scraping_variants.md → ...basics_javascript/11_scraping_variants.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Scraping product variants with Node.js
sidebar_label: Scraping product variants
description: Lesson about building a Node.js application for watching prices. Using browser DevTools to figure out how to extract product variants and exporting them as separate items.
slug: /scraping-basics-javascript2/scraping-variants
slug: /scraping-basics-javascript/scraping-variants
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...raping_basics_javascript2/12_framework.md → ...craping_basics_javascript/12_framework.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Using a scraping framework with Node.js
sidebar_label: Using a framework
description: Lesson about building a Node.js application for watching prices. Using the Crawlee framework to simplify creating a scraper.
slug: /scraping-basics-javascript2/framework
slug: /scraping-basics-javascript/framework
unlisted: true
---

Expand Down
2 changes: 1 addition & 1 deletion ...craping_basics_javascript2/13_platform.md → ...scraping_basics_javascript/13_platform.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Using a scraping platform with Node.js
sidebar_label: Using a platform
description: Lesson about building a Node.js application for watching prices. Using the Apify platform to deploy a scraper.
slug: /scraping-basics-javascript2/platform
slug: /scraping-basics-javascript/platform
unlisted: true
---

Expand Down
0 ...craping_basics_javascript2/_exercises.mdx → ...scraping_basics_javascript/_exercises.mdx
View file
Open in desktop
File renamed without changes.
0 ...raping/scraping_basics_javascript2/images → ...craping/scraping_basics_javascript/images
View file
Open in desktop
File renamed without changes.
Loading
Loading