UseScraper blog
Learn how to crawl and scrape the Internet
Introduction Web Scraping with C# 2024
Ethan Whitaker
Oct 19, 2023
Making HTTP Requests with Axios
Lukas Jansen
Aug 24, 2023
How to crawl a website sitemap and scrape all pages with with Scrapy and Python
Ethan Whitaker
Feb 27, 2024
Scraping APIs with JavaScript and Node.js
Ethan Whitaker
May 19, 2023
Common Web Scraping Challenges
Lukas Jansen
Oct 6, 2023
Data Extraction and Parsing with JavaScript
Ethan Whitaker
Aug 19, 2023
Storing and Managing Scraped Data
Caitlin O'Connor
Feb 1, 2024
Introduction Web Scraping with Go 2024
Lukas Jansen
Mar 1, 2024
Scraping Dynamic Websites with Selenium
Caitlin O'Connor
Oct 15, 2023
Proxies and Rotating IPs for Web Scraping with Python
Lukas Jansen
Nov 29, 2023
Web Scraping FAQs
Ethan Whitaker
Nov 25, 2023
Installing Python and Required Libraries
Ethan Whitaker
Aug 14, 2023
Introduction Web Scraping with Ruby 2024
Lukas Jansen
Dec 25, 2023
Making HTTP Requests with Python
Caitlin O'Connor
Feb 23, 2024
Web Crawling with Python
Lukas Jansen
Nov 30, 2023
The best 5 proxies for web scraping in 2024
Ethan Whitaker
Mar 5, 2023
Dealing with Rate Limiting and Throttling
Caitlin O'Connor
Mar 6, 2023
Puppeteer vs Playwright - Which is best for browser automation?
Caitlin O'Connor
Dec 31, 2023
Headless Browsing with Puppeteer
Caitlin O'Connor
Feb 10, 2024
Handling Anti-Scraping Measures in JavaScript
Ethan Whitaker
Dec 11, 2023
Web Crawling with JavaScript and Node.js
Lukas Jansen
Dec 15, 2023
Setting up Node.js Environment for Web Scraping
Ethan Whitaker
Nov 18, 2023
Web Scraping vs Web Crawling
Lukas Jansen
Jan 9, 2023
The 5 best open source web crawlers in 2024
Caitlin O'Connor
Sep 28, 2023
Scraping APIs and Authenticated Resources
Ethan Whitaker
Apr 25, 2023
Scraping at Scale and Performance Optimization
Ethan Whitaker
Jan 10, 2024
Handling CAPTCHAs and Other Anti-Scraping Measures
Lukas Jansen
Jun 27, 2023
How to load custom cookies in a Python request
Lukas Jansen
Mar 22, 2023
Scraping Best Practices and Optimization in JavaScript
Lukas Jansen
Mar 12, 2023
Extracting Data with Cheerio
Caitlin O'Connor
Dec 17, 2023
Parallel and Distributed Web Scraping
Caitlin O'Connor
Oct 10, 2023
Parsing HTML with BeautifulSoup
Ethan Whitaker
Mar 7, 2024
Debugging and Troubleshooting Web Scraping Issues
Lukas Jansen
Feb 25, 2024
Dealing with Anti-Scraping Measures in Python
Caitlin O'Connor
Jan 26, 2024
Take a screenshot of any website with Puppeteer and Python
Ethan Whitaker
Jan 18, 2024
Introduction to Web Scraping with Python
Lukas Jansen
Dec 30, 2023
Regular Expressions for Web Scraping
Ethan Whitaker
Dec 5, 2023
Data Extraction and Parsing with Python
Caitlin O'Connor
Dec 2, 2023
Web Scraping Use Cases
Caitlin O'Connor
Nov 30, 2023
Parsing HTML with Cheerio
Ethan Whitaker
Nov 29, 2023
LangChain ChatGPT RAG with scraped website content
Damien Tanner
Nov 21, 2023
How to upload a website's content into an OpenAI GPT's knowledge
Damien Tanner
Nov 20, 2023
Say 👋 to UseScraper Crawler
Damien Tanner
Nov 20, 2023
Scraping Websites with Complex Navigation
Lukas Jansen
Nov 1, 2023
Proxies and Rotating IPs for Web Scraping with JavaScript
Caitlin O'Connor
Oct 30, 2023
What are Headless browsers and how do they work?
Ethan Whitaker
Oct 27, 2023
Handling AJAX and JavaScript-rendered Content
Lukas Jansen
Sep 21, 2023
Building a Web Scraping API with Node.js
Ethan Whitaker
Sep 16, 2023
Navigating and Searching HTML with Cheerio
Caitlin O'Connor
Aug 11, 2023
Scraping Websites with Client-Side Rendering
Ethan Whitaker
Jul 25, 2023
Overview of Web Scraping Tools and Libraries
Ethan Whitaker
Jul 23, 2023
Introduction Web Scraping with PHP 2024
Caitlin O'Connor
Jul 4, 2023
Scraping Best Practices and Optimization in Python
Caitlin O'Connor
Jun 25, 2023
Introduction Web Scraping with Java 2024
Ethan Whitaker
Jun 4, 2023
Navigating and Searching HTML with BeautifulSoup
Lukas Jansen
May 22, 2023
Scraping Dynamic Websites with Puppeteer
Caitlin O'Connor
May 11, 2023
Scraping Websites with Infinite Scrolling
Caitlin O'Connor
May 11, 2023
Top tips for bypassing Cloudflare when web scraping in 2024
Ethan Whitaker
Apr 30, 2023
The 5 best open source web scraping tools in 2024
Ethan Whitaker
Apr 23, 2023
Handling JavaScript with Python
Ethan Whitaker
Mar 22, 2023
Rotating IP Addresses and User Agents
Lukas Jansen
Mar 20, 2023
Extracting Data with BeautifulSoup
Ethan Whitaker
Mar 20, 2023
Legalities and Ethics of Web Scraping
Caitlin O'Connor
Mar 16, 2023
Using Proxies for Web Scraping
Lukas Jansen
Feb 28, 2023
Comparison of Web Scraping Tools and Libraries
Ethan Whitaker
Jan 16, 2023
Introduction to Web Scraping with JavaScript and Node.js
Ethan Whitaker
Jan 13, 2023
What is Web Scraping?
Lukas Jansen
Jan 12, 2023
Scraping APIs with Python
Caitlin O'Connor
Jan 4, 2023