Author Profile
Sorin Marica is a Full Stack and DevOps Engineer at WebScrapingAPI, building product features and maintaining the infrastructure that keeps the platform running smoothly.
Published Articles
8 articles
TL;DR: Node-unblocker turns an Express app into a URL-prefix HTTP proxy you can hack on. This web scraping node unblocker guide walks through installing it, wiring up request and response middlewares, rotating instances, deploying on Docker or Heroku, and recognizing the point where a managed scraping API is the saner answer.
TL;DR: PHP is a perfectly capable language for web scraping, thanks to built-in extensions like cURL and DOMDocument, plus a rich Composer ecosystem that includes Guzzle, Symfony DomCrawler, and Symfony Panther for headless browsing. This guide walks you through the full workflow: fetching pages, parsing HTML, storing results in CSV/JSON/MySQL, handling errors, and avoiding blocks.
TL;DR: Use a catalog integration to inspect REST's six constraints, distinguish resource state from conversation state, and test all four parts of the uniform interface.
TL;DR: Find out how to use the newly released node-fetch to make http requests directly from node.js. Node-fetch is the equal of fetch api in javascript
TL;DR: The best PhantomJS alternative depends on what your old script did, because PhantomJS development was suspended in March 2018. Use Playwright for most new work, Puppeteer for the shortest Node.js port when you only need Chrome, and Selenium if your tests already run on a WebDriver grid. If the page is server-rendered, an HTTP client and a parser will do.
TL;DR: Build a Go scraper that extracts book records to JSON. Follow a tested example with goquery, then plan pagination, Colly, browser rendering, and error handling.
TL;DR: For web scraping in C#, start on .NET 10 with the built-in HttpClient to download pages and AngleSharp to parse HTML with CSS selectors. Pick HtmlAgilityPack when you prefer XPath or maintain older code, and add Playwright for .NET when JavaScript builds the page. This guide builds one scraper with polite retries, bounded crawling, CSV and JSON export, and offline tests.
TL;DR: This BeautifulSoup tutorial walks you through a complete Python scraper, from pip install to a hardened script that paginates Hacker News, exports to CSV and JSON, and stays polite enough not to get blocked. Every snippet is runnable, and we call out the exact moments when BeautifulSoup is the wrong tool.
Start Building
Join 2,000+ companies using WebScrapingAPI to extract web data at enterprise scale with zero infrastructure overhead.
