Language-by-language guides to web scraping — the right libraries, runnable code, and how to get past anti-bot blocking in Java, C#, Go, Ruby, PHP, R, Node.js and the command line.
Web scraping with Java means fetching a web page over HTTP and extracting structured data from its HTML, usually with Jsoup for static pages and Selenium or Playwright for JavaScri.
Web scraping with C# means using .NET's HttpClient to fetch a page and a parser like HtmlAgilityPack or AngleSharp to extract data from the HTML.
Web scraping with Go (Golang) means using net/http or the Colly framework to fetch pages and goquery to extract data with jQuery-like selectors.
Web scraping with Ruby means fetching a page with an HTTP gem like HTTParty and parsing the HTML with Nokogiri, which supports both CSS selectors and XPath.
Web scraping with PHP means fetching pages with the Guzzle HTTP client and extracting data with Symfony's DomCrawler component, which supports CSS selectors and XPath.
Web scraping with R means using the rvest package to download and parse HTML into tidy data frames, with CSS selectors or XPath.
Web scraping with Node.js means fetching a page (with Axios or the built-in fetch) and parsing it with Cheerio for static sites, or driving a real browser with Playwright or Puppet.
Web scraping with curl means fetching pages directly from the command line, setting headers, cookies, and proxies with curl's flags, then piping the output to a parser like pup (HT.
XPath (XML Path Language) is a query language for selecting nodes in an HTML or XML document, widely used in web scraping to pinpoint the exact elements you want to extract.