Skip to content
4.7
Excellent on Trustpilot

News Scraper API for
500+ news sites

Extract public news content from news outlets you're authorized to access — national papers, broadcasters, business press, and regional publishers. Render dynamic, JavaScript-heavy news pages automatically. Structured JSON output in 10-20 seconds.

Start Free Trial Documentation

Free demo trial • No credit card required • Setup in <2 minutes

Visual representation of news aggregation: from many sources to unified feed

What is News Scraper?

News Scraper is Scrappey's specialized API for extracting public news content from news outlets you're authorized to access, across hundreds of publications worldwide. Unlike manual scraping that requires handling each site's unique structure and JavaScript rendering, News Scraper automatically renders dynamic content to return clean, structured article data.

Built for media intelligence, financial monitoring, and news aggregation, News Scraper supports major publishers (major financial news outlets, international broadcasters), regional news (hundreds of local and international sources), and 25+ languages with proper character encoding. Each request returns article title, content, author, publish date, images, and metadata in clean JSON format.

What makes News Scraper special is its comprehensive coverage: from breaking financial news to regional publications, from English to Arabic to Chinese, all accessible through a single API. No need to build custom parsers for each site or manage browser rendering – we do it all automatically, across publicly available articles.

News Scraper architecture showing integrated components working together
Any language

Universal language support

Scrappey is a simple HTTP endpoint, so it works with any programming language that can make a request. No language-specific SDKs required — just send JSON and get results.

A universal HTTP/JSON endpoint connecting to many programming languages
PythonNode.jsPHPGoRubyJavaC#RustcURLand more

How it works

  1. 1

    Standard HTTP request

    POST to our API endpoint with your key and a JSON payload. Works with any HTTP client in any language — requests, axios, cURL, you name it.

  2. 2

    JSON in, JSON out

    Describe the scraping task as plain JSON. No SDKs, no language-specific wrappers, no build step to learn.

  3. 3

    Universal compatibility

    Python, Node.js, PHP, Go, Ruby, Java, C#, Rust — if it can make an HTTP request, it works with Scrappey.

HTTP
REST API
JSON
Simple format
Any
Language

Powerful news scraping features

Advanced capabilities for comprehensive news extraction

500+ News Sites Supported

Pre-configured for major financial news outlets, international broadcasters, and hundreds of regional publishers across 40+ countries

→500+ sites tested

Reliable Request Handling for Dynamic News Sites

Automatically renders JavaScript-heavy news pages so you get clean article data from publicly available articles.

→Handles common browser verification flows

Structured Data Extraction

Returns article title, body, author, publish date, images, and metadata in clean JSON format. No HTML parsing needed

→10-20 sec per article

Multi-Language Support

Scrape news in English, Spanish, French, German, Arabic, Chinese, and 20+ other languages with proper character encoding

→25+ languages

Real-Time Updates

Monitor news sites for new articles, set up webhooks for alerts, or poll RSS feeds with automatic deduplication

→Sub-minute latency

AI-Powered Parsing

Optional AI extraction using DeepSeek or GPT to structure messy HTML into clean JSON based on your schema

→DeepSeek & GPT-4

Simple integration

Start using our news scraping API in minutes

Request
{
  "cmd": "request.get",
  "url": "https://example-news-site.com/articles/example"
}
Response
{
  "solution": {
    "verified": true,
    "type": "browser",
    "response": "html..."
  }
}

Get started in minutes

Three simple steps to start scraping news

1

Create Account

Sign up for a free Scrappey account

2

Get API Key

Generate your API key from the dashboard

3

Start Scraping

Make your first news scraping request

footer-frame

Start building with Scrappey

Try it free. No subscription, no credit card, instant setup — your trial is waiting.

Sign up in 10 seconds
or
Join the Discord community

Frequently asked questions

What is Scrappey.com?
Scrappey.com is a web scraping API that handles all the complex aspects of web scraping, such as handling dynamic content, rotating proxies, advanced request handling, headless browsers, and verification processing. It offers an all-in-one solution for extracting publicly available data from websites.
How does Scrappey.com work?
Scrappey.com provides a web scraping API that allows you to send requests to extract publicly available data from websites. It handles dynamic content and modern website complexity, including rotating proxies, advanced request handling, and verification processing. You can easily extract publicly available data from websites using their built-in features like headless browsers and AI-powered data extraction.
Can I customize the proxies used for scraping?
Yes, with Scrappey.com, you have the option to use Sticky Rotating Proxies for seamless scraping. Alternatively, you can also set your own proxies if desired.
Is there a free trial available?
Yes, Scrappey.com offers a free trial where you can try it out without a subscription or credit card. Instant setup is provided, so you can explore the full capabilities of the platform right away.
What happens if a request fails?
We only charge for successful requests. Failed requests are not counted towards your usage, so you only pay for what works.
I need to scroll or click on a button on the page I want to scrape
No problem, you can pass any JavaScript snippet that needs to be executed by using our JavaScript scenario parameter. This allows you to interact with dynamic content, scroll pages, click buttons, wait for elements, and perform any custom JavaScript actions before extracting the data.
What is the pricing structure for Scrappey.com?
Scrappey.com offers simple and transparent pricing: €0.10 per 1,000 direct HTTP requests and €1.00 per 1,000 full-browser requests. Residential proxies are included on both tiers — no separate proxy billing, no hidden fees, no complicated pricing tiers. You only pay for successful requests.
Are there any usage restrictions or limitations?
Scrappey.com provides scalable access for extracting publicly available data. Whether you need to extract data from a few pages or a large dataset of publicly accessible content, you can do so with flexible usage options. Please note that Scrappey.com only supports scraping publicly available data, and users must comply with applicable laws and website terms of service.
What support channels are available?
Scrappey.com provides various support channels for assistance. You can refer to their documentation, frequently asked questions section, blog, and uptime status page. Additionally, you can get in touch with them via email or join their Discord community for further support.
I'm not a developer, can you create custom scraping scripts for me?
We don't create custom scraping scripts, however we will gladly write some code snippets helping you to use our most powerful features: AI-powered data extraction and JavaScript scenario. Our documentation includes examples in multiple programming languages to get you started quickly.
What is a request and how are they counted?
Each API call to Scrappey counts as one request. Our pricing is based on successful requests. By default, JavaScript rendering is enabled, which allows you to extract data from modern websites with dynamic content. All features including proxies, challenge handling, and reliable web access handling are included in each request.
How fast is Scrappey's API and what if a site is hard to scrape?
Scrappey's API is optimized for fast response time, even when working with JavaScript-heavy websites and browser verification flows, where access is authorized. If other tools struggle with sites that use browser verification, Scrappey is designed to handle these workflows efficiently, ensuring reliable data retrieval. Our reliable web access handling, residential proxies, and intelligent retry logic work together to maximize success rates.

Integrations

n8n logo

n8n

Automate workflows visually. Streamline data collection processes.

n8n Template logo

n8n Template

Pre-built template for modern websites. Simplifies Scrappey integration.

RapidAPI logo

RapidAPI

Access via API marketplace. Easy integration with comprehensive docs.

Apify logo

Apify

Scalable actor-based automation. Reliable browser rendering.

MCP Server logo

MCP Server

AI-powered browser automation. Intelligent session management.

Scrappey CLI logo

Scrappey CLI

Scrape from your terminal. One command, pipeable output, CI-ready.

Claude Code Skill logo

Claude Code Skill

Portable skill for Claude Code + Codex. Browser-backed data access on demand.

LangChain logo

LangChain

LangChain connector — clean web data for any chain or agent.

LlamaIndex logo

LlamaIndex

LlamaIndex reader — load modern web pages straight into RAG.

Zapier logo

Zapier

Connect with 7,000+ apps. Automate workflows easily.

Make logo

Make

Visual workflow automation. Connect with 1,000+ apps easily.

Related resources