Skip to content

Choosing Free Search, Scraping, and Browser APIs: Recurring Quotas, Trials, and Self-Hosting

Aug 21, 2026 1 min
TL;DR Free access is not one model: recurring allowances, balance top-ups, rate-limited access, one-time credits, and self-hosting have different steady-state costs.
Table of Contents
  1. Start with the Route That Matches Your Need
    1. Validate the Need Without a Card
    2. Keep Cost Behind a Fixed Ceiling
    3. Keep Data Inside Your Network
  2. Then Identify the Type of Free Access
  3. Run These Six Checks Before Comparing Plans
  4. Complete Plan Data: Use It as a Lookup Table
    1. Search APIs and MCP: Check Whether the Allowance Returns
    2. Browser and Scraping Credits Use Incompatible Cost Units
    3. One-Time Credits Belong in the Adoption Budget
    4. Free Access with Rate Limits
    5. A Free Web Product Does Not Mean a Free API
    6. Open Source Moves the Bill Somewhere Else
  5. Update Log
  6. References
    1. Search APIs and MCP
    2. Browser, Scraping, and Rate-Limited Access
    3. One-Time Trials and Counterexamples
    4. Self-Hosted Tools

🌏 中文版

Pricing pages for search, scraping, and browser agents all like the word “Free.” Underneath, however, a plan may reset daily or monthly, restore a balance to a ceiling, impose only an RPM limit, grant credits once at signup, or simply let you download the software. Those models have completely different long-term costs.

This article does not rank search quality or repeat dozens of product descriptions. It answers an earlier question that is easier to get wrong: will the free usage you see today return in the next period?

The data was first collected on August 21, 2026, updated from official material on August 22, and expanded with TinyFish plan details on August 29. Recheck the official page and authenticated Billing screen before adopting any service.

Start with the Route That Matches Your Need

If you only need a starting point, use these three scenarios first. The complete tables later in the article are lookup material for quotas and constraints; you do not need to read every row before making an initial choice.

Your situationStarting configurationWhat to check first
Validate the need without a cardTavily for Search and Firecrawl for Scrape; add Browserless only when a remote browser is necessaryTest 20 fixed questions and 20 fixed URLs before sending production traffic
Keep cost behind a fixed ceilingUse only a documented hard stop or a spending cap verified in the authenticated Billing screenParallel and Brave can enter PAYG, so the router still needs its own budget limit
Keep data inside your networkSearXNG for public-page discovery, Crawl4AI for fetching, and Meilisearch or Qdrant for internal documentsThere is no SaaS quota, but your team owns compute, proxies, backups, and operations

Validate the Need Without a Card

Use Tavily for Search and Firecrawl for Scrape; both publish recurring allowances without requiring a card. If a remote browser is necessary, use Browserless monthly units for a small test. Start with 20 fixed questions and 20 fixed URLs instead of production traffic. Save the query, URL, parameters, raw response, and verification date so the benchmark can be rerun after a provider changes its models.

Keep Cost Behind a Fixed Ceiling

Treat a plan as a cost ceiling only when the provider explicitly documents a hard stop or you have verified a spending cap in the authenticated Billing screen. Parallel and Brave can enter PAYG after the free allowance. Your router should still check daily_requests, monthly_credits, and the task's max_depth before every call, then switch to a cheaper route when any limit is exceeded.

if (budget.monthlyCredits <= 0) return fallback("self-hosted-search");
if (task.depth > 2) return fail("crawl_budget_exceeded");

const result = await provider.search(query);
budget.record(result.usage);
return result;

Keep Data Inside Your Network

Use SearXNG to discover public pages, Crawl4AI to fetch them, and Meilisearch or Qdrant for internal documents. This path has no vendor API quota, but you must define crawl budgets, source permissions, deletion propagation, and backups. This site's SearXNG and Crawl4AI integration guide covers public-web acquisition; private documents should not enter the same index without access controls.

Then Identify the Type of Free Access

ModelHow to identify itExamplesBest use
Recurring allowanceThe provider explicitly says daily, monthly, or billing cycleTavily, SerpAPI, Cloudflare Browser RunSustainable low-volume services
Balance top-upThe remaining balance is restored to a ceiling instead of incremented by a fixed amountLinkupSearch prototypes with a bounded allowance
Persistent rate limitThere is no monthly credit pool, only an RPM or QPS ceilingJina Reader, TinyFish Search/FetchLow-volume content reading and agent retrieval
One-time trialSignup or trial credits do not return after exhaustionSerper, You.com API, HyperbrowserAPI validation and short benchmarks
Local or self-hostedThere is no SaaS quota; the cost moves to compute, proxies, and operationsSearXNG, Crawl4AI, QdrantPrivate data and stable high-volume workloads

$0 does not prove that an API allowance exists, and a Free plan does not prove that its quota resets monthly. Count a quota as steady-state capacity only when the provider publishes a period. Otherwise, record the reset as unknown instead of multiplying it by twelve.

Run These Six Checks Before Comparing Plans

  1. Find an explicit daily, monthly, or billing-cycle statement. Record the reset as unknown when none exists.
  2. Determine whether the plan increments by a fixed amount, restores a balance ceiling, imposes a rate limit, or grants credit only once.
  3. Check how failed requests, retries, timeouts, proxy traffic, and browser time are charged.
  4. Confirm whether exhaustion returns 429, suspends service, requires an upgrade, or enters PAYG.
  5. Check whether a card is required, whether a hard spending cap exists, and whether unused credit rolls over.
  6. Store the source URL, verification date, and official wording; recheck before launch and every quarter.

Complete Plan Data: Use It as a Lookup Table

The sections below preserve each service's published allowance, card requirement, and overage behavior for provider-by-provider checks. Credits, requests, browser minutes, and units from different tables are not directly comparable.

Search APIs and MCP: Check Whether the Allowance Returns

ServicePublished allowanceCard, reset, and overage behavior
ExaA one-time $20 signup grant, then $10 in monthly creditsNo payment method required; reset date, timezone, and rollover are not published
Tavily1,000 credits per monthNo card; endpoints and search depth consume different amounts; exact reset date and rollover are not published
Firecrawl1,000 credits per monthNo card; Search, Scrape, and Crawl share credits; Free credits do not roll over and normal PAYG is unavailable, so users must upgrade
Linkup$20 at signup with a professional email; eligible accounts are topped back up to $20 monthlyPrepaid balance; zero balance returns HTTP 429; eligibility and the exact top-up date are not fully published
Brave Search API$5 in credits automatically applied each monthA payment card is required for fraud prevention; overage uses PAYG; rollover is not published
SerpAPI250 successful searches per billing cycleResets when a new cycle starts; cached, failed, and errored searches do not count; Free rollover is not published
Parallel$5 in monthly credits for eligible organizationsA card is required; credits expire at month-end and do not roll over; overage is charged at standard rates
You.com free MCP100 keyless you-search queries per daySearch only; Contents, Research, and Finance are excluded; reset time and timezone are not published
TinyFish Search/FetchSearch 30 requests/min; Fetch 150 URLs/minNo card, no monthly minimum, and usable with a $0 Wallet balance; only Agent and Browser draw from Wallet funds

Linkup is easy to misread. The official wording says an eligible account is topped back to $20 each month. That restores the balance to a ceiling; it does not add another $20. If $7 remains when the top-up occurs, the grant is $13. The exact top-up date is not public, so it should not be described as a month-end settlement.

Parallel has a different risk. Its recurring grant is real, but the account must have a card and usage beyond $5 is charged at standard rates. Recurring free access is not the same as a hard stop; your router still needs its own spending cap.

Browser and Scraping Credits Use Incompatible Cost Units

ServicePublished allowanceMost important constraint
Apify$5 in prepaid platform usage per monthActors, proxies, storage, and compute share the pool; unused allowance expires at the end of the cycle
AgentQL50 API calls per month on Starter, plus 10 browser hoursPublished overage is $0.02 per call and $0.12 per browser hour; hard-stop behavior without a payment method and the exact browser-hour reset are unclear
BrowserbaseMonthly allocation of 1 browser hour, 3 Agents, 1,000 Search, and 1,000 Fetch; concurrency 3Reset date, rollover, and Free-plan exhaustion behavior are not published clearly
Diffbot10,000 credits per billing periodResets when a new billing period begins; APIs consume different amounts; Free exhaustion returns 429
Bright Data Free Tier5,000 general Free Tier credits per month, renewed on the first day of the monthWeb Unlocker, SERP, Web Scraper, and Scraper Studio share the general pool; the MCP plan separately lists 5,000 requests per month, but public material does not prove whether the pools are shared or separate
Browserless1,000 units per month, 2 concurrent browsers, and sessions up to 1 minuteA browser connection costs 1 unit per 30 seconds; residential proxy traffic costs 6 units/MB, datacenter proxy traffic 2 units/MB, and a successful CAPTCHA 10 units; rollover and exhaustion behavior are not published
Cloudflare Browser Run10 browser minutes per UTC day on Workers Free; concurrency 3Exhaustion returns 429 until the next UTC day; Paid includes 10 hours per month, then costs $0.09/hour, with session concurrency tracked separately
ZenRows5,000 credits per month; concurrency 5No card, monthly refresh, no rollover, and no Free top-up; Fetch costs 1, JavaScript 5, premium proxy 10, and both together 25 credits
Browser Use Cloud10 agent tasks per month; 3 concurrent sessionsFurther usage uses top-ups or PAYG; browser, proxy, and token costs are separate; whether ordinary Free signup requires a payment method is not published

Browserless demonstrates why headline quota is not enough. Its 1,000 units do not mean 1,000 arbitrary requests: connection time, proxy bandwidth, and CAPTCHA solving can all draw from the same unit system. A short session and a high-bandwidth job therefore have very different practical capacities.

Bright Data also cannot be summarized as “every product gets 5,000.” Several scraping products share the general Free Tier pool, while the MCP page describes its monthly plan in requests. Public documents do not establish whether those two allowances share a pool. Verify the authenticated billing dashboard and usage response before integration.

One-Time Credits Belong in the Adoption Budget

ServiceOne-time grantExhaustion, expiry, or other constraint
Serper2,500 signup queriesNot monthly; further usage requires a top-up
You.com API$100 in complimentary API credits for new accounts, with no cardNot monthly; add funds after exhaustion; auto top-up is opt-in and separate from the keyless MCP's 100 daily searches
SearchAPI.io100 successful signup requests, with no cardOnly HTTP 200 responses count; refresh, expiry, and the zero-balance HTTP behavior are not published
ScrapingBee1,000 API credits, with no cardJavaScript rendering defaults to 5 credits; proxy options and some APIs cost more; expiry is not published
Steel Cloud$30 in usage credits valid for 90 daysBrowser, proxy, CAPTCHA, and Browser Tools share the balance; proxy and CAPTCHA require a $10 paid balance for verification
Zyte API$5 for 30 days or the first billing monthOnly successful responses are charged; the account is suspended after exhaustion or expiry
ValyuThe pricing page lists $10 at signup, while separate official material says $20 with a work email; no cardSearch, Answer, Contents, and DeepResearch share the balance; published retrieval and token billing descriptions conflict, so measure the returned API cost
Hyperbrowser5,000 credits, with no cardThe official FAQ describes them as testing credits; a Free user must upgrade after exhaustion; expiry of unused credit is not published
BochaA public promotion page listed a one-time package of 1,000 calls, with a possible second package via promo codeNo recurring reset; current redemption and expiry require authenticated verification. Standard Web Search is CNY 36 per 1,000 calls; CNY 3.6 per 1,000 is a promotional resource package

A large one-time grant is still not steady-state capacity. Serper's 2,500 queries, Hyperbrowser's 5,000 credits, and You.com's $100 are useful for the first evaluation. Multiplying any of them by twelve creates a budget that does not exist.

Free Access with Rate Limits

Jina Reader remains available without a key at 20 RPM; anonymous Jina Search is blocked. On a first website visit, an IP-eligible user may receive an automatically generated key with 10 million noncommercial tokens. An official maintainer clarification says a manually created key is expected to start at zero. That welcome balance does not refresh periodically, and its expiry is not published.

TinyFish: Free Search and Fetch, Paid Interactive Tasks

TinyFish Search/Fetch follows the same persistent-rate-limit model: Search allows 30 requests/min, Fetch allows 150 URLs/min, a $0 Wallet balance still works, and failed Fetch URLs do not count. The difference from Jina is scope. TinyFish runs pages through its Chromium infrastructure and returns cleaned Markdown, JSON, or HTML, so it is closer to a complete discovery-plus-reading layer for agents than a plain article reader.

TinyFish's paid boundary is also explicit: Search and Fetch are free, while Agent costs $0.016/step and Browser costs $0.002/min. In practice, public discovery and page reading can stay on the free rate-limited path; login, clicking, form filling, and long-lived browser sessions move into Wallet billing. Handle 429 carefully: a response with details.limit / details.unit means the account hit its per-minute limit and should respect Retry-After or upgrade; a response without details may indicate upstream throttling or capacity, so retry with backoff instead of treating it as a plan-limit problem.

A Free Web Product Does Not Mean a Free API

Perplexity Search API has no complimentary API credits. Free, Pro, and Max consumer subscriptions do not include API usage. Search API costs $5 per 1,000 successful requests, requires prepaid credits, and blocks the API key when the balance reaches zero.

Google Custom Search JSON API is closed to new customers. Existing customers retain 100 queries per day until the service shuts down on January 1, 2027. Google's free, ad-supported Standard Search Element is a client-side JavaScript widget, not a backend JSON API for an agent.

Open Source Moves the Bill Somewhere Else

AutoScraper, Trafilatura, and Readability have no monthly API quota because they run in your environment. Scrapy, SearXNG, Crawl4AI, Qdrant, and Meilisearch follow the same model at different layers of the stack.

That does not mean zero cost. A self-hosted workflow has at least five bills:

  1. Compute, storage, and backups.
  2. Browser CPU, memory, and concurrency.
  3. Proxies, CAPTCHA handling, or remote browsers.
  4. Model compute for LLM extraction and embeddings.
  5. Engineering time for upgrades, alerts, and retries.

For a small tool making a few dozen requests per day, a SaaS allowance is often cheaper than maintaining a server. Self-hosting becomes attractive when data cannot leave the network, crawl volume is stable and high, or the team already operates VMs or Kubernetes.

The most sustainable free plan is not the one with the largest headline number. It is the one whose reset rules, overage behavior, and cost unit can all be controlled in code. Search quality still requires a separate benchmark: a pricing table can tell you whether a route is affordable, not whether its results are useful.

Update Log

  • 2026-08-30: Reordered the article to put three starting scenarios first, keep the complete allowance tables as lookup material, and separate rate-limited access from free API allowances.
  • 2026-08-29: Added TinyFish Search/Fetch's persistent free rate limit, $0 Wallet boundary, Agent/Browser paid boundary, and 429 handling distinction.
  • 2026-08-22: Separated recurring allowances, persistent rate limits, and one-time trials; added Search, browser, and scraping services.
  • 2026-08-22: Corrected Hyperbrowser's 5,000 credits to a one-time grant and revised the quota descriptions for Exa, Linkup, AgentQL, Browserbase, Bright Data, and Jina.
  • 2026-08-22: Added Perplexity and Google Custom Search JSON API as counterexamples so consumer plans and frontend widgets are not mistaken for free APIs.

References

Search APIs and MCP

Browser, Scraping, and Rate-Limited Access

One-Time Trials and Counterexamples

Self-Hosted Tools