Skip to content
CrawlfolioSourced research on web data for AI
Menu

How to choose

Best Web Search APIs for AI Agents, Sorted by Route

The best web search API for your AI agent depends on the route: AI search, Google SERP, self-hosted or the model's own tool. Costs checked Nov 13.

Dozens of glowing round bulbs joined by thin copper rods in a geometric lattice against a dark ceiling
Photo: Julia Taubitz / Unsplash · Unsplash License

The best web search API for an AI agent depends on which of four routes you need: model-input search, a Google SERP API, self-hosted metasearch or a model provider’s built-in search tool. I choose the route before the vendor because response shape, billing unit and data rights differ. The primary sources retained below were checked October 31, 2026 and rechecked November 13, 2026; this is documentary research.

Microsoft retired its Bing Search APIs on August 11, 2025. Google closed Custom Search JSON API to new customers, with existing customers required to transition by January 1, 2027. Neither event makes another company’s Google scraper an official Google API.

Short on time?

My pick by route

Model-input retrieval
Exa or Parallel
Exa Lite (and legacy Instant) starts at $4/1K, Auto (and legacy Fast) at $7; Parallel Fast/Turbo at $1. Compare the selected response and optional content costs.
Google SERP collection
apiserpent.com or SearchApi
apiserpent.com has low usage rates with substantial deposits for discounted tiers (rechecked 3 Nov 2026; check the live rates before depositing). SearchApi has conditional legal-protection terms on eligible plans; neither establishes blanket permission.
Operate your own service
SearXNG
AGPL-3.0 metasearch software without a licence fee. Servers, maintenance and upstream access remain your responsibility.
Fewer integration steps
Built-in model search
Keep search within the model API, but distinguish tool calls, grounded prompts and executed search queries. Model tokens can add cost.

Prices verified . Workflow recommendations from documentation, not measured accuracy, speed or account-level pricing.

Do you need Google’s own results? #

Choose a SERP service for Google’s ranking and result-page features. For finding pages to feed a model, shortlist retrieval APIs by the content they document and the rights you need. A SERP JSON response is not automatically a full-page fetch; output contracts vary.

Four routes, four different contractsVerified
RouteWhat you integrateBudgeting unitMain check
Model-input searchRanked sources, excerpts, optional content or answersRequests, retrieved items or credits by endpointResult depth, content add-ons and storage permissions
Google SERP APIStructured representation of a Google results pageSearch request, SERP page or requested depthCollection terms, feature provenance and conditional legal cover
Self-hosted metasearchSoftware that queries upstream enginesInfrastructure and maintenance, not a vendor search tariffEngine access, licence and upstream terms
Built-in model toolSearch inside a model requestTool calls, grounded prompts or executed queries, plus tokensModel/channel-specific allowances and display rules

Source: Selected primary pricing and documentation linked below; these units are not automatically comparable. Scroll sideways for more columns.

How much does web search cost an AI agent? #

Use configured scenarios rather than a single market average. The historical image below preserves its September 27 caption; its $10 lower-bound example is consumed prepaid usage, not the deposit required, and the Gemini figure is only the search component of a particular paid model channel.

Aerial view at night of a highway interchange, its looping ramps and overpasses lit in white
Four routes to the same search results, with very different bills: at 100K searches a month, the anchor options below run from $10 to $1,330 before tokens. Photo: Justin Zhu / Unsplash · Unsplash License
What a month of search costs, by configuration (USD)Verified
Selected configuration1K units100K units1M unitsAssumptions and cash
Parallel Fast/Turbo$1$100$1,000Gross requests; promotional allowances excluded
Exa Lite (or legacy Instant)$4$400$4,000Base up-to-ten results; free credit and optional charges excluded
Brave Search / You.com base Search$5$500$5,000Gross calls, credits and optional full-page retrieval excluded
apiserpent.com Quick Web$0.60$10$30Consumed new-credit usage at rates shown 3 Nov 2026; qualifying deposits $10/$500/$1,250 respectively; best-effort depth
SearchApi eligible subscription$100$250$1,500Selected published capacity plans; legal terms and speed mode apply
Browserbase default Search$0 on Free$515$5,015$20 Developer fee plus overage beyond 1K calls, Parallel Advanced
OpenAI / Anthropic standard search$10$1,000$10,000Tool component only; tokens extra, response contracts differ
Gemini 3+ Developer API grounding$0 search component$1,330$13,930Paid Tier, shared 5K monthly executed search queries; model tokens extra; 100K and 1M exceed the default 1,500 requests/day cap unless it is raised

Source: Arithmetic from the linked vendor prices checked October 31 and rechecked November 13, with no row changes. Rows price different explicitly named units, exclude taxes, and are not a universal cheapest-vendor ranking or observed invoices. Scroll sideways for more columns.

The SERP cost study explains deposit and expiry assumptions. Withheld prices are unavailable, not zero.

Browserbase’s billing-plans documentation still lists $7 per 1,000 Search calls, while its current pricing and Search overview distinguish provider rates of $1/$5/$7. The examples here use the provider-specific schedule; the actual account tariff remains unverified.

For a provider-by-provider table of per-1K prices, see my web search API pricing comparison.

Which AI search API should your agent use? #

I would shortlist Exa or Parallel when the task is retrieval for a model, then compare the response against your permitted workload. Low price alone does not establish relevant sources, adequate freshness or usable data rights.

This Exa screenshot is a historical September 27 snapshot. The current modes below replace its unqualified $7 headline; the licensed image and dated caption are preserved.

Exa's product pricing cards: Search $7 per 1K requests, Agent $0.012 to $1.00 per run, Contents $1 per 1K pages per content type, and Deep Search $12 to $15 per 1K requests
Exa's per-request prices on 27 Sep 2026, in USD: $7 per 1,000 searches, plus $1 per 1,000 pages if you also want the page contents. Screenshot: Exa pricing page, 27 Sep 2026 · Screenshot of a public page (commentary/review)
  • Exa: Lite costs $4/1K and Auto $7, for the base up-to-ten results. Its changelog added the cache-only Lite type on October 19, 2026 and made Instant ($4) and Fast ($7) legacy types at unchanged prices. Extra results and summaries can add cost; standalone Contents is separately priced. The billing guide limits both the $10 monthly credit and the one-time $10 onboarding bonus to a user’s first team; both are excluded from the gross table.
  • Parallel: Fast/Turbo costs $1/1K, Basic/Advanced $5; its main pricing page now shows only the “From $1 per 1k requests” floor. The pricing page advertises 5K free requests and a separate $5 monthly promotion; stacking is unconfirmed. Its quickstart documents source URLs, excerpts and dates. I cover Parallel from documentation only.
  • Brave: base Search is $5/1K with a $5 monthly credit and card requirement. The same page’s banner says “Up to $20 in free calls every month” without explaining how that relates to the $5 plan credit, so I use $5 for Search. The API terms limit storage absent granted rights and restrict AI training/evaluation. Pricing marketing is not contractual permission.
  • Tavily: basic/fast/ultra-fast Search costs one credit; advanced two. PAYG is $0.008/credit; 1K credits/month are free. Keyless Search and Extract also work through REST/MCP without an account, with unpublished numeric caps. Its terms restrict publishing performance analysis; coverage here is documentary.
  • You.com: base Search costs $5/1K calls. The free allowance is 100 daily queries through the free MCP profile, not a 100-query daily REST entitlement. On October 31 the pricing page listed a separate “$10 free credit = 2,000 searches”; its recurrence and eligibility are unstated, so I deduct no grant. The quickstart prices live full-page extraction separately at $1/1K pages.
  • Linkup: standard search is $5/1K, or $6 with a sourced answer. Its credit documentation makes recurring $20 top-ups conditional on account eligibility; do not assume a permanent allowance for every account.
  • Perplexity: standard Search is $5/1K successful requests, Fast $1, with “no additional token-based charges” for Search. Its Sonar migration guide says support ended September 27, with gradual synchronous/streaming reformulation by model and asynchronous calls moving to background mode. That is documentation, not a live migration result.

Other tools have different units.

Browserbase includes 1K calls on Free and its $20 Developer plan, then defaults to Parallel Advanced $5/1K; Fast is $1 and Exa $7 by provider selection. Firecrawl Search uses two credits per block of up to ten results, with scraping additional.

Valyu’s website prices retrievals per 1,000 results by source, from about $0.31 (arXiv/PubMed) and $0.63 (web) to $30 (licensed journals). Its pricing docs bill the same retrievals in credits, at 1,600 credits per $10 top-up, and its Search reference does not state the unit of max_price. One query is not automatically one retrieval, so I withhold a per-query price.

The focused comparisons are Tavily vs Exa, Tavily alternatives and free search APIs.

When is a Google SERP API the right choice? #

Use this route when the selected Google results-page features are the output you need. Compare the exact endpoint, requested depth and optional AI blocks; a cheap organic-search billing unit does not price every feature.

apiserpent.com (SerpentAPI) publishes new-credit Web rates of $0.60/1K Default, $0.30 Growth after one $100 deposit, $0.10 Scale after $500, $0.05 Enterprise after $1,000 and $0.03 Enterprise Plus after $1,250. Existing credit keeps its old schedule. On October 31, 2026 the same page said “Prices to increase 10x after October 31”; when I checked it on November 3 that notice was gone, the lower tiers were unchanged and the $0.03 rate had moved to the new $1,250 tier. Check the live page before you deposit. Quick charges one unit per call with best-effort depth; Deep charges each requested page. Its optional AI Mode surcharge is $4/1K calls on top of Deep charges, and that label does not independently establish Google UI provenance.

The FAQ lists a $10 minimum and no public PAYG SLA. Terms distinguish free-call inactivity, nonexpiring purchased credit and expiring bonuses; credits are generally nonrefundable subject to law, with customer obligations. I did not establish comparable vendor-funded legal cover. Introductory calls are not a monthly free tier.

SearchApi publishes capacity plans, including $100 Production, $250 for 100K and $1,500 at 1M, with optional speed modes separate. Its terms describe protection for eligible plans and uses; this does not guarantee every use is covered.

SerpApi has a larger plan ladder than the first visible cards: selected Best Effort tiers include Searcher $725/100K and Cloud 1M $3,750/1M; larger Cloud tiers can have lower per-unit rates. Its legal contract offers up to $2M protection on eligible recurring plans, limited to specified lawful collection and U.S.-court claims, excluding downstream illegal use.

Serper advertises 2,500 introductory queries and $50/50K packs, with six-month credit expiry. DataForSEO prices one ten-result Google Organic SERP at $0.60/1K Standard-queue units or $2/1K Live, with depth and optional parameters additional. The Standard timing is an average, not a request-latency guarantee. See Serper vs SerpApi, SerpApi alternatives and free SERP tiers.

Once you’ve settled on a SERP API, I compare them by engines, fields and workflow in how to pick a SERP API.

Is self-hosted search (SearXNG, OpenSERP) really free? #

The SearXNG repository supplies AGPL-3.0 metasearch software. Its API documentation requires a supported output format, and many public instances disable JSON. Your own service still needs infrastructure, maintenance and access to upstream engines.

Self-hosting removes a hosted vendor fee, not the upstream terms or the risk of blocked requests. I withhold a fixed hosting budget and do not infer performance from source availability. Review the chosen project’s current licence and engine support before operating it.

Should you use your LLM’s built-in search tool? #

Choose a built-in tool when integrating another service adds more work than its benefit. Its fee is only part of the model bill, and one turn can invoke search more than once.

These are the selected model/channel rules, not universal Google Cloud prices. Model availability, quotas and account eligibility remain separate from the tariff.

What about Google’s own search API? #

It’s closing: the Custom Search notice directs existing customers to transition by January 1, 2027. Its suggested search alternative covers configured sites rather than recreating the Google consumer SERP.

Agent Search General Pricing lists $1.50/1K Standard or $4/1K Enterprise, with Core Generative Answers included in Enterprise; only Advanced Generative Answers adds another $4. Its 10K-query offer is explicitly a Free Trial, not a proven permanent allowance; storage and separate configurable subscription pricing also exist. The Custom Search alternatives guide distinguishes whole-web retrieval from configured-site search.

I cover every official option and what it costs in my guide to Google’s search APIs.

An endpoint being available for purchase is not a legal ruling. In Google’s case, ECF 60 vacated the former October 13 hearing because of the trial schedule; it permits a later hearing or a written decision and does not decide SerpApi’s motion to dismiss (ECF 49). ECF 61, filed October 12, is Google’s notice of another decision, not a ruling here.

That decision came on November 9, 2026: ECF 62 grants SerpApi’s motion to dismiss Google’s DMCA anti-circumvention claims with leave to amend. Google has 21 days to file a new complaint, or the action is dismissed with prejudice. It was the latest entry on the public docket feed when I checked on November 13; I could not review the full PACER record, so a newer filing cannot be ruled out.

Read the conditional protection contracts above and the case explainer. This is a source summary, not legal advice.

How to pick a web search API, in five steps #

  1. Decide whether you need Google rankings or retrieval for a model.
  2. Specify snippets, full page content, requested depth or a synthesized answer.
  3. Match the endpoint, engine and region to that requirement.
  4. Budget its actual unit, plan fee, deposit, expiry and optional token/content charges.
  5. Check storage, display and legal terms, then run permitted quality checks before production.

For known-page retrieval, start with crawl APIs. For clicks and sessions you need a browser-automation tool, which is a different workload from search and outside this hub; search vs fetch vs browser explains where each one fits.

FAQ

What are the best search tools for AI agents?

Choose the route first. I would shortlist Exa or Parallel for model-input retrieval, a configured SERP API when Google's results matter, SearXNG when you can operate metasearch, or the model provider's tool for fewer integration steps. These are documented workflow fits, not a quality ranking.

How do I add web search to an AI agent?

Choose a separate search API, Google SERP API, self-hosted metasearch service or built-in model tool. Define the output, billing unit and storage rights first. Then connect the selected API or tool and validate it on permitted queries; this hub does not claim that connection was executed.

Which AI model is best for web searching?

I have not measured models on search quality. OpenAI and Anthropic publish standard search-tool fees of $10 per 1K calls/searches plus tokens. Gemini Developer API billing depends on model: applicable Gemini 3 and newer models share 5K monthly search queries on Paid Tier, then $14 per 1K queries plus tokens. This is a billing comparison, not evidence of accuracy.

What is the best AI API to use?

For retrieval, shortlist by whether you need Google's ranking, snippets, full page content or a synthesized answer. Exa Lite ($4/1K, the same as legacy Instant) and Auto ($7/1K, the same as legacy Fast) are different modes; SERP page depth, content retrieval and model tokens can change the bill. Avoid selecting a vendor on a headline per-1K rate alone.

Which AI agent is the best for web browsing?

Search and browser control are different tasks. If the task needs clicks, forms or sessions, you need a browser-automation tool, which this hub does not cover. This hub does not rank browsing agents or claim first-hand browser testing.

What is the most accurate web search API for LLMs?

I have not measured relevance and withhold an accuracy winner. The comparison uses public prices, documented features and contract limitations. Run permitted checks on a representative query set before selecting on quality; free-tier size and price do not establish relevance.

Is using a SERP API legal?

No general permission follows from an API being sold. On 9 November 2026 the court granted SerpApi's motion to dismiss Google's amended claims (ECF 62), giving Google 21 days to file a new complaint; that is a ruling on how Google pleaded its case, not on the lawfulness of SERP APIs in general. I could not review the full PACER record. SerpApi and SearchApi advertise conditional legal protection on eligible plans. Check scope, exclusions and your intended use; these sources are not a complete docket review or legal advice.

Sources

48 sources, accessed to .

Official pricing, docs, changelogs and status pages 43

  1. Perplexity Sonar support end and Agent API migration docs.perplexity.ai · accessed
  2. Microsoft: Bing Search API retirement notice learn.microsoft.com · accessed
  3. Google: Custom Search JSON API overview and closure notice developers.google.com · accessed
  4. Tavily docs: API credits and plans docs.tavily.com · accessed
  5. Tavily terms of service tavily.com · accessed
  6. Exa pricing exa.ai · accessed
  7. Exa changelog: Lite search type added, Instant and Fast made legacy (19 Oct 2026) exa.ai · accessed
  8. Exa billing guide: first-team monthly credit and onboarding bonus exa.ai · accessed
  9. Brave Search API plans and pricing brave.com · accessed
  10. Brave Search API terms of service api-dashboard.search.brave.com · accessed
  11. Parallel pricing parallel.ai · accessed
  12. Parallel docs: per-mode Search pricing docs.parallel.ai · accessed
  13. Linkup pricing linkup.so · accessed
  14. You.com API pricing you.com · accessed
  15. Perplexity API pricing docs.perplexity.ai · accessed
  16. OpenAI API pricing developers.openai.com · accessed
  17. OpenAI docs: web search tool developers.openai.com · accessed
  18. Anthropic docs: web search tool platform.claude.com · accessed
  19. Gemini API pricing (now redirects to aistudio.google.com/docs/pricing) ai.google.dev · accessed
  20. Gemini API docs: grounding with Google Search ai.google.dev · accessed
  21. Gemini API additional terms of service ai.google.dev · accessed
  22. apiserpent.com (SerpentAPI) pricing apiserpent.com · accessed
  23. apiserpent.com (SerpentAPI) FAQ apiserpent.com · accessed
  24. apiserpent.com (SerpentAPI) terms of service apiserpent.com · accessed
  25. SerpApi pricing serpapi.com · accessed
  26. SearchApi pricing searchapi.io · accessed
  27. Serper home and pricing serper.dev · accessed
  28. Browserbase pricing browserbase.com · accessed
  29. SearXNG docs: search API docs.searxng.org · accessed
  30. cloud.google.com/generative-ai-app-builder/pricing cloud.google.com · accessed
  31. dataforseo.com/pricing/google-serp/google-organic-serp-api dataforseo.com · accessed
  32. docs.firecrawl.dev/billing docs.firecrawl.dev · accessed
  33. docs.linkup.so/pages/documentation/platform/pricing docs.linkup.so · accessed
  34. docs.parallel.ai/search/search-quickstart docs.parallel.ai · accessed
  35. docs.tavily.com/documentation/keyless docs.tavily.com · accessed
  36. docs.valyu.ai/api-reference/endpoint/search docs.valyu.ai · accessed
  37. docs.valyu.ai/pricing docs.valyu.ai · accessed
  38. serpapi.com/legal serpapi.com · accessed
  39. www.searchapi.io/legal/terms searchapi.io · accessed
  40. www.valyu.ai/pricing valyu.ai · accessed
  41. you.com/docs/agents/mcp-server you.com · accessed
  42. you.com/docs/quickstart you.com · accessed
  43. Browserbase plans: conflicting flat Search overage docs.browserbase.com · accessed

GitHub code, issues and releases 1

  1. SearXNG repository github.com · accessed

Other sources 4

  1. Google v. SerpApi ECF 60: hearing vacated on 5 Oct 2026 storage.courtlistener.com · accessed
  2. Google ECF 61: party notice, 12 Oct 2026 storage.courtlistener.com · accessed
  3. Google ECF 62: order granting motion to dismiss with leave to amend, 9 Nov 2026 storage.courtlistener.com · accessed
  4. Google v. SerpApi public docket feed (CourtListener; latest entry ECF 62, 9 Nov 2026) courtlistener.com · accessed

What readers say

Used one of the tools in this guide? Tell other readers how it went. I read every review before it goes up, and I never turn one down for being negative. How reviews work.

No reader reviews yet. Yours could be the first.

Write a review
Your rating

What did you use it for, what worked, and what didn't? 30 to 1500 characters. Please don't include links.

Your connection to the company

Your review appears with the name you enter, after I approve it. I don't ask for your email. Privacy.