Skip to content
CrawlfolioSourced research on web data for AI
Menu

Explainer

Bing's AI grounding opt-out, and what it means for Web IQ

Bing's AI grounding opt-out lets sites stay in Copilot but leave Web IQ and Foundry grounding from Feb 2027. I read the rules and priced a fallback index.

Frosted glass panels in slim clear frames beside a smooth pale column, with soft blurred colour showing through the textured glass
Photo: Declan Sun / Unsplash · Unsplash License

From February 1, 2027, Bing’s AI grounding opt-out lets publishers keep a page in Copilot and Bing’s AI answers while pulling it out of Web IQ and Foundry API grounding. Bing. If you ground an agent on Microsoft’s APIs, you need to decide whether to stay on one index or add a second before that date.

My answer: stay on Web IQ if it works for you, and add a cheap second index now, because you won’t be able to see which pages drop out. Below I cover what changed, who keeps the pages, what a fallback costs at 100,000 calls, and what I’d do.

Short on time?

Short on time? Here's my pick

You already ground on Web IQ
Stay on Web IQ, add Brave Search API as a fallback
Routing 10% of 100,000 calls to Brave costs about $45 a month (my estimate, verified 2026-11-16). Confidence: medium, because nobody knows how many pages will opt out.
Choosing between Microsoft's two grounding APIs
Web IQ
$7 per 1,000 Web calls against $14 per 1,000 for Grounding with Bing. The opt-out names Web IQ and likely covers Grounding with Bing too. Confidence: high on price, medium on the Foundry mapping.
You want an index Microsoft's preferences don't govern
Brave Search API
$5 per 1,000 requests with a $5 monthly credit, on Brave's own index. Storing results needs a custom plan. Confidence: high on price.
Your stack runs on AWS
AgentCore Web Search
$7 per 1,000 queries, the same list price as Web IQ, without leaving AWS. Confidence: medium.
Cheap Bing and Google result lists to monitor which sources still rank
apiserpent.com
$0.60 per 1,000 by default, down to $0.03 at the top deposit tier (verified 2026-11-16). Links and snippets, not page extracts, and the vendor forecasts a 10× rise from December 2026.

Prices verified . Sponsors cannot buy a verdict or a position.

What did Bing change on October 30? #

It split AI use into two separate preferences, training and grounding, and they replace NoArchive and NoCache for those uses. Bing says there’s no change to search eligibility. Bing blog.

Training can be set in robots.txt; I cover that side in the robots.txt AI training opt-out. Grounding is page-level only, through a meta tag such as <meta name="Bingbot" content="ai-grounding:disallow"> or an X-Robots-Tag: Bingbot: ai-grounding:disallow header. There’s no robots.txt line for grounding.

Grounding has three settings:

Setting How a site sets it Microsoft’s own AI (Copilot, AI Mode, AI Overview, M365) Web IQ and Foundry API grounding
Allow Default, no tag Yes Yes
DisallowExtended ai-grounding:disallowextended Yes No
Disallow ai-grounding:disallow No No

Source: Bing blog, verified 2026-11-16. Microsoft warns that either opt-out “will significantly reduce your content’s visibility in AI-generated experiences”.

The dates matter for planning:

Date What happens
December 15, 2026 Temporary grounding preferences open in Bing Webmaster Tools, for sites using NoArchive or NoCache
February 1, 2027 New preferences are honored as Microsoft crawls pages again
March 1, 2027 NoArchive and NoCache stop counting for AI use
September 30, 2027 Temporary grounding preferences expire

Search Engine Roundtable and Relevant Audience report the same four dates.

Who loses the pages, and who keeps them? #

Third-party API buyers lose them; Microsoft’s own products keep them. In Bing’s words, DisallowExtended “limits grounding use to Microsoft-operated experiences such as AI Mode, AI Overview, Copilot, and Microsoft 365, and excludes grounding services Microsoft provides to third parties, such as Web IQ and grounding through API access in Foundry”. Bing.

So it isn’t only Web IQ. Foundry API grounding is named too, and Microsoft’s Grounding with Bing Search tool costs “$14 per 1,000 transactions”. Microsoft. That page doesn’t mention publisher preferences, so I treat “Foundry API grounding” as likely meaning this tool, not certainly.

That’s a structural edge for Microsoft. A publisher who wants to stay in Copilot but out of third-party tools picks DisallowExtended, and your agent loses the page while Copilot keeps it, at the same $7 per 1,000 you paid before. My inference: the same price may now buy a smaller pool of eligible pages.

What doesn’t change is the link side. “The current Bing search syndication API returns links for traditional search scenarios, and is not intended for AI generated summaries, so it is not affected by the grounding preference.” Bing. Note that the old Bing Search APIs were retired on August 11, 2025, according to TechWyse, so that’s not a product you can sign up for.

Microsoft also says “Web IQ powers leading frontier AI assistants, including Microsoft Copilot and ChatGPT”. Web IQ overview. It’s possible that pages set to DisallowExtended stop reaching answers grounded through Web IQ elsewhere, but Microsoft hasn’t said so, and I wouldn’t plan around it.

Textured frosted glass fins stepping along the pale edge of a building against a white sky, one held by a brushed metal bracket
Frosted panels let light through but hide the detail behind them, much as a page can stay visible in one kind of product while its content is held back from another. Photo: kimi lee / Unsplash · Unsplash License

Can you see or undo it from the API side? #

No on both counts. Web IQ’s FAQ says it is “designed to honor supported publisher controls”, and it publishes no list of excluded sites: “The lists themselves are proprietary.”

Scopes won’t force a page back in. You can include or exclude domains, paths and URLs per request, but “An included source doesn’t guarantee that matching content is indexed or returned”. Scopes guide.

Web IQ’s terms already constrain you too. You may not display grounding content beyond the lesser of “(a) 200 characters or (b) the maximum amount specified by the applicable website owner or webmaster”, you can’t use responses where your own crawler is blocked by robots.txt, and you, “not Microsoft”, pay any fees due to news publishers. Web IQ terms.

What would a fallback index cost? #

Not much, if it’s a fallback rather than a replacement. Here are list prices at 100,000 calls a month, with my arithmetic:

Monthly cost at 100,000 calls, list pricesVerified
ServiceList priceMy estimate at 100,000What you get back
Web IQ /web$7 per 1,000100 × $7 = $700Grounding results from Bing's index; subject to the opt-out
Grounding with Bing Search (Foundry)$14 per 1,000100 × $14 = $1,400Grounding; likely subject to the opt-out
Brave Search API$5 per 1,000, $5 monthly credit100 × $5 − $5 = $495Results from Brave's own index
AgentCore Web Search$7 per 1,000100 × $7 = $700Web search results inside AWS
Google grounding, Gemini 3+5,000 free, then $14 per 1,000(100,000 − 5,000) × $0.014 = $1,330, if the daily cap allowsGrounded answers; '1,500 requests per day' may cap you near 45,000 a month
apiserpent.com Quick (Bing or Google)$0.60 per 1,000 Default; $0.30 after a $100 deposit100 × $0.60 = $60, or 100 × $0.30 = $30SERP links and snippets, not page extracts

Source: Pricing pages read 16 Nov 2026: Microsoft Web IQ and Learn pricing, Microsoft Bing APIs, Brave, AWS AgentCore, Google Gemini API, apiserpent.com. No negotiated discounts. Scroll sideways for more columns.

Sources: Web IQ, Learn pricing, Brave, AWS, Google. Web IQ’s Browse is $1 per 1,000, and its beta /auto endpoint ($8) isn’t charged while in beta.

A fallback is cheap. My estimate: routing 10% of 100,000 calls to Brave is 10 × $5 − $5 credit = $45 a month. Brave describes its index as “Brave’s own independent index”, which is why I’d pick it as the second source; storing results needs a custom plan. My Brave Search API pricing breakdown has its plans in more detail.

Throughput won’t be the limit. Web IQ’s default of 15 queries per second works out to 15 × 86,400 × 30, about 38.9 million calls a month. You need a paid Azure subscription, and “Azure credits don’t work”. Web IQ overview.

On AWS, my AgentCore Web Search explainer covers its terms. My Google grounding explainer covers the daily cap question.

Where does apiserpent.com fit? #

As a cheap way to watch result lists, not as a grounding API. apiserpent.com returns Google and Bing result lists (Bing via engine=bing), with position, title, URL and snippet per organic result; aiOverview is always null on Bing. Docs.

Quick searches cost $0.60, $0.30, $0.10, $0.05 or $0.03 per 1,000 at deposits of $0, $100, $500, $1,000 and $1,250, and deposited credits “never expire”. Pricing. On November 16 the pricing page warned prices are “likely to rise 10× from December 2026”; that’s the vendor’s forecast, and I can’t verify it. Verified 2026-11-16.

Because opted-out pages can still rank in ordinary Bing results, a SERP list shows you which sources still appear even when Web IQ stops grounding on them. The trade-offs: an API key only, no SLA, liability capped at 12 months of fees, and you indemnify the provider. Terms.

Thin metal venetian blinds lowered across a wide window, a hazy skyline faintly visible between the slats above a dark wall
With the blinds down you can still make out the outline of what lies beyond; a list of ranked links does the same, showing which sources still appear when the full content behind them is out of reach. Photo: rawkkim / Unsplash · Unsplash License

Which one should you pick? #

  • Already on Web IQ: stay, and add Brave Search API as a fallback. About $45 a month at 10% of 100,000 calls.
  • Choosing a Microsoft grounding API: Web IQ. Half the price of Grounding with Bing, and the opt-out names Web IQ and likely covers both.
  • You want an index outside Microsoft’s preferences: Brave Search API. Its own index, $5 per 1,000.
  • On AWS: AgentCore Web Search. Same $7 per 1,000 as Web IQ, without a new cloud vendor.
  • Monitoring which sources still rank on Bing and Google: apiserpent.com. $60 a month at 100,000 Quick calls on the default rate, before any December change.

For the wider field, see the best web search APIs, Brave Search API alternatives and LLM web search vs a search API, all under the search API pillar.

What I would do before February 1 #

In December and January, I’d log the domains Web IQ cites for my top 200 queries. After February 1, I’d re-run them monthly and diff the lists, because that’s the only way to see the opt-out hit your results.

I’d wire a second index behind a flag now, rather than in a hurry in March. Brave at 10% of traffic is about $45 a month at 100,000 calls.

And when my own fetcher loads a page, I’d read its Bingbot ai-grounding tag as a sign of the publisher’s wishes. That’s my opinion, not a legal requirement, but it’s a cheap courtesy that keeps you on the right side of the people whose pages you depend on. For the legal background, see whether robots.txt is legally binding.

FAQ

What does ai-grounding:disallowextended do?

It keeps a page available for grounding in Microsoft-operated experiences such as AI Mode, AI Overview, Copilot and Microsoft 365, and excludes it from the grounding services Microsoft provides to third parties, such as Web IQ and grounding through API access in Foundry.

When does Bing start honoring the grounding preferences?

From February 1, 2027, as Microsoft crawls pages again. Temporary grounding preferences open in Bing Webmaster Tools on December 15, 2026, NoArchive and NoCache stop counting for AI use on March 1, 2027, and the temporary preferences expire on September 30, 2027.

Can I block AI grounding in robots.txt?

No. Bing's grounding preference is page-level only, set with a Bingbot meta tag or an X-Robots-Tag header. The AI training preference is the one that can use robots.txt.

How much does Web IQ cost?

$7 per 1,000 calls for Web, News, Images and Video, and $1 per 1,000 for Browse (verified November 16, 2026). It needs a paid Azure subscription, and Microsoft says Azure credits don't work.

Does the grounding opt-out affect normal Bing rankings?

No, according to Microsoft. Bing says the change doesn't alter search eligibility, and the syndication API that returns links for traditional search is not affected. Microsoft does say either opt-out will significantly reduce a page's visibility in AI-generated experiences.

Will I know which sites opted out of Web IQ?

No. Web IQ's FAQ says the lists are proprietary, and including a domain in a Scope doesn't guarantee its content is indexed or returned.

Sources

20 sources, accessed .

Official pricing, docs, changelogs and status pages 16

  1. Bing blog: clearer preferences for training and grounding (2026-10-30) blogs.bing.com · accessed
  2. Microsoft Web IQ product page microsoft.com · accessed
  3. Microsoft Learn: Web IQ pricing (2026-11-10) learn.microsoft.com · accessed
  4. Microsoft Learn: Web IQ overview learn.microsoft.com · accessed
  5. Microsoft Learn: Web IQ FAQ learn.microsoft.com · accessed
  6. Microsoft Learn: Web IQ Scopes learn.microsoft.com · accessed
  7. Microsoft Web IQ terms microsoft.com · accessed
  8. Microsoft Learn: Web IQ documentation (2026-11-11) learn.microsoft.com · accessed
  9. Web IQ documentation changelog page (webiq.microsoft.ai) webiq.microsoft.ai · accessed
  10. Microsoft: Grounding with Bing Search and Custom Search microsoft.com · accessed
  11. Brave Search API plans brave.com · accessed
  12. AWS: Amazon Bedrock AgentCore pricing aws.amazon.com · accessed
  13. Google Gemini API pricing (grounding) aistudio.google.com · accessed
  14. apiserpent.com pricing apiserpent.com · accessed
  15. apiserpent.com documentation apiserpent.com · accessed
  16. apiserpent.com terms (updated 2026-10-31) apiserpent.com · accessed

News and press 2

  1. Search Engine Roundtable: Bing separates AI training from grounding (2026-10-30) seroundtable.com · accessed
  2. TechWyse: Microsoft Web IQ announced (2026-06-04) techwyse.com · accessed

Other blogs 2

  1. Presenc AI: how to set Bing's AI grounding controls (updated 2026-11-02) presenc.ai · accessed
  2. Relevant Audience: Bing replaces NoArchive and NoCache (2026-10-31) relevantaudience.com · accessed

What readers say

Used one of the tools in this guide? Tell other readers how it went. I read every review before it goes up, and I never turn one down for being negative. How reviews work.

No reader reviews yet. Yours could be the first.

Write a review
Your rating

What did you use it for, what worked, and what didn't? 30 to 1500 characters. Please don't include links.

Your connection to the company

Your review appears with the name you enter, after I approve it. I don't ask for your email. Privacy.