30. Indexable sponsored stories on DH — Medium (DH)
Added 16 Nov 2026; narrowed 19 Nov 2026. Found in the source audit, confirmed live.
What: DH sponsored stories (template brandspot-client-story) are indexable on /dhbrandspot/ and /connect/, and stories under /dhbrandpr/ stay indexed because robots.txt stops Google from seeing their noindex.
Evidence
- The template produced 327 stories in 7 Sep – 5 Nov 2026 (
/dhbrandpr/243,/connect/67,/dhbrandspot/17); 18% got Google impressions. Live:/dhbrandspot/jio-ipo-use-of-proceeds-…-4184885isindex, follow. Thenoindexrule inapp.js(~655,customMetaTags,tpml-dhupstream/main47a7e85e) matches only paths containing/brandspot,/dhbrandspot-pr,/dhbrandpr,/brandpr,/dhsponsored-health. Source:checks/traffic_funnel/report_dh_2026-11-13.md. - URL Inspection sample, 16 Nov 2026 (
checks/traffic_funnel/inspect_dh_2026-11-13.md): of 44 sampled sponsored stories with no impressions, 38 are "Indexed, though blocked by robots.txt" and 2 "Blocked by robots.txt"; all 40 are/dhbrandpr/(Disallow: /dhbrandpr/*). The 4 allowed ones (/connect/,/dhbrandspot/) are indexed normally. - Search Console → Security & Manual actions, checked by the user 16 Nov 2026: no manual actions and no security issues on DH or PV.
Why it matters: paid content should be labelled and kept out of Google's index (or at least carry rel="sponsored" on outbound links).
Fix (fix package P2, item 10)
- 🛠️ Make the sponsored-content rule cover every sponsored path by template (
brandspot-client-story) rather than by URL substring:noindex(or at leastrel="sponsored"on outbound links and a clear label) for/dhbrandspot/,/dhbrandpr/,/connect/. - 🛠️ Remove the
Disallowlines for sponsored paths (/dhbrandpr/*,/brandspot/*,/dhbrandspot-pr/*) until Google has recrawled them and dropped them (Pages report → "Excluded by 'noindex' tag"); only then re-add the block if crawl budget matters.noindexonly works on pages Google is allowed to fetch.
Verify: a /dhbrandspot/ and a /connect/ story carry noindex; sponsored URLs move to "Excluded by 'noindex' tag".
Scope narrowed on 19 Nov 2026; earlier notes are in git history (commit 3ed493a).