Notes on systems, AI, and building.
Long-form thinking on turning organic search into infrastructure - and what changes when AI does the execution.
32 guides · 3 categoriesCloudflare Lets Sites Block AI Training Without Blocking Search
Learn how to use Cloudflare edge rules to block AI scrapers while keeping search engine bots. Review configuration steps for your dashboard.
More guides
How Retrieval Augmented Generation Processes Forum Mentions
Learn how retrieval systems parse forum threads and weigh user comments for AI citations. Discover practical steps to audit and influence generative visibility.
Why Legacy Programmatic Pages Halt Your Site Recovery
Google confirmed that legacy template pages damage site trust during recovery efforts. Learn how automated bloat signals poor quality and halts organic performance.
How Log File Analysis Reveals Hidden Crawl Waste on Large Sites
Learn how to extract raw server logs, filter out noise, and correlate bot requests with index coverage data to fix crawl waste. Discover methods to isolate orphaned URLs and optimise resource allocation.
How Document Chunking Strategies Impact Publisher Citations
Learn how retrieval augmented generation systems split publisher text into vectors. Discover how poor document structure destroys citation visibility.
Why Daily Rank Trackers Fail When SERP Layouts Shift
Discover why traditional rank trackers fail to explain traffic drops when page layouts change. Learn when your SEO team needs a SERP monitor instead.
How to Track GPTBot and ClaudeBot Using Server Logs and CDNs
Compare server log analysers, CDN bot reports and robots.txt checkers. Learn how to track AI crawler requests and spot scraping behaviour.
AEO vs GEO: Which AI Search Strategy to Prioritise First
Learn the operational differences between answer engine optimisation and generative engine optimisation. Discover which tactic secures direct snippets and which builds brand authority.
Structuring product and pricing data for answer engines
How to use clean HTML tables and JSON-LD schema so answer engines match each price to the right tier and product, and cite your exact figures.
How Entity Disambiguation Controls Citations in AI Search
Learn how generative engines use schema markup to resolve ambiguous brand names. Discover why structured data prevents misattribution.
How Log File Analysis Exposes Dynamic Rendering Failures
Isolate crawler requests in your server logs to spot dynamic rendering failures. Cross-reference status codes and byte sizes to fix indexing bottlenecks.
Why Original Research Protects Content From AI Summaries
Discover how publishing first-hand testing data helps your content survive generative search engines. Learn how to structure metrics for AI parsers.
How Prompt-Level Share of Voice Measures AI Visibility
Learn how to track brand citations in generative AI assistants using prompt-level share of voice. Discover workflows to measure visibility and compare tools.
How Search Console Data Reveals Keyword Cannibalisation
Find competing URLs and fix traffic drops using Search Console query data. Learn to diagnose intent splits and consolidate pages safely.
How Large Language Models Select Forum Sources in RAG
How large language models pick forum threads for retrieval augmented generation: the four-stage process, why peer replies win, and how to audit your forum citations.
AI Crawlers Versus Googlebot: How Fetching Differs
AI crawlers fetch a handful of URLs on demand, in bursts tied to user prompts, while Googlebot crawls steadily to build an index. Here is how they differ and how to verify each in your server logs.
Diagnose Traffic Drops Using Search Console and Server Logs
Isolate the root cause of organic traffic declines without guessing. Use Google Search Console and raw server logs to spot crawler blocks and keyword cannibalisation.
Why AI Crawlers Fail to Render Client-Side JavaScript
Learn why artificial intelligence crawlers miss client-side rendered content and how to deliver raw HTML that large language models can retrieve.
How AI Search Shifts Keyword Research to Prompt Mapping
Learn how generative engines replace traditional keyword matching with conversational prompts. Discover methods to track zero click visibility and brand citations.
How Retrieval Systems Weigh Primary Data in RAG
Why retrieval systems favour primary research over aggregated summaries, how information density shapes which sources get retrieved, and how to restructure your data for extraction.
How to Separate Algorithm Penalties from Server Log Failures
Learn how to isolate the root cause of an organic traffic drop. Use server logs and Search Console data to distinguish technical failures from algorithm updates.
RAG vs Traditional Indexing for Unstructured Documents
RAG vs Traditional Indexing for Unstructured Documents. How retrieval augmented generation systems fetch and parse unstructured documents compared to traditional indexing engines
Faceted Navigation Is Quietly Eating Your Crawl Budget
Learn how faceted navigation causes crawl budget loss and duplicate indexation. Discover canonical, robots, and parameter handling setups to fix it.
Google Stores Hreflang URLs as Variants, Not Index Entries
Learn how Google treats hreflang URLs, affecting crawl and indexation behaviour. Diagnose international setups with updated knowledge.
Google Removes Rule Requiring Sites to Block Internal Search
Google has updated its documentation to remove the blanket ban on indexing internal search result pages. Discover why practitioners should still keep blocking these URLs to avoid crawl budget waste and index bloat.
Google Adds Opt-Out Toggle For AI Search
Learn about Google's new Search Console toggle and AI performance reports. Understand how to opt out of AI Overviews and AI Mode.
Reddit and AI Citations - Why Answer Engines Lean On It, and How to Show Up Honestly
Reddit is roughly 46% of Perplexity's citations and its share of Google AI Overviews grew about 450% in three months. Here is why models over-index on it, and the honest playbook for participating without astroturfing.
Schema Markup for AI Search - Which Structured Data Types Actually Earn Citations
Schema does not rank you in AI search, but it does tell answer engines exactly what your page is and which entity you are. Here is what each type does, what it cannot fix, and the order to roll it out.
llms.txt - What It Is, Whether It Actually Works, and How to Write One
A straight answer on llms.txt - what the proposal actually specifies, the evidence on whether AI crawlers read it, where it genuinely gets used today, and how to write one that earns its keep.
AI Crawlers Explained - GPTBot, ClaudeBot, PerplexityBot and Everything Else in Your Logs
A precise guide to the AI bots hitting your server - their real user-agent strings, who runs them, how to verify they are genuine, and what you actually lose when you block them.
GEO vs SEO vs AEO: What Actually Changes When Answers Replace Links
A precise definition of GEO, AEO and SEO, an honest split of what transfers from classic search and what is genuinely new, and a practical list of what to change first.
How to Get Cited by ChatGPT, Perplexity and Google AI Overviews
A technical guide to earning citations in AI answers. Covers what makes a passage quotable, the structural work that helps retrieval, the off-site signals models actually reach for, and how to measure whether any of it worked.