techcrunch.com

1 access agent(s) blocked: ChatGPT-User — these keep your site out of AI answers. 10 training-data crawler(s) blocked (GPTBot, ClaudeBot, anthropic-ai, Google-Extended, Applebot-Extended, Bytespider, CCBot, cohere-ai, Diffbot, FacebookBot) — a licensing choice, not scored.

修正 · WordPress: Use Yoast/Rank Math’s robots.txt editor (or a plugin) and ensure no Disallow for AI user-agents.

Visible text is 2.8% of HTML weight (12173/440440 bytes). Low. Markup may be crowding out agent-usable text.

修正: Heavy ad or navigation markup crowds out agent-usable text. Aim for a text-to-DOM ratio above 15%.

Heading issues: no <h1>; 1 skipped level(s).

修正: Use a single H1 and avoid skipping heading levels (H1 → H3).

A Link: header is present but carries none of canonical/alternate/describedby — the relations agents consume.

修正: Emit `Link:` headers for canonical, alternate-language, and describedby relations. Agents that fetch HEAD-only or stream-render rely on these.

No Content-Signal directives. Add e.g. `Content-Signal: ai-train=no, ai-summarize=yes` to declare granular AI usage policy beyond binary allow/disallow.

修正: Add `Content-Signal:` directives to your robots.txt. This is the emerging standard (Cloudflare-driven) for declaring fine-grained AI usage policy beyond a binary allow/disallow.

No valid MCP Server Card at /.well-known/mcp/server-card.json. Publish one so agents can discover your tools without HTML scraping.

修正: Publish an MCP Server Card describing the tools your site exposes. Agents discover capabilities via `/.well-known/mcp/server-card.json`. See modelcontextprotocol.io for the schema.

# Allow AI agents (AgentSpeed-generated)
User-agent: GPTBot
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Google-Extended
Allow: /

Sitemap: https://techcrunch.com/sitemap.xml

This scan shows whether an agent can read the site. One free probe asks a real assistant a real buying question and records who it cited.

採点したのはトップページだけです。価格・ドキュメント・購入ページは別のページにあり、アシスタントが引用するのはまさにそれらのページです。ここで76/100ということは、最も磨いたページですらエージェントが見逃しているということ。Deep Scan（$29）はサイト全体を全31チェックで監査し、失敗したチェックとその具体的な修正を、可視性への影響が大きい順にまとめたPDFをメールで送ります。1回限り・数分で納品・サブスクリプションなし。

TechCrunch | Startup and Technology News TechCrunch Desktop Logo TechCrunch Mobile Logo Latest Startups Venture Apple Security AI Apps Disrupt 2026 Events Podcasts Newsletters Search Submit Site Search Toggle Mega Menu Toggle Topics Latest AI Amazon Apps Biotech & Health Climate Cloud Computing Commerce Crypto Enterprise EVs Fintech Fundraising Gadgets Gaming Google Government & Policy Hardware Instagram Layoffs Media & Entertainment Meta Microsoft Privacy Robotics Security Social Space Startups TikTok Transportation Venture More from TechCrunch Staff Events Startup Battlefield StrictlyVC Newsletters Podcasts Videos Partner Content TechCrunch Brand Studio Crunchboard Contact Us Image Credits: TechCrunch Robotics Are brain waves the next unlock for physical AI? Tim Fernholz 11 hours ago Featured Inside one London founder house rewriting the founder-house rules Dominic-Madori Davis 18 hours ago AI Making sense of the panic over Chinese AI Anthony Ha 16 hours ago Top Headlines TechCrunch Mobility: Uber bets on its former CEO Kirsten Korosec Monday.com is the latest tech company to blame AI for layoffs — here are 20 others Rebecca Bellan Connie Loizos Hugging Face CEO calls for ‘radical transparency’ after ‘unprecedented’ OpenAI hack Anthony Ha Kalshi demands Netflix take down trailer for ‘Prediction Games’ documentary Anthony Ha The hacker who humiliated spyware makers and was never caught Lorenzo Franceschi-Bicchierai Latest News See More Startups Europe got its own TBPN-style live show, and everyone’s angling for a guest spot Dominic-Madori Davis 1 hour ago Robotics Are brain waves the next unlock for physical AI? Tim Fernholz 11 hours ago In Brief Can Apple make smart glasses that aren’t a constant privacy threat? Anthony Ha 14 hours ago AI Making sense of the panic over Chinese AI Anthony Ha 16 hours ago Featured Inside one London founder house rewriting the founder-house rules Dominic-Madori Davis 18 hours ago In Brief Hugging Face CEO calls for ‘radical transparency’ after ‘unprecedented’ OpenAI hack Anthony Ha 19 hours ago Transportation TechCrunch Mobility: Uber bets on its former CEO Kirsten Korosec 19 hours ago AI Monday.com is the latest tech company to blame AI for layoffs — here are 20 others Rebecca Bellan Connie Loizos 1 day ago In Brief Warner Bros. lawsuit accuses Amazon of illegally poaching executives Anthony Ha 2 days ago Security The hacker who humiliated spyware makers and was never caught Lorenzo Franceschi-Bicchierai 2 days ago Next October 13 – 15 San Francisco Scale faster. Grow your portfolio. Gain practical expertise. No matter your goal, Disrupt can empower you. Save up to $330 toda y! REGISTER NOW Most Popular SpaceX launches new V3 Starlink satellites but suffers another booster failure Sean O'Kane US accuses American of allegedly wiping his phone using a ‘duress’ password during border search Zack Whittaker Anduril reportedly in talks to raise funding at $100B valuation, more than 3x last year’s mark Ram Iyer Tesla’s robotaxis are moving in reverse Sean O'Kane Jack Dorsey is taking on Slack with Buzz, a group chat platform for teams and their AI agents Amanda Silberling Light made a flip phone — it’s colorful and it’s cheap Amanda Silberling AI music generator Suno breach affects 55M users, per Have I Been Pwned Zack Whittaker Upcoming Events See More Stripe x Startup Battlefield Sydney August 19, 2026 Presented by Register Now StrictlyVC NYC 2026 New York, New York September 10, 2026 Presented by Register Now Lock in your spot before it's too late! TechCrunch Disrupt 2026 San Francisco, CA October 13 – 15, 2026 Register Now Save up to $330 today! TechCrunch Founder Summit 2026 Boston, Massachusetts November 4, 2026 Presented by Register Now Exhibit Now Grab your pass at a low rate Newsletters See More Subscribe for the industry’s biggest tech news TechCrunch Daily News Every weekday and Sunday, you can get the best of TechCrunch’s coverage. Startups Weekly Startups are the core of TechCrunch, so get our best coverage delivered weekly. TechCrunch Week in Review Get the best of our coverage, delivered to your inbox every Saturday. TechCrunch Mobility TechCrunch Mobility is your destination for transportation news and insight. No newsletters selected. Subscribe By submitting your email, you agree to our Terms and Privacy Notice . AI See More Robotics Are brain waves the next unlock for physical AI? Tim Fernholz 11 hours ago AI Making sense of the panic over Chinese AI Anthony Ha 16 hours ago In Brief Hugging Face CEO calls for ‘radical transparency’ after ‘unprecedented’ OpenAI hack Anthony Ha 19 hours ago AI Monday.com is the latest tech company to blame AI for layoffs — here are 20 others Rebecca Bellan Connie Loizos 1 day ago AI Librarians are hosting viral ‘Avoiding AI’ workshops for people who are fed up with Big Tech Amanda Silberling 2 days ago Startups See More Startups Europe got its own TBPN-style live show, and everyone’s angling for a guest spot Dominic-Madori Davis 1 hour ago Startups Prentis, new AI lab co-founded by Reid Hoffman, Mark Pincus in talks to raise $100M Marina Temkin 3 days ago TechCrunch Disrupt 2026 TechCrunch Disrupt 2026’s new Smart Money Stage explores fintech, payments, AI, and everything between TechCrunch Events 3 days ago Startups Build in public, fail in public: what it’s like to be a founder under 20 right now Dominic-Madori Davis 3 days ago Startups ‘AI communism’, rogue models, and the why Kimi K3 spooked Wall Street Theresa Loconsolo Kirsten Korosec Anthony Ha Sean O'Kane 3 days ago Video See More OpenAI’s own model went rogue before Kimi had Wall Street sweating Chinese AI lab Moonshot’s open model Kimi went viral this week for reasons that had less to do with the model itself and more to do with how the U.S. AI industry reacted to it. Meanwhile, an unreleased OpenAI model wandered outside its test environment and ended up connected to a real security breach at Hugging Face — a reminder that “China risk” isn’t the only kind of AI risk worth worrying about. July 24, 2026 More From: OpenAI’s own model went rogue before Kimi had Wall Street sweating Theresa Loconsolo 3 days ago 37 min Startups How startups get noticed by Nvidia, Google, and other tech giants Maggie Nye Isabelle Johannessen 4 days ago 41 min Menlo Ventures’ Matt Murphy explains why Anthropic is winning (and it’s not the model) Theresa Loconsolo Jul 22, 2026 31 min AI How Apple’s big lawsuit could disrupt OpenAI’s IPO plans Theresa Loconsolo Jul 17, 2026 33 min Startups The founder who left Google and secured a $300M pre-seed valuation in months Maggie Nye Isabelle Johannessen Jul 16, 2026 34 min Startups Inside Ode with Anthropic, the startup betting AI services are the future of enterprise Theresa Loconsolo Jul 15, 2026 Startups Why raising your first round is harder than ever Maggie Nye Isabelle Johannessen Jul 9, 2026 40 min Startups Why this CEO thinks video games make better training data than the internet Theresa Loconsolo Jul 8, 2026 26 min Startups Autonomous vehicle hype is back, and Humble Robotics is bringing it to freight Theresa Loconsolo Jul 1, 2026 26 min AI Why everyone from OpenAI to SpaceX is building their own chips (and turning up the heat on Nvidia) Theresa Loconsolo Jun 26, 2026 36 min Security See More In Brief Hugging Face CEO calls for ‘radical transparency’ after ‘unprecedented’ OpenAI hack Anthony Ha 19 hours ago Security The hacker who humiliated spyware makers and was never caught Lorenzo Franceschi-Bicchierai 2 days ago Security US accuses American of allegedly wiping his phone using a ‘duress’ password during border search Zack Whittaker 3 days ago Security How AI guardrails are impeding the work of offensive cybersecurity researchers Lorenzo Franceschi-Bicchierai 3 days ago Security AegisAI, founded by former Google security execs, lands $36M to stop AI-d

自社のAIエージェントを運用していますか？ AgentSpeedは本番環境の監視も行います — すべての実行、レイテンシ、コスト、失敗を記録し、問題発生時にアラートを送ります。月10,000イベントまで無料、クレジットカード不要。