agentspeed.

crewai.com

scanned 7/25/2026, 11:40:36 PM · cached · refresh in 23h · rubric 2026.07.4
Built with Next.js
robots.txt present: passrobots.txt allows AI agents: passContent-Signal directives: passllms.txt present: warnSitemap present: passLink response headers: passCanonical URL: passMCP server card: failOAuth authorization metadata: passOAuth resource metadata: passAPI catalog / OpenAPI: passWeb Bot Auth: failMarkdown negotiation: passText-to-markup ratio: failContent without JavaScript: skipHeading hierarchy: warnCookie wall blocks content: passPage title: passMeta description: warnJSON-LD present: passStructured data validates: passSchema type coverage: passPaywall / login wall: passAgent Skills manifest: failWebMCP actions: failPrimary action reachable: passReachability: passTime to first byte: passFull render time: skipPage weight: pass85/ 100 · B
Good

This is how AI agents (not browsers) experience crewai.com. The score weights five categories of machine-readability; the ticks on the arc are the 30 individual checks behind it.

✉ Email me this report + alert me when it changes ↓

Top fixes

Checks tagged “emerging” are 2026 agent-protocol standards most of the web hasn’t adopted yet — adopting early is an edge, not a defect.

warnllms.txt presentDiscoverability

Found /llms.txt but missing markdown links.

Fix · Next.js: Add /llms.txt via app/llms.txt/route.ts (or public/llms.txt). Generate one free at /tools/llms-txt-generator.

failText-to-markup ratioReadability

Visible text is 2.2% of HTML weight (5855/262279 bytes). Low. Markup may be crowding out agent-usable text.

Fix: Heavy ad or navigation markup crowds out agent-usable text. Aim for a text-to-DOM ratio above 15%.

warnMeta descriptionReadability

Meta description is 32 characters; aim for 50–200 so it's neither thin nor truncated.

Fix: Add `<meta name="description" content="...">` to your primary pages. Agents frequently use it as a summary.

warnHeading hierarchyReadability

Heading issues: 1 skipped level(s).

Fix: Use a single H1 and avoid skipping heading levels (H1 → H3).

failMCP server cardemergingDiscoverability

No valid MCP Server Card at /.well-known/mcp/server-card.json. Publish one so agents can discover your tools without HTML scraping.

Fix: Publish an MCP Server Card describing the tools your site exposes. Agents discover capabilities via `/.well-known/mcp/server-card.json`. See modelcontextprotocol.io for the schema.

failWeb Bot AuthemergingDiscoverability

No Web Bot Auth JWKS at /.well-known/http-message-signatures-directory.json. Publish one to allow trusted agents while keeping a default-deny posture for the rest.

Fix: Publish a JWKS at `/.well-known/http-message-signatures-directory.json` and accept signed requests per the Web Bot Auth draft. Lets you allow trusted agents while keeping a default-deny posture for the rest.

Don’t lose this report

Get it in your inbox now — and a heads-up whenever crewai.com’s agent-readiness score changes. Free, unsubscribe anytime.

Fix it

Generated, ready-to-ship files for the gaps above — copy them or download and drop them into your repo.

Add an llms.txt
Publish this at https://crewai.com/llms.txt
# CrewAI

> The Leading Multi-Agent Platform

## Key pages
- [Home](https://crewai.com/)
- [Build. Deploy. Manage. Enterprise Agents](https://crewai.com/)

## About
Describe what crewai.com does, who it's for, and the primary action you want an
agent to be able to complete. Keep it factual and current.
Qualifies for certificationSilver

This score clears the Silver threshold (80+). Certification turns it into a dated, publicly verifiable attestation — a verification URL, an embeddable badge, and weekly monitoring for a full year. Scores under 70 can’t buy this, which is what makes displaying it mean something.

Get certified — $199/year →

What the agent receives

The agent’s-eye view
CrewAI NEW: know what to automate before you build with CrewAI Discovery Enterprise Open Source Docs Resources Resources Case Studies Webinars Events Blog Pricing Sign In Sign Up Enterprise Open Source Docs Resources Resources Case Studies Webinars Events Blog Pricing Sign In Sign Up Build. Deploy. Manage. Enterprise Agents The open platform that accelerates agent adoption. From discovering what to automate, to launching your first agent, to optimizing your thousandth. Request a Demo No Code CLI No Code CLI No Code CLI No Code CLI CrewAI simplifies the agent production process without sacrificing the control enterprises demand. Loved by AI builders. Trusted by AI leaders. Used by 63% of the Fortune 500. Discover Know what to automate before you build CrewAI Discovery matches patterns observed over billions of agent runs against your tickets, chats, apps, and workflows. You get a list of automation opportunities ranked by effort, value, and readiness. Learn more Agentic use case generator powered by billions of agent runs Interactive suggestions refine and improve recommended automations Agent a utomations in shareable presentation format accelerates team alignment Accelerated path to build automations with one-click context Build Easy to build multi-agent workflows Anyone who needs to build an agent can work with CrewAI. Use simple visual build tools to sophisticated CLI or APIs for complex multi-agent orchestrations, CrewAI flexes to meet you where you are. Try Now No-code visual editor, exportable to Python Code-first API built for total control Role-based agents separate and simplify agent orchestration Create deterministic agent workflows Govern Manage production agents with control and confidence CrewAI&#x27;s Control Plane sits in the execution path of every workflow, ensuring every agent interaction is observable, compliant, and reversible Request a Demo Real-time tracing of every LLM call, tool call, and memory read is observable with full cost accounting RBAC and audit provide granular control, immutable audit trails, and Enterprise IAM Human-in-the-loop approval gates and intervention during execution Runtime hooks inject PII redaction and policy checks at every LLM and tool call Optimize Build agents that get better with every run CrewAI turns every production run into training data to sharpen accuracy, save money, and surface the next workflow to build Request a Demo Automated and human-guided training for continuous improvement Multi-LLM testing for model swapping at runtime, find the right model for every workflow Evaluation for native tracking with expanded sophistication powered by Arize, Galileo, DataDog, and Patronus Real-time tracing for every LLM call, tool call, and memory read is observable with full cost accounting Proven Results The future is here, right now. :host{display:inline-block;direction:ltr;white-space:nowrap;line-height:1}span{display:inline-block}:host([data-will-change]) span{will-change:transform}.number,.digit{padding:round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) 0}.symbol{white-space:pre} 0 M+ :where(number-flow-react){line-height:1}number-flow-react > span{font-kerning:none;display:inline-block;padding:calc(round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) * 2) 0} 0M+ Agentic workflows ran per month :host{display:inline-block;direction:ltr;white-space:nowrap;line-height:1}span{display:inline-block}:host([data-will-change]) span{will-change:transform}.number,.digit{padding:round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) 0}.symbol{white-space:pre} 0 + :where(number-flow-react){line-height:1}number-flow-react > span{font-kerning:none;display:inline-block;padding:calc(round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) * 2) 0} 0+ Sign ups per week :host{display:inline-block;direction:ltr;white-space:nowrap;line-height:1}span{display:inline-block}:host([data-will-change]) span{will-change:transform}.number,.digit{padding:round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) 0}.symbol{white-space:pre} 0 % :where(number-flow-react){line-height:1}number-flow-react > span{font-kerning:none;display:inline-block;padding:calc(round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) * 2) 0} 0% of the Fortune 500 Testimonials Our clients love us Gelato improved lead quality and prioritization with AI agents that enrich leads with data on company size, printer infrastructure and revenue estimates. Styrbjorn Holmberg - VP Product Management 3,000+ leads enriched per month General Assembly streamlined and scaled its curriculum design process with a crew of AI agents that generate lesson content and instructor guides. 90% reduction in development time Docusign accelerated lead time-to-first-contact by extracting, consolidating and evaluating lead data from multiple internal systems with AI agents. 75% faster first contact with leads Piracanjuba improved customer support ticket response time as well as accuracy by replacing its legacy RPA tooling with a crew of AI agents. 95% response accuracy for customer support Automated voice agent testing helped a leading food ordering service reduce QA from 74 to 3 hours. 96% reduction in QA time Get Started CrewAI supports any stage of your agentic journey Starting out You&#x27;re ready for agents. You need a solid foundation to start building. Try Now Scaling up You&#x27;ve launched pilots. Now you need agents in production. Meet with us At scale Agents are running. You need to manage the sprawl. Meet with us Sign up for our monthly newsletter Help Chat with our docs Blog Privacy policy Terms of service Status Explore Meet with us Careers Resources Documentation Case Studies Webinars Events Blog GitHub project Community forum Security trust center CrewAI © Copyright 2026.

Show your score

Embed this badge on your site. It links back to this live scan and updates on every rescan.

AgentSpeed score for crewai.com
<a href="https://agentspeed.com/scan/crewai.com"><img src="https://agentspeed.com/badge/crewai.com" alt="AgentSpeed agent-readiness score" height="56"></a>

Track this score

Get this report by email, then a heads-up when crewai.com’s agent-readiness actually changes — a check regressing, or the composite dropping.

Two things never trigger an email: a score change caused by us publishing a new rubric, because that is a different instrument rather than a change to your site, and movement explained only by timing-derived checks, which shift run to run on a site nobody touched.

Want it on your own schedule, with Slack or a webhook instead of email? Score-drift monitoring is on every paid plan.

Full breakdown

20 pass3 warn5 fail2 skip
Discoverability
pass
robots.txt present
A robots.txt is reachable at the site root.
100/100
pass
robots.txt allows AI agents
All 8 answer-time access agents allowed.
100/100
pass
Content-Signal directivesemerging
Content-Signal directives are advertised, declaring fine-grained AI usage preferences.
100/100
warn
llms.txt present
Found /llms.txt but missing markdown links.
60/100
pass
Sitemap present
sitemap.xml reachable and referenced from robots.txt.
100/100
pass
Link response headers
Link: header carries useful relation(s): describedby.
100/100
pass
Canonical URL
Canonical points to self: https://crewai.com/.
100/100
fail
MCP server cardemerging
No valid MCP Server Card at /.well-known/mcp/server-card.json. Publish one so agents can discover your tools without HTML scraping.
0/100
pass
OAuth authorization metadataemerging
OAuth authorization-server metadata (RFC 8414) is published, so agents can discover authorization endpoints without out-of-band setup.
100/100
pass
OAuth resource metadataemerging
OAuth protected-resource metadata (RFC 9728) is published, so agents can discover required scopes and authorization servers programmatically.
100/100
pass
API catalog / OpenAPIemerging
An API catalog (RFC 9727) or an OpenAPI document is reachable, so agents can plan API calls against your site.
100/100
fail
Web Bot Authemerging
No Web Bot Auth JWKS at /.well-known/http-message-signatures-directory.json. Publish one to allow trusted agents while keeping a default-deny posture for the rest.
0/100
Readability
pass
Markdown negotiationemerging
Requests with Accept: text/markdown return a markdown representation — agents prefer markdown over HTML for summarization and citation.
100/100
fail
Text-to-markup ratio
Visible text is 2.2% of HTML weight (5855/262279 bytes). Low. Markup may be crowding out agent-usable text.
17/100
skip
Content without JavaScript
Browser pass unavailable; cannot measure JS dependency.
warn
Heading hierarchy
Heading issues: 1 skipped level(s).
75/100
pass
Cookie wall blocks content
No common consent-modal markers detected.
100/100
pass
Page title
A concise <title> is present (6 chars).
100/100
warn
Meta description
Meta description is 32 characters; aim for 50–200 so it's neither thin nor truncated.
60/100
Structured data
pass
JSON-LD present
Found 1 JSON-LD block.
100/100
pass
Structured data validates
1/1 checkable block(s) validated cleanly against schema.org.
100/100
pass
Schema type coverage
Page intent unclear; no specific schema.org type expected.
100/100
Actionability
pass
Paywall / login wall
No paywall or login-wall detected on the landing URL.
100/100
fail
Agent Skills manifestemerging
No Agent Skills manifest at /.well-known/agent-skills.json. Enumerate the tasks agents can perform (search, add-to-cart, contact-support) so they pick the right one without scraping.
0/100
fail
WebMCP actionsemerging
No WebMCP detected. On pages with first-class actions (cart, support, account), embed a WebMCP server so on-page agents invoke tools directly.
0/100
pass
Primary action reachable
Primary offering identified ("Enterprise AI agent platform") with price/CTA ("Request a Demo").
100/100
pass
Reachability
HTTP 200.
100/100
Performance
pass
Time to first byte
TTFB 118ms. Healthy.
100/100
skip
Full render time
Full-render time unavailable (browser pass skipped or failed).
pass
Page weight
Initial document is a lean 256 KB.
100/100
Beyond the scan

Running AI agents of your own? AgentSpeed also monitors them in production — every run, its latency, cost, and failures, with alerts when something breaks. Free for 10,000 events a month, no credit card.

Start watching free →See plans