Is MCP still relevant now that AI agents can just crawl the website/Swagger docs directly?

I've been thinking about this for a few weeks and wanted to get your take. MCP emerged as a way to standardize how AI accesses external tools/APIs. But with the latest generation of agents, I'm seeing more and more cases where the AI just crawls the website or Swagger/OpenAPI docs directly, and manages fine without going through a dedicated MCP server. So it makes me wonder: does MCP still hold a real advantage in this context (reliability, auth handling, token consumption, state between calls...), or are we seeing a "brute force" approach emerge, where the agent reads the docs on the fly and adapts, without needing a standardized contract? Personally, I've seen cases where crawling works great (well-documented REST APIs) and others where it clearly struggles (poorly documented APIs, need for state, complex permissions). But I wonder if MCP will remain an essential standard long-term, or if it's more of a transitional solution while agents get good enough to figure out any doc on their own. What do you think? Any concrete examples where one clearly outperformed the other?