🔙 Throwback Thursday for 2025-06-12
AI crawlers are evolving, reshaping how we access instant search results online.
🤖 + 🕸️ One story caught my eye this week was the growth in AI crawlers that are gathering instant results for users of various alternatives to web search. Some coverage uses the “bot” name as an inside baseball style reference to robots.txt.
https://www.techmeme.com/250612/p13#a250612p13
As for “bots”, if you look back at coverage of early web crawlers, there are some familiar patterns. 20 years ago, coverage of Google Base was mixed but provided a roadmap for where the increasingly machine readable web was heading.
https://googleblog.blogspot.com/2005/11/first-base.html
Enjoyed this post?
Consider supporting my sponsor!
🔓 Unlock Your Best Self with Lida Coaching! 50% off regular coaching rates until July 31, 2026!
A quick message from Lida:
With 18 years building, marketing, and scaling products at startups, I work with founders and leaders stuck between where they are and where they need to be. I help you cut through the noise, make sharper decisions, and get your team executing with clarity instead of chaos.
Most founders mistake complexity for strategy. They keep adding when they should be subtracting. When I'm brought in, the team is usually doing a lot right, and the real issue is focus and direction. I diagnose what's actually going wrong across product, positioning, and execution, then reset direction and get everyone aligned around one clear path forward that will lead to growth.
A bit of what I've done: I was the first PM on a fintech product that hit 10,000+ users within months, built a national incubator that supported over $500M in startup funding, and led teams at 23 Design before it was acquired by frog (the design team behind Apple’s first products). I've spoken at Google, Microsoft, and LinkedIn, etc.
🔓 Unlock Your Best Self with Lida Coaching! 50% off regular coaching rates until July 31, 2026!
