Looking at the /robots.txt file on a few different instances, there’s nothing preventing Google or any other web crawlers from indexing Lemmy. I was even able to find some posts by searching site:lemmy.ml.

I think part of it is that all the separate instances make for bad SEO. And there just isn’t enough content here yet to compete with Reddit and other search rankings. Hopefully it’ll keep growing and eventually take over.