Meta's (Facebook and Instagram's parent company) web crawler, used to train its AI models and improve its products.

meta-externalagent identifies itself in the User-Agent header and is Meta's named AI-training crawler, separate from Meta's older, unrelated bots used for link-preview generation on Facebook and Instagram. It can be permitted or restricted independently via robots.txt.

Related terms