Meta used its annual Connect event in Menlo Park on Wednesday to set out a series of new capabilities and integrations for Muse, its personal AI agent that launched in early September. CEO Mark Zuckerberg opened the keynote by saying the company is going all-in on Muse.
Muse will be integrated with Meta's smart glasses line, the company announced. Users will be able to communicate with the agent by speaking to their glasses, with activation via a wake word. Meta said the agent will be able to guide users through a personalised workout, log meals, book an appointment and help them buy products they see. It is not clear exactly when the feature will become available, although Meta says it should launch sometime in the coming months.
Meta also said it is bringing Muse computer work to Mac, allowing users to delegate tasks to the agent, which will be able to operate any app on a user's desktop. "You can have it help you run your small business, or just get work done for you," Meta's chief AI officer Alexandr Wang said during the keynote. "You can walk away from your computer and it keeps working for you on all the jobs you lined up."
Wang also announced that Meta is developing an email address for Muse and will make it available soon, without providing a more precise timeline. Users will be able to add Muse to an email thread or forward emails from the agent to handle on their behalf.
On shopping, Meta has locked in partnerships with companies including Stripe and Shopify. Wang said Muse can access the entire Shopify product catalog agentically and use Lync and now Shop Pay to buy almost anything on the internet, with added support for PayPal payments. Meta also announced partnerships with retailers including Best Buy, Gap, Sephora, Walmart and Wayfair, as well as connectors with Expedia and soon Instacart, GitHub, Granola and Notion.
Meta recently opened its platform to allow developers to build their own connectors. Wang said the company received more than 1,500 applications in less than a week.