Anthropic's New Claude 3.5: AI Takes Over Your Computer!

Kanaad H Shetty

10/23/20241 min read

Anthropic just launched something truly groundbreaking: Claude 3.5 Sonnet, a language model that goes beyond chat – it's taking control of our computers! None of the top players are offering this, making it a unique game-changer in the AI space. The new model brings improvements in math, coding, and graduate-level reasoning, although GPT-o1 still edges it out in some areas. But the real headline is that Claude 3.5 can actually use your computer.

This feature is available through an API, making it accessible for developers, and the possibilities are seriously exciting. Imagine this: in a demo, Claude filled out a vendor form by gathering scattered data across the computer. It navigated through multiple pages and transferred information seamlessly, automating the kind of mundane tasks that people often slog through daily. It's like having a personal assistant for your desktop.

While it's still in beta, the way it operates is similar to Open Interpreter, with Anthropic giving a clear definition of the tool's capabilities. Currently, it requires some setup in a computerized form. According to Anthropic's blog, if LLMs can interact with software like we do, it could unlock a whole new range of applications for AI assistance. This might be the first step toward transitioning to new operating systems and redefining how we interact with AI.

That said, companies like Google and Apple still have a leg up. They're deeply integrated into our lives and already have access to our phones, giving them a natural advantage. But if Claude can code, run the code, debug, and even build a website just through prompts, who knows what’s next?

Sure, the computer control feature is still buggy and sometimes goes off-script, but it's an incredible start. The future of AI-assisted tasks is here – and it’s already sitting at your desktop.