Anthropic announced the release of an upgraded version of Claude Sonnet 3.5 model and a new Claude 3.5 Haiku in its beta form for testing out the feature called ‘computer use’. Available to only a select few developers, the new upgraded version is already making its mark among users. Many enthusiasts took to the internet to share their experience with the model.
Here are a few that stood out:
Poetry Like A Pro
Users spoke about its use beyond coding and exploring the literary world of poetry. On being prompted with a tweet about the personal struggles and haunting wisdom of famous philosophers, Claude took the theme to new depths, weaving a vivid, empathetic narrative.
The prompt guided it to reflect on each thinker’s unique pain, transforming historical figures into poignant characters. With nuanced verses and resonant imagery, Claude captured their inner turmoil, illustrating that Sonnet’s capabilities are not only technical but strikingly expressive.
people say the new claude sonnet 3.5 is solid in coding but not as creatively vibrant as the previous version.
I have to disagree. I gave it this tweet with a custom poetry prompt and the results were astonishing.
philosophers and their pain
they write about it in books,
these… https://t.co/8EJ3QQClQu pic.twitter.com/fjOaXAsT8M— Marouane A. Lamharzi (@marouane53) October 25, 2024
Cellphone Integration
With user consent, Anthropic’s Claude AI has taken a step further in device integration, now able to control computers and iPhones to handle specific tasks. The new version is equipped to carry out real-time action and retrieve information on one’s cellular device.
A recent demo showcased Claude using the iPhone’s Sports App to look up stats, highlighting its practical potential and offering a glimpse into future possibilities for seamless task automation.
It's so over.
Claude AI with Computer Use can now take over your computer and iPhone (if you let it) to complete tasks.
10 wild demos (and how to run it):
1. Look up stats in iPhone Sports Apppic.twitter.com/oGRJfYPkeG— Min Choi (@minchoi) October 25, 2024
Create Stimulator
A user experimented with the model beyond its controlled Ubuntu Docker environment, allowing it to directly interact with macOS on a user’s actual computer. In an accelerated demo, Claude was tasked with building a Double Pendulum simulator from scratch, even opening it in Chrome to showcase the finished product.
This project, now available on GitHub, demonstrates Claude’s potential for complex task automation and hints at the evolving landscape of advanced AI capabilities across operating systems.
I made Computer Use work for MacOS directly and let it loose on my actual computer!!
Anthropic's "safe" Ubuntu docker demo was too painful. In this video (8x), it creates a Double Pendulum simulator from scratch and opens it up in Chrome.
Put it all on Github too. Feel the AGI. pic.twitter.com/vJRpVUl26N— Deedy (@deedydas) October 24, 2024
Classifier Training with Claude
A user combined the upgraded model and a bash tool worked together to download a random dataset, install sci-kit-learn, and train a simple classifier. He took to the internet to share the results that were beyond satisfactory. The model generated the response to a single prompt in under five minutes.
It even displayed the classifier results on a webpage, showcasing Claude’s efficiency in streamlining data science tasks autonomously.
This is pretty amazing.
Claude with computer use plus a bash tool downloads a random dataset online, installs sklearn, trains a simple classifier on the dataset, and then displays the classifier results in a webpage.
All with just one prompt in under 5 minutes. pic.twitter.com/OFr3A0N4CM— Alex Albert (@alexalbert__) October 23, 2024
Gaming On the Go
Users tested its capability on gaming by playing games like Doom on Replit and Magic: The Gathering Arena. While Claude managed to start Doom, it lacked the speed to keep up with real gameplay but did help navigate by opening an in-game map.
In Magic: The Gathering Arena, Claude showed good strategic insight for card selection and mulligans, yet sometimes miscalculated available mana, ending in unplayable moves. These tests show potential for in-game support, even if full control remains a challenge.
I tried to get Claude's Computer Use to play Doom on @Replit.
It started the game but was way too slow to actually play. It might be an implementation issue?
But I found it to be a good helper. I asked it where to go and it popped open the map (I didn't know there was one). pic.twitter.com/C73Pp5VrTG— Amjad Masad (@amasad) October 24, 2024
Build App From Scratch
A user shared how he used Claude to build an app from scratch by feeding it code, followed by opening a local server (in a Docker VM) and fixing its own styling. Once set up he tested it and restyled it like an iPhone, fixing a syntax error. The results were impressive. The user also acknowledged that software engineering will not be the same.
Got Claude Computer Use to "build a Timer app" from scratch!
—downloaded React + deps
—wrote the code
—opened local server (in a Docker VM)
—fixed its own styling
—TESTED it fully
—restyled it like an iPhone
—fixed a syntax error
Software engineering will not be the same.
1/4 pic.twitter.com/K6gmAvtMsR— Deedy (@deedydas) October 23, 2024
Code Like A Pro
Another fellow user used the update to visualise chaos with forty triple pendulums, each having very slightly different initial conditions, in five mins after a couple of iterations, the user remarked it would have easily taken him hours to do this without Claude.
I'm really impressed by Claude 3.5 Sonnet's coding skills.
I made this visualization of chaos with 40 triple pendulums, each having very slightly different initial conditions, in ~5 mins after a couple of iterations! It would have easily taken me hours to do this without claude. pic.twitter.com/RhCKhFwUyu— Luis Batalha 🇵🇹🇺🇸 (@luismbat) June 22, 2024
The post 7 Mindblowing Claude 3.5 ‘Computer Use’ Applications You Didn’t See Coming appeared first on AIM.
