← Back to search

New FREE Hermes Computer Use Agents!

AI News Today | Julian Goldie Podcast · 2026-06-24 · 10 min
relevance 100 2186 words Episode page ↗ Audio ↗
Show full episode description
Hermes Agent Computer Use Update: Background Desktop Control Now on Windows, Linux & macOSHermes Agent’s “computer use” feature has a new update adding Windows and Linux support and improving macOS, allowing Hermes Jarvis to control a computer by reading the screen and clicking/typing in the background without moving your real cursor or interrupting your work. The script demos opening Obsidian, websites, Google, and writing a note via real-time mode and a more powerful agent mode that can run tasks in the background. It explains the “Hermes Takeover Engine” workflow, emphasizes cross-OS support, and notes you can use different AI “brains” (including local/free options) rather than being locked to one model. Safety is highlighted through approval prompts before potentially destructive actions, plus a stop button. The episode contrasts this with slower, screen-taking tools like Claude Computer Use and promotes the AI Profit Boardroom/Agent OS for setup, training, and support.
✨ Episode Outline — click any point to jump to it in the episode
Problem solved
How to let an AI agent control your computer in the background without locking you out of your own screen.
Benefits
  • Works on Mac, Windows, and Linux through one Hermes
  • Background cursor leaves your real mouse untouched
  • Driven by any vision model, including free local ones
  • Asks approval before destructive actions
  • Set up in three terminal commands
Use cases
  • Opened Obsidian and Julian Goldie.com by voice command
  • Opened Notes and wrote a 'hello' note instantly
  • Opened Google hands-free via real-time voice agent
  • Members set up the Agent OS within ~30 minutes
KPIs / results
  • Available on 3 OSes: Mac, Windows, Linux
  • Setup in ~3 terminal commands
  • Agent OS configured in ~30 minutes
  • 187 pages of testimonials
Tools / build
  • Hermes Takeover Engine
  • Hermes Jarvis voice agent
  • Hermes Computer Use (hermes computer-use install)
  • Agent OS / AI Profit Boardroom
0:00 / 0:00
📑 Chapters — tap a time to jump there
00:00
Update Overview
  • Hermes Computer Use now on Windows and Linux
  • Improved Mac OS support
00:16
Live Demo Basics
  • Real-time voice opens Obsidian and a website instantly
00:37
Agent Mode Tasks
  • Agent Mode builds and runs tasks in background
  • Opens Notes, writes a note
01:18
Voice Interaction Demo
  • Voice agent talks back and opens Google hands-free
01:43
Takeover Engine Explained
  • Takeover Engine clicks and types with own cursor
  • Your mouse never moves
02:57
Five Step Quiet Control
  • Five-step quiet takeover keeps windows and desktops put
03:43
Models Setup Commands
  • Ultra-fast Jarvis vs Agent Mode
  • Plug in local models, free APIs, or Grok OAuth
05:45
Agent OS Pitch
  • Full Agent OS pitch: chat, studio, goal mode, memory Galaxy
06:20
Safety Approvals
  • Agent asks before deleting or editing files
06:52
Why Hermes Beats Others
  • Hermes runs background, model-agnostic; Claude computer use is slow and locks you out
08:40
Key Takeaways
  • Stop clicking, keep working, stay in control, use free models
09:07
Join And Wrap Up
  • Grab Hermes Jarvis in AI Profit Boardroom; four weekly coaching calls
So there's a brand new update from Hermes Agent which is computer use and you can now use computer use on Windows and Linux as well and also there's been improvements on the Mac OS. So if you're not sure what this is, basically this means that Hermes Agent can now control your computer. Let me show you an example. So we've got Hermes Jarvis over here inside our agent operating system and for example if we switch on real time and we'll say, Hey, can you open up Obsidian for me? Boom! Look at that. It literally opens up Obsidian. Hey, can you open up Julian Goldie.com? Boom! Shackalaka! It opens up Julian Goldie.com. And then we're going to switch that off and what we can also do is switch over here to Agent Mode. Now Agent Mode is pretty powerful because now we can actually have it improving and building stuff directly inside our computer. So not only can we get Hermes Jarvis to, for example, open websites, control our computer, open up Obsidian, whatever. We can also have this working in the background, working on tasks with Agent Mode inside Hermes Jarvis as well. So if we say, Hey, can you open up notes and just write a quick note saying hello? Look at that. It just opens it up instantly. Pretty crazy stuff. Also, this can speak to us as well and it's pretty powerful. So let me explain exactly how it works in a second. And then just to show you as well that it can like talk back and that sort of thing. If we switch on real time here and we've got the sound on now. Hey, are you there? How's it going? Quite well, sir. Ever ready to assist you. How may I be of service today? Can you open up Google for me? Google is now open, sir. So we can see how that works, basically. And if you're wondering, OK, how does this whole system loop around? How do you get Hermes Agent to control your computer like this? Let me walk you through the whole system. And this is using something I call the Hermes Takeover Engine. Essentially, what you can do is you can get Hermes now to click and type on your computer in the background with its own cursor. So yours doesn't move. So, for example, when we created that note before that says hello, it doesn't interfere with what you're doing on screen. So you can work on something at the same time and it will just work in the background. And this just landed on Windows and Linux 2, which is pretty awesome. So you can say, OK, you ask. You can say, do this for me. It reads the screen. It clicks and types. It does it in the background. Everything gets done. And then you can keep typing or doing whatever you're doing whilst it's working on all that other stuff. Now, you might be worried here. Like, wow, it can take over my screen. These AI agents can take over my screen. Like, won't this lock me out or something like that? Well, that's really the whole point of this one is it doesn't. It works in the background. So your real mouse doesn't actually move. Your windows don't jump to the front. Your desktops don't switch. Your agent is just working in the background with this system. This really changes everything. So the way this works is in five steps with the Hermes Takeover engine. So it's a quiet takeover, right? It's driving your desktop in the background. Your cursor stays where it is. Your windows stay put. Nothing pops up in the front. You and the agent just work on the same machine at the same time. You can hand it any OS. So Mac, Windows, and now Linux, whatever you run, Hermes can click and type on it. Same simple commands, same background magic. And we have two options. So you can have ultra fast inside Hermes Jarvis or you can have agent mode. Agent mode can do a lot more. It's a lot more powerful in the background. Auto is just like super fast, like literally real time as you saw before. And then it can do basic things as well with this. So it depends, you know, what you're automating with computer use and how powerful you want it to be. Now, you can do this with any brain you want, which means, for example, you could plug in. So we've got local models. We've got free APIs. We have OAuth, like, for example, Grok working with Hermes Jarvis. Whatever you want to work with this, you can have it working. And there's also a stop button whenever we want as well. So we can click this on and off if you want to. Or we could refresh a page. And it's pretty powerful stuff. And so how this works is you've got, like, two people operating the same machine. You, whatever you're doing, and also Hermes that's working in the background. Both are happening at once. And it's hands-free when you use something like this. So this is now available on Windows and Linux as well. So Mac OS, Windows, Linux, they all work through one Hermes. And they can all click and work in the background, which is pretty amazing. So, you know, some people say, oh, you only can do this on Mac. No, you can do it on everything now because of this new update that's just dropped today. And the cool thing about this is, like, any AI can drive this. So most computer-use tools only work with one model. But Hermes doesn't care which AI you bring. So it could be Claude. It could be GPT. It could be Gemini. It could be a free API as long as it's got vision. You can use the one you already have set up. Or you could use a free API. So you don't need to pay for, like, Claude or something like that to do this. And then there's one command to switch it on, which you can see here. So you just use Hermes computer-use install. And then you can go from there. Other people say, well, I'm not technical. Is this going to be a nightmare to set up? So it's literally, like, three commands inside your terminal or inside Hermes directly. It's pretty chill to use. Bear in mind, like, our actual agent operating system where we've built in Hermes Jarvis, which is kind of like a customized version of this, which, you know, is voice activated and everything else. Like, people have joined our AI Profit Boardroom community, got the agent OS set up, and set this up within, like, 30 minutes. So if they can do it, and I'm non-tentacal and I can do it, then you can do it too. So if you want Hermes computer use wired into a full agent operating system where you have Hermes, you can have a live chat with it here. You can jump inside the studio, generate images, videos, voice. You can have a workspace. We even got goal mode and all sorts of crazy stuff here. Like, for example, we have a loop engine system for agent loops with Hermes. And we also have a memory system here where basically all of our memories are visualized inside the Galaxy. Plus, you get four coaching calls a week. And I do daily tutorials and answer your questions daily as well inside there. You can get that all inside the AR Profit Boredom with the agent operating system. Now, you might be wondering, okay, what if this tries to do something crazy on my computer as well? You know, what about that? Well, basically, it will actually ask before it touches anything. So handing your computer to an AI sounds pretty scary, but it actually isn't because every click or keystroke stops at war. Your yes. And, you know, anything that might be destructive, for example, like deleting or editing a file, the agent will wait for your approval and then it will act, which is pretty good. So if you look at the old way, you are hours of clicking, repetitive clicking, renaming, copying and pasting. Sometimes you would let a tool grab your mouse, you know, like an AI computer use tool, but it will freeze you out until it's finished. Core computer use does that. It's quite annoying. And you kind of watch your mouse move around the screen whilst you have to wait for it to finish. Sometimes like computer use is super slow, so it's not that powerful when you're using Claude. So if you're using, for example, Claude computer use, well, number one, you can't operate your screen at the same time. And number two, it gets a lot of stuff wrong. Whereas with this setup, it actually works as you've seen and it's super smooth as you've seen today as well. So you can just tell Hermes to task once in plain words. It clicks and types in the background. Your mouse never moves. Your windows don't jump. And it runs on Mac, Windows and Linux. And any model can drive it, even a free local one as well. Some people say, well, I tried a computer use tool before and it was useless. Same. Most of them are. The thing that made them useless was usually because it just takes over your screen. And also it was super slow. Whereas as you've seen today, like it works smoothly on all the demos and it's pretty powerful stuff. So some people say, well, letting an AI control my computer, it sounds a bit crazy, but it asks before it does anything that could be, you know, slightly destructive, like deleting a file, that sort of thing. Other people say, well, I'll wait until this stuff is more mature. But honestly, if you're early, you won't move ahead. So you should start learning it right now whilst you've got the head start on everyone else. Other people say, well, this is only for coders and techies. I actually know you can set it up in three words from the terminals I've mentioned before. And also the great thing about this is that I'm non-technical. I've tested it and it works. So if I can do it, anyone can do it. So what have you learned today? You learned how to stop clicking. You learned how to keep working whilst computer use runs in the background. You learned how to use this, even if you're not on a Mac, because it works on Windows and Linux. You stopped being locked into one single model. You stayed in control because it asks before it acts. And you stopped having to pay for models because you can just use a free local model. And the agent finally has hands. And it's working in the background. So if you want to test this out, if you want Hermes computer use actually doing things for you, not just another tool that you test once, you can grab Hermes Jarvis with the agent operating system inside the AI Profit Boardroom and it turns Hermes Claude OpenClaw into one system with shared memory. So the agent driving your screen already understands you as well. I mean, Hermes Jarvis is pretty powerful. Like we can see everything that was spoken with it about before. It's got previews of everything that was built. It's got a workspace where we can actually see everything that we've created previously. And we can also jump inside the studio. And this is all voice activated and it works in real time, which is crazy stuff. So if you want to get that, it's inside the AI Profit Boardroom. Link in the comments description or go to the AI Profit Boardroom dot com. Inside the community, you can ask questions, get help and support. If you want the stuff that I've shown you today, that's inside the agent OS system, as you can see. And we update this daily with a new video tutorial, a zip file and everything else. You also get new updates as things come out, which is super useful as well. And if you're a complete beginner at this stuff, you can go from beginner to expert inside this training in the classroom. You also get four weekly coaching calls. So if you need to jump on a Zoom call, ask questions, share your screen, speak to someone. You can do that on four coaching calls per week. Inside the map, you can meet people locally in your area who are building with AI agents like you. And we've already got 187 pages of testimonials and wins from people getting awesome results with this stuff. So if you want to join us, link in the comments description or just go to the AI Profit Boardroom dot com. Thanks for watching.