Build Anything with Hermes Agent, Here’s How...

Hermes has a new Computer Use Agent update. So Hermes Agent just got superpowers and this free update has made it the most powerful it has ever been because Hermes can now do your computer work for you. Your emails, your notes, your files, your admin, all of it handled in the background whilst you do something else entirely. I tested this out today and it genuinely saved me time within the first five minutes. One instruction and Hermes had already opened an app, created a note, filled it with 10 personalized ideas and I didn't know what to do. Touch A Thing and I'm going to show you all of it in this video. By the end of this, you're going to have a free AI agent that handles the repetitive stuff that eats up your day so you can focus on the work that actually helps you grow. And I'll show you the exact setup, the framework I use to get the best results and the one use case that is going to save you the most time starting today. No coding, no technical experience required. Anyone can do this. And if you want an AI that actually does the work for you instead of just answering answering your questions, this is it. Let's get into it. So today we're going to be looking at the new computer use models inside Hermes. Now this is crazy powerful from what I can see. Basically, it's a brand new update. It's just been announced a few hours ago. And essentially what this means is that Hermes agent can now do stuff on your Mac desktop, right? It can click, it can type, it can scroll, it can drag in the background. That is the most important part. It does it in the background whilst you're not even working on Hermes, right? It just goes off and does it, right? So your cursor doesn't move. Your keyboard focus doesn't change. It doesn't switch spaces on you. It's just you and your agent using the same machine at the same time, right? As a team, which is really crazy stuff. Now this uses an MCP server to do it. And the first thing that we need to do is set up the CLI command, which you can see right here. I'm just going to make sure that I have the latest version of Hermes as well. So we're going to go to Hermes update inside a terminal. From Hermes before you set this up. And then we'll start working on this. And if you have any questions as you go along, feel free to ask. Now you might be wondering, okay, what actually is computing use? So imagine you have an agent who can use your computer for you, right? They can click, they can type in this scroll just like a human, but they do it in the background without touching your mouse, right? Without switching windows, without interrupting what you're doing. That is basically Hermes agent computer use. So it's a feature inside a free open source tool called Hermes agent built by news research. And it lets an AI model operate your Mac computer like a person would with any AI model, right? It works with any AI model. So you could use Claude, you could use ChatGPT, Gemini, or even a free local model running on your machine, which is crazy stuff. We've updated now. And you might say, why does this matter? You know what? Most people use AI by just copying and pasting back and forth. And that's fine, but it's slow. It's the old way to do things, right? This is a new way. So it still requires you to do the actual clicking, the searching, the filing, et cetera, if you're doing it the old way. But with Hermes agent computer use, the AI does all of it for you. So it reads the screen, identifies every button, it clicks the right one, types for you, files results, or whilst you're doing something else entirely, which is almost scary, to be honest with you. So we're going to try this now. Bain says, is it only on Mac? As far as I can see, is only available on Mac? So yeah. And then we're going to install this CLI command, which is Hermes computer use install. So let's run that now. It's now going to set this up. So you can see that was pretty quick. So it's already installed, which is great. You can also, there's two ways to install this. So you can do the dedicated CLI command, or you can enable the tool set interactively as well. And then after installing, no matter which option you took, you need to grant OS permissions, right? Which is what you can see right here. So I'm just going to do that now. So you have to go to accessibility settings, and then we have to allow terminal. So let's do this. So we've just got allow these, which you can see here. So I'm just going to click on settings and allow. And you can see that basically what I did is I took those instructions here, and then just pasted them into Hermes to set that up for me, right? Just to make it easier for me, basically. Terrell says, hello, good to see you. All right. So this is configuring computer use, as you can see with our Hermes agent. One thing to bear in note is this is an experimental feature, right? And obviously you're giving it access to your computer. So don't do anything that you're not comfortable with. If you're like, do you know what? I don't really want to give my agents access to my computer. You can just watch this video and learn from me. I'm testing this out. I may uninstall it afterwards because it's a very experimental feature. I don't really want my agent using my computer all the time, but I do want to test this out and see how it goes. So you can see here that Hermes is actually testing this out for us, right? So it says, use computer use tool to list the apps and then reply with a short confirmation that actually worked, which is pretty cool. So Hermes is actually testing this works for us. That's the thing I like about Hermes is it's self-improving. It learns itself. It improves itself. It's so cool in that way. Now, if you want to know some examples of how you could use this, here's an example, right? So you can give it a prompt, like, for example, find this email about this and summarize what they want me to do, blah, blah, blah. And then it will give you a plan, right? Now, you can see here Hermes has replied to us and it's like, what I checked and changed. So verified macOS permissions are granted, ensured computer use is enabled, verified actually works as well, which is really cool. Relevant section includes, also verified it with this. So you should be good to use this with this one, as you can see. And you can use it in two ways. You can use it with this command, Hermes t computer use chat, or you can actually just use regular Hermes CLI, right? So you can use it inside your Hermes. You could be on your phone and ask Hermes to just use your computer, which is pretty mind-blowing when you think about this. Now, they also talk about the best models for this too. So you've got Anthropic, OpenRouter, OpenAI, Local, et cetera. The only one that it doesn't recommend is text-only models. And the reason they don't recommend that is because it doesn't have vision, right? If it's a text-only model, which is a problem because it needs to be able to understand and see screenshots on your computer to be able to do computer use, right? It also has a safety section here. So they've added multi-layer guardrails, which is good. So for example, anything where it's like, I don't know, deleting something, it requires approval from you, right? This is really good because obviously you don't want... We all saw this with OpenClaw, which is it could go off and do crazy stuff. These guardrails help it avoid that. It's not going to be perfect, so just be aware of that. But yeah. So let's try this out now. I'm just going to close Notes, and I'm going to see if it can open Notes up for me. And say, Open up the Notes app, just to test if this actually works. So let's see what we've got here. All right. So we can see all the apps here. It's now going to use computer use. So it's using the computer skill, and boom. It's just opened up Notes for us. Wow. And this is whilst I'm talking to you, whilst I'm operating terminal and checking this out, but it can use computer use. Amazing. That was so fast and easy. All right. Let's test something else out now. So I want to start with the basics and just see how advanced it actually is. So we've tested out creating a new note. Let's try something else out now. So I'm going to say, open up Notes app and create a new note journaling about what you learned from me today. Or journaling about the best ways you could help me save time day to day. Because obviously Hermes has a lot of context on me. I'm going to close Notes just to make sure it actually opens again and see what it does. I'm going to say, open up Notes app and create a new note journaling about the best ways you could help me save time day to day. Let's see if it can actually do that. So it's brainstorming now, coming up with ideas. And I'm using GPT 4.4 for this as an API. Just so you know, it's not even an API. I'm just using Codex or off login. So it's opening up Notes. It's using macOS computer skill. You see here it has two different skills, right? It says Apple Notes and has macOS computer use. So it's using both of those to operate. Now it's open up. We're going to allow that. Now it's set up. Whoa. This worked perfectly. So it's literally just set up a new note and it was so fast. I've never seen computer use work that quickly before. So it's created a new note inside our Notes app using computer use whilst I was talking to you. And it's done it perfectly, right? So it says ways Hermes could save me time. Day to day. Journal note. Here are the biggest ways you could save me time. Inbox, content, research. And this is all personalized to me, right? It understands, for example, I talk a lot and do a lot of AI SEO. And then it's put that inside the Notes here. It set up an idea on personal knowledge capture so it could save useful ideas before they disappear. Build a lightweight second brain. Surface the right context when I come back to something later. And it's come up with 10 different ways it could help me, right? And put that into a note, which is pretty amazing. I wasn't expecting it to work that smoothly, honestly. So that's really cool. Let's try something else out now. So I want to say go into Obsidian app and organize my knowledge base. Plus add lots of details and context about me. Plus make it more organized and way more useful as a second brain. So Obsidian, if you're not aware, it's basically a place where I give all my knowledge on everything that I work on, but it's still messy, right? So you can see, for example, in the graph view, it's still a little bit messy. It's not that clean to use, et cetera. We do have lots of notes and lots of memories on me and what I work on, et cetera. As you can see right here, it's got a thousand memories on me, but it's all inside one note. And it's not that nice to use, right? I think it could be a lot better. So I'm going to go inside Hermes. I'm going to say go into Obsidian app, organize my knowledge, add lots of details and context about me, make it more organized, way more useful as a second brain, add emojis, add titles, headlines, organize the folders, make it super organized and easy to navigate through. Also improve the knowledge graph and do this with computer use. So that's a bit more of an advanced task. I would expect it to do it half right in this situation, but I've never tested this out. It's a brand new feature that just came out. So I'm excited to test what it can do and how it works and how powerful it is, right? And even if it breaks, great, we learned something. But if it does it correctly, my mind will be blown, my friend. So let's have a look here. It's getting its skills. So it's pulling in Obsidian and computer use here. It's reading in the local files, as you can see from the Obsidian vault. And I'm just going to stop that here and say, make sure you're using computer use for everything. I don't want it to start doing it locally. I want it to use computer use just so we can see the power of computer use. Now, I've actually got a custom framework for this stack right here that I've come up with. So the way that I would do this is like you give the agent a goal, right? And you stop giving one of tasks. So instead, you give it a full goal for real world outcome. So for example, it would not just be like, write me an email, but it'd be like, find the latest emails, summarize what they need, draft a reply, put it in the drafts folder. It's something like that. One prompt, but multiple actions. Now, you can see here that it's beginning to use computer use and it's actually asking for permissions. So I'm going to allow this, as you can see. And then we'll see what it does in the background here. So this is Obsidian. We've got the terminal over here and I'm going to allow this access. So it's good that it asks for permissions as well before it does something like this, because it's a bit more, but it could delete everything, for example. So now it's prompting. And you can see it's struggling with that. So I'm going to say fix the computer use backend here. And then you want to oversee, right? You don't want to operate. So we've talked about giving it a goal. You want to give it a goal, hand it to your computer, right? Then you want to oversee, which is what we're doing here. So you don't want to operate. You become the CEO, not the operator. And you review the work. You approve the big decisions, but you're not clicking anything else yourself, right? Now, I don't think this can be like fully amazing. As you can see, it's still in beta, but we're going to allow this to work. And then we can stack in any model that we want, right? So we could use Claude. We could use free local models. We could swap models based on what we prefer. And then you want to transform that output into something useful, which is like more content, more client work, more research, right? More productivity systems. And that's basically how this whole stack works. This is how the framework works. So you can see here it's beginning to use computer use now. So are you saying it's free? Yeah, it's like computer use is free to use because you can use a local model, right? Or you can use a free API. For example, our alpha on Open Router. You could use something like this. Actually, they've just got inside news research on the portal. They've just announced that Quen 3 is free as well for now. So you could use a free API with this as well. And computer use is free plus Hermes agent is free. It's a free open source project. So now it's going into, this is actually Hermes using Obsidian, right? So I can see the notes over here and it's actually typing over here, right? Now it's typing in the background. So even when I click on, for example, back to here or back to terminal, it's operating Obsidian in the background, which is pretty crazy stuff. And it's actually prompted the agent to use computer use only for this example. What would be the best model to run locally? It depends on your setup. The best way to figure that out is go into LM Studio, go into this section here if you want to run local models and just see which model works. So you can see from me, for example, it will tell me, okay, Nemetron 3 Nano Omni is a little bit too, is not going to work that well, right? So it will actually tell you what's working and what's not. So if we go on the dropdown, it says likely too large, blah, blah, blah. And you can just scroll through the models and see which one you think is the best for you. That's the way that we do it. Christopher says Quen 3.6. Yeah, that's a free model that's available right now with News Portal. Christopher says, thanks for the great work. Happy to help. So you can see it's actually using the mouse here. This is Hermes using my computer, right? So it's clicked on home and it's got the cursor here. Now, the one thing I will say about this is when it's doing something complex like this, it does seem a bit slow. So there are limitations and I just want to be 100% honest with you, right? It was amazing at opening up notes. It was amazing at that. With this, it seems to be a little bit slower than I would like. So just be aware of that too. Let's stop that task for now and we're going to go back into Hermes here. And then what I'm going to say here is go into Terminal and have a conversation with Hermes. Let's see if it can talk to itself. You can see the API limit has been hit with Hermes. I'm just going to switch the model. Trad says Hermes is so complex. It's simple for day-to-day stuff. It's pretty easy to learn. But the way that you want to look at it is like we're doing something like computer use, right? Which is a bit more complicated. It's a brand new feature. It's obviously difficult for people to get their heads around at first. So just using Hermes day-to-day is super chill. But then if you want to set up something like computer use, obviously it requires a bit more technical expertise, right? It's not something we're all going to get right first time around. And that's okay. That's part of the process, right? So I'm going to say open up Hermes in Terminal using computer use and say hello. So Jonah says, thanks for what you do. Maybe one of these days an interview with a user might be a good idea. I'd be happy to do that at some point. We actually do a lot of coaching sessions inside the AI Profit boardroom. So you can see what people are using it for and how it works and that sort of thing. So you can see it's now using computer use. I've switched over to KimiK 2.6 because it seemed to use a lot of tokens on codecs, right? Codecs actually ran out of usage. So that's something to be aware of as well. It seems to use a lot of usage. So it's now navigating, as you can see, it's clicking the mouse and it's navigating over to Terminal, which you can see here. So the cursor is moving over. It's clicked in there. So you can see this is Hermes agent using the computer. It does say, if you look at the token efficiency guidelines inside Hermes, it says the screenshots do use a lot of tokens. Now there's some layers of optimization, as you can see right here, but I think that's one of the problems that we found. There's also some limitations, of course, as well. So it's macOS only. You need good performance, et cetera. But it is opening up Hermes here. So it has managed to open up Hermes, which is pretty cool. So it's done that in the background. This is Meta watching Hermes talk to Hermes inside the terminal here. And then it's written hello here. So you can see like it actually wrote hello inside the terminal with Hermes. It managed to open up a new terminal window, set up Hermes, talk to itself. And you can see that Hermes responded. Hey, Julian, what are we working on today? So Hermes talked to Hermes here, which is crazy. This is pretty interesting. I'm actually going to stop it there. There's some things that I would say about this. It's really cool. It seems good for basic tasks. I wouldn't use it for like massive tasks or super complicated stuff like organizing Obsidian. It seemed to fall down on that. But for like just basic stuff, the most useful stuff was like just writing notes and journaling, right? Like I can see right here. That was pretty cool. So that's the way that I would use it. But pretty cool. Fun to use. Definitely worth testing out. It's a major level up from where Hermes computer use was before as well. So just to recap on this is basically a new feature inside Hermes that allows you to get Hermes to operate your computer for you in the background. So you don't need to do anything. I've talked through that framework and how you can use it, how you can set up. We actually have 100 prompts inside the guide, as you can see right here, along with a 30-day roadmap and a step-by-step operating procedure for implementing this stuff, right? As you can see, a 30-day roadmap right here. The crazy thing about this is like we didn't really need to be technical to set this up. We just pasted in the instructions from Hermes guide. It can do real tasks like we saw inside notes. It can't do super complicated stuff. That's just something to be aware of. But yeah, really cool stuff there. So super powerful. Let's talk about some limiting beliefs that might be holding people back on this. So some people say, hey, I can't do real computer tasks. But actually, Hermes computer use, it can click, scroll, type, and operate any app on your Mac in the background. And you've seen it live today. It's not perfect, but it works. Other people say, you need to be a tech expert to use this. I'm not a coder. I'm not a developer or programmer. I think if you can type a sentence, you can give an agent a task. And you just need to install it. And once it's installed, you're good to go. Other people say, it will take over my computer and mess everything up. It actually asks you for permissions, as you saw today, before it does anything. So if it does anything, like, for example, moving files or deleting them, it will actually ask you before you go ahead of it. And some people say, I feel like I'm too late. Everyone else is already ahead of me. With AI, background compute use is brand new. And this release literally just dropped today. Most people have never heard of it. It's earlier, and that's your advantage. So if you want to get the full guide on Hermes computer use, you can get it inside the AI Profit Boardroom. Link in the comments description or go to the AI Profit Boardroom.com. This is my AI automation community that helps you save time, grow and scale with AI automation and agents. You can post questions inside the community and actually create videos daily for people who ask questions and cover them in videos like this. Inside the calendar, you can jump on four weekly coaching calls, share your screen, ask questions about your setup, meet other people doing stuff with AI agents. Inside the map, you can actually connect with people using AI in your local city. And then inside the classroom, you get access to all of my new best trainings, right? So if you want to learn, for example, more about Hermes computer use, we've got the guide with 100 prompts, a 30-day roadmap and a step-by-step framework and how to use it right there. We also have tons of training on Hermes use cases, agent workspace, how to run it for free with our alpha, the desktop app, et cetera. So loads of cool stuff on it. So feel free to get that link in the comments description or go to the AI Profit Boardroom.com. Julian says you have agents in production. Yeah. Yeah. I use agents every day for stuff, right? Particularly AI SEO. That's my favorite use case right now is using it for AI SEO is really powerful for that. How to switch models in Hermes. All right. So what you do is you go inside your terminal here, make sure you have Hermes running like this, and then you just type in model and select the model that you want to use. So I can switch between models right here. Let me show you that. I'm just going to drag that. So you can see I can switch between like all these different models that I've set up. Now, if you want to set up a new model inside Hermes, you just type in Hermes setup like this, and then you can just switch between the different models you want to set up inside here. So that's how you do it.