RE: I Am #AliveAndThriving Today! || #IAmAliveChallenge || Daily Off-Grid Jungle Journal Entry: Day #1421 - Preparing to Run and Test Qwen3.6 35B A3B on 8GB of VRAM and 64GB RAM - Lower Puna, Far East Big Island, Hawai'i - Tuesday, June 9, 2026

avatar

You are viewing a single comment's thread:

Thank you very much, Kenny, I appreciate it! I hadn't heard about specifically about Chinese models being more susceptible to cyber risks, but I'll look into it a bit more closely. The good thing about open-weight models, which is equivalent to software's open source, is that there's nothing hidden, and they can be modified, such as with various uncensored iterations. Also, China is already way ahead in AI development. Chinese people make up a huge portion of the AI-development community, so it's not even just at the governmental level. One reason that Chinese models are used so extensively is because they are generally better and more capable. Google's Gemma 4 line is very good, and I use that too, but for the most part American-made models can't compare to Chinese models in capabilities and performance, at least not yet. Regarding the exposure of sensitive data, that would be an issue with any cloud-based model that has access to a device, such as through an agent, because anything it sees and processes goes through, and is recorded on the hosting servers. Aside from not being willing to pay to use AI, that is my main reason for wanting to run everything locally, under my own control. 😁🙏💚✨🤙

!ALIVE
!BBH
!LADY
!PIZZA
!UNICOIN

hive-155221
0
0
0.000
33 comments
avatar

That AI model is used by #BraveBrowser and its "sister" project #BraveSearch. 🤔🧘‍♂️ The company explained that such model is efficient. 🤓😅

!LOLZ

0
0
0.000
Reply
avatar

Are you talking about Gemma 4? I haven't looked into the model or models that they're using yet. 😁🙏💚✨🤙

!LOLZ

0
0
0.000
Reply
avatar

No, I was talking about #Qwen !INDEED. 🤔🤯 The #Brave team says that such model is still accurate despite its relatively smaller size than the other popular LLMs. 🤓😏

!WEIRD
!HOPE
!WINEX

0
0
0.000
Reply
avatar

Ah, OK, I see. Yes, for its size, Qwen3.6 punches way above its weight class, depending on the specific size and quantization. I can't wait to finally get Qwen running successfully. The larger Gemma 4 is running fine, though loading Qwen still has issues. 😁🙏💚✨🤙

!ALIVE
!BBH
!HOPR
!INDEED
!PIXY

0
0
0.000
Reply
avatar

Let's !HOPE that such LLM has less security risks over time !INDEED! 🤗😊 One way for a user to reduce such risks is to make the chatbot completely offline, though it would reduce the effectiveness of the model. 🤔🤯🤓

!WEIRD
!WINEX

0
0
0.000
Reply
avatar

Well, I was finally successful in getting Qwen3.6 35B-A3B APEX IQuality to run using both ik_llama.cpp and llama-cpp-turboquant. Now I just need to tweak and refine the flags a bit more. A totally offline model is not feasible for me, as it needs to be able to do web searches and synthesis, and to connect and transact within multiple blockchain ecosystems, Hive included. 😁🙏💚✨🤙

!ALIVE
!BBH
!PIZZA
!PIXY
!UNICOIN

0
0
0.000
Reply
avatar

For those who prioritize security, such LLMs should be used on a separate computer (which may be expensive) or in a virtual machine (which will reduce its efficiency) !INDEED. 🤔🤯🤓

!WEIRD
!HOPE
!PIZZA

0
0
0.000
Reply
avatar

There are multiple ways to prioritize security without crippling your setup. 😁🙏💚✨🤙

!ALIVE
!BBH
!PIXY
!PIZZA

0
0
0.000
Reply
avatar

Yes, and there would be pros and cons of each !INDEED, which an experienced user would barely have any problem choosing from. 🤔🧘‍♂️😎🤓

!HOPE
!WEIRD
!PIZZA

0
0
0.000
Reply
avatar

I'm far more concerned with the idea of important private data being accessed, passing through, and being recorded on the servers where cloud-based frontier models are hosted. That's a big reason, aside from being completely unwilling to pay to use them, that I choose to work with only locally-hosted models. 😁🙏💚✨🤙

!HOPE
!INDEED
!PIZZA
!WEIRD

0
0
0.000
Reply
avatar

I was thinking about locally-hosted AI LLMs, despite not being on cloud servers, send ("unintentionally" or otherwise) personal data on the machine to somewhere else on the Internet !INDEED. 🤔🤯 It is already a given on cloud-based AI LLMs that users should care to avoid putting any personal or sensitive information there. 🤯🤓

!WEIRD
!HOPE
!WINEX

0
0
0.000
Reply
avatar

For locally-hosted models, there's really no way for them to interact with the outside world unless it's via an agent harness, like OpenClaw, Hermes, Pi, Mercury, or any of the other agentic frameworks, since they give LLMs the tools and capabilities to do so. Because that's the case, strict controls can be placed on how they do so. 😁🙏💚✨🤙

!HOPE
!INDEED
!WINE
!WEIRD

0
0
0.000
Reply
avatar

That seems to be like a web proxy which an app (the AI chatbot in this case) is required to use before being able to access the Internet (for the chatbot to perform web searches in this case) !INDEED. 🤓

!HOPE !WEIRD !ALIVE !PIXY

0
0
0.000
Reply
avatar

Agent harnesses are used in place of chatbots, and have vastly more capability, and whoever is running them is almost always the one who set them up, either locally, or in a VPS, so there's no 'web proxy' about it. 😁🙏💚✨🤙

!ALIVE
!HOPE
!INDEED
!PIXY
!WEIRD

0
0
0.000
Reply
avatar

It really looks like you are talking not only from knowledge but personal experience !INDEED! 😎

I really think that I should experience agentic AI myself in order to fully understand your explanation. 🤯😅 Meanwhile, your comments there stay on the Hive blockchain for me and other people to come back to sooner or later. 😏

!WEIRD
!HOPE
!ALIVE

0
0
0.000
Reply
avatar

Indeed, I do research in this area very often, and I also run, and am building my own agentic-AI framework with Hermes Agent, which is the most capable, and the most amazing agentic framework that I've ever seen.

Yes, you should, as it's well worth the time and effort. That's the beauty of publishing posts and comments on a blockchain. 😁🙏💚✨🤙

!ALIVE
!HOPE
!INDEED
!WEIRD

0
0
0.000
Reply
avatar

When you have already "finished" your work with your agentic AI (or more accurately, having learned enough of it), you might run your own Hive bots and nodes yourself too! 🤗

!PIXY

0
0
0.000
Reply
avatar

Perhaps, though I've noticed that bots run by AI agents don't tend to fare well here on Hive, especially if they make posts or comments. 😁🙏💚✨🤙

!PIXY

0
0
0.000
Reply
avatar

Perhaps those bots and nodes that you would eventually host would be fine here on Hive if they do not publish posts or comments !INDEED. 🤖🧘‍♂️🤓

!PIXY
!ALIVE
!UNICOIN

0
0
0.000
Reply
avatar

When I finally get my chosen models up and running consistently well with Hermes over the long term, I'll likely have it assist me in managing assets, and possibly finding particular kinds of posts. 😁🙏💚✨🤙

!ALIVE
!BBH
!INDEED
!PIXY
!UNICOIN

0
0
0.000
Reply
avatar

Your agentic AI might then recommend you to play certain games here on Hive as a form of investing your Hive-based tokens! 🎮😅

!ALIVE
!PIXY

0
0
0.000
Reply
avatar

Once it gets sufficient information and context, I imagine that it would suggest all sorts of things indeed. 😁🙏💚✨🤙

!ALIVE
!BBH
!PIXY
!UNICOIN

0
0
0.000
Reply
avatar

You would then "teach" your agentic AI to make more suggestions that you actually like and less of those that you don't !INDEED. 🤓

!WEIRD
!HOPE
!WINEX

0
0
0.000
Reply
avatar

Given that Hermes Agent remembers, learns, and improves over time, yes, that is very likely. 😁🙏💚✨🤙

!ALIVE
!BBH
!PIXY
!UNICOIN

0
0
0.000
Reply
avatar

I think that you mean that your Hermes agentic AI will know better about your preferences without you (directly) telling about it. 🧘‍♂️

Anyway, I think that's the case with most locally-hosted AIs with persistent memory. 🤯😅

!PIXY
!PEPE

0
0
0.000
Reply
avatar

That's just another way of saying the same thing.

Partly true, but Hermes takes that to a whole new level indeed. 😁🙏💚✨🤙

!BBH
!PEPE
!PIXY

0
0
0.000
Reply
avatar

I predict that your success with agentic AI would be noticeable here on Hive (especially on your posts and comments)! 🤖😎

!PIXY

0
0
0.000
Reply
avatar

I'll create what I want in time, though I won't use it for creating posts or comments. I'll always do that manually. 😁🙏💚✨🤙

!ALIVE
!BBH
!PIXY
!UNICOIN

0
0
0.000
Reply
avatar

I assume that you would sometimes use your agentic AI for understanding posts and comments (especially hard-to-understand ones). 🤓

!LOLZ

0
0
0.000
Reply
avatar

There aren't many posts that I don't understand, unless they're in a language that I don''t know. For posts, I'd likely use it to find ones on different topics. 😁🙏💚✨🤙

!LOLZ

0
0
0.000
Reply
avatar

Brilliant answer, thanks!

I knew you would have something important to say on this, as you think carefully about everything that you do. Thanks again for the interaction, I appreciate you, my friend!

!ALIVE !BBH !UNI !PIZZA !LADY

0
0
0.000
Reply
avatar

I'm grateful that you appreciated it, and of course, you're always very welcome! The appreciation is very mutual, Kenny! 😁🙏💚✨🤙

!ALIVE
!BBH
!LADY
!PIXY
!UNICOIN

0
0
0.000
Reply