In my opinion, Qwen3-30B-A3B-2507 would be the best here. Thinking version likely best for most things as long as you don’t mind a slight penalty to speed for more accuracy. I use the quantized IQ4_XS models from Bartowski or Unsloth on HuggingFace.
I’ve seen the new OSS-20B models from OpenAI ranked well in benchmarks but I have not liked the output at all. Typically seems lazy and not very comprehensive. And makes obvious errors.
If you want even smaller and faster the Qwen3 Distill of DeepSeek R1 0528 8B is great for its size (esp if you’re trying to free up some VRAM to use larger context lengths)
I used to think this would be sufficient as well but as you’ve probably noticed it’s damned near impossible to get our “democratic” governments to even consider something like this since they have been so thoroughly captured by the wealthy elite. You don’t have to call it revolution or socialism if those are scary words or just don’t seem possible but somehow we have to overcome that reality and I don’t see how it can be done without dispossessing these elites of their power so we can dispossess them of their wealth.
The problem is that wealth = power and influence in society and this has led to essentially all modern neoliberal ‘democracies’ having their governments captured and controlled by the wealthy elite. So the only way you would be able to implement something like this would be via a revolution replacing capitalism with some form of socialism that would make private wealth a thing of the past and provide a decent standard of living for all.
I’m certainly not trying to say that other claims about Donald Trump’s association and friendship with Epstein aren’t true but the specifics of this one at least seem questionable.
Not to mention battery life…
It’s new so reviews are just filtering out but it’s starting to look like SteamOS powered version of the Legion Go S (Z1 Extreme version) is a pretty great handheld that uses the latest AMD chipset with a sizable assist from Linux/proton efficiencies vs Windows to drive a 15-30% performance improvement which does make some more modern games more playable though it is significantly more expensive than the deck. I watched Retro Games Corps review of it yesterday. That said, if you’re okay waiting another couple years or so I bet there will be a Steam Deck 2 release but it seems like it mainly rests on AMD to deliver a significant (“generational”) leap with upcoming mobile APUs. Valve seems keen on not releasing a follow-up to the first deck until it is significantly better in every way and the chipsets available now just aren’t quite there yet it seems.
It sounds like we’re on similar levels of technical proficiency. I have learned a lot by reading and going down wormholes on how LLMs work and how to troubleshoot and even optimize them to an extent but I’m not a computer engineer or programmer for sure.
I started with LM studio before Ollama/Open WebUI and it does have some good features and an overall decent UI. I switched because OWUI seems to have more extensibility with tools and functions etc and I wanted something I could run as a server and use on my phone and laptop elsewhere etc. OWUI has been great for that although setting up remote access for the server on the web did take a lot of trial and error. The OWUI team also develops and updates the software very quickly so that’s great.
I’m not familiar with text-generation-WebUI but at this point I’m not really wanting for much more out of a setup than my docker stack with Ollama and OWUI
Mostly to help quickly pull together and summarize / organize information from web searches done via Open WebUI
Also to edit copy or brainstorm ideas for messaging and scripts etc
Sometimes to have discussions around complex topics to ensure I understand them.
Favorite model to run locally now is easily Qwen3-30B-A3B. It can do reasoning or more quick response stuff and runs very well on my 24 GB of VRAM RTX 3090. Plus, because it has a MoE architecture with only 3B parameters active when doing inference its lightning fast.
Interesting project. Is it actually possible to track workouts using your phone or smartwatch without needing proprietary third-party apps like Strava or Garmin Connect though?
Thanks! now I feel a bit lazy since there was a whole wiki article on their relations that I could have just looked up. Sorry it’s early in the morning here… appreciate it
Upvoted for the info about Greek support for Israel. I didn’t know that was a thing. Any other context for why that could be?
Oh no! I don’t have any frost on mine but I have several varieties of tomatoes and peppers that have been mostly uncovered for cool nights down to 40-42 F and have been worried about them a bit still.
Sure but that’s not as weird haha
I figured. Crazy the color though. Kinda cool. I will probably check the place out if I get a chance. I’m not too far away.
Interesting. What was the name of the shop? And what is activated charcoal coconut? I’m assuming it isn’t just charcoal since that would probably taste terrible haha
Interesting. I have always felt that the Steam deck loses quite a bit of battery percentage during sleep. I agree that it would be a fantastic quality of life update to enable to shut down or enter some form of lower power consumption hibernation state after a period of time at a certain battery level.
I think some of the responses here, while they may be well-intentioned, are a bit off base because they are confusing the word ‘normal’ (which is what you are asking) with ‘recommended’. Is it normal for someone in your position who has had a lot of time alone due to your health challenges to want more social outlets and someone to talk to? Absolutely. Is it normal to see a character in a work of art (a video game, movie, show etc.) and become attached to them in some degree? I would say yes. Most of us have done that at one point or another. Is it normal to want to be able to communicate with this person to help provide a social outlet and a listening ear for someone in your situation? Again, I’d say probably yeah. Now, is it recommended to have an ‘AI’ like this as your primary social outlet or to see them as a real human friend or even romantic partner? That is much more questionable. But, personally, with the context you provided and the challenging situation you have been in I think the tendency towards doing this is still quite normal and understandable. I think you should strive to validate your feelings of loneliness and the understandable desire to assuage those feelings with what you have available to you in a challenging and socially isolating environment while still understanding that an ‘AI’ like this should not ideally be your primary social outlet and to strive to find more ways in the future to connect with real people who care and are interested in you (and vice versa). It may not seem like it right now, but they are out there! I wish you peace and a speedy recovery!
Can’t speak to those but I just got a GameSir G7 controller for like $28 and it’s great. I usually play with the Xbox One controller on my PC but the Dpad was shitting out as well. It does have a couple buttons on the back but you could just ignore them if you don’t like them. Otherwise I can’t tell the difference between OEM and this one. Also has those ‘hall effect’ joysticks to avoid stick drift.
Yeah, it’s a great game. I didn’t quite do the full completionist thing, but I told myself I’d get at least 95% of all of the banandium gems for each level and that would be good enough haha.
I actually do like roguelikes and might check this out because if it does have a good gameplay loop it will have a ton of replayability as opposed to a DLC that just adds another world or two and you’re done with it in four hours. It’s cool they’re offering a demo as well.