thefunkycomitatus [comrade/them, they/them]

  • 1 Post
  • 8 Comments
Joined 5 years ago
cake
Cake day: July 29th, 2020

help-circle




  • I’m a little curious how the AI version works with much accuracy. If the context window is like 1M tokens, that sounds like a lot. But it would have to tokenize the whole book and that book gets fed into prompt behind the scenes with every question. Everytime you ask a question not only is the LLM having to process your question, but it gets fed the entire prompt + book. Plus it gets fed all your previous conversation for the session. If you’re asking it questions about a Dostoevsky book, you’re probably going to fill up the context window pretty fast if not immediately. Then it will just start hallucinating answers because it can’t process all the context.

    If they’re doing something fancy with tokenization or doing some kind of memory thing, then it seems like it would be suited for a standalone program. But it also says they’re using local LLMs on your computer? I mean those are going to have small context windows for sure. It seems like bloat as well. In order to run those models locally, you need to download the tensors. Those are several GB in size. I don’t want my e-book library management software to do that.





  • I’m kind of hoping it will be like a new Marvel movie and not do as well as the previous one. But I also think we’re seeing the nature of gaming transform. We’re going from these solitary or multiplayer experiences to a viral, meta experience. People will buy the game because doing so will allow them gain social media influence. Right now there is some no-name gamer youtube channel that will be a millionaire in a few years due to this game. That’s already what we have seen. Aspiring influencers latch on to a viral game and then gain a massive following, even off of one or two games. You get people not only racing to finish the game first but videos on how to do things in the game, details, bugs, lore, speed running, glitches, cheats. Go see how many “Details in RDR 2” videos there are on youtube and how successful they are. Then you get the periphery content of visiting the real locations, cosplay, and humor.

    There will be a goldrush to be one of the GTA 6 influencers. Then all that hype will drive further sales in people who just want to play the game. Even if the sentiment on GTA has cooled, the increase in social media from 2012/2013 to 2028 will drive interest.

    My theory is that Rockstar already knows this. They’re designing the game around this idea. I also think it’s the present and future of corporate game development overall. God knows what monetization they have cooked up since shark cards and how that ties into all this. The depravity will be astounding. I’m waiting to see if they do any partnerships with influencers. There were also rumors that the game will have a social media simulator that’s more in-depth that V’s facebook parody. Who knows if that’s real or how it would relate to the monetization and real social media.