☆ Yσɠƚԋσʂ ☆

  • 3.46K Posts
  • 5.7K Comments
Joined 5 years ago
cake
Cake day: January 18th, 2020

help-circle


  • Actually we do know that there are diminishing returns from scaling already. Furthermore, I would argue that there are inherent limits in simply using correlations in text as the basis for the model. Human reasoning isn’t primarily based on language, we create an internal model of the world that acts as a shared context. The language is rooted in that model and that’s what allows us to communicate effectively and understand the actual meaning behind words. Skipping that step leads to the problems we’re seeing with LLMs.

    That said, I agree they are a tool, and they obviously have uses. I just think that they’re going to be a part of a bigger tool set going forward. Right now there’s an incredible amount of hype associated with LLMs. Once the hype settles we’ll know what use cases are most appropriate for them.




































  • That’s incredibly naive I’m afraid. This sort of logic works in very simple cases, but quickly breaks down in any complex scenario. The reality is that a lot of knowledge cannot be easily verified because it’s just too complex. Take a peer reviewed scientific study as an example, the study might reference a different study as its basis, that references another study, and so on. If one of the studies in the chain wasn’t conducted properly, and nobody noticed then the whole basis could be flawed. This sort of thing happens all the time in practice.

    What you really have is an ideology, which is a set of beliefs that fit together and create a coherent narrative of how the world works. A lot of the knowledge that you integrate into your world view has various biases and interpretations associated with it. Thus, it’s not an absolute truth about the world, but merely an interpretation of it.


  • Kind of hilarious how people in the west would always claims that the differentiating factor between them and countries like China was freedom of expression. Turns out what was really happening was that majority of people in the west were just swallowing their state propaganda uncritically, and there was no need for heavy handed censorship. Now that the state is losing control of the narrative heavy handed measures are promptly introduced.

    As always, the west is no different from its adversaries, but people in the west are gullible enough to think they’re special.