Why I am not impressed by A.I.
Why I am not impressed by A.I.
You're viewing a single thread.
152 comments
-
That happens when do you not understand what is a llm, or what its usecases are.
This is like not being impressed by a calculator because it cannot give a word synonym.
-
But everyone selling llms sells them as being able to solve any problem, making it hard to know when it's going to fail and give you junk.
-
And redbull give you wings.
Marketing within a capitalist market be like that for every product.
-
Is anyone really pitching AI as being able to solve every problem though?
-
-
Sure, maybe it’s not capable of producing the correct answer, which is fine. But it should say “As an LLM, I cannot answer questions like this” instead of just making up an answer.
-
I have thought a lot on it. The LLM per se would not know if the question is answerable or not, as it doesn't know if their output is good of bad.
So there's various approach to this issue:
- The classic approach, and the one used for censoring: keywords. When the llm gets a certain key word or it can get certain keyword by digesting a text input then give back a hard coded answer. Problem is that while censoring issues are limited. Hard to answer questions are unlimited, hard to hard code all.
- Self check answers. For everything question the llm could process it 10 times with different seeds. Then analyze the results and see if they are equivalent. If they are not then just answer that it's unsure about the answer. Problem: multiplication of resource usage. For some questions like the one in the post, it's possible than the multiple randomized answers give equivalent results, so it would still have a decent failure rate.
-
Why would it not know? It certainly “knows” that it’s an LLM and it presumably “knows” how LLMs work, so it could piece this together if it was capable of self-reflection.
-
It doesn't know shit. It's not a thinking entity.
-
Precisely, it's not capable of self-reflection, thinking, or anything of the sort. It doesn't even understand the meaning of words
-
-
-
152 comments