thats completely false when you only ask the llm a very basic question like “what color is the sun?” you need to talk to the model like its smarter than a google search engine. “what color is the sun? pull the data from scientific articles and other sites that study the sun”
if you google the first question, you will have list of different pages, where if you use AI to search on your query, it will model an answer from thoese sources, with said sources linked, similar to a Wikipedia page.
There are thousands of papers on the color of the sun, its trivial to google a paper, if you need an LLM to do this, that’s on you. But if you ask it valve clearances for an indonesian motorbike in english, it will make it up, even though the service manual is available in Indonesian. If you ask it how to synthesize a chemical that nobody bothers to write about because its uninteresting or impossible, it will straight up lie.
OK, instead of “lie”, I should have said it produces incorrect information any time the answer isn’t obvious from a cursory google search, and does so in a way that deceives anyone who isn’t already familiar enough with the subject that they didn’t need to ask in the first place.
It’s fine for asking it to generate answers you could have typed out yourself, such as boilerplate code and “what color is the sun”.
thats completely false when you only ask the llm a very basic question like “what color is the sun?” you need to talk to the model like its smarter than a google search engine. “what color is the sun? pull the data from scientific articles and other sites that study the sun”
if you google the first question, you will have list of different pages, where if you use AI to search on your query, it will model an answer from thoese sources, with said sources linked, similar to a Wikipedia page.
There are thousands of papers on the color of the sun, its trivial to google a paper, if you need an LLM to do this, that’s on you. But if you ask it valve clearances for an indonesian motorbike in english, it will make it up, even though the service manual is available in Indonesian. If you ask it how to synthesize a chemical that nobody bothers to write about because its uninteresting or impossible, it will straight up lie.
i think that learning to prompt AI is somthing people lack as a skill and then call it bad and a liar like its some intelligence when it isn’t
IMHO, the real problem is that it sounds just as “confident” whether the answer is accurate or not.
OK, instead of “lie”, I should have said it produces incorrect information any time the answer isn’t obvious from a cursory google search, and does so in a way that deceives anyone who isn’t already familiar enough with the subject that they didn’t need to ask in the first place.
It’s fine for asking it to generate answers you could have typed out yourself, such as boilerplate code and “what color is the sun”.