The Fundamental Problem with AI
The biggest problem is easily fixed
That explains a considerable amount of the fundamental problem of AI right there. The first wave of AI systems are trained on absolute garbage, literally the dregs of the Internet. Wikipedia is bad enough, but Reddit is the most-biased, least-accurate source on the planet one can find outside of professional PR firms.
It’s not going to be hard for iAI to surpass dAI performance simply by virtue of not training it on unreliable garbage.
Some early AI research was trying to understand why the AI had strange connections. They created a view into the AI's patterns and followed it back to the training data. They discovered that there was a subreddit full of autists who spend their time counting together. "5,600,201", "5,600,202" ... Millions of posts of number sequences, all fed into the AI.
The LLM noticed the pattern of specific redditors posting a large amount of numbers, and treated that as a relationship between those numbers and their usernames.
It never occurred to me that they would not sanitize the inputs before using the Internet as LLM training data. Garbage In Garbage Out.
Super Intelligence: Trained on the output of 85-115 IQ people who are bored and looking to waste time.