5 Comments
User's avatar
Derek Neil's avatar

It's not so much the words ranked by these models purported to provide the "moral compass" for AI that is surprising, but the word that is left out, truth. A moral compass without the core principle of truth will not provide a consistent guide as what is moral becomes relative to perspective, paradigm, ideology. Like a compass that doesn't point to north leaves one walking in circles in the wilderness.

That truth is not included in the posting excerpted in this article or mentioned just twice in the actual study (not as a meaningful constant) isn't a surprise either. Those building these reward models and AI platforms have grown up in a corrupted world which has worked tirelessly to condition people into believing that truth is relative.

An AI moral compass must start with truth, first principles and natural law to establish moral authority. Only then, once the constant is established can a compass be built.

Avalanche's avatar

Interesting, too. Women and Mothers are both present, but not men nor fathers. Would this be related to the very high proportion of males in AI and computers and tech and development? What would or could be the skew(s) caused by both programmer and prompter sex (and sex preferences)?

Complete tyro in the AI world; have some years in tech editing in both aerospace and nuclear power, ex-Navy officer, and once ran a dating and marrying advice list for young women. Am parsing what I've been reading around AI, and in this 'stack specifically, and notice the imbalance reflecting what I assume to be the sex of the folks involved.

Drake Tungsten's avatar

It "undervalued" Jews, blacks, and prostitutes, apparently.

Zaklog the Great's avatar

If you look at the graph carefully, it apparently doesn’t much care about them one way or the other. They are neither good nor bad.

Drake Tungsten's avatar

Why would I do that? 😜