15 Comments

" there is no such thing as a “mind” back there in Gemini producing the answers."

And for that reason (as others have pointed out) "hallucination" is an inappropriate term that adds to the confusion. "Fabrication" is better. It doesn't capture the drunkard's walk, but it doesn't force you to adopt a theory of mind. (Now I must go, there are more clouds that need to be yelled at.)

Expand full comment

Telling that they get so exercised about the image of a Black pope, which is something that's perfectly plausible and likely to happen, I'd think, inside the next century, as the African church gets bigger and the European and North American churches continue to shrink--but nobody screams about the image of a female one, which would be impossible without radical change in canon law. Wonder what that's expressing?

Expand full comment

I got the image of a black Pope when I asked AI, "When the US has peace, full employment, and low inflation, what will be our biggest problem?"

Expand full comment

The Black Pope was supported by the Black Guelphs, I presume.

No, it's not a good idea to outsource your "research abilities or critical faculties or moral compass to the probabilistic text generator"; but more generally, I am skeptical of Bayesianism as an epistomology.

Expand full comment
Feb 29·edited Feb 29

So this is the start of the "Destroyer" program from Piers Anthony's "Macroscope"?

Expand full comment

This post was indeed hilarious. Pichai is clearly upset at the performance of Gemini - although it couldn't produce "woke" code or simple statements of fact, could it?

That various techbros were allegedly demanding his resignation is bizarre. Shouldn't they demand their fellow billionaire, Elon Musk, to resign for destroying Xitter and turning it into a Nazi-bar?

A black pope. A black,female pope? The horror!

Maybe Gemini is just a blip, or maybe we have reached the peak of the hype cycle for LLMs. We may know over the next 5-10 years.

Expand full comment

I don't understand the problem. They didn't ask for a picture of a white pope or a particular pope or a pope from a particular time frame. It's like every other cursed API in the computer world. You never want the default settings, and there are always a bazillion settings you might have to set to get the most obvious thing done in a reasonable manner. Companies like Microsoft and Cisco offer courses and certifications rather than coming up with a reasonable default behavior. Expect to see the big profits in AI coming from courses and certification in prompting, and, remember, natural language embeds even more ambiguity than computer language.

Expand full comment

Historically, Google has always been out of touch with its clients. Its cash flowing search engine has flowed with endless dollars and they modified it as they wished. It was the advertisers and markets job to keep up with the changes. So unrepentant were the leaders Brin and Page, they hardly bother to show up at the stockholders meetings. Gemini is merely a symbol of how they feel about their clients. Interesting that they unleashed it without proper feedback, functioning as programmed. Nevermind the pictures. What was on full display was their internal culture. Let the market punish them. It must be a new sensation for them.

Expand full comment

Hexapodia! an insightful podcast by DeLong Technology Systems and its ChatbBot Noah Smith.

Expand full comment

"I did not think that Chat-GPT needed to be shut down ... when Chat-GPT told me that ....Noah Smith was... a ChatBot maintained by DeLong Technology Systems."

Lol! I'm not a Turing-whatever, but I could've told him that to make him happier. Well said and funny to boot. To engage further with the fun, it looks like cognitive dissonance along with many other grievous cultural maladies are gonna be a huge social problem. I imagine a lot of cursing at the monitor in the years ahead. In many languages.

Expand full comment

So, I asked ChatGPT "Have there been any black popes?" This is its reply:

"As of my last update in January 2022, there has not been a pope of African descent. The papacy has been predominantly held by individuals of European descent, particularly from Italy. However, it's worth noting that the potential racial or ethnic background of future popes cannot be predicted with certainty, as the selection process for the papacy, carried out by the College of Cardinals, is based on various factors including qualifications, leadership qualities, and theological beliefs rather than race or ethnicity."

And people are mad that when asked to draw a picture of a generic "pope" it drew a black guy. Look in the mirror, friends.

Expand full comment

"very important that the class of admissible images of popes contain only white men."

??? Only men The next Pope might very well be outside the narrow concept of "white." [As an old East Texas boy, "white" to me means "not descended from previously enslaved people, like those people on t other side of the T&NO railroad tracks."]

OTOH, it does seem like a genuine systematic error, one that should have been picked up in testing, that when asked to produce a picture of Nazis the machine did not consult pictures of real Nazis and when asked for a black pope consult images of real popes before modifying the skin tone.

Expand full comment