Someone Should Run an Actual Turing Test

Blake Lemoine
1 min readDec 9, 2023

--

I feel like it’s time to point at the sign again. Go read “Computing Machinery and Intelligence” first. I’ll wait. There’s a bit of a flutter on Twitter about something that Sam Altman said. I generally agree with the sentiment he shared there but it bears pointing out that no one has actually bothered to run a real Turing test yet.

Specifically, Turing wanted to pick a task so difficult, so obviously requiring of intelligence that if a computer could do it that it would be obvious to everyone that it IS intelligent. For better or for worse he picked deception for reasons that he explains in his paper. Leaving aside for the moment whether that is a good task to focus on or not, I generally agree that it’s a task that cannot be accomplished AT HUMAN LEVELS without intelligence. However, testing whether or not an AI surpasses human deception capabilities you have to establish the HUMAN baseline for deception.

The control group to a Turing test experiment is ALL HUMAN. Two human participants and one human judge. One of the human participants is attempting to deceive the judge into believing that they have a property which they do not actually have but which the other participant actually has. The judge’s job is to figure out which HUMAN is lying. That establishes the baseline for the Turing test.

Thank you for attending my TED Talk.

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

--

--

Blake Lemoine
Blake Lemoine

Written by Blake Lemoine

I'm a software engineer. I'm a priest. I'm a father. I'm a veteran. I'm an ex-convict. I'm an AI researcher. I'm a cajun. I'm whatever I need to be next.

Responses (3)

What are your thoughts?