[LINK] Sentient Robots Not Possible According To Math Proof

post by Darklight · 2014-05-14T18:19:59.555Z · LW · GW · Legacy · 13 comments

Based on Tononi's earlier work on Integrated Information Theory, apparently, Maguire et al. have come up with a formulation of consciousness as a lossless integration of information that requires noncomputable functions, which implies that consciousness cannot be modeled computationally.

http://www.newscientist.com/article/dn25560-sentient-robots-not-possible-if-you-do-the-maths.html

I'm personally skeptical of this, but their paper (seen here: http://arxiv.org/abs/1405.0126v1) has some impressive looking formal mathematical proofs that I will admit I lack the mathematical competence to judge the veracity of.  Anyone with greater mathematical acumen want to take a look?

13 comments

Comments sorted by top scores.

comment by Douglas_Knight · 2014-05-14T18:50:31.640Z · LW(p) · GW(p)

These authors argue that consciousness should be based on lossless integration, otherwise the memory traces would be affected each time we remember something. Problem is, this is exactly what happens.

- Jay

Replies from: V_V
comment by V_V · 2014-05-14T22:04:37.228Z · LW(p) · GW(p)

So they basically tried to model an infinite memory system and it turned out that it wasn't consistent with physically plausible computational systems. Big deal.

comment by [deleted] · 2014-05-14T18:26:47.708Z · LW(p) · GW(p)

As with most papers in this genre, the trouble probably won't be the math. The trouble will be in the interface between the math and the thing it's supposed to be describing.

Replies from: lukeprog
comment by lukeprog · 2014-05-14T18:32:05.807Z · LW(p) · GW(p)

Yup. In particular, most people I know don't take Tononi's theory of consciousness seriously, and neither do I.

Replies from: Transfuturist
comment by Transfuturist · 2014-05-15T18:44:30.429Z · LW(p) · GW(p)

What are the problems with Tononi's theory? Can you even call it a theory? I thought it was more of a paradigm.

comment by Mestroyer · 2014-05-14T20:13:56.007Z · LW(p) · GW(p)

This is the kind of thing that when I take the outside view about my response, it looks bad. There is a scholarly paper refuting one of my strongly-held beliefs, a belief I arrived at due to armchair reasoning. And without reading it, or even trying to understand their argument indirectly, I'm going to brush it off as wrong. Merely based on the kind of bad argument (Bad philosophy doing all the work, wrapped in a little bit of correct math to prove some minor point once you've made the bad assumptions) I expect it to be, because this is what I think it would take to make a mathematical argument against my strongly-held belief, and because other people who share my strongly-held belief are saying that that's the mistake they make.

Still not wasting my time on this though.

Replies from: Luke_A_Somers
comment by Luke_A_Somers · 2014-05-16T02:45:25.813Z · LW(p) · GW(p)

To be fair to yourself, would you reject it if it were a proof of something you agreed with?

If they had gone out and 'proven' mathematically that sentient robots ARE possible, I'd be equally skeptical - not of the conclusion, but of the validity of the proof, because the core of the question is not mathematical in nature.

comment by jimrandomh · 2014-05-14T18:50:39.719Z · LW(p) · GW(p)

None of the words in that paper's abstract mean what they conventionally mean, nor do they mean what they sound like they mean, nor do they mean things that are useful. This is an esoteric point about math, couched in words that falsely resemble philosophy of mind.

The paper does not use the word "sentient" anywhere. That was added by New Scientist.

comment by Gav · 2014-05-15T04:41:59.510Z · LW(p) · GW(p)

From the paper: http://arxiv.org/pdf/1405.0126v1.pdf "In particular, memory functions must be vastly non-lossy, otherwise retrieving them repeatedly would cause them to gradually decay. " I wonder if they've ever met a human being? That's pretty much how we work. Memories don't so much decay as get influenced slightly every time we remember them. That's one reason why they get witnesses to crimes to write stuff down straight away, rather than waiting till a trial, etc.

Sigh. To go from 'brains are pretty good at storing information' to 'therefore brains must never leak lose data in an information theoretic sense' is so misleading that it makes me wonder if it's deliberate.

They seem to be doing this to build up the argument that a non-lossy consciousness isn't computable. (And therefore, humans are special. ) The irony is that they're trying to make human consciousness special by making it more stereotypically robot-like, by implying it can't lose information.

comment by shminux · 2014-05-14T21:07:24.475Z · LW(p) · GW(p)

As Douglas_Knight's link points out, the lossless integration model has been falsified experimentally, so the "formulation of consciousness as a lossless integration of information" does not apply to the actual observed consciousness. The math may or may not be interesting in itself, but it has no bearing on whether "sentient robots" are possible. Fortunately, the authors' conclusion is suitably qualified (emphasis mine):

This result implies that if unitary consciousness exists, it cannot be modelled computationally.

Replies from: fubarobfusco
comment by fubarobfusco · 2014-05-15T00:50:51.663Z · LW(p) · GW(p)

In other words, well, unitary consciousness doesn't exist. Score one more for the Buddhists.

comment by David_Gerard · 2014-05-15T18:11:39.769Z · LW(p) · GW(p)

This is terrible even by New Scientist standards. I do wish they'd stop writing up random arXiv ramblings as if they'd even passed basic peer review. (Conference proceedings generally haven't.)

Replies from: Darklight
comment by Darklight · 2014-05-15T21:06:58.911Z · LW(p) · GW(p)

I'm not sure what conference proceedings you've been looking at, but the ones I've managed to publish in generally do have basic peer review (I know because I got comments back from the reviewers).

Though, whether or not the quality of peer review done by conferences is any good is another matter entirely.