ChatGPT banned in Italy over privacy concerns

post by Ollie J (Rividus) · 2023-03-31T17:33:10.345Z · LW · GW · 4 comments

This is a link post for https://www.bbc.co.uk/news/technology-65139406

Contents

4 comments

Italy has become the first Western country to block advanced chatbot ChatGPT.

The Italian data-protection authority said there were privacy concerns relating to the model, which was created by US start-up OpenAI and is backed by Microsoft.

The regulator said it would ban and investigate OpenAI "with immediate effect".

 

Alternative article available here.

4 comments

Comments sorted by top scores.

comment by Bezzi · 2023-04-01T08:21:18.928Z · LW(p) · GW(p)

Here is the original legalese document from the Italian authority:

https://www.garanteprivacy.it/web/guest/home/docweb/-/docweb-display/docweb/9870832

Replies from: dr_s
comment by dr_s · 2023-04-01T14:15:22.911Z · LW(p) · GW(p)

Italian speaker here. Skimming it, the short version is: it's unclear what happens to the personal data of the users (in reference to the requirements of GDPR), also there's no age checks nor guarantees that the AI won't just write porn or other inappropriate material at younger people. So it doesn't stand up to the standards of safety that Italian (and EU) law requires, and it has to be blocked unless it fixes that.

Good luck RLHF'ing your way out of this, OpenAI. The age thing I think is Italian exclusive, but the data protection stuff is EU-wide and other countries might follow up.

comment by Rudi C (rudi-c) · 2023-03-31T20:30:04.402Z · LW(p) · GW(p)

Does anyone have any guesses what caused this ban?

Replies from: dr_s
comment by dr_s · 2023-03-31T21:11:26.695Z · LW(p) · GW(p)

From what I understand, the reason has to do with GDPR, the EU's data protection law. It's pretty strict stuff and it essentially says that you can't store people's data without their active permission, you can't store people's data without a demonstrable need (that isn't just "I wanna sell it and make moniez off it"), you can't store people's data past the end of that need, and you always need to give people the right to delete their data whenever they wish for it.

Now, this puts ChatGPT in an awkward position. Suppose you have a conversation that includes some personal data, that gets used to fine tune the model, then you want to back out... how do you do that? Could the model one day just spit out your personal information to someone else? Who knows?

It's problems with interpretability and black box behaviour all over again. Basically you can't guarantee it won't violate the law because you don't even know how the fuck it works.