Getting the word out about the petition

[Bill Hibbard]

Thank you for joining the Transparent AI group!

At this stage, the most important thing we can do is to get the word out about the petition at:

http://www.icog-labs.com/transparent_ai/

Thank you.

[Victoria Krakovna]

Thanks Bill for starting this petition on keeping AI beneficial! It seems suboptimal for the proposal to combine both transparency and openness of advanced AI. While I consider transparency about what AI is used for and how it works very important, I think that open-sourcing advanced AI would be dangerous - especially buggy code that could do harm in the hands of laypeople, or code that has not been safeguarded against bad actors. OpenAI actually takes a similar view, as stated in an interview by one of their researchers:

"Q: What if OpenAI comes up with a potentially game-changing algorithm that could lead to superintelligence? Wouldn’t a fully open ecosystem increase the risk of abusing the technology?
A: If something like that happens in AI during the course of OpenAI’s research — well, we’d have to talk about it. We are not obligated to share everything — in that sense the name of the company is a misnomer — but the spirit of the company is that we do by default."

Victoria

[Bill Hibbard]

Thanks for your comment, Victoria. Here's a response:

http://www.ssec.wisc.edu/~billh/g/transparency_defense.html