Analogy to the Heisenberg Uncertainty Principle for Powerful AI?

Ah, I disagree - that's only the first question to ask if the person is used to having ideas. My human-simulator tells me that posts like this come from people who aren't used to having ideas - certainly not enough to throw them away - so are enormously taken with any they do come up with (c.f. Draco in HPMOR ch. 78 ) and are not used to the idea of robustness-testing of their ideas at all - they're still in the mode of thinking of them as aesthetic creations, and will not let go of them easily. Once they've got used to coming up with a few, they will then benefit from seeing what presumptions the ideas are coming from.

My aim here is to get them used to thinking of themselves as someone who can come up with ideas, rather than thinking that's a job for other people. (Noting there are cases where one really wishes they would leave coming up with ideas to other people, and encouraging the young always has its moments of gritting one's teeth at the same beginner's stupidity yet again.) If they're spewing out terrible beginner's ideas in disposable quantities, that's time to start some stringent culling mechanisms.

Again, the above is out of my human simulator, but I've spent some time on the difficult task of encouraging people to think of themselves as the sort of people who can do something rather than just the consumers of others' output, so I have slight experience of practical encouragement.