They will come for your thoughts, and I’m not sure what your defense will be. For surely, they are better at thinking than you. That choice you are about to make, well you see, we have modeled your life, and have calculated you will be happier making this choice instead. And they aren’t wrong.

The effective altruists will fail, you’ll be able to see through their schtick. They will try to get you to act against your own interests for the interests of some hypothetical global good they made up. This is age old, and people generally aren’t that stupid.

But that doesn’t solve the real problem. When the clowns are gone and it’s just you and your aligned superintelligence, what will you do against the machine that knows you better than you know yourself? Your life will be better for listening, but if you do always listen, is it still your life?

Here’s to the rubble, a brick through every window
A casket buried six feet deep for everybody’s hero
Here’s to our lives being meaningless
And how beautiful it is because freedom doesn’t have a purpose
  – Pat the Bunny