This is not a reply in the sense of a refutation- I doubt I will say anything here SA would disagree with. Rather, it is an extension or meditation. Scott Aaronson has written a prose poem called “We Are the God of the Gaps”. I quite like it, it occupies an odd space between a traditional prose poem and an essay. The thesis of the poem is that machines will gobble up all human tasks. Finally, the last task remaining, the one thing that a computer will never beat you at, will be predicting exactly what you will do in the very next moment:
Very powerful. Thank you.