Yeah, sorry to say, that's just the Ilusionista's way. He's known for making very hard games - to my horror, as well. :(
I too will get very frustrated if he increases the "asshole-liness" of enemies, because I'm not a great player. True, I've gotten better (I got to play well with Emma, of...