He would also say "melior foris quam intra" (better out than in). Oh wait, no, that was Shrek.
His choice of words is interesting. "Vae me" is extremely casual, and the verb "concaco" (I shit on), while not offensive, is still rather vulgar. However this was coming from someone who was rather worried about his public image, given that his predecessor (Caligula) has been assassinated, and Claudius was always trying finding historical figures to connect himself to. I'm almost sure that he did this sort of stuff to be casual, as an "ice-breaker", to become a bit more liked.