Contrary to expectations; "he didn't stay home; on the contrary, he went out with his friends".
In a contrary disobedient manner.