As you make a bigger and bigger mess, your human will act like you are destroying the place - ignore them!