Capitalization of a word after quotations?

It is grammatically incorrect to capitalise 'he' following the exclamation mark. It is a single, complete sentence, and you do not capitalise the part of the sentence outside the quotation marks.