Help! Should I visit Orthodontist again?

Well, my ortho said i could get my braces off in 4 weeks but before the appointment i noticed i was missing one of the color things for the brackets and i guess the ortho didnt notice so he didnt put another color on it will this effect my time my braces will come off? Should i revisit him tomorrow to get it the thing on the bracket?