A bracket is considered broken when you can see that it's off centered and it can slide back and forth along the wire. If the bracket is not causing discomfort, it could be left in place; you may wish to place orthodontic wax to minimize the movement of the loose bracket.
If the loose bracket has rotated on the wire (you can't see the "O" ring) and is sticking out, using your fingers or a pair of tweezers you may attempt to turn it back into its normal position. Apply wax to minimize the movement of the loose bracket.
If the bracket becomes extremely bothersome you may attempt to remove the bracket from the wire. Using a pair of tweezers or a small unbent paper clip, remove the "O" ring (usually the "O" ring is a colored elastic around the brace) from the bracket. Slide the bracket to the interproximal area and remove the bracket from underneath the wire (see pictures 2-3)
1) 
2) 
3)