If there are other players at the table I usually wait until all the cards are dealt then count the table, or each hand individually as its played, but I admit to sometimes lapsing into following each card out of the shoe and my eyes dart back and forth, possibly being a give away to counting.

The other day I notice the floor hawking the table and I don't know if he was hawking me or not, I never made eye contact, so I used the occasion to just watch my cards and the dealers cards and take the count by catching the cards out of the corner of my eye.