うしろゆびをさす

To talk behind someone's back

Point指 your finger指 at someone from behind後, i.e., when they are turned away and cannot notice