I actually feel that leaderboards are mostly bad only when there are too many people participating. With a small enough number of participants they can be motivating (although they might be better yet if they were opt-in). There are a subset of people that like to rank themselves and "see how they stack up" against others. As you mentioned, it can also degrade motivation for others which is why an opt-in method might work best for something like this.