Why can you call a liberal a leftist but can't call a conservative a rightist?

Because they're always the wrongest.