Any "sport' that relies on opinion of group of people is NOT sport.
This is the sort of argument I would expect from a grade school student. Virtually every sport has judges, even time based sports (who do you think makes the false start calls in track) while their involvment may be less obvious many a race has been affected by their judgement calls.
The reason for having a group of judges in the more subjective sports is to minimize the effects of favoritism and for the most part this works fairly well. The biggest difference in figure skating is all us armchair judges out there actually have online forums where we can endlessly debate this GOE score or that UR call or thousands of other bits of minutia.