It's indeed the opposite of science, but the average person doesn't have the time, patience or energy to be doing science. Thus the need to put the trust on people that do because they're often right. If anything, when you see them appealing to the wrong or vague authority, you could provide better options or become one yourself.