Originally Posted by
Reticuli
In science, non-blinded data gathering and testing is not useless. In electronics repair, non-blinded testing is not useless. In quality assurance, non-blinded testing is not useless. In the development of new products, like codecs, non-blinded testing is not useless. There was the case of, I think it was one of the big European broadcast standards groups, where they did blinded testing with a great many people who heard nothing wrong with the output of a new codec. Test subjects did not know which was the test track and which was the original. It took a single golden ears outside engineer later who knew it was a test track to hear there was a spurious tone that a glitch in the codec had embedded, which was then confirmed with actual measurements. Useless non-blinded observation? Confirmation bias in observation and later measurement? Lack of utility? Hogwash. The codec was improved as a result. That's as empirical as you can get. The blind tests using random test subjects were showing one thing: that the average listener was a poor critical listener. There is certainly a hierarchy of power in science with blinded data gathering and testing above non-blinded, because bias and preconceptions in a variety of ways can influence results, knowingly or unknowingly. But that does not mean some Doctor Without Borders physician running a rapid TB test out in the boonies in Africa doesn't find utility in the test because he runs it on someone who's showing outward symptoms of TB. Pardon the pun, bro, but get real.