Much ado about a dress: how perception skews interpretation

March 1, 2015

Methods, Research, Theory

This week generated a meme which nearly melted the internet: the case of the gold or blue dress. A picture of dress worn at a wedding was seen by some people as being gold and white and others as blue and black. A riotous global argument that cast friends and lovers against one another ensued.

While a seemingly silly issue at base, fact that this went viral points to how quickly we become disturbed when our version of reality is called into question. Anyone who tries to trick a child on a matter of perception will similarly raise angry protestations: people become disturbed when what they see or experience is fundamentally called into doubt. The incident also observes how easily different people can perceive things in completely different ways.

This raises a central challenge for data analytics: how do we validate and socialize the conclusions we derive from data analytics when different people may perceive completely different patterns? How do we validate the conclusions we draw from data?:

28dress1-web-blog427

Gold and white or blue and black?

The fact that so much consternation was generated by the lack of ability to generate a consensus on the dress color was, as a larger phenomenon, quite interesting. Indeed, this raises a fundamental issue from the philosophy of science: how can we rely upon empirical observations if they too are filtered by our perceptions.  And, if our perceptions lead to different conclusions, how can we achieve consensus in order to form scientific propositions?  Such arguments led the 20th century attack against pure positivism.

The fact that so many people apparently saw two markedly different color schemes deeply disturbed (or perhaps just deeply annoyed) many. Even when we do reach a consensus, there is always the looming threat that new information may appear which invalidates our original assumptions (the famous black swan of Karl Popper).  How do we know anything at all, especially when the world cannot agree on the color of a dress?

Popper applied a structured set of arguments to posit that we cannot know anything through pure induction (i.e. pure empirical or sensory observation). Even when perceptions are validated by consensus and scientific measurement, the possibility of future disconfirming evidence always exists. As such, he proposed that we can only falsify theory – we can only propose that a hypothesis is not NOT true based on observations.  As well, for a working theory to be valid, it  must clarify the conditions under which the theory can be disproven: the principle of falsifiability.

Karl_Popper

The power of reason: Karl Popper

In the case of the fateful dress, we can only posit an empirical perception of the picture, which is essentially an opinion, but the “real” truth is found by actually locating the dress and viewing the “real” color in strong light (this was done and the answer is… BLUE!). Yet, is this enough: can we also admit that there are similar dresses that may appear blue-like under certain conditions, but are actually gold?

Why are we spilling electronic ink on this? It is a fundamental, but troubling topic which underlies the analytics movement:  how do we validate conclusions drawn from data analytics?  The answer is that we must frame conclusions as hypothesis which are capable of being falisified (of being proven false). Additionally, we must supply the caveats for any confirmatory evidence that has been gathered and produced.

For instance, lets say we are proposing that a particular type of customer likes a particular type of product more than another. We can use a statistical test to examine correlation via significance testing.  Such a test attempts to show that there is a lack of evidence for the null hypothesis, that is, for the disconfirming case that there is no correlation.  If we reject the null hypothesis (as per falsification), we have suggested that at some threshold level (i.e. 95%), evidence of NO correlation is not supported based on our sample.

The crucial thing for data scientists is to keep in mind that we have only proven that the proposition is not NOT true in the specific test on the specific data sample.  Thus, we admit that more data may change the conclusion and that the theory is always open to being disproved.  Ideally the conditions for disproving the theory become clearer in the process.  For instance, the test may suggest that a different data sample would be useful to increasing confidence.

Without this very frank treatment of the errors possible in both sampling and hypothesis testing, data analytics experts can indeed reach a point where a blue dress appears gold.  We can fool ourselves and believe, through tricks of perception, that we have validated something when in fact we are seeing a trick of the light…

For the full ‘Dress that melted the internet’ story in the NY Times – and now you know you are really killing time 😉 

About SARK7

Scott Allen Mongeau (SARK7) is an INFORMS Certified Analytics Professional (CAP) and a Data Scientist in the Cybersecurity business unit at SAS Institute. Scott has over 20 years of experience in project-focused analytics functions in a range of industries, including IT, biotech, pharma, materials, insurance, law enforcement, financial services, and start-ups. Scott is a part-time PhD (ABD) researcher at Nyenrode Business University. He holds a Global Executive MBA (OneMBA) and Masters in Financial Management from Erasmus Rotterdam School of Management (RSM). He has a Certificate in Finance from University of California at Berkeley Extension, a MA in Communication from the University of Texas at Austin, and a Graduate Degree (GD) in Applied Information Systems Management from the Royal Melbourne Institute of Technology (RMIT). He holds a BPhil from Miami University of Ohio. Having lived and worked in a number of countries, Scott is a dual American (native) and Dutch citizen. He may be contacted at: webmaster@sark7.com All posts are copyright © 2015 SARK7 All external materials utilized imply no ownership rights and are presented purely for educational purposes.

View all posts by SARK7

Subscribe

Subscribe to our RSS feed and social profiles to receive updates.

No comments yet.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: