I have always been concerned about the trivialisation of serious issues by some popular authors (often journalists). The general approach is to pick up some partially understood theory, find a few hundred illustrative examples which can be used to fill out the chapters and then sit back while the money rolls in. To complete the process you then charge speaker fees of $80K to recite material that people have already read in your book. Now there are several examples, and the books are not all bad, they contain useful material, they create awareness, but the simplistic causality demanded by the genre does little service to serious work.
It's always nice when someone takes them on, and thanks to Wayne for this article by Duncan Watts of Columbia University. He challenges Gladwell's idea that you have to target influencers, connectors and mavens to get your ideas out. Watts has three fairly simple arguments:
- You can't create a crude category like influencers because different people and groups work in very different ways, I quote: whatever theory applies to Oprah Winfrey probably doesn't apply to Anna Wintour, let alone the local hipsters. In blending them all together under one vague label, it becomes impossible to specify how influentials are supposed to make anything happen, and therefore to evaluate whether or not the claim is correct
- His second reason will resonate with anyone with even the most basic understanding of complexity theory: Common sense notions of cause and effect are deeply misleading with respect to social processes
- His third point is the most critical and applies to most of the popular books: Data gathered retrospectively is biased
This last point is at the heart of my objection to the popularisers; it is all too easy to find facts to fit theory when you use hindsight. It is also far too easy to draw causal chains backwards. In respect of influencers Watts makes the point well: The natural (and almost universally practiced) thing to do is to follow the story back in time until the "beginning" and see what led to what. As part of this process, we will almost certainly find (if we're looking for it, anyway) that near this beginning, a few people were doing things (trying out the style, promoting the book, etc.) that subsequently became very widely copied. At this point, in part because of the sloppy thinking described in (1) and the common sense notion of cause and effect described in (2), the temptation to label these people influentials, and to assume they are somehow special, is almost overwhelming. For the same two reasons, it is very hard to disagree with.
It is rather like blaming the butterfly flapping its wing in the Amazonian Rain Forest for the Hurricane in Texas. If you could then killing the butterflies would stop the hurricanes, or creating the right robot butterfly could create a devastating weather based weapon of mass destruction. In a complex system small things lead to large effects, but it is multiple interacting small things, not a linear track to the butterfly.
Now its interesting that there seems to be a first/second book syndrome here. Tipping Point (despite the criticism above) is, overall not a bad book with some useful material while Blink is truly terrible in use of selective cases. We see the same thing with Taleb. Fooled by Randomness, was a timely book, well written and useful, but then we got Black Swan which again has good examples but over generalises its theory. Taleb in other writings is also overlaying a strong political ideology (I have blogged this before but can't find it for the moment) arguing that US market capitalism is the best method to handle surprise. I wonder if that is true of Global Warming?
Mind you the title of Taleb's latest put me off. The discovery that some swans were black is used an an illustrative example of identity in philosophy. All the swans you have seen are white, so you include the whiteness in the definition of a swan, then you find you are wrong. No one was particularly surprised, interested possibly, certainly it was neither high impact or unpredictable.
Comments (5)
See also "Is the Tipping Point Toast ?" article by Clive Thompson in this month's issue of Fast Company. The long interview with Watts goes over some similar ground, describes how he tried reproducing the Milgram "six degrees of separation" experiment, and how he upset the (American) advertising industry. Watts is now on sabbatical at Yahoo working on his "Big Seed" marketing approach. Oh and you will hate the "order vs chaos" diagrams in the article.
Posted by Cheryl Cooper | February 4, 2008 11:08 PM
Posted on February 4, 2008 23:08
I have given up reading books by journalists on scientific subjects unless highly recommended by someone I trust. The ones I particularly don't like are ones like a complexity book written by a journalist I read some time back that started something like "while the sunshine was bright on the desert landscape horizon I was just thinking of those lovely blue eyes from the last time I met scientist X in the gorgeous mountains while the snow ...." But Watts, a mathematician (he is Australian for those who like to know) is a true expert in this field and he is also very helpful. He has written to me a couple of times to help out with solving some of the implicit functions in one of his books (his "Small Worlds" book published by Princeton. He was very courteous and helpful. And he as also published an extremely well written popular book "Six Degrees" (at least 3 different publishers). What is particularly good about the book is that he is very careful to describe the problems associated with this type of mathematics and its limitations.
But your quotes here Dave certainly highlights big warnings for those undertaking social network analysis. I have once been seriously disliked for challenging such a diagram by repeatedly asking about the nature of the relationships, the implicit assumptions that have gone into defining and constructing them and how they were reading recommendations from them. Watts article is an excellent one to rebuff some of the social engineering practices of social scientist using these tools.
Posted by Peter Stanbridge | February 5, 2008 10:07 PM
Posted on February 5, 2008 22:07
Cheryl, the "Is the Tipping Point Toast?" article is very interesting - What do you make of the conclusion? Mass marketing is still *likely* to be more effective on probabilities than targeted toward "influentials". (I have added the "likely" and "probabilities" because this is what Watt's work really addresses. I expect he doesn't imply that there are no circumstances in which aiming to a market will improve success). Another interesting point is that it would appear that exponential growth is extremely rare and can't be accounted for by standard models and certainly not available on by design. There is also an interesting paradox in some of the work claiming to be associated with eco-system landscapes.
I was involved on a project called the digital business eco-system (http://www.digital-ecosystem.org/) where a primary premise of the project was based on the power law distribution of scale free networks - in other words, that the core network nodes would act as influencers in the eco-system. Strangely, the project then took great pains to use social network models and other models relating to power law networks to determine policies to guarantee fairness in the eco-system and provide the "appropriate" behaviour and type of participants. I always thought this was more akin to creationism than evolution but it would appear from Watt's work it would be all in vein anyway.
Also Cheryl, I didn't see any "order vs chaos" diagrams in my version of the article and couldn't find any.
Posted by Peter Stanbridge
|
February 6, 2008 9:15 AM
Posted on February 6, 2008 09:15
My favorite metaphor about retrospective attribution is the one of the nasty dolphins.
Common knowledge is that dolphins like humans and rescue reople in danger of drowning by bringing them back to the shore. Whereas: they just bring them in any direction, at random - but those who (just by chance) are brought to the cost survive and can spread the story of the dolphin who saved their life. And you will never hear the stories of the others ...
More seriously: we have this problem in statistical analysis of e.g. cancer studies, where patients die during the duration of the study. There are ways to handle it properly, but asking the survivers about why they survived is not enough.
Posted by christianhauck
|
February 6, 2008 9:19 AM
Posted on February 6, 2008 09:19
Thats what i find so appealing about actor network theory, its the relationships that matter. Change theory just doesn't cut it for me, i know i behave differently depending on who i am with and what the innovation is about. Attributes don't stay rigidly fixed, context matters. I also like what John Law says of social science; when it tries to deal with things that are complex, diffuse, and messy, it tends to make a mess of it. Simple clear descriptions do not work well when the stuff itself is incoherent. The attempt to be clear, increases the mess.
I also found Talebs white swans annoying, an ok idea taken too far.
A good clear blog thanks, i enjoyed it.
Posted by ailsa | February 10, 2008 9:38 PM
Posted on February 10, 2008 21:38