A Curmudgeon's and Improv's Guide to Outliers: Chapter 2

Part three in my continuing pedantic slow-as-molasses walk through Outliers: The Story of Success by Malcolm Gladwell.

List of posts here: introduction, ch 1, ch 2.

SPOILER ALERT: Dude, I can't talk about the book without giving away what the book is about, so if you don't want the book's main ideas to be spoiled, don't continue reading.

IDIOT ALERT: I'm in no way qualified in most of the fields Gladwell will touch on, so please, a grain of salt, before you start complaining about my ignorance. Yes I'm an idiot, please tell me why!

Having, in the past chapter (hopefully) convinced us that there are factors to success (like the hockey cut-off date) that are not acknowledged, important, and, most importantly constructions of a social or cultural nature (in contrast to being of intrinsic or related to individuals) for determining who is successful, Gladwell, in chapter two delves into another such effect which is important: the 10000 hour rule. Actually this chapter has three main thoughts: the 10000 hour rule, the role of this rule in success, and a final analysis building on this second insight on the influence of success and when you are born.

The 10000 hour rule is roughly: to become a world-class expert in a field you need to spend 10000 hours practicing in this field. Gladwell describes a study by Anders Ericsson for violin students. Three groups of violinists were identified in a music academy: those with the potential to become professional, those merely "good", and the low batch on the totem pole, those who were destined most likely to become music teachers. These groups were studied for amount of practice time they spent and it was found that the "great" group practice more than the "good" group which practiced more than the "teacher" group. Integrating up to the age of twenty the top group practiced 10000 hours, while the mere good group praticed eight thousand hours. The poor future teachers totaled a mere four thousand hours.

Gladwell then goes on to describe how this 10000 hour rule appears to be fairly ubiquitous. As Gladwell says:

The idea that excellence at performing a complex task requires a critical minimum level of practice surfaces again and again in studies of expertise. In fact, research have settled on what they believe is the magic number for true expertise: ten thousand hours.

He then describes how this is true of (even) Mozart, grand masters in chess, etc. etc.

i-b7c9b3a359e77121d4f9571e5e38b7bb-Bill_Gates_2004_cr.jpg
10000 hours of practice on the wall, 10000 hours of practice.
Go to U-Dub, steal some computer time, 9999 hours of practice on the wall.

Then, and here is where this idea of 10000 hours of practice ties in with "outliers," Gladwell notes that 10000 hours is quite a lot of time (its a bit over a year in total time). Thus

...it's all but impossible to reach that number all by yourself by the time you're a young adult. You have to have parents who encourage and support you. You can't be poor, because if you have to hold down a part-time job on the side to help make ends meet, there won't be time left in the day to practice enough.

Gladwell illustrates this by two three main examples, Bill Joy (co-founder of Sun, programmer extra-ordinaire, and, more recently, author of Why the future doesn't need us, a warning against the dangers of technology), Bill Gates (nothing needed here), and the Beatles (who also needs no introduction, being more popular than Jesus.)

All of this points Gladwell to the conclusion that "all the outliers we've look at so far were the beneficiaries of some kind of unusual opportunity" which he then goes to illustrate by a very strange argument concerning when you were born and what this does to impact your chance of being on the list of seventy five most wealthy individuals in history.

Pedantic curmudgeon's take: First off, the good points about this chapter! Here Gladwell starts to develop his thesis better than in the previous chapters, where he largely used anecdotes to make insinuations (at least in my mind.) For example, I largely didn't like the hockey chapter because, well, he seemed to me, to be insinuating that this effect was somehow the main effect in determining who is an outlier. I still have this trouble with this chapter, but here at least Gladwell says point blank that there are other factors. But, and here the curmudgeon takes over, it is exactly his dismissal of these "other factors" which I find most disturbing.

But lets back up a bit. What about the 10000 hour rule? A (slightly old) review of the roll of dedicated practice in becoming an expert is The Role of Deliberate Practice in the Acquisition of Expert Performance by Ericsson, Krampe, and Tesch-Romer (1993). Now, I must say that I find the evidence that 10000 hours is required to become an "expert" to be a very plausible idea, and the studies do seem to bear this out. However, I hate, absolutely hate the violin study. Recall that in this study, violinists were selected into one of three categories. If you read the above paper you'll find that this was done with a total of 30 students, and further that the "great" category was determined by nomination from the teachers in the school. Ugh, this last part makes me very dubious of the whole study. Teachers, I'm sure, have a good idea about which of the students are the most studious and the most dedicated. In fact, many would even claim that they are overly sensitive to the more studious among the violinist. So does the fact that the group which was deemed "potential for greatness" versus "merely good" have a difference in reported practice times surprise me? No. Isn't it just as likely to arise from the teacher prejudices about what makes a great student as it does with whether the student is "great?" The study tries to independently verify that these are indeed good violinists, by studying their success in open competitions and by having the violinists estimate how much music they could memorize. But to me, the difference between the "good" and the "great" might be just as much a function of the practice time they spend, as the tracking that these students have received, because they are more studious. Which is all to say, that I don't like the violin study. But that a large amount of practice to become an expert in many fields seems reasonable.

That said there are still many problems with the 10000 hour rule, as applied to outliers. First of all it is not at all obvious that becoming an expert is the one and only way to becoming an outlier, nor even whether expertise is the prerequisite for success in a given field. Michael Nielsen has a blog post on this that I recommend. I would add to what Michael says in that I believe that the 10000 hour rule is a horrible predictor for discovery, cross-disciplinary serendepidity, and founders fortune. While it is certainly true that large numbers of discoveries have come about from experts working diligently in their fields of expertise, a surprising large number of discoveries seem to have come from people who were by no means 10000 hour experts in the relevant field. Indeed, the examples Michael cites are exactly these cases: Heisenberg's discovery of quantum matrix mechanics, Chaitin's independent invention of algorithmic information theory at a young age, etc. I also don't think many founders of companies who go on to vast fame and fortune necessarily have had 10000 hours to become an expert in their given field. See the book Founders at Work: Stories of Startups' Early Days for numerous few examples.

The second problem I have with the 10000 hour rule is that it is not at all clear to me how one is supposed to calculate this number. I'll take myself as an example. I think that I'm probably an expert in quantum computing (a loud mouthed good for nothing one, BTW.) Probably I would have counted myself an expert at the time I got my Ph.D. in 2001. At that point I had been studying quantum computing for around only three years. Certainly I was nowhere near 10000 hours in total practice time for the field of quantum computing. On the other hand, if you start to include my entire education, stretching back through my graduation in 1997 at Caltech and reaching back into high school and even grade school, certainly I've been practicing for well over 10000 hours. But, for me, and I think for many researchers, becoming an expert was not a 10000 hour event unless you include all the prior education. But should this be included? (Note that it's estimated that 10000 hours practice requires about ten years, unless you're spending an extraordinary amount of time on the one chosen subject.) This seems to me to be troublesome: for things where "expert" is not as well defined as "becoming a professional violin player" such as academic experts, it's not clear that the 10000 hour rule isn't just a function of the fact that most of us spend a good amount of time being educated. I propose:

Dave's 10000 hour rule: it takes 10000 hours to become enough of a functioning human being to be entered into the "Outliers!" sweepstake.

i-58a27b507ed679f960bdca1b74e00b0c-ringo.jpg
Sorry, not an Outlier. :(

Okay, but enough with the 10000 hour rule. The real curmudgeon in me comes about when Gladwell then gives us the stories of how this ties into becoming an outlier (which, damnit, he still hasn't properly defined. I'm reminded of the statement: "What is the smallest number which is not unusual?") The basic idea here is that one needs extraordinary opportunities to log 10000 hours. Here is Gladwell:

If we put the stories of the hockey players and the Beatles and Bill Joy and Bill Gates together, I think we get a more complete picture of the path to sucess. Joy and Gates and the Beattles are all undeniably talented. Lennon and McCartney had a musical gift that comes along only once in a generation, and Bill Joy, let us not forget had a mind so quick he was able to make up a complicated algorithm on the fly that left his professors in awe. That much is obvious.

But what truly distinguishes their histories is not their extraordinary talent but their extraordinary opportunities. The Beatles, for the most random of reasons, got invited to go to Hamburg. Without Hamburg, the Beatles might well have taken a different path. "I was very lucky" Bill Gates said at the begnning of our interview. That doesn't mean he isn't brilliant or extraordinary entrepreneur. It just means he understands what incredible fortune it was to be at Lakeside in 1968.

(....sorry Ringo and George, you don't make the cut for Outliers!)

Okay, well first there is the problem of defining these extraordinary opportunities and separating them out from extraordinary talent. Let's take Bill Gates. It is certainly true that it was fortuitous that Gates went to Lakeside private school where they had access to a computer starting 1968 (but then again, our real estate agent went to Lakeside and was in advanced math classes with Paul Allen, so it's hard for me to call this "extraordinary.") But in order to prove to me that the key to Gates being an outlier was this event, you'd have to show me that Gates not going to Lakeside would have led to Gates not becoming a success. But everything that Gladwell points to following Lakeside indicates to me that Gates was, like most of the brilliant and successful people I've known, not just a pawn in a series of "extraordinary" opportunities, but actively engaging in trying to create these opportunities. For instance, we learn that after Gates and buddies drained the money used for the computer at Lakeside, Gates got to work on a computer at a company called C-Cubed. Galdwell is astonished (absolutely astonished!) at this turn of events, resulting from the fact that one of the founders of the firm had a son at Lakeside. But bah, (1) Gates had to distinguish himself and be known to the community in order to get this access (talent), and (2) as Gladwell points out Gates took the bus to their offices and programmed long into the evening: nice an "opportunity" in which most kids of Gates age probably wouldn't have made the effort to chase. But it gets better, we then learn that after C-Cubed failed (wait, that couldn't be a negative opportunity could it?) Gates "began hanging around the computer center at the University of Washington." Yeah, now that's an extraordinary opportunity, that has nothing to do with Gates driven nature. Most kids, you know, liked to hang around UW computer labs in the 70s. And on and on. What Gladwell seems to have missed in this entire story is that perhaps, just perhaps, that Mr. Bill Gates was a hell of a driven kid who realized that he was good with computers and that computers would change the world. If Gates hadn't gone to Lakeside, do we really think he wouldn't have ended up obsessed with computers? I don't know, and I certainly don't think Gladwell knows either.

Further, and I think even more damaging, the story Gladwell tells only makes sense in a post selected world. Everyday kids everywhere are given access to different extraordinary opportunities. Some of these opportunities lead down the path to fame and fortune. But others most certainly do not. If one is to make any use out of the idea that extraordinary opportunities are important to becoming an outlier, then one needs to be able to identify in advance which of these opportunities help lead one down the correct path. It is easy to find, in retrospect, exactly the "events" which caused Bill Gates to be worth $50 billion, but would it have been possible to have done this in 1972?

Finally there is the problem with all "just-so" stories: cherry picking what seems relevant. Gladwell doesn't mention Gates getting speeding tickets. Why aren't these relevant? If Gates hadn't gotten a speeding tickets in Albuquerque, would Microsoft be were it is today? They certainly could have changed Bill Gates' life in different ways, but why don't these matter? What about moving Microsoft back to Seattle? Event or non-event in making Gates' and outlier? Gladwell is again using insinuation to imply that the things he picks out as important, are important, while disregarding everything that he deems not important.

i-3a746da05cb57e61e9ce73d92565738f-li_ka_shing.gif
Outlier from an outlying era. Or maybe the beginning of a new era?

Now, finally lets talk about the Gladwell's final argument in this chapter, having to do with when you are born and being on the list of the top 75 richest people in history. First of all, can I say that I'm a bit pissed at buying a hard copy book and finding six full pages filled with this list, and one in which the most relevant data for his argument (the dates of their birth) is left off the list. Second of all, I don't follow Gladwell's argument at all. Um, the Beatles and Bill Joy aren't on this list, first of all...and where are the hockey player outliers that appear just just a bit back? This 75 richest people schtick, seems to me to be just some arbitrary list that sounds good. And clearly the 75 richest people list is going to be dominated by some major historical facts, like, for instance, the computer revolution. And yes, you had to be of the right age (and in the right country!) to participate in this list. But the suggestion that this somehow has anything to do with explaining outliers is absurd. Really only the 75 richest people? Why not the 1000 richest people? They're not outliers? And rich people as the gauge of outliers? Better not tell Alan Turing, Richard Feynman, or Bobby Fisher! I'm pretty certain a careful examination of "outliers" as a function of time won't show anything resembling the age bunching claimed by Gladwell. But to suggest that most eras don't have outliers who are vastly wealthy for their age seems to me a bit silly.

Improv's take: Perhaps, since 10000 hours is the exact requirement for expertise we should simply start timing kids in their chosen profession. 10000 hour diplomas are the standard of excellence! "Sorry son, you've only got 8000 hours, no job for you." That way we can be guaranteed that we end up with perfect experts in fields. Better yet, we should just design artificial adult sized wombs in which people exist practicing their desired skills until they are ready to participate in the real world of experts. "O wonder! How many goodly creatures are there here! How beauteous mankind is!" Okay, perhaps this is less improv and more snarkov :)

Categories

More like this

Malcolm Gladwell has a new book out and critics all home in on different aspects of it.... MICHIKO KAKUTANI: Much of what Mr. Gladwell has to say about superstars is little more than common sense: that talent alone is not enough to ensure success, that opportunity, hard work, timing and luck play…
I am talking about Bill Gates, of course. Most people have read the recent reports that Microsoft Chairman Bill Gates's personal net worth exceeds 40 billion dollars. Consider that he made this money in the 22 years or so since Microsoft was founded in 1975. If you assume he worked 14 hours a…
You are at university. Do you like stars, and stuff? Another rehashed blast from the past Should you do astronomy as an undergrad? (the following is in part shamelessly cribbed from a colleague's previous freshman seminar for our majors): Do you like stars and stuff? If not, you probably should…
You are at university. Do you like stars, and stuff? Another rehashed blast from the past Should you do astronomy as an undergrad? (the following is in part shamelessly cribbed from a colleague's previous freshman seminar for our majors): Do you like stars and stuff? If not, you probably should…

So I've got 32,000 hours between databases and networks. So that averages out to 16,000 hours each. I guess I'm an expert.

Don't tell me, I can guess: Gladwell also neglected to control for inheritance when identifying the 75 richest people, didn't he? Not that making money has anything at all to do with how much money you start with...

Everyday kids everywhere are given access to different extraordinary opportunities.

My 34 year old self really wishes he could follow a CTC back to my 17 year old self so I could get my head out of my ass. I missed opportunity after opportunity after opportunity.

On time management
http://terrytao.wordpress.com/2008/08/07/on-time-management/
7 August, 2008 in non-technical, opinion | Tags: time management | by
Terence Tao

Prodded by several comments, I have finally decided to write up some my thoughts on time management here.[truncated]

======================================
15 August, 2008 at 3:57 pm

Jonathan Vos Post

There's some discussion on the "Does one have to be a genius to do maths?" thread about how much time it takes to reach proficiency (I say 10^4 hours), and whether the public confuses inspiration with perspiration.

Time-management, to me (as an ex-professor and high-tech executive) is dual to collaborator-management. "Man-hours" (I don't mean to exclude women) can be constant on a project if you either spend more solo time on it until you solve it, or if you break it into pieces distributed between co-workers, and then synthesize the solved subproblems.

Hence there is a strategic component (what's the optimal team size?) and a tactical component (what critical path method is best for us?).

[truncated]

But my point is: time management is more deeply about YOUR time and that of those with whom you work well. If Minsky's "Society of Mind" theory is correct, these are really the same, when different parts of yourself collaborate. The "you" doing Math and the "you" listening to electronic/ambient music at the same time, for example.

I very much agree with Terry Tao about serendipity. So did a subset of
my mentors including Richard Feynman, Herb Keller, and Herman Kahn. These were all super-productive people (also geniuses) so I listened very carefully to what they shared about time-management. Feynman's approach has been mentioned in this blog, to always having roughly 10
problems in mind, as an ideal level of parallelism, and rubbing them all against any new theorem or method you chanced upon.

======================================

20 August, 2008 at 5:39 pm

hilbertthm90

When you say 10^4 hours, when do you consider this to start? Is this 10^4 hours of math total, in which probably a factor of 10 gets shaved off during grade school learning silly things like 8Ã9, or do you think that the time starts when you start learning more abstract things? Maybe as in after your first proof based class. Or does it not even start until very serious studying gets done at say first year of grad school?

20 August, 2008 at 7:55 pm
======================================

21 August, 2008 at 4:58 am

Todd Trimble

The "10000 hours" (rough number of hours it takes to achieve mastery in a nontrivial field of human endeavor) is a popular meme which needs to be taken with a grain of salt, but which I think has a kernel of sense to it. That's about 3 hours a day for 10 years. I'd say that should include the "silly things" (I strongly question the "silly")
like learning the times tables: a kid going through grade school might spend half the school year (3/4 x 5/7, not including holidays) spending a max of two hours actively studying math each school day; two hours is probably generous. At that rate it would take him 30 years to become a master mathematician, so I don't think you shave off a factor of 10 by discounting the so-called silly stuff. (Those people bent on mastery will ramp up the time spent as they get more into it; they pack in the hours much more than they did in grade school, but you should still factor in grade school.)

======================================

Monday, October 01, 2007
10,000 Hours to Ding!
http://tidehorizon.blogspot.com/2007/10/10000-hours-to-ding.html

Now, I know this has been copied all over the place, and will probably become the new Dunbar's Number meme, but I'm coming to it late and this is my own take on it in games.

Dr. Daniel Levitin a cognitive psychologist, neurologist, music producer and no doubt all round good sport, has collated a lot of the current research on music therapy and effects of music on neural development in his book, Your Brain on Music. Amidst other things he proposes democratically that what's most important is not perhaps an
innate talent, but a disciplined and regimented practice routine.

... ten thousand hours of practice is required to achieve the level of mastery associated with being a world-class expert -- in anything. In study after study, of composers, basketball players, fiction writers, ice skaters, concert pianists, chess players, master criminals, and what have you, this number comes up again and again.
Ten thousand hours is the equivalent to roughly three hours per day, or twenty hours per week, of practice over ten years. Of course, this doesn't address why some people don't seem to get anywhere when they practice, and why some people get more out of their practice sessions than others. But no one has yet found a case in which true world-class
expertise was accomplished in less time. It seems that it takes the brain this long to assimilate all that it needs to know to achieve true mastery. (courtesy of Tertiary Education)

There you have it. Maybe regardless of domain, if you want to "master" something it takes a dedication lasting no less than 10,000 hours. That's sort of comforting. Inasmuch as it lets me know if I am truly serious about accomplishing something, I ought to spend more time on it. It gives me a limit, but no guarantee.

But turn to games and the old usability chestnut: How long should a level or zone take to master? How long should someone -- particularly with consoles -- be given to complete and "win" the game. I know I never got far into God of War, mostly because I gave up looking for cheats (yes, for that ridiculous first crates puzzle). Should I have got in-game assistance? Should there have been a number of turns the game monitors I've tried this challenge and then offers me a break, for a lesser reward, or a harder penalty later? Otherwise the game becomes a coaster for me.

And similarly, how about MMORPG's? How long should designers give users to reach the cap? There's lots of evidence for how people pace themselves, but sometimes I sense it gets lost. For example, we hear more about racers in the Burning Crusade reaching level 70 within 28 hours and some wag finishing all of DDO in the same time, but dismiss the lone whiner who may still be stuck at the start (on some crates...). Reaching a level cap is not a mastery, but it does respond to the same desire. And maybe the same built-in bio-cognitive need.

Dedicating time, often alone, to reach a limit for self-reward and public acclaim may be a real human drive. But likewise when the challenge does not meet the realistic effort required, then most people who can't succeed turn to other things to help their advancement. In MMO's, the obvious ones are RMT, cheats, hacks, powerlevelling services. In music or athletics, it might just be a better coach. Or drugs.

David Seah on Levitin has a nice break down, and so a critique, on how mastery could be reasonably seen. The point, as every game designer knows, is to offer a carrot and an encouragement (ding!) through ones' advancement. It's not about 10,000 hours or bust -- it's about maybe 100 hours and a pat on the back.

# at 1 hour ⦠you know some basics
# at 10 hours ⦠you have a pretty good grasp of the basics
# at 100 hours ⦠you are fairly expert
# at 1000 hours ⦠you are an experienced expert
# at 10000 hours ⦠you are a master

If you know your limit -- in this case, the almost mythical 10k of investment -- you can offer a realizable training program for people.

And that circuit of gradual achievement and self-esteem reinforcement is maybe vital for someone to continue.

While 10,000 hours over 10 years is a daunting proposition, consider this:
# 1000 hours is pretty doable. That's a little less than a year of full-time work.
# 100 hours is even more achievableâ¦you could do that over a few months on the side, or just slam through it in a very intense couple of weeks.
# Even spending 10 hours practicing something is going to make you significantly better at it. If you spent 10 hours practicing one song, or learning how to juggle, or learning how to bowl strikesâ¦you're going to learn something.
# One hour? That's worthwhile too. You could spend an hour writing your signature over and over again to make it cooler. I've done that at least a couple of times in my life.

I bet understanding and planning the least and mean time for a user to finish your game (or a part of it) is actually in the back of every designer's mind. After all, it's how we got "levels" and intro tutorials in the first place. And it affects how they introduce new content as well. I remember, for instance, very clearly in the first
few months of SWG a poll on the forums asking how much time people spent playing. It came out near the same week as official survey results on the number and types of classes people were picking. Why that was important is that SOE was trying to see how to shoehorn in the Jedi class. Once they could show users where they were spending their time already, they might have a better sense of how long the
class might take to unlock and then master. And then reconcile players to that required grind. Needless to say, it wasn't 10,000 hours, but after 28 professions for me it felt bloody close.

So much of play testing is functional tire kicking. However, the tuning which happens with character stats and abilities and their mean-time-to-success, whatever the genre or platform, I bet is also carefully scrutinized. Or it should be. We don't need 10,000 hours on any game, and certainly my time on Jedi I know now was not healthy. I
knew there was a carrot, but I didn't know how long the stick was to reach it. If I knew then what I know now... I would not have tried. I think it would be healthier (and would help overall retention) if players had a better sense of the kind of investment they're going to be required to make. The kicker is if they know, they probably won't
bother. But conversely when I play Scrabble online with my girlfriend, I know there's a limited number of tiles that gradually get used, and part of the key to that game is knowing how much time is left via their diminishing number. If users knew what might be required of them hypothetically, the grind might have more appeal.

Ultimately though, I really wish designers would just give us more of an opportunity for challenges that scale. Gameplay that didn't assume infinite time and didn't reward the racers. That's ultimately why people hate the DIKU
MUD model. And there ought to be by now some opportunity for improving play in a game the more you learn, other than just leveling to cap or finishing off some crates.

NYT article on Your Brain on Music

On time management
[URL left off this time; last time my comment stuck in queue?]
7 August, 2008 in non-technical, opinion | Tags: time management | by
Terence Tao

Prodded by several comments, I have finally decided to write up some my thoughts on time management here.[truncated]

======================================
15 August, 2008 at 3:57 pm

Jonathan Vos Post

There's some discussion on the "Does one have to be a genius to do maths?" thread about how much time it takes to reach proficiency (I say 10^4 hours), and whether the public confuses inspiration with perspiration.

Time-management, to me (as an ex-professor and high-tech executive) is dual to collaborator-management. "Man-hours" (I don't mean to exclude women) can be constant on a project if you either spend more solo time on it until you solve it, or if you break it into pieces distributed between co-workers, and then synthesize the solved subproblems.

Hence there is a strategic component (what's the optimal team size?) and a tactical component (what critical path method is best for us?).

[truncated]

But my point is: time management is more deeply about YOUR time and that of those with whom you work well. If Minsky's "Society of Mind" theory is correct, these are really the same, when different parts of yourself collaborate. The "you" doing Math and the "you" listening to electronic/ambient music at the same time, for example.

I very much agree with Terry Tao about serendipity. So did a subset of my mentors including Richard Feynman, Herb Keller, and Herman Kahn. These were all super-productive people (also geniuses) so I listened very carefully to what they shared about time-management. Feynman's approach has been mentioned in this blog, to always having roughly 10
problems in mind, as an ideal level of parallelism, and rubbing them all against any new theorem or method you chanced upon.

======================================

20 August, 2008 at 5:39 pm

hilbertthm90

When you say 10^4 hours, when do you consider this to start? Is this 10^4 hours of math total, in which probably a factor of 10 gets shaved off during grade school learning silly things like 8Ã9, or do you think that the time starts when you start learning more abstract things? Maybe as in after your first proof based class. Or does it not even start until very serious studying gets done at say first year of grad school?

20 August, 2008 at 7:55 pm
======================================

21 August, 2008 at 4:58 am

Todd Trimble

The "10000 hours" (rough number of hours it takes to achieve mastery in a nontrivial field of human endeavor) is a popular meme which needs to be taken with a grain of salt, but which I think has a kernel of sense to it. That's about 3 hours a day for 10 years. I'd say that should include the "silly things" (I strongly question the "silly") like learning the times tables: a kid going through grade school might spend half the school year (3/4 x 5/7, not including holidays) spending a max of two hours actively studying math each school day; two hours is probably generous. At that rate it would take him 30 years to become a master mathematician, so I don't think you shave off a factor of 10 by discounting the so-called silly stuff. (Those people bent on mastery will ramp up the time spent as they get more into it; they pack in the hours much more than they did in grade school, but you should still factor in grade school.)

======================================

Monday, October 01, 2007
10,000 Hours to Ding!
http://tidehorizon.blogspot.com/2007/10/10000-hours-to-ding.html

Now, I know this has been copied all over the place, and will probably become the new Dunbar's Number meme, but I'm coming to it late and this is my own take on it in games.

Dr. Daniel Levitin a cognitive psychologist, neurologist, music producer and no doubt all round good sport, has collated a lot of the current research on music therapy and effects of music on neural development in his book, Your Brain on Music. Amidst other things he proposes democratically that what's most important is not perhaps an
innate talent, but a disciplined and regimented practice routine.

... ten thousand hours of practice is required to achieve the level of mastery associated with being a world-class expert -- in anything. In study after study, of composers, basketball players, fiction writers, ice skaters, concert pianists, chess players, master criminals, and what have you, this number comes up again and again.
Ten thousand hours is the equivalent to roughly three hours per day, or twenty hours per week, of practice over ten years. Of course, this doesn't address why some people don't seem to get anywhere when they practice, and why some people get more out of their practice sessions than others. But no one has yet found a case in which true world-class
expertise was accomplished in less time. It seems that it takes the brain this long to assimilate all that it needs to know to achieve true mastery. (courtesy of Tertiary Education)

There you have it. Maybe regardless of domain, if you want to "master" something it takes a dedication lasting no less than 10,000 hours. That's sort of comforting. Inasmuch as it lets me know if I am truly serious about accomplishing something, I ought to spend more time on it. It gives me a limit, but no guarantee.

But turn to games and the old usability chestnut: How long should a level or zone take to master? How long should someone -- particularly with consoles -- be given to complete and "win" the game. I know I never got far into God of War, mostly because I gave up looking for cheats (yes, for that ridiculous first crates puzzle). Should I have got in-game assistance? Should there have been a number of turns the game monitors I've tried this challenge and then offers me a break, for a lesser reward, or a harder penalty later? Otherwise the game becomes a coaster for me.

And similarly, how about MMORPG's? How long should designers give users to reach the cap? There's lots of evidence for how people pace themselves, but sometimes I sense it gets lost. For example, we hear more about racers in the Burning Crusade reaching level 70 within 28 hours and some wag finishing all of DDO in the same time, but dismiss the lone whiner who may still be stuck at the start (on some crates...). Reaching a level cap is not a mastery, but it does respond to the same desire. And maybe the same built-in bio-cognitive need.

Dedicating time, often alone, to reach a limit for self-reward and public acclaim may be a real human drive. But likewise when the challenge does not meet the realistic effort required, then most people who can't succeed turn to other things to help their advancement. In MMO's, the obvious ones are RMT, cheats, hacks, powerlevelling services. In music or athletics, it might just be a better coach. Or drugs.

David Seah on Levitin has a nice break down, and so a critique, on how mastery could be reasonably seen. The point, as every game designer knows, is to offer a carrot and an encouragement (ding!) through ones' advancement. It's not about 10,000 hours or bust -- it's about maybe 100 hours and a pat on the back.

# at 1 hour ⦠you know some basics
# at 10 hours ⦠you have a pretty good grasp of the basics
# at 100 hours ⦠you are fairly expert
# at 1000 hours ⦠you are an experienced expert
# at 10000 hours ⦠you are a master

If you know your limit -- in this case, the almost mythical 10k of investment -- you can offer a realizable training program for people.

And that circuit of gradual achievement and self-esteem reinforcement is maybe vital for someone to continue.

While 10,000 hours over 10 years is a daunting proposition, consider this:
# 1000 hours is pretty doable. That's a little less than a year of full-time work.
# 100 hours is even more achievableâ¦you could do that over a few months on the side, or just slam through it in a very intense couple of weeks.
# Even spending 10 hours practicing something is going to make you significantly better at it. If you spent 10 hours practicing one song, or learning how to juggle, or learning how to bowl strikesâ¦you're going to learn something.
# One hour? That's worthwhile too. You could spend an hour writing your signature over and over again to make it cooler. I've done that at least a couple of times in my life.

I bet understanding and planning the least and mean time for a user to finish your game (or a part of it) is actually in the back of every designer's mind. After all, it's how we got "levels" and intro tutorials in the first place. And it affects how they introduce new content as well. I remember, for instance, very clearly in the first
few months of SWG a poll on the forums asking how much time people spent playing. It came out near the same week as official survey results on the number and types of classes people were picking. Why that was important is that SOE was trying to see how to shoehorn in the Jedi class. Once they could show users where they were spending their time already, they might have a better sense of how long the
class might take to unlock and then master. And then reconcile players to that required grind. Needless to say, it wasn't 10,000 hours, but after 28 professions for me it felt bloody close.

So much of play testing is functional tire kicking. However, the tuning which happens with character stats and abilities and their mean-time-to-success, whatever the genre or platform, I bet is also carefully scrutinized. Or it should be. We don't need 10,000 hours on any game, and certainly my time on Jedi I know now was not healthy. I
knew there was a carrot, but I didn't know how long the stick was to reach it. If I knew then what I know now... I would not have tried. I think it would be healthier (and would help overall retention) if players had a better sense of the kind of investment they're going to be required to make. The kicker is if they know, they probably won't
bother. But conversely when I play Scrabble online with my girlfriend, I know there's a limited number of tiles that gradually get used, and part of the key to that game is knowing how much time is left via their diminishing number. If users knew what might be required of them hypothetically, the grind might have more appeal.

Ultimately though, I really wish designers would just give us more of an opportunity for challenges that scale. Gameplay that didn't assume infinite time and didn't reward the racers. That's ultimately why people hate the DIKU
MUD model. And there ought to be by now some opportunity for improving play in a game the more you learn, other than just leveling to cap or finishing off some crates.

NYT article on Your Brain on Music

Why is there a cutoff at 10k hours? Does any "master" stop improving at 10k hours? What about people who logged 20k hours?

It essentially boils down to this: there are a ton of people who are into XYZ. The ones who rise to the top tend to have, unsurprisingly, both the top talent and max time devoted. We're roughly looking at the age period low teens-mid thirties when this development can happen before family obligations, etc. put a serious dent in the available time. How is this a surprise to anybody?

Your comment about John and Paul is a perfect example of "how do you define an outlier?" George is rated one of the top ten guitarists of all time.