Revisiting Deliberate Practice

by:

Joe Patti

Last Tuesday I wrote a post on some recent research about the value of deliberate practice. Over the weekend, I had an opportunity to read a little more on the recent study. Come to find out, this recent bit of research (Macnamara & Maitra) was an attempt to replicate the a study about deliberate practice conducted in Germany in 1993 (Ericsson, Krampe & Tesch-Römer). I mention this because some of the posts I made about deliberate practice in the past was based on Ericsson, et. al research.

Macnamara & Maitra were unable to replicate all the results of Ericsson study, finding that deliberate practice only accounted for a 26% variance in the difference in ability between violinists versus the 48% difference reported in 1993. They say:

26% of performance variance is not an inconsequential amount. However, this amount does not support the claim that performance levels can ‘largely be accounted for by differential amounts of past and current levels of practice’

The most recent research attributes this to bias built into the design of the 1993 research as well as inconsistent definitions of deliberate practice. As a result, in their conclusion they say deliberate practice alone can’t account for the differences of expertise between elite performers .

However, they do suggest that the training regimen of violinists today might also be a factor in the smaller variance. In the 1993 group, many had never entered a competition. The best violinists had entered about 3 competitions; good ones about 1; and less accomplished around 0.

Compare to those in the most recent study where the best entered about 13; good around 8-9; and least accomplished about 3.  The worst in the most current study might be evaluated higher than some of those in the 1993 study.

As I was looking through my blog feed over the weekend, it just so happened that Marginal Revolution linked to a post on Cal Newport’s blog where he reprints a letter from a pianist responding to an earlier post Newport made about deliberate practice.

One of the things the pianist discusses is the value of variety in pursuit of mastery:

Strategy #2: To Master a Skill, Master Something Harder.
“Strong pianists find clever ways to ‘complicate’ the difficult parts of their music. If we have problem playing something with clarity, we complicate by playing the passage with alternating accent patterns. If we have problems with speed, we confound the rhythms.”

In the post the pianist was responding to, Newport wrote:

To summarize these results:

  • The average players are working just as many hours as the elite players (around 50 hours a week spent on music),
  • but they’re not dedicating these hours to the right type of work (spending almost 3 times less hours than the elites on crucial deliberate practice),
  • and furthermore, they spread this work haphazardly throughout the day. So even though they’re not doing more work than the elite players, they end up sleeping less and feeling more stressed. Not to mention that they remain worse at the violin.

Both these posts were made in 2011 and Newport was citing the 1993 Ericsson, et. al study. However, the most recent study by Macnamara & Maitra found something very similar.

…we found no statistically significant differences in accumulated practice alone to age 18 between the best and good violinists. In fact, the majority of the best violinists had accumulated less practice alone than the average amount of the good violinists.

I should note that the research tracks practice from age 4 to 20 so the subjects are all students whose level of proficiency is determined around 18-20 years old. My read of Macnamara & Maitra is that they see this as evidence of inherent talent making up for less practice rather than the quality of that lesser amount of practice was much higher.

If you are thinking that perhaps those evaluated as having more skill had better teachers, the most recent research found:

Simply put, there is no evidence to suggest that teacher-designed practice activities are more relevant to improving performance than practice activities designed by the performer.

Granted, this doesn’t diminish the value of a better teacher. Presumably any self-designed routine of an 18 year old is going to be heavily informed by their teacher even if they are aren’t strictly following a dictated practice regimen. You may chalk it up to talent, either on the part of the performer or teacher, being able to identify and implement what is needed to obtain greater proficiency makes the difference between quantity and quality.

A World, And Its Participants, Continues To Grow

by:

Joe Patti

Last year I wrote about a live roleplay drama loosely based on Dungeons and Dragons/Pathfinder roleplaying game mechanics that a guy was experimenting with.  This year he was back at it again. Apparently he felt like it was moving in a good direction and quit his job in order to focus on more fully developing his product with an eye to doing residencies at universities and performing arts centers.

As I mentioned last year, what the creator, Martin Noyes, does is work with a core group of people for about a week developing characters for a story in a fantasy setting. When asked if the story I was seeing was set in the same world as last year, he pulled out a map and pointed out three-four other continents/landmasses where future stories will take place.

They had about 8 performances over two weeks, all improvised based on character goals/motivations and dice rolls. Each performance started where the last one left off, providing some incentive to attend on multiple days. Noyes is adept at gauging how to balance allowing the actors time to develop their character through active interactions and poignant silences against moving the action along with a narrative framework that keeps things from dragging and devolving.

He has done a fair bit of work since last year in terms of streamlining the mechanics to make things move along faster. As a result, he has been able to involve the audience much more than last year both in terms of rolling dice to determine the outcome of encounters and as participants in the action. There were a number of audience members who came in costume and got integrated into the action.

Not only were audiences three times as large as last year, there were a greater number of people returning from performance to performance.

I suspect the fact they offered a discounted pass for multiple performances might have contributed to the repetition. More likely was the fact that you could roll a 10 sided dice at the door to determine what amount between $1 and $10 you would pay for admission.

An important element I didn’t mention last year that I think contributes to the success of the project is the pre- and post-show interactions between the audience and performers. The show is performed in a blackbox space. When you enter, the actors are chatting among themselves and with the audience about everything from other roleplaying games they play; how the foam weapons were constructed; how the weapon or costume piece contributes to the character development; what happened in previous performances; what their character was thinking during a tense moment or what their motivation was at that point.

When the director calls for the show to start, everyone takes their places. When it is over, actors and audience members mingle again on the playing area to discuss whatever interests them at the moment.

Due to the way the event is structured, the quality of performance and storytelling isn’t at a very high level. (Though much better than you might expect.) But the conceptual separation of the audience and performer that results from a more formal format doesn’t manifest either.

I am hoping Noyes has the opportunity to bring us the stories of the other landmasses over the next few years. I am interested to see how this approach continues to evolve. I am just hoping he doesn’t get so many bookings that he debuts new stories from other landmasses in other places first.

Even More Important That Panels & Post-Show Discussions Be About Audience Experience

by:

Joe Patti

Today I had a post appear on ArtsHacker where I point out some general tips for organizing panel discussions. This covers everything from pre- and post-show chats to conference panels.

Essentially, the tips follow the same philosophy generally espoused for any sort of arts and culture event — make the environment about enriching the attendee experience  rather than celebrating how awesome the people on the panel are. People are intentionally present at this conversation in the hopes of becoming better informed so the goal should be on removing any impediments to that. (And, after all, even those of us that produce and present events are audience members at some point, too. We are seeking the same enrichment.)

For discussions oriented on performances, it is all about facilitating meaningful conversations for the audience and then getting out of the way. One person I cite mentions that having performers present can inhibit a free flow conversation because people tend to censor themselves or focus on the performer rather than the performance. He suggests ways to involve performers so they don’t become the focus.

A dramaturg I quote suggests some questions that focus on the audience experience which can prevent audience members from feeling they are obligated to ask a question and resort to “How do you remember all those lines/notes/movements?”

For discussions that are the event rather than the complement to the event, the concept is very much the same. Don’t spend half the allotted time reading panelist bios and allowing them to make increasingly lengthy opening statements – keep introductions short and get right into a discussion between panelists that have real things to say to one another.

The panelists don’t have to be so diametrically opposed to each other that you need a security guard prepared to tackle them, but no one walks away with something new to consider if everyone is nodding in agreement with everyone else.

By the way, many of the same guidelines for panelists are suggested for questioners from the audience- run a disciplined Q&A with a strict time limit and ground rules stated in advance to prevent an escalating series of lengthy rants.

I am sure frequent conference attendees probably silently pray that most of these guidelines were applied to the sessions they attend.

Panels And Post Show Discussions

Deliberate Practice Better Than A lot of Practice

by:

Joe Patti

The Guardian recently had a story about a study debunking the idea that it took 10,000 hours of practice to master a skill. I have written a number of posts on the subject over the last few years, but feel it is important to revisit it often given our cultural predilection for valuing quantity over quality.

…there was little to separate the good from the best musicians, with each logging an average of about 11,000 hours. In all, the number of hours spent practising accounted for about a quarter of the skills difference across the three groups, according to the study published in Royal Society Open Science.

Macnamara believes practice is less of a driver. “Once you get to the highly skilled groups, practice stops accounting for the difference. Everyone has practised a lot and other factors are at play in determining who goes on to that super-elite level,” she said.

“The factors depend on the skill being learned: in chess it could be intelligence or working memory, in sport it may be how efficiently a person uses oxygen. To complicate matters further, one factor can drive another. A child who enjoys playing the violin, for example, may be happy to practise and be focused on the task because they do not see it as a chore.”

That last bit about the value of enjoyment is really one of the key elements. This is enjoyment in terms of being engaged by the practice, not necessarily being happy about the callouses, aches and frustrating lack of progress. (In fact Nina Simon just posted about a torturous experience whose ridiculous sadism she feels helps her prepare for the adversity life throws at us.)

If your practice is based on pushing yourself to do 5 minutes more than yesterday, then your focus will be on the clock rather than on improving.  The result is that you can play longer, but not that much better.

There is a lot of evidence that variety and deliberate practice helps much more than consistently practicing in the same way. Teaching others a skill is often very valuable to improving your own practice. Even if you don’t feel you are a particularly good teacher or enjoy teaching, the act of teaching any skill at all, even washing dishes, can instill the patience and tolerance of yourself useful for your own practice.

Since we can often be harder on ourselves than others, learning not to obsess about our mistakes might be one of the most valuable assets in practice that no one ever teaches us. A focus on achieving “not wrong” is not equivalent to achieving greater mastery. At a certain point needing to redeem the poor job you did yesterday or deriding yourself for doing better yesterday than today becomes an obstacle rather than path to growth.

As the researchers imply, there can be other factors outside of your control which limit greater mastery. But you never know if that limitation is permanent or a temporary factor associated with your current method of pursuit. Mental healthwise, it may be better to assume the latter and examine alternative approaches.