Wednesday 19 November 2014

Quis custodiet ipsos custodes?

I have read Rugby journalism on various sites, primarily G&GR, The Roar and Rugby Heaven, with the fervour of a religious fanatic for pretty much the past 6 years.

Spiro Zavos, an inspiration for me in Rugby journalism.

I have commented in other places on this site about where I think Rugby journalism is lacking, but today I want to focus on something a little bit more murky.  Something a bit more intangible, a little bit dark and conspiratorial.

I want to talk about agenda and bias in Rugby journalism. 

Logically, articles from guys like Paul Cully, Smith, Zavos and Growden were bound to be opinionated and subjective (being grounded more often than not in a lack of any objective statistics) so we can forgive them this.

What I find harder to fathom or forgive, is when statistics (if you can call them that) are parroted as a means of objectively justifying an agenda, without any acknowledgement of the potential failings of the said statistics.  Over the years, this has not been a dominant form of journalism, people like Spiro for example would use statistics sparingly (perhaps in knowledge of their potential fallacy, and also in the absence of any really good statistics).

But when Scott Allen appeared on G&GR I think it is fair to say that most of us fans and critics felt like it was a breath of fresh air.  Here was a fresh product, someone attempting to objectively analyse the play of various players using video analysis, statistical metrics and the like.  It felt dispassionate and rational, and it felt right.

Then it all went to shit.

After article and article full of questionable statistics, rubbishing the same players while praising others, the veneer of objectivity over the articles began to wear thin.

And the worst bit?  Readers of this journalism where eating it up like Oliver Twist.  It almost appeared to me that people where quite happy to let someone else do the thinking for them and then to stand behind it as gospel supporting their own agendas. 

This drove me from commenting on sites like The Roar.

All of this was a lengthy introduction to this new series of articles which I have called the Who watches the watchers series.  In this series all I want to do is tear any Rugby journalism to objective shreds.  I want to stress test and tease out inconsistencies and I want to hold their statements on certain players, coaches on the record.  

I hope you guys enjoy it.

JP

Michael Hooper - Part 2: the role of awards

This is the second article in a series which looks in depth at some of the arguments for and against Michael Hooper.  In this post I will focus on awards given to players, in particular the John Eales Medal ("JEM") and the IRB Player of the Year Award.

These accolades are often used as arguments by bloggers to support their assessment of a player.

If they win these awards, they must be good. If you don't think so, while you must be up against some fairly expert knowledge on the point. Therefore, the argument goes, you would be an idiot to disagree.

This applies certainly to Michael Hooper who has racked up the awards over his short career.  A catalogue of his awards to date:

  • Australian Rookie of the Year (2012)
  • Australian Super Rugby Player of the Year (2013)
  • Australian Under 20s player of the Year (2011)
  • John Eales Medalist (2013)
  • Waratahs Player of the Year (2013, 2014)
  • Australia's Choice Player of the Year (2014 - chosen by the fans)
How do you win these awards?  And, what are their relevance?  These questions have come under more spotlight recently given the controversial inclusion of Johnny Sexton in the consideration for the IRB Player of the Year award.

The JEM is awarded to the best player in Australian Rugby Union each year and began in 2002 (inaugural winner George Smith).  According to Wikipedia, the award is based on a 3-2-1 points tallying system - awarded after each test match by the players.  A sort of players' player medal.

In the year that Michael Hooper won, he polled 297 votes, 100 votes ahead of his nearest rival Wycliff Palu.  What do these numbers mean in context?

Assuming each player in the 23 person matchday squad has 6 votes to allocate, that equals a possible 138 votes per test match available for distribution among the players who played (realistically 17-18 players - it would be hard to see a substitute being awarded as many votes as a run-on player for obvious reasons).

In the 12 month period relevant to the JEM the Wallabies played 13 tests (the JEM is awarded prior to the EOYT, but would include the tests of the following EOYT), this means that 1794 votes where available to be won from other players in the period relevant to the JEM.

On this basis, Michael Hooper secured 16.5% of the potential vote followed by Palu with 10.3%.

Hardly a compelling statistic, when put into context.  In my view this shows that from a player's perspective there is a lot of differing opinion on who the best player is each game.  I don't mean to denigrate the fact that at the end of the day Hooper got more votes than the next man, it is interesting to see that it is by no means clear cut.  While we can assume that the votes are cast in anonymous fashion, is it not hard to imagine factors outside of a players performance on the pitch contributing to a player's decision to vote for a peer.  In this way, this award might not fully reflect the performance of the player.  By its nature it would allow some player bias - are players in the best position to judge performance?

In contrast to the JEM, the IRB international player of the year award is awarded on the basis of votes cast by a panel of experts (known as the IRB awards panel), this year:


John Eales (AUS, 1991-2001) - Convenor
POSITION - Lock
Will Greenwood (ENG, 1997-2004)
POSITION - Centre
Gavin Hastings (SCO, 1986-1995)
POSITION - Full Back
Francois Pienaar (RSA, 1993-1996)
POSITION - Flanker
Paul Wallace (IRE, 1995-2002)
POSITION - Prop
Scott Quinnell (WAL, 1993-2002)
POSITION – Back row
Agustin Pichot (ARG, 1995-2007)
POSITION – Scrum half
Tana Umaga (NZL, 1997-2005)
POSITION – Centre
Raphel Ibanez (FRA, 1996-2007)
POSITION - Hooker
 

The process involves the panel awarding a 3-2-1 after every test match (from January to the last test of the year), at which point following a discussion (regarding form, appearances and opposition) the players are nominated to the public and the media.  Selected media and public input is then provided before the final award of the player.

I think there are a number of key points to highlight about the process above:

  1. Given the primacy in the process provided to the panel (that's a lot of p's), it is reasonable to question how such a panel is appointed and the nature of its composition.
  2. Irrespective of the votes tally following the test matches, the decision is still subject to a discussion between the panel.  This means there remains a residual discretion for the panel to act contrary to the results of the vote tally.
  3. The IRB website states that selected media and public input is the final stages in the process.  What weighting is provided to this part of the process? And why only selected media - and who are the selected media? How do they become selected media?
In 2014, the nominated players are:

  • Jonathon Sexton (Ireland)
  • Willie Le Roux (SA)
  • Duane Vermuelen (SA)
  • Brodie Retallick (NZ)
  • Julian Savea (NZ)
To put this in to context, during the period in which the IRB Awards panel considered the nominees, their respective teams records were as follows:

Ireland: 6 W 1 L (Opponents - six nations, Argentina whitewash)
SA: 6 W 2 L (Opponents - Rugby Championship, Wales whitewash)
NZ: 7 W 1 D 1L (Opponents - Rugby Championship, England whitewash).

From these statistics, we can see that Sexton and Ireland have had a great season (even recently rising to their highest ever ranking #3 in the World).  Against this background, it is not hard to see why Sexton made the cut (although I am unsure whether the win against SA was included).

Sexton talk aside, the awards are useful measures of a players performance, but they should not be used I think without a better understanding of how they are calculated.  Each award is subjective in the way that they are awarded, this is the important thing to remember.  But it is also important to note that the weight of subjective opinion is what is required to win these awards. 

A final word, sometimes armchair Rugby critics can be deceived into thinking that their opinion actually matters.  It doesn't.  The opinion of the other players in the squad means a lot when assessing the value of a player to a team.  I think this is particularly important in the case of Michael Hooper.

Thursday 13 November 2014

Michael Hooper - Part 1: age and potential



In America, the draft plays a huge part in defining the career of a player and the success of organisations involved in picking that player.  For this reason, the evaluation of a players potential, ceiling, or upside is big business.

A number of draft experts are employed to develop algorithms focused on (amongst other things) a players performance in his college games and an athletic combine (a series of athletic tests such as vertical leaps and sprints designed to test an athletes raw athleticism), the thought being that these algorithms might help decisions on the potential of players.  A huge number of statistics are also employed as part of this process, experts might evaluate a players playing IQ, assist stats, turnover stats, points per game - these metrics are invaluable in the process of comparing apples with apples.

In Rugby, we are far less developed in the assessment of potential.  Potential for most Rugby writers is a word used as a crutch for lazy journalism.  Which in fact leads me to the first argument in favour of Michael Hooper, and the subject of the first part of the series.  Michael Hooper is young, and therefore has potential to be great.

Well, does he?  Undoubtedly it is logical that if a player starts young he has a long time to play the game (and therefore maybe to improve).  But it does not necessarily follow that he will improve, in fact he could regress, plateau or simply be replaced by the next big thing. 

In this post, I want to analyse the relevance of age to the potential of Michael Hooper (ie this analysis won't necessarily stand for all players, but there may be some general application).  First, I am going to talk about age and then move on to analysis of potential.

Michael Hooper is very young.  He recently had his 23rd birthday (DOB: 29/10/91).  He has achieved a lot since his debut against Scotland in June 2012.  He is the youngest captain of the Wallabies since Ken Catchpole in the 60's.  He has amassed 38 caps, a John Eales Medal, and a Wallabies Rookie of the Year Award.

As a way to track the possible length of career we might expect from Michael Hooper I have looked at the age of flankers at retirement (or close to retirement) from national teams.  This is a crude attempt to estimate the amount of time Hooper has to grow, decline or plateau.

The sample base is taken from top tier IRB nations like the Wallabies, and all during the professional era.  The sample aims to take into account injuries across a number of players (and therefore games etc), it also includes caps to illustrate the different playing loads on players.

Richie McCaw
Age: 33 years old (DOB:31/12/80)
Retirement: Still playing
Active playing years: 13 (and counting)
Caps: 135

George Smith
Age: 34 years old (DOB:14/7/80)
Retirement: Retired from international Rugby in 2013
Active playing years: 10
Caps: 111

Richard Hill
Age: 41 years old (DOB:23/05/73)
Retirement: 2008
Active playing years: 11
Caps: 71

Schalk Burger
Age: 31 years old (DOB:13/04/83)
Retirement: Still active
Active playing years: 11
Caps: 73

Thierry Dusatoir
Age: 32 years old (DOB:18/11/81)
Retirement: Still active
Active playing years: 8
Caps: 65

So from our base we can take the following statistics:

  • Average age at retirement = 33.6 years (for the players defined as still active, I added a modest single season to their current age)
  • Average active playing career = 11.2 (for the players defined as still active, I added a modest single season to their current age)
  • Average caps = 94 caps (for the active players I added a modest 5 caps in line with my adjustment above for one extra season).
Using these figures we see that for our sample base the average player began his career aged around 22, played on for 11 seasons at a rate of roughly 8 games a year (this of course includes the RWC which pulls that figure out a little bit).

Bringing this back to Michael Hooper.  Michael should play until he is 33 years old, which would be in line with the sample retirement age.  This would equate to a playing career of 12 years (just above the sample rate).  It is not unreasonable to assume he would play beyond these statistics.  Given he has received 38 caps in little over 2 years (ie 19 caps a year), on our sample rate of 8 caps a year, he should amass 118 caps - although of course at his current rate and uninjured he would gain many more caps.

While deciphering the age potential for Michael Hooper is relatively straightforward, tracking his actual potential is a vastly different matter.  In contrast to College draft picks in America, Michael Hooper is more or less fully physically developed, so this removes any evaluation of his prospective physical development from the equation.

What this leaves us with is the question of whether there is potential for Michael Hooper to improve his skills, leadership or play.  In other words can he improve on the things he is already doing?  From another perspective, can he improve on perceived or actual shortcomings in his own game?  Can he improve his breakdown technique, tackle more dominantly, run more aggressively? Taken this way, a shortcoming shows potential (potential to improve). 

However, the implicit assumption with this approach is that if Michael Hooper can already run aggressively or tackle in a dominant way, he does not have potential to improve in those particular skills.  American draft experts describe this as an intuitive perception based on the law of diminishing returns.  However, as the graphs below show this does not necessarily need to be the case.



In the above graph, the model on the left shows two players B and A and their relative ability at the breakdown.  As you can see, Michael Hooper (A) suffers from the law of diminishing returns as he tries to improve his breakdown work, whereas your average jobber from grade rugby (B) may see significant returns if he decides to go for a midweek run for example.  However, model 2 defeats this assumption by assigning the two players to separate curves reflecting the difference in their skills.  Here Michael is only compared against himself, ie based against his fundamental capacity.  In fact under model 2, equal investments will result in equal increases in skill.  These are two very different ways to model a players potential to improve. 

What draft experts in the US have found is that some skills of players conform to the model of diminishing returns (model 1) while others tend to align with model 2 potential. Model 1 skills tend to be baseline skills such as freethrow percentages, while other skills such as scoring capacity tend to improve in line with model 2 (ie disobeying the law of diminishing returns and improving consistent with the individuals fundamental capacity).

In the context of Rugby, the distinction between the two models becomes important.  Arguably, Rugby is a game characterised more by model 2 type skills (breakdown play for example is not as regulated as a goal kick or touchfinder - which would be more analogous to a free throw).  This is even more applicable in the context of Hooper who as a 7 specialises in the sorts of skills adhering to the model 2 potential curve. 

In short, Michael Hooper has the potential to improve in his skills (even the ones he is already doing well) - of course such improvements would eventually be subject to the law of diminishing returns as model 2 indicates.

Another interesting insight from the US was the concept of player IQ.  This does not mean the ability to read a game, but instead refers to the players ability to acquire new skills, pick up training drills, respond to game plans, maybe learn a new skill from a rival. 

In the NBA what the draft experts have increasingly found is that players with good statistics across multiple skill traits (can pass well, rebound well, shoot well) have greater development trajectories when they hit the professional ranks than those who are more impressive perhaps physically but more two dimensional.  Such high IQ (potential) players are usually identified by their high statistics in forcing turnovers, steals, and assists and their correspondingly poor combine results.

I have not found any equivalent idea in Rugby, but it is not hard to imagine Michael Hooper ticking some of these boxes in terms of his ability to play as an outside back as well as a forward.  Further, his young elevation to a leadership role can be seen as evidence of particular aptitude for leadership, reading the game etc.

I understand that this article hasn't come to any concrete conclusions on the likelihood of Michael to improve greatly during his projected career. To properly apply some of the models I have come across, we would need a raft of statistics, which unfortunately at this stage are not publicly available in Rugby.

However, if there are conclusions from this article they would be this:

  1. From an age perspective, Hooper has the potential to play for another ten years (this much perhaps obvious).  The weight of experience (assuming it is good experience) has the potential to prove very valuable to the development of the Wallabies and to himself.
  2. From a potential perspective, Hooper has the potential to improve in areas of his game which we would perhaps already define as a strength (linebreaks, run metres, points). While shortcomings (likely in my opinion to be model 2 type skills) will also have the potential to improve, it could be the case that Hooper's skills in these areas may be incapable of reaching other players levels (ie he is the lower curve in the model 2 graph above).
  3. Michael appears to be a player with a high player IQ.  I believe in a Rugby context this is evidenced by run metres (identification of space), linebreaks (positioning of body through contact, and successfully running lines as part of planned moves) and also elevation to leadership capacity.  This speaks well for the trajectory of his potential improvement.
Where do I stand on his potential to improve given his age, and the pundits who use this argument?  I mean, he is young he has already achieved much, he could achieve more.  It has an intuitive logic about it, but that is not the same as saying it is logical, he could very well be worked out, plateau, regress or be replaced as discussed above.  However, if I had to fall on a side of this argument, it would be that Hooper is very likely to improve as time goes on.  He has the dual benefits of a likely long career, plus what American draft experts call pedigree (John Eales Medal Winner, Rookie of the Year, Waratahs player of the year) - these players tend to go on to greater things (evidenced by their high draft picks).  So, fingers crossed for Wallabies fans (and Rugby fans) that he does continue on the upward curve.

John







Wednesday 12 November 2014

Michael Hooper - a love hate relationship?



(Photo credit to abc.net.au)

Michael Hooper is a real conversation starter on the various Rugby sites covering the game in the Southern Hemisphere.  These conversations tend to move quickly into heated arguments, reflecting the love or hate that the various fans have for him as a player.

In their condensed form the arguments for Michael Hooper tend to be grouped into the following categories:
  1. Age based arguments which focus on his youth relative to his achievements, musing on his potential for the future.
  2. Arguments which focus on his accolades to date as a sort of "well if they rate him, who are we to say any better sort of argument".
  3. Statistical based arguments, which are self explanatory.
There have also been some common themes in the arguments against Michael Hooper.  These tend to centre around the narrative that has developed on the internet about Hooper, namely that he is ineffective and/or absent at the breakdown (more on the role of these narratives in a later post), and include that he:
  1. Lacks the size and physicality at the breakdown to affect turnovers, secure ball and add weight to the contact area.
  2. Plays too wide, often like an outside centre, again reducing his ruck involvement (which leads to the usual arguments surrounding the traditional role of the flanker in Rugby).
  3. The perceived lack of breakdown work from him places huge pressure on the other moving parts of the Wallabies already fickle forward pack.
In this series of articles on Michael Hooper I want to dig a bit deeper than these often trumpeted arguments for and against him, in the hope of finding (or maybe not finding) some definitive facts on which to base a solid opinion on his play. 

To do this, I will be looking at each of these arguments in greater depth, and adding some statistical and analysis techniques that I have picked up from the US (mainly in the context of basketball) but also in other sports.  At this stage this analysis is largely limited to publicly available statistics, but I am in the process of developing a statistic gathering tool in addition to a video analysis tool which I hope to make available as soon as possible to the discerning Rugby reader of this blog.

I hope you enjoy the series.

John