Thursday, January 30, 2014

How to Fix a Stack Rank System: An Open Letter to the Next Microsoft CEO

With reports of a new CEO on the horizon I wanted to take some time as an x-msftie to give a foot soldier's perspective on fixing the performance review system - core to fostering great talent.

Recently, Microsoft did away with the dreaded stack rank – the system that forces all performance reviews to a curve with fixed ratios of low, adequate and high performers.  However, this may be overkill.

From my time in engineering and field teams it is clear that the biggest issue with the stack rank is each team is fitted to pretty much the same curve.  In the diagram below you can see that each team gets the same amount of rewards to play with - regardless of the team's performance as a whole.  This means that a rockstar team will have to give around the same number of reviews as a failing one. 



The reason for this is to create an organization wide standard that brings consistency to the review process across their 100k+ employees.  However, it creates perverse incentives where great performers will be paid more to contribute to weak teams than strong ones.  Great steadily revert to the mean as they compete to be mediocre +1.  Failing teams over reward the complacent best of the worst.

However, this isn’t the fault of the system – it’s just a failure of implementation.  Here’s how to get it right: 

1. Product P&L

When I was at Microsoft there were about 22 layers of management between a salesman and an engineer. The only person with true cross-functional P&L for those two individuals is the CEO (true fact).  This prevents any hard accountability from being enforced.   Products need to be re-structured into independent silos.   The organization needs to be restructured into GM-level accountabilities directly responsible for revenue.  While this will make collaboration more difficult, it does
prevent dead wood from accumulating and killing organizations.

2. Trickle-down stack.

A normal distribution can’t be assumed for all of your teams – simply put there will be good and bad performers.  So plan for it.  Each organization with P&L should be fitted to a curve (see below). 


Placement on this curve should dictate the skew of the distribution of reviews given within each team.  E.G. If you crushed it this year – everyone should be able to be rewarded.  If you failed, many more of you should get the axe.  This process will quickly filter people into superstar teams and remove deadwood quickly.

3. Intrepreneurship

As companies grow, they seem to deliberately remove incentives for employees to make revolutionary breakthroughs.   The intent is to avoid destabilizing an organization.  However, the result is always a stagnant top-heavy organization that is doomed to be overtaken by a younger rival (see disruptive innovation). In order to steadily create new products, individual employees needs to have the incentive and resources to break away from existing product teams to create their own.   When engineers only see a ~10% variation in compensation there isn't incentive to do 10x better work or be innovative.

The Next Step for Founders/Engineers: How to Get Traction

I had a great time talking with the hackers at The Next Step for Founders/Engineers: How to Get Traction (thanks Optimizely for hosting!).  As I was taking notes I was struck by how the different varied based on stage of the business.  So, here’s a breakdown of the nights top gems (IMHO) by stage of company it is relevant to:

Pre-product – you have an intuition about a product or idea you want confirm

  • ID your customer – don’t waste time talking with or using feedback from people who won't buy – they are not relevant.
  • Use a list – email your personal and professional contacts directly to get your initial users
    • My favorite tools for managing customer conversations are Boomerang, Excel, and Contastic (of course)
  • Go narrow and personal (direct emails/in person conversations) and only go broad (twitter/ads/content marketing) when you've scaled to hundreds of users.

Pre-Revenue – you have some users and are now looking for ways to find people who will pay

  • Move to micro communities of under 100 people (i.e. Linkedin groups, FB, Techendo)
  • Add a buy button for a couple days to see if people will click it.  This demonstrates clear willingness to pay.
  • In the early stages the founder is more valuable than the product.  The product will be weak - people are betting on you to make it better.

Post-Revenue – you’re off to the races with product market fit and are looking for ways to grow

  • Reference customers.  For Optimizely having the Starbucks logo was a key demonstrate of credibility. 
  • Use twitter to meet and research people.  Find common interests to connect over.
  • **cameo from Pete Koomen (Founder Optimizely) – force people to unsubscribe by emailing you ask them. They got invested enough to be annoyed.  Find out why.
After the talk I got quite a few questions about sales.  Here’s what early stage founders need to know:
  1. Use a list (keep it in Excel, Paper, Google Docs).  Just make it simple and and continually keep it up to date with you you talked to, what they said, and what the next step is.
  2. For (Every sales call) {close a sale, get a feature request, or disqualify;  If (disqualified or sold) {ask for a an intro to a new prospect;}}
  3. Stay in touch.  Jupiter research estimates 50% of qualified leads aren't ready to buy.  Just keep asking and a large proportion will convert (Contastic was made for this).