1. 5

  2. 6

    No. No. No.

    Managers and project managers should get some training in how to manipulate estimates with uncertainty values attached. There are simple rules for this, but they’re not always intuitive.

    With a link to http://web.uvic.ca/~jalexndr/192UncertRules.pdf

    Those formula assume the uncertainty is…

    • Independent. Not valid for most software projects.
    • And the relative uncertainties are Small. Not true for most software projects.
    • And the distribution of uncertainty is symmetrical. Also not true.

    Conversely, the only thing in his favour is the Central Limit Theorem works remarkable rapidly (for independent variables with finite variance).

    That said, you can build up a model and use monte carlo methods to get the resulting spread in uncertainty.

    He is right about the dismal lack of calibration of estimates, but worse than that is the disastrous failure to update estimates daily as new information comes in (eg. story just done blew out by factor of two).

    Hidden in all this are two immutables…. the Deadline and The Scope. If nobody is going to flex on that and insist that the original estimates must hold…. Guess what? The quality implodes and technical debt explodes.

    And the velocity for subsequent projects slows and slows.

    1. 3

      I wrote the article. Thanks for the feedback!

      I agree that linking to those uncertainty rules was misleading. I should have given that some more thought. I still think that you can get good calibrated estimates in the face of interdependencies, but it’s true that the rules I linked to are not meant for that.

      1. 3

        I’m pretty sure there are some off the shelf tools to do this sort of modelling.

        Guess what?

        I haven’t heard of anybody in the industry using them.

        Not a single blogger is ranting about how wonderful these tools are.

        Why on earth would someone not use a tool that works for estimating the probability distribution of the outcome?

        Because estimates have no value.

        The PHB’s simply don’t actually care about the answer.

        Michael O’ Church has the answer why.

        It’s much easier to pour on pressure, juggle teams and scope, “manage expectations”, sacrifice quality, incur technical debt with zero intent of repaying…. than to estimate properly.

        The payoffs for project managers are perverse.

      1. 2

        Actually, let’s just stop making estimates.

        There are counterexamples to what I’m saying. If you’re launching something into space and it’s going to cost millions of dollars to bump that launch from May 19 to May 20, then you need adult project management and you need to be 3-10x over capacity. Only government-funded research can afford this, but it’s what you need when you have deadlines with severe consequences if they’re missed. I don’t mean “An executive is mildly embarrassed in a way that no one will remember next week”, but “Millions of dollars are lost or people die”. Then, you need adult project management– not this Agile shit.

        In the corporate world, estimates are purely about manipulation. It’s to create internal competition. The people who underbid in estimation get their first pick of projects. Engineers suffer, and executives gain, due to the winner’s curse. It’s a way for management to push people to work unreasonable hours without explicitly asking them. Then they can say, “No one is making you work weekends, but you committed.” It’s a trap.

        1. 5

          If someone asks you for an estimate which they’ll in turn use to try and plan other dependent work, they should be open to (even welcome!) being told as soon as possible if the estimate is going to change in either direction.

          When used that way, as a communication mechanism, they’re useful. But it requires a company wide belief that their purpose is estimation.

          Keep people in the loop at every turn. The next time you’re told you committed, you remind them that you estimated.

          Don’t get trapped :)

        2. 1

          Bah I didn’t see @craigstuntz ’s comment until today and it appears that the window has closed for fixing the URL. Bummer.