For an interesting counterpoint on the reproducibility of the reproducibility study itself:
More counterpoints: https://gist.github.com/samth/9641364
The idea is reproducibility is great, however this is a bit better way of going about it: http://reproducingnetworkresearch.wordpress.com/
A “does it build” test isn’t very useful, which some of the U of A results are showing.
Follow-up work in this area attempting to get more people involved: http://cs.brown.edu/~sk/Memos/Examining-Reproducibility/
Interesting discussion and a bit of brief counterpoint analysis near the end: https://plus.google.com/117185293319274359863/posts/Tf4D2HKQRKi