LinkedIn has open-sourced their large-scale machine learning library, which can run on a single nodes, a Hadoop cluster, or a Spark cluster.