On a somewhat related note, Leo Breiman, the guy who invented random forests among many other accomplishments, wrote a paper, Statistical Modeling: The Two Cultures [1] that discusses inference and versus prediction approaches. It is certainly worth reading for anyone studying machine learning.
