Partial Dependence Plots (PDPs) are a standard model inspection technique. It turns out that for decision trees, they can be computed very efficiently. This post explains how PDPs are computed in general, and goes into the details of the optimized version for tree models.

http://nicolas-hug.com/blog/pdps