Judging Books by Their Covers