Useful for grabbing and keeping a personal backup of emails. Can be referenced offline if connection to the internet is poor. Native notifications. Better integration into other desktop applications. For Apple users, good syncing across devices.

Obviously web clients could also provide most of these benefits as well.