I found this list gratifying because it's fairly close to my current practice, although it's hard to quantify what's sufficiently 'different'. Jopling mentions boutique labels to explore such as Nonesuch, Real World and ECM. That's all very nice, but at least around here some music is too different to be under consideration, even for one listening.
The back catalogues of my recently discovered favourites. Play all the classics at least once a year. Listen to more music that’s ‘different’. Give the old masters more time. New stuff when the hype has settled.
I've written before about using playlists to manage new music, but it's always interesting to see how other people approach this problem.