On big packs, sure, grim harvest is dependable enough. Smaller, spread out packs, not so much. Keep in mind, you have permanent ancients, you can probably afford to spend your fury a bit more freely.
Even if I had zero fury usage, I still might prefer CDR over IAS, just from a damage...