Not loading a mod will not exempt you from other people hacking, becaust it isn't loading a mod.
IE in starcraft, you dont have to load a mod for other people to use their maphack.
I want to say that this doesn't detract from the experience, but it does for me.
Then again, it really boils down to what the ARPG genre means to you.
Diablo III was nice until about halfway through inferno, then I let it go at ~60 hours. Great game, but the gear disparity was too much of a problem for me. Definitely got my monies worth though.