I had no idea a thread like this could actually generate discussion. Arguments being used:
1. Arguments that don't care for energy conservation: please...
2. CPU operating at higher temperatures have higher power draw than on lower temperatures: That's true but i bet i wont make any measurable difference in room temperatures, assuming like +5 W. I dont know the exact numbers though.
3. Thermal inertia of the heat sink will impact the room temperature (the one with graphs): While true this effect is negligible. It will not take hours before coolers reach their final temperature. I don't have a aftermarket cooler, but if its anything like GPUs, it will take more like 5 minutes after starting the CPU load... after that, heat output will be the same regardless of cooler. Not only that, but if you later stop the CPU load, CPU/heat sink temperatures will go back to idle levels, unloading the stored energy back to the ambient.
So, in the end, if you run your CPU load non stop, it will indeed keep a little bit of heat out of the ambient, but when you are generating a lot more heat for hours, it doesnt matter. If you run a variable load, it does not matter since on lower loads the heatsink unloads the stored heat to the ambient.