You can try it both ways and see how your results are.
Generally, you'd just test with the core speed at default, but due to your individual card cooling, case temps and air flow around the card, you might get differing results if you test the mem with your core OCed.