I'm sitting here at 37C and it's 28C outside .... which is normal + 8 - 10C. Under stress testing all cores / threads, I will hit mid 70s (RoG Real Bench) ... worse gaming temps I have seen is low to mid 60s. GFX cards run at 39C under Furmark (44C with fand topped out at about 650 rpm). And yes, temps will follow a delta T ... if at 23C temp in ya room, 33C means +10 Delta T. Now if it's 35C in ya room, you can then expect 45C. For short term loadings you can get over 90 w/o too much worry. If you are often in the mid 80s or above, you should be prepared for long term degradation. I see OC instability start to creep in simetimes after 5-6 years ... the 4770k box I am typing from for example, I knocked down fro, 4.8 to 4.6 about 6 months ago as it started to act up in some games my son was testing.
As far as addressing the problem, remember delta T ... the difference between room and CPU temps should remaoin a constant. Take a powerful desk fan and after taking off the side panel of your case. If temps drop significantly, then case ventilation should be addresses. Figure one 120 mm fan for every 50-75 watts of componentry (or one 140 mm for every 75-100 watts) .
If you still have a concern, I recommend the $46 Scythe Fuma .... it beats or exceeds the $90 Noctua and Cryorig flagship air cooler and just about every 2 x 120mm CPC type water cooler. If budget is an issue, you could consider the Cryorig C7 or Hyper 212 but the Scyyth beats those by 13C and 11C respectively