Well I do shooting all year, hot in the 90's to cold in the below numbers. Cold temperatures will effect the POI. But lets say you are dead bull in the summer. At the distance you were talking there might be a couple inches difference. So while the temps can make a difference, I think the problem might lie somewhere else.
Primer changes, powder changes, bullet changes, cleaning procedure changes, swabbing changes, prep of the rifle, there could be a number of things. Maybe you just misses. Who knows. That is hunting for you. You also might have hit the animal but in a place where it showed little to no effect. High hits between the organs and the spine can do that. There is a layer there where if a deer is hit, they will often times run off with what appears to be little ill effect.
Lets consider this, a couple inches high at 100 yards means a little more at 50 yards. Now add the cold temp difference, and it could mean several inches high at that distance. I think I would hit the range and try to match the circumstances and see what the rifle tells me.