I'm not sure that there are any bonafide high-altitude fossil sites older than the Pliocene, though there might be some in the Rockies (Florissant?).
Was it you who once mentioned the Gamburtsev Mountains in Antarctica onlist? Whoever did, however, ended by saying "Unfortunately, they're covered by about a mile of ice."