For Numenor dates and lifespans, I usually go to "The Line of Elros" in Unfinished Tales. I find it conveniently organized for my purposes, at least.

It is hard to keep track of -- I had this very belated realization a while back that Miriel was 60 years old when her father came to the throne and thus spent her childhood and a significant portion of her adult life in a very hostile atmosphere.

I can see it as entirely plausible that many of the Faithful would have left and not all come back with Tar-Palantir. Or that if they were still in Armenelos, that they could still be afraid to show their beliefs openly during his reign.