I don't think it sits well with me either, I've lost people that I dearly love that seemingly had no care for God whatsoever, and according to scripture if they were not elect would be under the condemnation of their creator forever.
It saddens my to contemplate it because of the gift of there...