Yes, that's generally the issue everyone has with the idea of immortality when they think about the practical aspects of it. Everyone around you will inevitably die because they're not immortal, so... hopefully you don't have any worldly attachments.