I knew there was a remove notification which I personally think sucks for LJ to put that up. Because sometimes people will defriend for various reasons and I would rather not know if I get defriended.

Back to you, it sucks for that to happen. You could always ask, chances are you might have been accidentally removed due to your being away for a long while. If not, then accept it and move on.