Leaving Judo

I broke my neck a couple years ago, and it just can't take the constant throwing. So I'm thinking about making the move to BJJ. The thing is, I love Judo. My ego is telling me not to move, it says that it doesn't matter that I can't move my neck for two days after practice. My mind is telling me that I'm being ridiculous and that I'm going to be sorry when I'm older.

So any comments welcome, comic relief, real advice, whatever.