He just wants to go quietly. He doesn't want Elena to mourn him, after everything else that happened. And he knows what's coming, he knows how bad it's going to get, and he's just...he's driftwood. He's been drifting for a long, long time.
that is important is that in the very crux of it he brought Elena to his brother. He brought Elena to Stefan so that Stefan could see her, (and so that Damon could un-stake Stefan) because at the end of the 日 he loves them both.