When will Rob Lowe learn? He left The West Wing because he didn't feel like his character was the lead, he turned down the actual lead of McDreamy in Grey's Anatomy, and then he joined the thousand-member cast of Brothers and Sisters as Calista Flockhart's husband. Now, you will not be surprised to find out, he is leaving that show too because he doesn't feel like he has enough to do. Also, they totally wouldn't change the title of the show to Brother-in-Law and Others. [Deadline]