Jeffrey Dahmer

Is it wrong to feel sorry for Jeffrey Dahmer? ...of course the victims deserve the most sympathy. But I've just read a book detailing Dahmer, his psychology - a life of unrelenting failure and lonliness - and I can't help feeling real sympathy for him. Is that wrong?