Well if you needed to keep track of the dealings you had with them whilst they were alive, you might want to keep track of who they were. Provided they don't have an Address they do not take up any of your licensed capacity anyway.

By marking someone as 'Deceased' they will automatically be excluded from mail-merges and will not appear if you send correspondence to someone and their partner, if their partner is dead.