Kelsey Grammer -- Piers Morgan's Ban Is IRRELEVANT

Kelsey Grammer DOESN'T GIVE A CRAP about his lifetime ban from the Piers Morgan show ... telling TMZ the CNN host is so irrelevant, it's not worth his time to be upset. We broke the story ... Kelsey became persona non grata at Morgan's show last…