It was not Mark Twain who said the phrase.
The quote first appeared in an editorial in the Hartford Courant of August 24, 1897, probably written by associate editor Charles Dudley Warner.
Warner had collaborated with Twain on The Gilded Age (1873).