In the eighteenth century, the best meat of any meal went to the men of the house and their friends.
The women and children ate the umbles, the tongue and entrails, baked in an umble pie.
In time, the dish went out of fashion, but the phrase took on a new life that it still has today.