She based it on a family story of her forebears: an early-nineteenth-century John Allingham who had a second family by Charlotte Duncan, in addition to his legitimate family.
Martin, Richard. Ink in Her Blood: The Life and Crime Fiction of Margery Allingham. UMI Research Press.