Eleanor Rose Conway (1731-1829) (1731–1829) Parents Rebecca Catlett Francis Conway Children Ambrose Madison William Madison James Madison Nelly Conway Madison Francis Madison Catlett Madison unknown son Madison Sarah Catlett Madison Reuben Madison Frances Taylor Madison Rose Elizabeth Madison Siblings Jane Taylor Francis Conway Partners James Madison, Sr.