Frances Taylor Madison Rose sister of James Madison (1774-1823) (1774–1823) Parents James Madison, Sr. Eleanor Rose Conway Children Lucinda Garland Siblings unknown son Madison Nelly Conway Madison Ambrose Madison Sarah Catlett Madison Francis Madison Elizabeth Madison Catlett Madison James Madison William Madison Reuben Madison