William Madison (1762-1843) (1762–1843) Parents Eleanor Rose Conway James Madison, Sr. Children Letitia Slaughter Siblings unknown son Madison James Madison Frances Taylor Madison Rose Reuben Madison Catlett Madison Elizabeth Madison Francis Madison Ambrose Madison Sarah Catlett Madison Nelly Conway Madison