| Father | James Madison McBrayer Sr (1769 - 1851) |
| Mother | Mary "Polly" Stratton (1779 - 1872) |
| Sibling | William Strutton "Stratton" McBrayer (1798 - 1857) |
| Sibling | Elizabeth "Betsy" McBrayer (1806 - 1839) |
| Sibling | Jane Elmyra McBrayer (1810 - 1875) |
| Sibling | Martha Caroline McBrayer (1810 - 1906) |
| Sibling | Rev James Madison McBrayer (1814 - 1899) |
| Sibling | James Henry McBrayer II (1815 - 1884) |
| Sibling | Maria Theresa "Millie" McBrayer (1816 - 1880) |
| Sibling | Thomas Adolphus McBrayer (1820 - 1874) |
| Sibling | Andrew Harvey McBrayer (1829 - 1856) |