| Father | Thomas Scott Spencer (1721 - 1793) |
| Mother | Elizabeth Julia Flournoy (1721 - 1793) |
| Sibling | Mary Spencer (1742 - 1829) |
| Sibling | Capt John Spencer (1745 - 1826) |
| Sibling | Elizabeth Julia Spencer (1747 - 1831) |
| Sibling | Ann Spencer (1749 - 1777) |
| Sibling | Col Thomas Cole Spencer Jr (1750 - 1806) |
| Sibling | Octavius William Spencer (1755 - 1806) |
| Sibling | Samuel Flourney Spencer (1755 - 1838) |
| Sibling | Judith Spencer (1757 - ) |
| Sibling | Martha Owen Spencer (1758 - 1833) |
| Sibling | Gideon Spencer (1760 - 1822) |
| Sibling | John Spencer (1770 - 1835) |