| Father | Alfred Gilham Lee (1805 - 1870) |
| Mother | Elizabeth Caroline "Ann" Laflesh (1805 - 1875) |
| Sibling | Living |
| Sibling | Caroline Lee ( - ) |
| Sibling | Isaac Lee (1826 - 1900) |
| Sibling | Thomas Laflesh Lee (1828 - 1890) |
| Sibling | Elizabeth Ann Lee (1830 - 1831) |
| Sibling | Mary Elizabeth Lee (1832 - 1905) |
| Sibling | Samuel Francis Lee (1834 - 1894) |
| Sibling | Alfred Laflesh Lee (1837 - 1838) |
| Sibling | Joseph Smith Lee Sr (1839 - 1921) |
| Sibling | George Henry Lee (1841 - 1852) |
| Sibling | Eli Laflesh Lee (1843 - 1904) |
| Sibling | John Stanforth Lee (1848 - 1910) |