| Father | George C. Gilmer Jr (1742 - 1795) |
| Mother | Lucy Walker (1751 - 1800) |
| Sibling | Thomas Walker Gilmer (1771 - 1793) |
| Sibling | Mildred Gilmer (1772 - 1799) |
| Sibling | George Gilmer III (1778 - 1836) |
| Sibling | Peachy Ridgeway Gilmer (1779 - 1836) |
| Sibling | Walker Gilmer (1781 - 1826) |
| Sibling | John Gilmer MD (1782 - 1834) |
| Sibling | Susanna Fry Gilmer (1783 - 1817) |
| Sibling | Harmer Gilmer (1787 - 1812) |
| Sibling | (Francis) Thornton Walker Gilmer (1790 - 1826) |
| Sibling | Lucy Walker Gilmer (1781 - 1848) |
| Sibling | George Walker Gilmer III (1778 - 1836) |