| Father | George W. WHITLEY III (1787 - 1858) |
| Mother | Rebecca Louisa CAGLE (1791 - 1873) |
| Sibling | Leonard WHITLEY (1810 - 1811) |
| Sibling | Mary WHITLEY (1812 - ) |
| Sibling | Rebecca WHITLEY (1813 - 1860) |
| Sibling | Green Deberry WHITLEY (1815 - 1881) |
| Sibling | George W. WHITLEY IV (1816 - 1816) |
| Sibling | Benjamin Lindsay WHITLEY (1818 - 1880) |
| Sibling | Addison Franklin WHITLEY (1819 - 1865) |
| Sibling | Temple Irenius WHITLEY (1821 - 1865) |
| Sibling | Louisa WHITLEY (1823 - 1892) |
| Sibling | Susannah WHITLEY (1825 - 1865) |
| Sibling | Elizabeth Carolina "Betty" WHITLEY (1827 - 1899) |
| Sibling | Milia Ann WHITLEY (1829 - ) |
| Sibling | Columbus WHITLEY (1832 - 1890) |