| Spouse | Susan Anne McBrayer (1806 - 1888) |
| Child | Mary Frazier (1826 - 1926) |
| Child | Nancy Frazier (1832 - ) |
| Child | Elizabeth Frazier (1834 - 1910) |
| Child | Rhoda Frazier (1836 - 1913) |
| Child | Caroline Frazier (1837 - 1913) |
| Child | George Morgan Frazier (1839 - 1917) |
| Child | William Thomas Frazier (1842 - 1900) |
| Child | Susan Frazier (1845 - 1904) |
| Child | Sarah Frazier (1846 - 1902) |
| Child | Rebecca Frazier (1851 - 1902) |
| Child | John Wesley Frazier (1852 - 1919) |
| Child | James Frasure (1853 - ) |
| Child | Samuel P Frazier (1858 - 1922) |
| Child | Armenia Frazier (1860 - ) |