James married Martha "Patty" Lewis on 10 Oct 1858 in Annapolis, Iron County, Missouri, USA. Martha (daughter of George Lewis and Elizabeth Gilliland) was born on 25 Mar 1839 in , Marion County, Tennessee, USA; died on 25 Mar 1919 in Annapolis, Iron County, Missouri, USA; was buried in Annapolis Cemetery, Annapolis, Iron County, Missouri, USA. [Group Sheet] [Family Chart]

1. Elizabeth Josephine Casteel was born in 1860.
2. Rebecca Isabelle Casteel was born in Dec 1862 in , , Missouri, USA; died on 1 Apr 1926 in , Iron County, Missouri, USA; was buried in Annapolis Cemetery, Annapolis, Iron County, Missouri, USA.
3. Nancy "Jennie" Jane Casteel was born on 22 Aug 1863 in , Iron County, Missouri, USA; died on 28 Apr 1939 in , Iron County, Missouri, USA; was buried in Annapolis Cemetery, Annapolis, Iron County, Missouri, USA.
4. Levander "Lee" James Casteel was born on 11 Jul 1865 in Annapolis, Iron County, Missouri, USA; died on 21 Jun 1941 in Annapolis, Iron County, Missouri, USA.
5. Galveston L. Casteel was born on 7 Apr 1868 in Annapolis, Iron County, Missouri, USA; died on 14 Mar 1943 in Union Township, Iron County, Missouri, USA; was buried in Annapolis, Iron County, Missouri, USA.
6. Hepsie Charlotte Casteel was born on 7 Dec 1874 in Annapolis, Iron County, Missouri, USA; died on 3 Aug 1955 in Poplar Bluff, Butler County, Missouri, United States; was buried in Memorial Gardens Cemetery, Butler County, Missouri, United States.