Clayton is an unincorporated community in Panola County, Texas, United States. According to the Handbook of Texas, the community had an estimated population of 79 in 2000. The area was first settled around 1845 by Georgia native Jacob Cariker. He constructed a house two miles southwest of Reed's Settlement, one of the earliest communities in P…Clayton is an unincorporated community in Panola County, Texas, United States. According to the Handbook of Texas, the community had an estimated population of 79 in 2000. The area was first settled around 1845 by Georgia native Jacob Cariker. He constructed a house two miles southwest of Reed's Settlement, one of the earliest communities in Panola County. During the 1870s, most residents from Reed's Settlement had relocated to the Cariker site. A post office was established in 1874 under the name Clayton, after Clayton, Alabama, said to have been the origin of several early settlers. Clayton had a population of 130 in 1885. That number had risen to 200 by 1914. During the Great Depression, the population declined to 175 and steadily decreased thereafter. By the late 1960s, the number of inhabitants stood at 125. By 2000, Clayton had 79 residents and two businesses.