Charlton was established as a District separated off from Oxford. It was named after Sir Francis Charlton, farming continued to be the major occupation, but woolen mills were being built along some of the town's brooks by the turn of the twentieth century.