The residence of a person for the purpose of taxation shall not be changed by a temporary removal from a town to avoid taxation.