Upon receipt of an application for a permit to engage in any business taxable under the provisions of Sections 27-71-303 through 27-71-317, Mississippi Code of 1972, and the oath required by Section 67-3-17, the commissioner shall issue to such applicant, without cost, a permit to engage in such business upon condition that the applicant shall obtain a license and pay the tax imposed under the provisions of law for the privilege of engaging, or continuing, in such business. Such permit shall be displayed at all times in some conspicuous place at the applicant's place of business. No permit shall be transferable.