All penalties or interest and all penalties and interest imposed or authorized to be imposed by any state law or municipal ordinance, accrued or which may accrue hereafter, shall be recoverable by the officer authorized to sue for or collect the tax in respect to which said penalties or interest are imposed or authorized to be collected as a part of the tax with respect to which they are imposed or authorized to be collected, and all such penalties and interest shall be apportioned as provided for the apportionment of the tax on which such penalties or interest are collected.