If the party is detained for any cause or offense for which the party is bailable, the party shall be discharged on becoming bound by recognizance, in a proper sum and with sufficient surety, for appearance at the court having cognizance of the matter. If the party does not give such security, the party shall be remanded with an order therefor expressing the sum in which the party is held to bail, and the court at which the party is required to appear. Any justice of the peace, court or other officer authorized by law to take bail, may, at any time before the sitting of the court, bail the party pursuant to such orders.