I would like to point out that Oliver was hanging behind because he was stationed there. The soldiers' marching orders were how they were seated in the wagon.

Oliver Desolair is a lot of things, but he's no coward.