Casper left the place where he was surrounded by Ridires. He seemed pretty calm when dealing with Freygar, but the truth was that he was on the verge of opening that door and start a fight with him.
When they crossed, all he wanted was to turn around again and knock him out, or that the Aesir lost control to give him a reason to start something.
However, that was not the time yet, just as it wasn't in the infirmary from the upper levels of the Third Lab, nor in the path to the interrogation room. The time when they would solve their differences was still to come.
Casper knew that it would be more beneficial to just brush it off and run for it, leading the prisoners to the outside. And Freygar also was aware of his opportunity to stop them if he waited for the White warrior to initiate that maneuver.
This way, both controlled themselves, and waited for the right time, even though it was hard.