Far-right activist Neil Erikson has picked up a Koran by mistake before giving sworn evidence in court about Toll uniforms worn in inflammatory videos.

Erikson appeared before the Federal Circuit Court on Monday after he breached court orders by failing to hand back Toll uniform items, after they were worn in United Patriots Front videos - including one where former senator Sam Dastyari is ambushed at a Melbourne pub.

The unemployed forklift driver picked up the Koran as he prepared to give sworn evidence by providing a religious oath on Monday, before he picked up the Bible when court staff pointed out the difference.