A question about a British phrase? Possibly a spiritual one?

Jove is another name of Jupiter, the Roman equivalent of Zeus. People swore by him (in Roman courts of law) because he was the overseer of cosmic justice.