Hi There
I have not managed to get back further than the early 1700's with the Bagge's but I have now found out that they were never on the Isle of Mann but from the Norfolk area of England. I agree that the name is Scandinavian in origin so I have no doubt that they came from Norway or Denmark originally.
If you would like my info, I would be happy to send it on. There appears to be many Bagge's that went to USA from England.