Horse too attached to the herd?

He may just think it's bogus for him to be inside and the rest are out. Try bringing him in with another horse (one that he hangs around a lot) at the same time so he doesn't feel like he is being stuck inside while the rest of the horses are out in the field having a good time.