Don't fly between the legs of a Fel Reaver. He finds it offensive and will pummel you.
However, you can fly around his head and chest all you like.