I have created a new HTTP port and have put IP restrictions against it. I have noticed significant response degredation when the restrictions are enabled. what would take 150ms now takes 1000ms.
Is it the same with one address in the list or does it get worse the more you add? You may need to open a ticket on this as it should not degrade that much.