Add a "temporarily allow" feature

A post was split to a new topic: Temporary bypass by IP address