The challenge has been issued.

Also, a ban on building a library in a tavern.

How can this be tracked? Most likely, the player will place it before rebuilding. And then it will rebuild itself and learn.