Alternative rating.

...a player who is challenged to a duel must accept the challenge at least once...

There is no need for any penalty system. This isn't a job. Besides, if a person receives 10 requests to play in a day, and is obligated to play with each one, there will be legal disputes, not games.