I offer for your review only the facts (it will be up to you to decide what is what and how it all fits together :) )
Currently, there is no shortage of information regarding antivirus testing. Moreover, the test results and the ratings assigned based on these results sometimes follow opposite vectors of evaluation.
As a rule, all tests boil down to evaluating the results of checking certain antiviruses against some set of malicious objects. The objectivity of such check results depends most heavily on the following aspects:
- Availability of the virus collection or its composition to the antivirus authors
- Quality of the virus collection
- Adequacy of the virus set to real viral threats
- There are quite a few "collections" of viruses that include software modules that are only similar to viruses, but in reality are incapable of causing any harm. Most often these are programs that were infected by a virus, but subsequently the virus within them was sterilized—meaning the program was modified and the virus code no longer gains control. Such a program is no longer a malicious object, but it contains traces (signatures) of a virus's presence. If it is checked by an antivirus with primitive recognition algorithms—for example, by scanning the body of the checked object for certain signatures—then this "antivirus" will let out a victory cry, and its author will be proud that another antivirus "misses" the virus. A huge number of such examples can be given; therefore, if the quality of the collection is not verified and confirmed by independent specialists, the value of testing on such a collection will be low. Thus, primitive antiviruses will seem better than more advanced ones capable of modeling executable program code.
- Another important aspect is how adequate the chosen collection composition is to the existing threat. Again, there are a vast number of collections consisting of viruses for which the probability of landing on computers is zero. One has to deal with "testing" results using same-collector viruses held only by the antivirus author, who is very proud that this set of viruses is detected only by their antivirus and no one else! The real value of such an "antivirus" is also equal to zero.
In reality, the true value of an antivirus lies in its ability to prevent attacks from malicious objects that actually and currently threaten your computer. Unfortunately, all existing methods of testing antiviruses cannot provide such an assessment!
Below is a proposed methodology for assessing antivirus quality based on calculating the probability of an antivirus resisting attacks from malicious objects that actually threatened the computer system. The numerical value of such an assessment can be calculated using the formula:
Pav - Probabilistic quality assessment of the antivirus; the closer it is to one, the better the antivirus.
Nvir - Total number of recorded malicious objects on this computer (organization).
Nbad - Number of malicious objects that the antivirus failed to detect at the time of attack.
Table 1 contains calculations of the reliability indicator (last column) for various antiviruses. The results of checking the reaction of various antiviruses to malicious objects actually encountered by the author of this publication between January 2006 and July 2007 were used as source data. The total number of recorded malicious objects was 51. The calculated reliability indicators for various antiviruses are provided in Table 1.
| Antivirus Name | Viruses missed during the corresponding period of 2006 - 2007 | Viruses missed out of 51 attacks | Antivirus Quality | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 10.12 - 23.02 | 17.05 | 05.06 - 13.07 | 12.07 | 17.07 | 21.07 | 24-26.07 | 27.07 | 27.07 | 30.07 | 31.07 | 03.08 | |||
| DrWeb | 12 | 1 | 0 | 0 | 0 | 0 | 3 | 0 | 0 | 1 | 0 | 0 | 17 | 0,667 |
| Kaspersky | 11 | 1 | 3 | 1 | 0 | 0 | 2 | 1 | 0 | 0 | 1 | 1 | 21 | 0,588 |
| AntiVir | 13 | 1 | 2 | 0 | 2 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 22 | 0,569 |
| Fortinet | 14 | 1 | 0 | 0 | 2 | 2 | 1 | 0 | 1 | 1 | 1 | 1 | 23 | 0,549 |
| Sophos | 19 | 1 | 0 | 0 | 0 | 1 | 0 | 0 | 1 | 1 | 1 | 0 | 24 | 0,529 |
| BitDefender | 14 | 1 | 3 | 0 | 2 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 25 | 0,510 |
| McAfee | 19 | 0 | 1 | 0 | 2 | 2 | 0 | 0 | 1 | 1 | 0 | 1 | 27 | 0,471 |
| Ikarus | 19 | 1 | 1 | 0 | 2 | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 27 | |
| eSafe | 15 | 1 | 4 | 1 | 1 | 2 | 3 | 1 | 1 | 0 | 0 | 0 | 28 | 0,451 |
| NOD32v2 | 16 | 1 | 4 | 0 | 2 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 29 | 0,431 |
| CAT-QuickHeal | 19 | 0 | 3 | 0 | 2 | 2 | 0 | 1 | 1 | 0 | 1 | 1 | 30 | 0,412 |
| ClamAV | 16 | 0 | 3 | 1 | 2 | 2 | 2 | 1 | 1 | 1 | 1 | 1 | 31 | 0,392 |
| VBA32 | 18 | 0 | 4 | 0 | 1 | 1 | 2 | 1 | 1 | 1 | 1 | 1 | 31 | |
| Sunbelt | 20 | 1 | 3 | 0 | 2 | 2 | 0 | 1 | 1 | 0 | 1 | 1 | 32 | 0,373 |
| Norman | 21 | 1 | 1 | 1 | 1 | 1 | 3 | 0 | 1 | 1 | 1 | 0 | 32 | |
| F-Prot | 16 | 1 | 4 | 1 | 2 | 2 | 3 | 1 | 1 | 1 | 1 | 1 | 33 | 0,353 |
| Microsoft | 26 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 1 | 1 | 1 | 1 | 33 | |
| Panda | 19 | 1 | 4 | 0 | 2 | 2 | 1 | 1 | 1 | 0 | 1 | 1 | 33 | |
| Authentium | 16 | 1 | 4 | 1 | 2 | 2 | 3 | 1 | 1 | 1 | 1 | 1 | 34 | 0,333 |
| AVG | 18 | 1 | 4 | 0 | 2 | 2 | 2 | 1 | 1 | 1 | 1 | 1 | 34 | |
| TheHacker | 23 | 1 | 2 | 1 | 1 | 1 | 3 | 0 | 1 | 1 | 1 | 1 | 36 | 0,294 |
| Ewido | 22 | 1 | 4 | 1 | 2 | 1 | 3 | 1 | 1 | 1 | 1 | 1 | 38 | 0,255 |
| Avast | 25 | 0 | 4 | 1 | 2 | 2 | 0 | 1 | 1 | 1 | 1 | 0 | 39 | 0,235 |
| Antivirus Name | Viruses missed during the corresponding period | Viruses missed out of 17 attacks | Antivirus Quality | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 30-01 | 02-02 | 02-02 | 14-02 | 23-02 | 17-07 | 17-07 | 21-07 | 21-07 | 24-07 | 25-07 | 25-07 | 27-07 | 27-07 | 30-07 | 31-07 | 03-08 | |||
| DrWeb | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 6 | 0,647 |
| Kaspersky | 0 | 1 | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 1 | 0 | 0 | 1 | 1 | 8 | 0,529 |
| NOD32v2 | 0 | 1 | 1 | 0 | 0 | 1 | 1 | 0 | 1 | 0 | 0 | 0 | 1 | 1 | 1 | 1 | 1 | 10 | 0,412 |
| Symantec | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 14 | 0,176 |
Sincerely K0Lb@zzeR.
:smile28: [M] "Я и моя тень" - "I am and my shadow" :smile28:
:smile16: