Performance measurement

1. Product Information

Product versions to be tested:

  • MetaDefender Kiosk 4.7.8.3994

  • MetaDefender Managed File Transfer 3.9.3.0

  • MetaDefender Core 5.15.0

  • Engines:

    • Metascan:

      • 20 AV engines package + Crowdstrike when testing with CAB file
      • MAX AV engines package when testing with mixed dataset
      • 8 AV engines package when testing with mixed dataset
    • Deep CDR: 7.5.0

    • Proactive DLP: 3.0.0

    • Archive: 7.5.0

    • FileType: 7.5.1

    • File-Based Vulnerability Assessment: 4.2.416.0

2. Environment

MetaDefender Kiosk devices

Using the KIOSK devices in the local test environment. MetaDefender Core is installed on the same system as MetaDefender Kiosk.

ModelCPUMemory (GB)Disk typeOS
K1001 (Dell 7410)

Intel Core i9-13900

Cores: 24

Logical processors: 32

Base speed: 2.00 GHz

32SSD

Windows 10 IoT Enterprise LTSC

Version: 21H2

K1001 (Dell 7420)

Intel Core i9-14900

Cores: 24

Logical processors: 32 Base speed: 2.00 GHz

32SSD

Windows 10 IoT Enterprise LTSC

Version: 21H2

K2100

Intel Core i7-1260U

Cores: 10

Logical processors: 12

Base speed: 1.10 GHz

32SSD

Windows 10 IoT Enterprise LTSC

Version: 21H2

K3001

Intel Core i9-12900

Cores: 16

Logical processors: 24

Base speed: 2.40 GHz

32SSD

Windows 10 IoT Enterprise LTSC

Version: 21H2

Storage Device

Using to store the dataset and connect to the Kiosk device: 128GB SanDisk USB 3.2 Gen 1

MFT Server

In case the MD Kiosk sends files to MD MFT after scanning, MD MFT is a virtual machine with the following specifications:

OSvCPUMemory (GB)Disk typeNetwork bandwidth (Gbps)
Windows Server 2022816SSD10 Gb Ethernet

Client

Using to run the Python script. The Client is a virtual machine with the following specifications:

OSvCPUMemory (GB)Disk typeNetwork bandwidth (Gbps)
CentOS Linux 7.9816SSD10 Gb Ethernet

3. Test flows

  • Flow 1: MD Kiosk sends CAB file to MD Core (21 AV engines) for scanning.
  • Flow 2: MD Kiosk sends Mixed dataset to MD Core (MAX AV engines) for scanning.
  • Flow 3: MD Kiosk sends Mixed dataset to MD Core (8 AV engines) for scanning.
  • Flow 4: MD Kiosk sends Mixed dataset to MD Core for scanning, and Allowed files are copied to MD MFT.

4. Dataset

CAB file:

  • Extracted files: 849 479
  • Total size of extracted files: 26.5 GB

Mixed dataset:

  • Summary (compressed):

    • Number of files: 5000
    • Total size: 7728.5 MB
    • Average file size: 1.55 MB
  • Summary (extracted):

    • Number of files: 5260
    • Total size: 7759.5 MB
    • Average file size: 1.48 MB
  • Largest file size: 24.7 MB

  • Smallest file size: 5 KB

File categoryFile typeNumber of filesTotal size (MB)Average file size (MB)
AdobePDF370385 MB1.0 MB
ExecutableEXE45309.5 MB6.9 MB
MSI1545.75 MB3.1 MB
ImageBMP80515 MB6.4 MB
JPG420237.5 MB0.6 MB
PNG345169 MB0.5 MB
MediaMP3135865 MB6.4 MB
MP450500 MB10.0 MB
OfficeDOCX235190 MB0.8 MB
DOC225486 MB2.2 MB
PPTX365860 MB2.4 MB
PPT3551950 MB5.5 MB
XLSX340283.5 MB0.8 MB
XLS335284.5 MB0.8 MB
TextCSV100236 MB2.4 MB
HTML107576 MB0.1 MB
TXT500210 MB0.4 MB
ArchiveZIP

Compressed files: 10

Extracted files: 270

Compressed size: 125.5 MB

Extracted size: 156.5 MB

Avg compressed size: 12.6 MB

Avg extracted size: 0.6 MB

5. MetaDefender Core settings

General settings

  • Turn off data retention
  • Turn off the engine update
  • Max size:
    • File scan: 9999999999999 MB
    • URL file download: 9999999999999 MB

Metascan

  • Enable engines depend on the testing package
  • Per AV engine scan: 1 min
  • Global scan: 10 mins
  • File download: 5 mins

Deep CDR

  • Enable engine
  • 135 file types

Proactive DLP

  • Enable engine

Archive Extraction

  • Enable engine
  • Max recursive level: 99999999
  • Max number of files extracted: 99999999
  • Max total size of extracted files: 99999999
  • Timeout: 90 mins

Archive Compression

  • Enable engine

FileType

  • Enable engine
  • Timeout: 5 mins

File-Based Vulnerability Assessment

  • Enable engine

6. Test Summary

Flow 1: MD Kiosk sends CAB file to MD Core (21 AV engines) for scanning.

DeviceDurationAvg. CPU UsageAvg. Memory UsageAvg. Disk Speed (KB/s)Throughput (objects/hour)Throughput (files/hour)
Kiosk Desktop (Dell 7420)3 hours and 27 minutes46.4%61.8%Read 2,855.8 Write 14,135.1246,232.30.3
Kiosk Desktop (Dell Pro 24)3 hours58.4%63.0%Read 2,577.6 Write 16,037.1329,556.70.3
Kiosk Mobile/Mini (Dell 7230)9 hours 56 minutes94.4%52.3%Read 808.9 Write 5,942.385,5200.1
Kiosk Tower (Dell 17S XE4)3 hours 56 minutes59.7%61.6%Read 1,897.1 Write 14,183.6222,847.50.3

Flow 2: MD Kiosk sends Mixed dataset to MD Core (MAX AV engines) for scanning.

DeviceDurationAvg. CPU UsageAvg. Memory UsageAvg. Disk Speed (KB/s)Throughput (objects/hour)Throughput (files/hour)
Kiosk Desktop (Dell 7420)2 hours and 21 minutes49.2%71.8%Read 5,302.8 Write 6,856.655,347.41.693
Kiosk Desktop (Dell Pro 24)2 hours and 15 minutes47.8%75.0%Read 5,606.3 Write 7,221.457,950.22,226.3
Kiosk Mobile/Mini (Dell 7230)5 hours 15 minutes94.3%60.1%Read 2,170.9 Write 4,143.624,764951.4
Kiosk Tower (Dell 17S XE4)2 hours 26 minutes61.5%72.3%Read 5,770 Write 7,001.253,663.72,061.4

Flow 3: MD Kiosk sends Mixed dataset to MD Core (8 AV engines) for scanning.

DeviceDurationAvg. CPU UsageAvg. Memory UsageAvg. Disk Speed (KB/s)Throughput (objects/hour)Throughput (files/hour)
Kiosk Desktop (Dell 7420)56 minutes28.7%42.2%Read 7,557 Write 10,145.2138,819.85,333.3
Kiosk Desktop (Dell Pro 24)51 minutes24.7%42.5%Read 7,337.8 Write 9,348.6167,419.25,863.2
Kiosk Mobile/Mini (Dell 7230)1 hour 36 minutes71.9%39.6%Read 4,195.9 Write 6,610.781,001.73,111.5
Kiosk Tower (Dell 17S XE4)52 minutes32.7%41.8%Read 7,242.8 Write 10,545151,525.75,821.5

Flow 4: MD Kiosk sends Mixed dataset to MD Core for scanning, and Allowed files are copied to MD MFT.

DeviceDurationAvg. CPU UsageAvg. Memory UsageAvg. Disk Speed (KB/s)Avg. Network Speed (KB/s)Throughput (objects/hour)Throughput (files/hour)
Kiosk Desktop (Dell 7420)1 hour 23 minutes16.9%44.6%Read 4,767.6 Write 4,479.7Receive 12.2 Send 1,645.5213,096.73,611.6
Kiosk Desktop (Dell Pro 24)1 hour and 40 minutes7.0%32.5%Read 4,417.4 Write 4,348.76Receive 27 Send 1,398.2165,829.22,993.5
Kiosk Mobile/Mini (Dell 7230)1 hour 18 minutes38.3%28.1%Read 4,930.3 Write 8,521.3Receive 27.5 Send 1,769.7120,420.33,863.5
Kiosk Tower (Dell 17S XE4)1 hour 2 minutes11.2%32.5%Read 5,148.7 Write 7,479Receive 78.5 Send 2,021.5174,025.34,838.7
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard