Standalone DB - Windows

Disclaimer

These results should be viewed as guidelines and not performance guarantees, since there are many variables that affect performance (file set, network configurations, hardware characteristics, etc.). If throughput is important to your implementation, OPSWAT recommends site-specific benchmarking before implementing a production solution.

Environment

Using AWS environment with the specification below:

MetaDefender Core

OS

AWS instance type

vCPU

Memory (GB)

Network bandwidth (Gbps)

Disk type

Windows Server 2022

c5.4xlarge

16

32

Up to 10

SSD

Client tool

A simple tool written in Python to collect files in a designated folder and submit requests to MetaDefender Core.

files_to_scan = list of files to scan scan_futures = [asyncio.create_task(self.scan_file(file_path)) for file_path in files_to_scan] async def scan_file(self, file_path): api_url = f'{self.core_url}/file' with open(file_path, 'rb') as file: file_content = file.read() headers = {'Content-Type': 'application/octet-stream', 'filename': file_path} max_retries = 20 # Maximum number of retry attempts retry_delay = 120 # Delay in seconds before retrying for attempt in range(max_retries + 1): try: response = requests.post(api_url, data=file_content, headers=headers) status_code = response.status_code if status_code == 200: response_json = response.json() data_id = response_json.get('data_id') return status_code, response_json, data_id if status_code == 503: print(f"Received status code {status_code}. Retrying in {retry_delay} seconds...") await asyncio.sleep(retry_delay) else: return None, None, None except requests.RequestException as e: return None, None, None return None, None, None

OS

AWS instance type

vCPU

Memory (GB)

Network bandwidth (Gbps)

Disk type

CentOS 7

c5.2xlarge

8

16

Up to 10

SSD

Dataset

Detailed information of dataset below will be used for testing:

File category

File type

Number of files

Total size (MB)

Average file size (MB)

Adobe

PDF

370

385 MB

1.0 MB

Executable

EXE

45

309.5 MB

6.9 MB


MSI

15

45.75 MB

3.1 MB

Image

BMP

80

515 MB

6.4 MB


JPG

420

237.5 MB

0.6 MB


PNG

345

169 MB

0.5 MB

Media

MP3

135

865 MB

6.4 MB


MP4

50

500 MB

10.0 MB

Office

DOCX

235

190 MB

0.8 MB


DOC

225

486 MB

2.2 MB


PPTX

365

860 MB

2.4 MB


PPT

355

1950 MB

5.5 MB


XLSX

340

283.5 MB

0.8 MB


XLS

335

284.5 MB

0.8 MB

Text

CSV

100

236 MB

2.4 MB


HTML

1075

76 MB

0.1 MB


TXT

500

210 MB

0.4 MB

Archive

ZIP

Compressed files: 10

Extracted files: 270

Compressed size: 125.5 MB

Extracted size: 156.5 MB

Avg compressed size: 12.6 MB

Avg extracted size: 0.6 MB

Summary (compressed)


5000

7728.5 MB

1.55 MB average file size

Summary (extracted)


5260

7759.5 MB

1.48 MB average file size

Product Information

Product versions:

  • MetaDefender Core version 5.6.0

  • Engines:

    • 8 AV engines: Ahnlab, Avira, ClamAV, ESET, Bitdefender, K7, Quick Heal, VirIT Explorer

    • Deep CDR: 6.6.2

    • Proactive DLP: 2.16.0

    • Archive: 6.3.2

    • File type analysis: 6.3.2

    • File-based vulnerability assessment: 4.2

MetaDefender Core settings

General settings

  • Turn off data retention

  • Turn off engine update

Archive extraction settings

  • Max recursion level: 99999999

  • Max number of extracted files: 99999999

  • Max total size of extracted files: 99999999

  • Timeout: 10 minutes

  • Handle archive extraction task as Failed: true

    • Extracted partially: true

Metascan AV settings

  • Max file size: 99999999

  • Scan timeout: 20 minutes

  • Per engine scan timeout: 5 minutes

Performance test results

Summary

MetaDefender Core with single engine (technology):

Use case

Scan duration (minutes)

Avg. CPU usage (%)

Avg. Memory usage (%)

Avg. Network speed (KB/s)

Throughput (processed objects/hour)

Avg. processing time (seconds/object)

Metascan (8 AV)

31

42.6

30.6

Receive: 8,116.2 Send: 85.5

249,872.6

0.014

Deep CDR

20

59.8

30.2

Receive: 12,113.1 Send: 70

374,999.4

0.01

Proactive DLP

16

39.6

29.5

Receive: 14,055.3 Send: 99.2

482,510.5

0.007

Vulnerability

10

57.5

23.9

Receive: 13,521.9 Send: 97.7

748,308.5

0.005

MetaDefender Core with common engine packages:

Use case

Scan duration (minutes)

Avg. CPU usage (%)

Avg. Memory usage (%)

Avg. Network speed (KB/s)

Throughput (processed objects/hour)

Avg. processing time (seconds/object)

Metascan (8 AV engines) + Deep CDR

35

64.2

34.4

Receive: 10,400.9 Send: 61.6

218,663.8

0.016

Metascan (8 AV engines) + Deep CDR + Proactive DLP

37

72.7

37.6

Receive: 11,558.3 Send: 75.7

205,513.6

0.018

Metascan (8 AV engines) + Deep CDR + Proactive DLP + Vulnerability

37.5

73.6

36.9

Receive: 12,577.4 Send: 83.5

203,880.7

0.018

System resource utilization charts

MetaDefender Core with Metascan (8 AV engines):


Utilization charts

Memory usage


CPU usage


Network usage


MetaDefender Core with Metascan (8 AV engines) + Deep CDR:


Utilization charts

Memory usage


CPU usage


Network usage


MetaDefender Core with Metascan (8 AV engines) + Deep CDR + Proactive DLP:


Utilization charts

Memory usage


CPU usage


Network usage


MetaDefender Core with Metascan (8 AV engines) + Deep CDR + Proactive DLP + Vulnerability:


Utilization charts

Memory usage


CPU usage


Network usage


MetaDefender Core with Deep CDR :


Utilization charts

Memory usage


CPU usage


Network usage


MetaDefender Core with Proactive DLP :


Utilization charts

Memory usage


CPU usage


Network usage


MetaDefender Core with Vulnerability:


Utilization charts

Memory usage


CPU usage


Network usage



Next to read:
Standalone DB - Linux
null
On This Page