Standalone DB - Linux

Environment

Using AWS environment with the specification below:

MetaDefender Core

Client tool

A simple tool written in Python to collect files in a designated folder and submit requests to MetaDefender Core.

files_to_scan = list of files to scan

scan_futures = [asyncio.create_task(self.scan_file(file_path)) for file_path in files_to_scan]

​

async def scan_file(self, file_path):

    api_url = f'{self.core_url}/file'

    with open(file_path, 'rb') as file:

        file_content = file.read()

    headers = {'Content-Type': 'application/octet-stream', 'filename': file_path}

    max_retries = 20  # Maximum number of retry attempts

    retry_delay = 120  # Delay in seconds before retrying

    for attempt in range(max_retries + 1):

        try:

            response = requests.post(api_url, data=file_content, headers=headers)

            status_code = response.status_code

            if status_code == 200:

                response_json = response.json()

                data_id = response_json.get('data_id')

                return status_code, response_json, data_id

            if status_code == 503:

                print(f"Received status code {status_code}. Retrying in {retry_delay} seconds...")

                await asyncio.sleep(retry_delay)

            else:

                return None, None, None

        except requests.RequestException as e:

            return None, None, None

    return None, None, None

Dataset

Detailed information of dataset below will be used for testing:

Product Information

Product versions:

• MetaDefender Core version 5.12.1
• Engines:
  • 10 AV engines: Ahnlab, Avira, ClamAV, ESET, Bitdefender, K7, Quick Heal, IKarus, Cyren, Tachyon (nProtect)
  • Deep CDR: 7.2.3
  • Proactive DLP: 2.21.1
  • Archive: 7.2.1
  • File type analysis: 7.2.2
  • File-based vulnerability assessment: 4.57-236

MetaDefender Core settings

General settings

• Turn off data retention
• Turn off engine update

Archive extraction

• Max recursion level: 99999999
• Max number of extracted files: 99999999
• Max total size of extracted files: 99999999
• Timeout: 10 minutes
• Handle archive extraction task as Failed: true
  • Extracted partially: true

Metascan

• Max file size: 99999999
• Scan timeout: 10 minutes
• Per engine scan timeout: 1 minutes

Performance test results

Summary

MetaDefender Core with single engine (technology):

MetaDefender Core with common engine packages:

System resource utilization charts

MetaDefender Core with Metascan (10 AV engines) :

	Utilization charts
CPU usage
Memory usage
Network usage
Disk usage

MetaDefender Core with Metascan (10 AV engines) + Deep CDR :

	Utilization charts
CPU usage
Memory usage
Network usage
Disk usage

MetaDefender Core with Metascan (10 AV engines) + Deep CDR + Proactive DLP :

	Utilization charts
CPU usage
Memory usage
Network usage
Disk usage

MetaDefender Core with Metascan (10 AV engines) + Deep CDR + Proactive DLP + Vulnerability :

	Utilization charts
CPU usage
Memory usage
Network usage
Disk usage

MetaDefender Core with Deep CDR :

	Utilization charts
CPU usage
Memory usage
Network usage
Disk usage

MetaDefender Core with Proactive DLP :

	Utilization charts
CPU usage
Memory usage
Network usage
Disk usage

MetaDefender Core with Vulnerability :

	Utilization charts
CPU usage
Memory usage
Network usage
Disk usage