Physical or Virtual Machine-Based Setup

Before executing the setup, please ensure System requirements are met and that any necessary dependencies are installed.

Installation order

MetaDefender Cluster consists of the following components along with their corresponding default ports.

StepComponentHow to install (short name)Default port
1Redis Caching ServerRedis6379
2RabbitMQ Message BrokerRabbitMQ5672
3PostgreSQL Database ServerPostgreSQL5432
4MetaDefender Cluster File StorageMD Cluster File Storage8890
5MetaDefender Cluster Identity ServiceMD Cluster Identity Service8891
6MetaDefender Cluster Control CenterMD Cluster Control Center8892
7MetaDefender Cluster WorkerMD Cluster Worker8893

The system administrator should adhere to the following service installation sequence to prevent conflicts:

  1. Install Redis, RabbitMQ, Postgres, MD Cluster File Storage, MD Cluster Identity Service.
  2. Install MD Cluster Control Center.
  3. Install MD Cluster Worker on the targeted machines (for deploying MD Cluster API Gateway or MetaDefender Core).

An exception rule for the firewall needs to be created to permit both incoming (inbound) and outgoing (outbound) connections to every component.

While many components can be set up on a single machine, they should be installed individually on different machines according to their features. Kindly consult Best practices for further information.

Installation

Install Redis Caching Server

Redis version 7.0 or higher is required.

Only Redis on Linux is officially recommended.

  1. Follow steps to install Redis Caching server.
  2. Access Redis configuration file/etc/redis/redis.conf for editing.
  3. Comment out the bind setting and set protected-mode option to no.
redis.conf
Copy
  1. Restart the service.
Bash
Copy

Install RabbitMQ Message Broker

RabbitMQ version 3.13.0 or higher is required.

RabbitMQ functions effectively only with specific supported versions of Erlang. Please refer to the link for the Erlang-RabbitMQ compatibility matrix.

Windows

  1. Download Erlang and follow the instructions to install Erlang.
  2. Download RabbitMQ for Windows.
  3. Run the executable file as administrator, follow instructions to complete the RabbitMQ installation.
  4. In Command Prompt, change working directory to <RabbitMQ installation folder>/rabbitmq_server-<version>/sbin and run the following command:
None
Copy

Linux

  1. Download Erlang and follow the instructions to install Erlang and its dependencies.
  2. Download RabbitMQ for Red Hat/Rocky or Debian/Ubuntu .
  3. In Terminal, run the following command:
Bash
Copy
  1. In Terminal, run the following command:
None
Copy

Install PostgreSQL Database Server

PostgreSQL version 16.9 or higher is required.

pg_trgm extension is required for PostgreSQL running on Linux.

  1. Download PostgreSQL Database Server.
  2. Follow steps to setup Postgres Database Server to allow connections from external applications.
  3. Restart Postgres Database Server.

Install MD Cluster File Storage

  1. Build Ignition file for MD Cluster File Storage service.
  2. Start Command Prompt as Administrator on Windows or Terminal on Linux and run the following command:
Bash
Copy
  1. Check the service status.

Install MD Cluster Identity Service

  1. Build Ignition file for MD Cluster Identity Service.
  2. Start Command Prompt as Administrator on Windows or Terminal on Linux and run the following command:
Bash
Copy
  1. Check the service status.

Install MD Cluster Control Center

  1. Build Ignition file for MD Cluster Control Center service.
  2. Start Command Prompt as Administrator on Windows or Terminal on Linux and run the following command:
Bash
Copy
  1. Check the service status.

Setup Data Lake and Data Warehouse

  1. Go to C:\Program Files\OPSWAT\MetaDefender Distributed Cluster Control Center directory in Windows Command Prompt or /usr/sbin directory in Linux Terminal.
  2. Run the following command:
Bash
Copy

Make sure the postgres-user possesses superuser rights to successfully create the database.

Install MD Cluster Worker

You need to prepare at least two workers: one for MetaDefender Core and the other for MD Cluster API Gateway.

  1. Build Ignition file for MD Cluster Worker service.
  2. Start Command Prompt as Administrator on Windows or Terminal on Linux and run the following command:
Bash
Copy
  1. Check the service status.
  2. Repeat the above steps for other MD Cluster Workers.

Configurations

When all MD Cluster Worker instances are installed successfully, it marks a completed installation. Now, heading to essential configuration steps.

Connect essential services

Essential services for the Cluster includes Redis, Postgres, RabbitMQ, and MD Cluster File Storage.

The system is operational only when MD Cluster Control Center can effectively connect to all essential services.

  1. Sign in to MD Cluster Control Center web console with the initial administrator user account that you created in Install MD Cluster Identity Service.
  2. Go to Inventory > Services, open the relevant service category, and click on Add service.
  1. Complete all necessary fields as specified by the selected services.
  1. Save result.
  2. Check status of the service connections.

Submit MetaDefender Core and MD Cluster API Gateway installers

The installers of MetaDefender Core and MD Cluster API Gateway will be subsequently deployed on MD Cluster Worker remotely by MD Cluster Control Center.

Various versions of installation files may be submitted to MD Cluster Control Center. The correct version to install will be chosen during Deployment phase.

  1. Sign in to MD Cluster Control Center web console with the initial administrator user account that you created in Install MD Cluster Identity Service.
  2. Go to Inventory > Installers and select Upload installer .
  3. Select MetaDefender Core or MD Cluster API Gateway installation files.
  4. Click Upload .

Connect to MD Cluster Workers

  1. Sign in to the MD Cluster Control Center web console with the initial administrator account that you created during the installation of MD Cluster Identity Service.
  2. Go to Inventory > Workers and select Add workers.
  3. Complete the required fields to add new workers and click Submit.
  1. Check the status of MD Cluster Worker connections.

Deploy MetaDefender Core and MD Cluster API Gateway instances

  1. Sign in to the MD Cluster Control Center web console with the initial administrator account that you created during the installation of MD Cluster Identity Service.
  2. Go to Inventory > Workers and select Deploy workers.
  1. In API Gateway tab, select workers for MD Cluster API Gateway deployment and decide which installer version will be used to deploy on the selected workers.
  1. Repeat the step for selection of workers for MetaDefender Core deployment.

MetaDefender Cluster is only ready to use when both MD Cluster API Gateway and MetaDefender Core are deployed.

  1. Click Next.
  2. Confirm the deployment details, then click Deploy and Finish.
  3. Hold off until the deployment is completed successfully.
  1. Although MetaDefender Core instances are deployed successfully on workers, a valid license is required for them to function.

Activate online license

  1. Sign in to the MD Cluster Control Center web console with the initial administrator account that you created during the installation of MD Cluster Identity Service.
  2. Go to Inventory > Licenses and select Online License.
  3. Click Add license and input your license key.
  1. Click the three-dot icon beside your selected license key and choose Activate.
  1. Wait until the license activation finishes on the deployed MetaDefender Core instances.
  1. Navigate to Inventory > Workers to ensure the running status of the workers hosting MetaDefender Core.
  1. MD Cluster API Gateway can now efficiently accept scan requests.
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard