Skip to main content

Installation Guide for Disaster Recovery (DR) Deployment

A Disaster Recovery (DR) plan ensures your ServiceOps platform remains available and resilient, protecting against data loss and minimizing downtime in the event of a catastrophic failure at your primary data center.

A Disaster Recovery (DR) strategy is crucial for ensuring business continuity in the event of a catastrophic failure at your primary Data Center (DC). This guide outlines the architecture and procedures for setting up a DR site for ServiceOps, enabling you to minimize downtime and data loss.

The primary objective of a DC-DR setup is to replicate your critical IT infrastructure, applications, and data to a secondary location. This ensures that essential services can be brought back online quickly after an incident.

Architecture Overview​

The ServiceOps DR architecture relies on continuous data replication to a secondary, or DR, site.

ServiceOps DC-DR Architecture

Key components of this architecture include:

  • Continuous Database Replication: The database is continuously replicated from the primary (DC) to the secondary (DR) site.
  • Continuous File Storage Replication: All file attachments and other stored assets are replicated to the DR site.

In the event of a failure at the DC site, a manual switchover is required to activate the DR site and maintain business operations.

Prerequisites​

Before proceeding with the DC-DR setup, ensure the System Requirements and Pre-Installation Checklist are met.

Phase 1: Replication Setup​

This phase involves configuring the continuous replication of the database and file storage from the DC to the DR site.

On the DC Site Server​

  1. Download and Run Setup:

    • Log in as the root user.

    • Download the CommonDCDR.zip file, extract it, and move the Motadata_DC_Setup script to the /home directory.

    • Assign execute permissions and run the script:

      chmod 777 Motadata_DC_Setup
      ./Motadata_DC_Setup

  2. Configure Replication Scripts:

    • Copy the script folder from /opt/DCDR/script to your user's home directory.
    • Change the ownership of the copied script folder:
      # Syntax: chown -R {user}:{user} /home/{user}/script
      chown -R flotomate:flotomate /home/flotomate/script

  1. Edit Sync Configuration:

    • Switch to your application user (e.g., flotomate).

    • Edit the file_sync.sh script located in /home/{user}/script/.

    • Update the following parameters with your DR site details:

      • current_slave: DR_IP_ADDRESS
      • username: SSH_USERNAME
      • password: SSH_PASSWORD
      • port: SSH_PORT

  2. Schedule Cronjobs:

    • Execute the crontab.sh script to schedule the file sync job:
      sh crontab.sh

    • Return to the root user.

    • Navigate to the /opt/DCDR/script folder and execute dcdr_crontab.sh to schedule the database sync job.

      sh dcdr_crontab.sh

    • Verify that the cronjobs have been created successfully:

      crontab -l

On the DR Site Server​

  1. Download and Run Setup:

    • Log in as the root user.
    • Download the CommonDCDR.zip file, extract it, and move the Motadata_DR_Setup script to the /home directory.
    • Assign execute permissions and run the script, providing the IP address of the Master (DC) Database Server:
      chmod 777 Motadata_DR_Setup
      ./Motadata_DR_Setup {Master_Database_IP_Address}

  2. Schedule Cronjobs:

    • Navigate to the /opt/DCDR/script folder and execute the dcdr_crontab.sh script.
      sh dcdr_crontab.sh
    • Verify that the cronjob has been created:
      crontab -l
note

The cronjob setup for database replication (dcdr_crontab.sh) must be performed on both the DC and DR site machines.

For DC and DR servers (Optional, in Absence of HA)​

To configure continuous replication for file attachments to the DR site, follow these steps on both the DC and DR application servers.

  1. Download the Motadata_HA_Setup script and move it to the home directory of a common sudo user (e.g., /home/{user}).

  2. Log in as that common sudo user.

  3. Assign execute permissions to the setup script:

    chmod 777 Motadata_HA_Setup

  4. Run the setup script:

    ./Motadata_HA_Setup

Phase 2: Perform Switchover and Switchback​

For instructions on how to perform manual switchover (failover) to the DR site and switchback (failback) to the original DC, refer to the Disaster Recovery Operations Guide.

Next Steps​

After completing the HA deployment, you may need to set up additional components depending on your requirements. Below are links to guides for other server components that you can deploy.