Add and manage Sync(s)

To add a Sync, successfully, the user must configure the source and the sync destination.

  1. Navigate to Syncs and click + Add New Sync on the top-right of Sync Overview.

  1. Select the required data source and Continue. Gravity supports hundreds of connectors as data sources.

  1. Configure the data source details as required and Continue. Users need to Authorize the user account for Gravity Data IDE to connect and access data for OAuth-based sources.

Once authorized, Gravity Data IDE connects to the user account, you can Continue to configure Sync.

  1. Configure the sync frequency to schedule how often the data synchronization process occurs.

It dictates the interval the sync jobs will run to fetch data from the source and load it to the destination. The sync frequency is scheduled based on the Cron job format. You can either fill in the time field or enter your Cron expression in the unix-cron string format (* * * * *). The Cron job runs periodically at a fixed internal, time or date. Users can set up a sync frequency depending on the data volume to be migrated, urgency and available system resources.

The sync frequency applies to all jobs within the sync. You can modify individual job frequencies in job configuration.

  1. Once the source and sync frequency are configured, connect the sync with the Destination. Select your destination based on the destinations added to your workspace and Continue.

Note

It is recommended to add a destination to your Gravity workspace before configuring a Sync. If the workspace does not have a destination, you can add a Destination when setting up a Sync.

The Sync is successfully added and has an active status by default. To begin migrating data from your linked source to the destination, users need to add and run Job(s).

A newly added sync is updated on the Syncs Overview with an Alert icon beside its name.

Note

When there are no Jobs set up within a Sync, it is enabled as a placeholder.

A sync connector displays the replaced source > configured destination set up for the Sync. You can enable/ disable it to run/pause the sync and delete a sync if required.

Supported Data Sources

  • Amazon Aurora for MySQL

  • Amazon Aurora for PostgresSQL

  • Amazon DocumentDB

  • Amazon DynamoDB

  • Amazon RDS for MySQL

  • Amazon RDS for PostgresSQL

  • Amazon RDS for Microsoft SQL Server

  • Amazon Redshift

  • Azure for Microsoft SQL Server

  • Azure for MySQL

  • Azure for PostgresSQL

  • Azure Synapse

  • Cloud SQL for MySQL

  • Cloud SQL for PostgresSQL

  • Cloud SQL for SQL Server

  • Derby

  • Elasticsearch

  • Exasol

  • Firebird

  • Google BigQuery

  • Google Cloud Storage

  • Google Sheets

  • Microsoft SQL Server

  • MongoDB

  • MSSQL

  • MySQL

  • Oracle

  • PostgresSQL

  • SFTP

  • Snowflake

  • Vertica

Last updated