Setup Zuora Connector for GCP Postgres
Configure your GCP Postgres Destination
Follow the steps in this guide to set up GCP Postgres database credentials, manage permissions, configure access to the database, and other necessary configurations to facilitate a smooth data transfer process from Zuora to GCP Postgres.
Prerequisites
- If your Postgres database is protected by security groups or other firewall settings, you will need to have the data-syncing service's static IP available to complete Step 1.
Step 1: Allow access
- In your Google Cloud Console > SQL instances list, click the PostgreSQL instance you want to send data to.
- On the instance page, click the Connections tab on the left. Note the Public IP address. Use
5432
as the port. - In the Networking tab, ensure that the Instance IP assignment setting is set to Public IP to ensure that the destination is accessible from outside your VPC.
- In the Authorized networks section, click Add a network. Enter a descriptive name like data transfer service and the data-syncing service's static IP and click Done.
- Click Save.
Step 2: Create writer user
Create a database user to perform the writing of the source data.
- Open a connection to your PostgreSQL database (locally or using the Google Cloud Shell).
-
Create a user for the data transfer by executing the following SQL command
-
CREATE USER <username> PASSWORD '<some-password>';
-
- Grant user
create
andtemporary
privileges on the database. create allows the service tocreate
new schemas andtemporary
allows the service to create temporary tables.
GRANT CREATE, TEMPORARY ON DATABASE <database> TO <username>;
If the schema already exists By default, the service creates a new schema based on the destination configuration (in the next step). If you prefer to create the schema yourself before connecting the destination, you must ensure that the writer user has the proper permissions on the schema, using
|
Step 4: Add Your Destination
- After completing the initial setup, provide the host address of your GCP Postgres database to a Zuora representative. They will use this information to create a connection link for you.
- Using the provided link, you can securely input your GCP Postgres details, including the port, database name, schema, and authentication credentials.
- Once you fill in these details and test the connection, saving the destination will initiate the onboarding process and begin transferring data from Zuora to your GCP Postgres database.
Verification and Data Transfer
Once data synchronization is configured with the GCP Postgres connector, the data is automatically transferred to the specified GCP Postgres database. This enables direct access and querying of the data within your GCP Postgres environment or through compatible data analysis tools. You can seamlessly manage and analyze this data within your GCP Postgres ecosystem.
Format of Transferred Data
For GCP Postgres, the transferred data will be loaded as properly typed tables within a single schema in the database. Additionally, a special _transfer_status
table will be created within the schema to record transfer metadata, specifically including a transfer_last_updated_at
timestamp for each table. This table helps track the last update time for the transferred data, facilitating data management and synchronization processes.