Transfer Citus Data to PostgreSQL
Fast, streaming database-to-database transfer with parallel processing
Terminal
.\FastTransfer.exe `
--sourceconnectiontype "pgcopy" `
--sourceserver "your-source-server" `
--sourceuser "your-username" `
--sourcepassword "your-password" `
--sourcedatabase "your-source-db" `
--query "SELECT * FROM your_schema.your_table" `
--targetconnectiontype "pgcopy" `
--targetserver "your-target-server" `
--targetuser "your-username" `
--targetpassword "your-password" `
--targetdatabase "your-target-db" `
--targetschema "your_table" `
--targettable "your_table" `
--parallelmethod "Ntile" `
--distributekeycolumn "id" `
--degree 10 `
--loadmode "Truncate"Source - Citus Data
Citus is a PostgreSQL extension that transforms PostgreSQL into a distributed database. FastTransfer uses the PostgreSQL protocol for seamless integration.
Features:
- •PostgreSQL wire protocol compatibility
- •Distributed query optimization
- •Support for sharded tables
Parallel Method - Ntile
Divides data into N equal partitions based on a numeric column.
Requirement: Requires a numeric distribution column
Available parallel methods with Citus Data:
Destination - PostgreSQL
FastTransfer uses PostgreSQL's binary COPY protocol for ultra-fast loading between two pg compatibles if you use pgcopy both in source and target connection types. Binary mode eliminates format conversions and maximizes insertion speed.
Loading method:
Binary COPY Protocol
Advantages:
- •Binary COPY for maximum performance
- •Full support for PostgreSQL types
- •Guaranteed atomic transactions
