SQL Server Examples
Comprehensive examples for exporting data from SQL Server (MSSQL, OLEDB, ODBC).
Single-threaded Export
Simple export without parallelization for smaller datasets.
.\\FastTransfer.exe `
--connectiontype "mssql" `
--server "localhost" `
--database "FASTExportData" `
--trusted `
--query "SELECT top 1000 * FROM dbo.TEST_71_1M_12m" `
--directory "C:\temp" `
--fileoutput "TEST1000.csv" `
--decimalseparator "." `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--parallelmethod "None"
Parallel Export - Random Method
Export using Random distribution based on modulo operation.
- Windows Authentication
- SQL Authentication
.\\FastTransfer.exe `
--connectiontype "mssql" `
--server "localhost" `
--database "FASTExportData" `
--trusted `
--query "SELECT * FROM dbo.TEST_71_1M_12m" `
--directory "C:\temp" `
--fileoutput "TEST_71c_1Mr.csv" `
--decimalseparator "," `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--parallelmethod "Random" `
--distributekeycolumn "ID_ARTICLE" `
--paralleldegree 8 `
--merge "False" `
--runid "mssql_to_csv_parallel8_random"
.\\FastTransfer.exe `
--connectiontype "mssql" `
--server "localhost" `
--database "FASTExportData" `
--user "FastUser" `
--password "FastPassword" `
--query "SELECT * FROM dbo.TEST_71_1M_12m" `
--directory "C:\temp" `
--fileoutput "TEST_71c_1Mr.csv" `
--decimalseparator "," `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--parallelmethod "Random" `
--distributekeycolumn "ID_ARTICLE" `
--paralleldegree 8 `
--merge "False" `
--runid "mssql_to_csv_parallel8_random"
Parallel Export - RangeId Method
Export using RangeId distribution for evenly distributed integer keys.
Using table name:
.\\FastTransfer.exe `
--connectiontype "mssql" `
--server "localhost" `
--database "tpch10_collation_bin2" `
--trusted `
--sourceschema "dbo" `
--sourcetable "orders" `
--directory "D:\temp" `
--fileoutput "mssql_orders.csv" `
--decimalseparator "," `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--parallelmethod "RangeId" `
--distributekeycolumn "o_orderkey" `
--paralleldegree -2 `
--merge "False" `
--runid "mssql_to_csv_parallel-2_rangeid"
Using query with filter:
.\\FastTransfer.exe `
--connectiontype "mssql" `
--server "localhost" `
--database "tpch10_collation_bin2" `
--trusted `
--query "select * from orders WHERE o_orderdate between '19950101' and '19951231'" `
--directory "D:\temp" `
--fileoutput "mssql_orders.csv" `
--decimalseparator "," `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--parallelmethod "RangeId" `
--distributekeycolumn "o_orderkey" `
--paralleldegree -2 `
--merge "False" `
--runid "mssql_to_csv_parallel-2_rangeid_using_query"
Parallel Export - Ntile Method
Export using Ntile distribution for evenly distributed chunks.
Full table export:
.\\FastTransfer.exe `
--connectiontype "mssql" `
--server "localhost" `
--database "tpch10_collation_bin2" `
--trusted `
--sourceschema "dbo" `
--sourcetable "orders" `
--directory "D:\temp" `
--fileoutput "mssql_orders.csv" `
--decimalseparator "," `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--parallelmethod "Ntile" `
--distributekeycolumn "o_orderkey" `
--paralleldegree 12 `
--merge "False" `
--runid "mssql_to_csv_parallel12_Ntile"
Filtered export with date column:
.\\FastTransfer.exe `
--connectiontype "mssql" `
--server "localhost" `
--database "tpch10_collation_bin2" `
--trusted `
--query "select * from orders WHERE o_orderdate between '19950101' and '19951231'" `
--directory "D:\temp" `
--fileoutput "mssql_orders.csv" `
--decimalseparator "," `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--parallelmethod "Ntile" `
--distributekeycolumn "o_orderdate" `
--paralleldegree 12 `
--merge "False" `
--runid "mssql_to_csv_parallel12_Ntile_using_query"
Parallel Export - DataDriven Method
Export using DataDriven distribution based on distinct values of a column.
Using partition function:
.\\FastTransfer.exe `
--connectiontype "mssql" `
--server "localhost" `
--database "tpch10_collation_bin2" `
--directory "D:\temp" `
--fileoutput "mssql_orders.csv" `
--trusted `
--sourceschema "dbo" `
--sourcetable "orders_part" `
--decimalseparator "." `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--parallelmethod "DataDriven" `
--distributekeycolumn "`$partition.PF_DATE(o_orderdate)" `
--merge "False" `
--paralleldegree 10
Export to Parquet
Export SQL Server data to Parquet format.
Single-threaded:
.\\FastTransfer.exe `
--connectiontype "mssql" `
--server "localhost" `
--database "faker" `
--trusted `
--sourceschema "dbo" `
--sourcetable "faker_s1000" `
--directory "D:\temp" `
--fileoutput "mssql_faker_s1000.parquet" `
--parallelmethod "None" `
--runid "mssql_to_parquet_NoParallel"
Parallel with RangeId:
.\\FastTransfer.exe `
--connectiontype "mssql" `
--trusted `
--server "localhost" `
--database "tpch10_collation_bin2" `
--directory "D:\temp" `
--fileoutput "mssql_orders.parquet" `
--parallelmethod "RangeId" `
--distributekeycolumn "o_orderkey" `
--paralleldegree 7 `
--sourceschema "dbo" `
--sourcetable "orders" `
--merge "False"
Parallel with Ntile and query:
.\\FastTransfer.exe `
--connectiontype "mssql" `
--trusted `
--server "localhost" `
--database "tpch10_collation_bin2" `
--directory "D:\temp" `
--fileoutput "mssql_orders_1995.parquet" `
--parallelmethod "Ntile" `
--distributekeycolumn "o_orderkey" `
--paralleldegree 7 `
--query "select * from dbo.orders where o_orderdate between '1995-01-01' and '1995-12-31'" `
--merge "False"
OLEDB Connection
Alternative connection method using OLEDB provider.
Single-threaded:
$query="SELECT top 10000 * FROM FASTExportData.dbo.TEST_71_1M_12m"
$target="localhost"
.\\FastTransfer.exe `
--connectiontype "oledb" `
--provider "MSOLEDBSQL" `
--server $target `
--directory "C:\temp" `
--fileoutput "TEST.CSV" `
--paralleldegree 1 `
--trusted `
--query $query `
--parallelmethod "None" `
--decimalseparator "." `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8"
Parallel Random with Windows Auth:
.\\FastTransfer.exe `
--connectiontype "oledb" `
--provider "MSOLEDBSQL" `
--server $target `
--directory "C:\temp" `
--fileoutput "TEST.CSV" `
--paralleldegree 6 `
--trusted `
--query $query `
--parallelmethod "Random" `
--decimalseparator "." `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--distributekeycolumn "ID_ARTICLE" `
--merge "False"
Parallel Random with SQL Auth:
.\\FastTransfer.exe `
--connectiontype "oledb" `
--provider "MSOLEDBSQL" `
--server $target `
--directory "C:\temp" `
--fileoutput "TEST.CSV" `
--paralleldegree 6 `
--user "FastUser" `
--password "FastPassword" `
--query $query `
--parallelmethod "Random" `
--decimalseparator "." `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--distributekeycolumn "ID_ARTICLE" `
--merge "False"
Parallel DataDriven:
.\\FastTransfer.exe `
--connectiontype "oledb" `
--provider "MSOLEDBSQL" `
--server $target `
--directory "C:\temp" `
--fileoutput "TEST.CSV" `
--paralleldegree 6 `
--trusted `
--query $query `
--parallelmethod "DataDriven" `
--decimalseparator "." `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--distributekeycolumn "ID_DECOUPE_GEO" `
--merge "False"
ODBC Connection
Using ODBC DSN for connection.
Single-threaded:
.\\FastTransfer.exe `
--connectiontype "odbc" `
--dsn "DSN4FastTransfer" `
--directory "C:\temp" `
--fileoutput "TEST.CSV" `
--paralleldegree 1 `
--trusted `
--query "SELECT * FROM [TEST_71_1M_12m]" `
--parallelmethod "None" `
--decimalseparator "." `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8"
Parallel Random with Windows Auth:
.\\FastTransfer.exe `
--connectiontype "odbc" `
--dsn "DSN4FastTransfer" `
--directory "C:\temp" `
--fileoutput "TEST.CSV" `
--paralleldegree 6 `
--trusted `
--query "SELECT * FROM [TEST_71_1M_12m]" `
--parallelmethod "Random" `
--decimalseparator "." `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--distributekeycolumn "ID_ARTICLE" `
--merge "False"
Parallel Random with SQL Auth:
.\\FastTransfer.exe `
--connectiontype "odbc" `
--dsn "DSN4FastTransfer" `
--directory "C:\temp" `
--fileoutput "TEST.CSV" `
--paralleldegree 6 `
--user "FastUser" `
--password "FastPassword" `
--query "SELECT * FROM [TEST_71_1M_12m]" `
--parallelmethod "Random" `
--decimalseparator "." `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--distributekeycolumn "ID_ARTICLE" `
--merge "False"
Parallel DataDriven:
.\\FastTransfer.exe `
--connectiontype "odbc" `
--dsn "DSN4FastTransfer" `
--directory "C:\temp" `
--fileoutput "TEST.CSV" `
--paralleldegree 6 `
--trusted `
--query "SELECT * FROM [TEST_71_1M_12m]" `
--parallelmethod "DataDriven" `
--decimalseparator "." `
--delimiter "|" `
--dateformat "yyyy-MM-dd HH:mm:ss" `
--encoding "UTF-8" `
--distributekeycolumn "ID_GEO" `
--merge "False"
Build your command with the Wizard