Partitions

Some Composer connectors support partitions and pruning. This feature enables the Partition column on the Fields tab of the data source configuration, when the data source uses a supporting connector. Partitioning allows you to link a partitioned field to another field to help improve the performance of filtering operations for a data source.

Although many data stores support partitions in some form, this feature specifically tells Composer that the partitions may be used for manual pruning of result sets to increase speed.

Support for this feature by Composer connectors is shown in the following table.

Key: Y - Supported; N - Not Supported; N/A - not applicable

Connector Supported?
Amazon Redshift N/A
Amazon S3 N/A
Apache Drill Y
Apache Phoenix N/A
Apache Phoenix Query Server (QS) N/A
Apache Solr N/A
BigQuery Y
Cloudera Impala Y
Cloudera Search N/A
Couchbase N
Dremio N/A
Elasticsearch 6.0 N/A
Elasticsearch 7.0 N/A
Flat File N
HDFS N/A
Hive Y
MemSQL N/A
Microsoft SQL Server N
MongoDB N/A
MySQL N
Oracle N
PostgreSQL N
Presto N
Real Time Sales N/A
SAP Hana N
SAP IQ N
Snowflake N
Spark SQL Y
Teradata N
TIBCO DV N/A
Upload API N
Vertica N