Manage the Amazon S3 Connector

The Composer Amazon S3 connector lets you access the data available in Amazon Simple Storage Service (S3) storage using the Composer client.

The Composer Amazon S3 connector uses its own embedded Apache Spark functionality. It supports Apache Spark 2.2 in its implementation.

Before you can establish a connection from Composer to Amazon S3 storage, a connector server needs to be downloaded, configured and enabled. See Manage Connectors and Connector Servers for general instructions and Connect to Amazon S3 for details specific to the Amazon S3 connector.

After the connector has been set up, you can create data source configurations that specify the necessary connection information and identify the data you want to use. See Manage Data Source Configurations for more information. After data sources are configured, they can be used to create dashboards and visuals from your data. See Create Dashboards.

Composer Feature Support

Amazon S3 connector support for specific Composer features is shown in the following table.

Key: P - Supported; O - Not Supported; N/A - not applicable

Feature Supported?
Admin-Defined Functions P
Box Plots P
Custom SQL Queries O
Derived Fields (Row-Level Expressions) P
Distinct Counts P
Fast Distinct Values N/A
Group By Multiple Fields P
Group By Time P
Group By UNIX Time P
Histogram Floating Point Values P
Histograms P
Kerberos Authentication O
Last Value P
Live Mode and Playback P
Multivalued Fields N/A
Nested Fields N/A
Partitions N/A
Pushdown Joins for Fusion Data Sources O
Schemas P
Text Search N/A
User Delegation O
Wild Card Filters P
Wild Card Filters, Case-Insensitive Mode P
Wild Card Filters, Case-Sensitive Mode P

Connect to Amazon S3

Scheduled reload of newly added data is not supported for the Amazon S3 connector. To add new data:

  1. Navigate to the Fields tab of your data source configuration.
  2. Select (check) the Refresh Fields checkbox on the tab. This forces the connector to reload any new data discovered at the level of the data source.