Supported connections¶
DSS can read and write data from a variety of sources.
Connectors¶
Here is a list of the available connectors in DSS.
Type |
Read |
Write |
---|---|---|
yes (see supported formats) |
yes (see supported formats) |
|
yes (see supported formats) |
yes (see supported formats) |
|
yes (see supported formats) |
yes (see supported formats) |
|
yes (see supported formats) |
yes (see supported formats) |
|
yes (see supported formats) |
yes (see supported formats) |
|
yes (see supported formats) |
yes (see supported formats) |
|
yes (see supported formats) |
yes (see supported formats) |
|
yes (see supported formats) |
yes (see supported formats) |
|
yes (see supported formats) |
no |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes |
yes |
|
yes (Tier 2) |
yes (Tier 2) |
|
yes (Tier 2) |
yes (Tier 2) |
|
yes (Tier 2) |
yes (Tier 2) |
|
Other SQL databases (JDBC driver) |
best effort, not guaranteed |
no, generally |
MongoDB |
yes |
yes |
yes |
yes |
|
yes |
yes |
|
yes (Experimental) |
no |
|
Twitter (Streaming API) |
yes (Tier 2) |
no |
Generic APIs |
Custom Python or R code, plugins |
Custom Python or R code, plugins |
yes |
yes |
File formats¶
Here is a list of the file formats that DSS can read and write for files-based connections (filesystem, HDFS, Amazon S3, HTTP, FTP, SSH).
Standard formats¶
Format |
Read |
Write |
---|---|---|
yes |
yes |
|
yes |
no |
|
yes |
only via export |
|
yes |
yes |
|
Custom format using regular expression |
yes |
no |
yes |
no |
|
yes |
no |
|
yes |
no |
|
MySQL Dump |
yes |
no |
Apache Combined log format |
yes |
no |
Note that file-based formats can be read compressed: ZIP, GZIP, BZ2.
Hadoop/Spark specific formats¶
The following formats can be read and written on HDFS, S3, Azure Blob and Google Cloud Storage.
Format |
Read |
Write |
---|---|---|
yes |
yes |
|
yes |
yes |
|
yes |
no |