Public | Automated Build

Last pushed: 17 days ago
Short Description
Redshift sink
Full Description

#Aries Integration for Redshift Databases

This is an integration to store data in Amazon's Redshift.

##Configuration

###Schema
The name of the schema to insert data.

"schema": "test_schema",

###Table
The name of the table.

"table": "test_table",

###Drop
Set to true to drop the existing table and refill it, or false to insert as new data.

"drop": true,

###JSON
Set this to true if incoming data is JSON-formatted, otherwise data is expected to be CSV. Defaults to false.

"json": true,

###PrimaryKey
Specify the primary key of the incoming data in order to perform an UPSERT command instead of a plain COPY.
Drop must not be true.

"primaryKey" : "id",

###Connection

  • Host: The url of the redshift database.
  • Port: The port of the database.
  • User: The username, used for authentication.
  • Password: The password associated with the user account.
  • Database: The database where data should be stored.
    "connection" : {
      "host" : "redshifturl.com",
      "port" : 5439,
      "user" : "root",
      "password" : "veryinsecure",
      "database" : "test_database"
    },
    

###Example Config

{
    "schema" : "test_schema",
    "table" : "test_table",
    "drop" : true,
    "primaryKey" : "id",
    "connection" : {
        "host" : "redshifturl.com",
        "port" : 5439,
        "user" : "root",
        "password" : "verysecure",
        "database" : "test_database"
    },
    "json" : true
}
Docker Pull Command
Owner
astronomerio

Comments (0)