Airbyte

Airbyte is an open source data integration platform for building ELT data pipelines. You can use it to sync data from a bit.io database to any of Airbyte's supported destinations.

Connecting Airbyte with bit.io

In order to connect Airbyte with bit.io, you'll need to find your PosgreSQL connection credentials from the bit.io Connect Tab of the database to which you would like to connect. You can find everything you need to know about your PostgreSQL credentials here

Once you have your bit.io credentials, proceed to create an Airbyte source by clicking on Sources in the sidebar, then on the "New source" button.

Select Postgres as the source type.

Fill in the Postgres connection settings, use your bit.io credentials obtained above.

🚧

You Will Need to Modify Your Database Name to Connect

Airbyte's connector requires you to use an alternate character in the database name (e.g. username.dbname rather than username/dbname). The / in the database name is not supported.

The completed connection settings will look like this:

Click on "Set up source" button and you'll see the connection status.

Using Airbyte with bit.io

Once we've set up our bit.io database as source lets proceed to configure a connection. A connection is a configuration for syncing data between a source and a destination.

In this example we'll be connecting our bit.io database to the e2e-test destination, tough you could use any destination from their catalog.

Create a new connection by going to Connections on the sidebar, then click on "New connection" button.

You now need to select or create a data source, use the bit.io source created above, then click on the "Use existing source" button.

Select the destination for this connection and configure accordingly.

Airbyte will read the schema from your bit.io database and let you configure the select the tables to sync, select frequency and sync mode, configure according to your needs, then click on the "Set up connection" button.

You'll get redirected to connection status page and see the details of first task triggered.

Once sync is complete you'll see the details of the synced records.