Hi all,

I have what seems a simple MySQL consumer to Postgresql sink. The consumers are configured as below, credentials changed...

The reason for two source/sink pairs is each table uses different primary keys and timestamp columns.

name=mysql-first-source

connector.class=io.confluent.connect.jdbc.JdbcSourceConnector

tasks.max=1

connection.url=jdbc:mysql://mysql.example.com:3306/my_database?user=alice&password=secret

key.converter=io.confluent.connect.avro.AvroConverter

key.converter.schema.registry.url=http://localhost:8081

value.converter=io.confluent.connect.avro.AvroConverter

value.converter.schema.registry.url=http://localhost:8081

table.whitelist=users

mode=timestamp incrementing

timestamp.column.name=modified

incrementing.column.name=user_id

topic.prefix=users_pipeline-

##############################################

name=mysql-second-source

connector.class=io.confluent.connect.jdbc.JdbcSourceConnector

tasks.max=1

connection.url=jdbc:mysql://mysql.example.com:3306/my_database?user=alice&password=secret

key.converter=io.confluent.connect.avro.AvroConverter

key.converter.schema.registry.url=http://localhost:8081

value.converter=io.confluent.connect.avro.AvroConverter

value.converter.schema.registry.url=http://localhost:8081

table.whitelist=products

mode=timestamp incrementing

timestamp.column.name=date_status_change

incrementing.column.name=product_id

topic.prefix=products-pipeline-

Sinks are configured to work with the above examples, only a Postgresql connection. The first source/sink combination works perfectly.

My problem is, the second consumer does not deliver anything to its Postgresql sink. Table schema is identical, and running the connector-standalone without forking shows no errors. I see the second source's query logged, but the data doesn't make it to the Postgresql sink.

What am I missing?

Edited for clarity.