Question

MySQL to Kafka+CSR

  • 14 December 2023
  • 2 replies
  • 56 views
sploiselle
Badge

Trying to set up:

  • Source: MySQL replication hosted in RDS, which works on its own
  • Target: Kafka (works on its own) + CSR (untested) hosted on Confluent Cloud--using the AvroFormatter.

The CSR is untested bc it doesn't seem like CSR is supported w/ the builtin load generators--though maybe I'm wrong.

When I deploy it, I get:
Error Deploy failed! java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException

I’ve tested the connection to the CSR and it works, so I don’t believe it’s a credential issue.

2 replies

john
Userlevel 1
Badge

Hi! Were you able to go through the steps documented in integrating with Confluent Schema Registry?

https://striim.com/docs/en/using-the-confluent-or-hortonworks-schema-registry.html

sploiselle
Badge

@john -- thanks for checking. As far as that doc recommends, I have:

  • In my MySQL sources, set Schema Evolution – CDDL Capture enabled and the action set to Process
  • In the Kafka target, have the FORMAT AS option of the schema registry set to Table, though I have also tried Native.

I have also verified that I can connect the schema registry using the CURL commands you’ve provided there, and the registry has received updates for other schemas.

Reply


Terms & ConditionsCookie settings