Skip to main content
Question

MySQL to Kafka+CSR

sploiselle
Forum|alt.badge.img

Trying to set up:

  • Source: MySQL replication hosted in RDS, which works on its own
  • Target: Kafka (works on its own) + CSR (untested) hosted on Confluent Cloud--using the AvroFormatter.

The CSR is untested bc it doesn't seem like CSR is supported w/ the builtin load generators--though maybe I'm wrong.

When I deploy it, I get:
Error Deploy failed! java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException

I’ve tested the connection to the CSR and it works, so I don’t believe it’s a credential issue.

    john
    Forum|alt.badge.img
    • john
    • Community Manager
    • December 14, 2023

    Hi! Were you able to go through the steps documented in integrating with Confluent Schema Registry?

    https://striim.com/docs/en/using-the-confluent-or-hortonworks-schema-registry.html

    sploiselle
    Forum|alt.badge.img
    • sploiselle
    • New Participant
    • December 18, 2023

    @john -- thanks for checking. As far as that doc recommends, I have:

    • In my MySQL sources, set Schema Evolution – CDDL Capture enabled and the action set to Process
    • In the Kafka target, have the FORMAT AS option of the schema registry set to Table, though I have also tried Native.

    I have also verified that I can connect the schema registry using the CURL commands you’ve provided there, and the registry has received updates for other schemas.

    Reply


    Copyright©2012-2022
    Striim |
    Legal |
    Privacy Policy
    Terms & ConditionsCookie settingsAccessibility statement

    Cookie policy

    We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

     
    Cookie settings