Product Q&A

For a CDC app using MySQL reader, I use the last checkpoint of the source component using  Mon <namespace>.<application name>  before I restart an app.After making a change to the source component , the checkpoint info is gone.Is there any other way I can retrieve the last checkpoint?Any tips are deeply appreciated and also curious to see different options available for these kind of scenarios. Thanks in advance!  

Hello, I am participating in a project at the company I work for where we are considering migrating data from a MYSQL database to ALLOYDB but so far I have not found any effective documentation that could help me... could you give me some support with this?

Hey! I have the following setup:MySQL → Striim → KafkaThis all works as expected, but if I have multiple MySQL tables, all changes are streamed into 1 single Kafka topic.Is there a way to configure the KafkaWriter to stream the messages to dedicated topics for each table?For exmaple:Events from table `users` should go to a topic `users` Events from table `items` should go to a topic `itmes`As far as I can see in the docs, you can only specify one topic per KafkaWriter.

I’ve got the following setup:MySQL → Striim → Kafka + CSR and avro encoding The table that I’m replicating is pretty simple: items | CREATE TABLE `items` (  `id` bigint unsigned NOT NULL AUTO_INCREMENT,  `name` varchar(100) DEFAULT NULL,  `category` varchar(100) DEFAULT NULL,  `price` decimal(7,2) DEFAULT NULL,  `inventory` int DEFAULT NULL,  `inventory_updated_at` timestamp NULL DEFAULT CURRENT_TIMESTAMP,  `created_at` timestamp NULL DEFAULT CURRENT_TIMESTAMP,  `updated_at` datetime DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,  PRIMARY KEY (`id`),  UNIQUE KEY `id` (`id`)) ENGINE=InnoDB AUTO_INCREMENT=2001 DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_0900_ai_ci However the bigint seems to be causing the following error when Striim starts ingesting messages:Message: KafkaWriter is unable to produce events to shop. Component Name: Kafka_2_1_0_mysql_kafka_csr_Target. Component Type: TARGET. Cause: KafkaWriter is unable to produce events to shop. Cause: Suitable Avro type not found fo

Hi Team, Can we create a Postgresql to Oracle CDC pipeline to make sure oracle is sync with postgresql post migration.  Regards, Mahesh

I am trying to write a CQ with MODIFY statement that replaces all “Not Available” to NULL but I am getting an error “Left expression do not refer to an object”. Please refer to the screenshot for reference. 

Trying to set up:Source: MySQL replication hosted in RDS, which works on its ownTarget: Kafka (works on its own) + CSR (untested) hosted on Confluent Cloud--using the AvroFormatter.The CSR is untested bc it doesn't seem like CSR is supported w/ the builtin load generators--though maybe I'm wrong.When I deploy it, I get:Error Deploy failed! java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetExceptionI’ve tested the connection to the CSR and it works, so I don’t believe it’s a credential issue.

I created a Vault that integrates with Google Secrets Manager. As the documentation suggests, we use a service account key with ‘Secrets Accessor’ permissions.However we’re getting the below error 

I am building a CQ to inject NULL values for String data fields that have “Not available” in the source database.CASE WHEN META(o,"TableName").toString()=="<schema-name>.<table-name>" then CASE WHEN TO_STRING(data[12]) ="Not Available" THEN putUserData(o, 'DENOMINATOR', "NULL") WHEN TO_STRING(data[13]) = "Not Available" THEN putUserData(o, 'SCORE', NULL) WHEN TO_STRING(data[14]) = "Not Available" THEN putUserData(o, 'LOWER_ESTIMATE', NULL) WHEN TO_STRING(data[15]) = "Not Available" THEN putUserData(o, 'HIGHER_ESTIMATE', NULL) ELSE OI am receiving the following compile error : Error Saving ComponentSyntax error at: CASENULL)Please fix the errors and click "Save" again. I also tried the following syntaxCASE WHEN TO_STRING(data[12]) ="Not Available" THEN NULLWHEN TO_STRING(data[13]) = "Not Available" THEN NULLWHEN TO_STRING(data[14]) = "Not Available" THEN NULLWHEN TO_STRING(data[15]) = "Not Available" THEN NULLReference docs : https://www.striim.com/docs/en/handling-null

While it’s great that you offer a Forwarding Agent for sources/destinations that have no direct public IP, I’m having a hard time finding any information as to whether or what sort of encryption in transit is used for the data conveyed by the Agent. And before I go digging into testing what it appears to do, I thought I’d ask here:  Does Striim Forwarding Agent use any encryption for any of its communication?Context here is that it was suggested to me that Striim might be useful in migrating from an antiquated MySQL ring replication cluster to a modern MySQL master-master cluster. Neither source nor destination cluster has, nor will have, a public IP address, and will not have any direct access available to to the greater internet.

Are there any examples of using Striim’s KafkaWriter to stream data to a topic in Confluent Cloud? 

I have a JSON Field in my PostgreSQL database with this format I want to take all the fields in this flat JSON structure and turn each of them into fields in a typed stream. How would I go about doing that? I tried using the ‘makeJSON’ function on the JSON string column but I’m unable to run JSONNode function on it.  Running the above query results in a ‘CRASH, cannot map’ exception.