Community Q&A

please delete

striim Unable to connect to MySQL,  

Seeking a Striim expert to implement our real-time data streaming and analytics solution. Project includes:Data pipeline setup for real-time CDC from Oracle/SQL Server to cloud targets Stream processing configuration with transformations and filtering logic Dashboard creation for real-time monitoring and data visualization Source-to-target mapping for database replication and data lake ingestion Performance tuning and lag monitoring optimization Error handling and recovery procedures implementationRequirements:Experience with Striim platform and real-time data streaming Knowledge of CDC (Change Data Capture) and database replication Understanding of stream processing and data transformation Familiarity with cloud data platforms (AWS, Azure, GCP) SQL and data modeling skills

I receive the Error "Please upload a local file" when I try to upload MySQL driver in the Developer Edition.I have tried to upload MySQL and MariaDB drivers and I always receive the same error. 

We are publishing CDC changes from Oracle table to GBQ PubSub, however the Striim is publishing JSON Array with square brackets with one CDC change. I don’t want those flower brackets , how can we resolve this. Even I tried to change the Advance setting of No.of events to 1 in the pubsub connector but still the events are coming with square brackets. Kindly help me how i can remove those square brackets. Thanks,Murali 

I am trying to modify an existing Striim App which routes events based on the table name to different Target Writers.  I would like to know if two different WHEN statements can be routed to the same stream. Based on the Striim Router documentation here . Can the sample code be modified to route the events of two case statements to `stream_one` as shown below. CREATE ROUTER myRouter INPUT FROM mySourceStream AS src CASE WHEN TO_INT(src.data[1]) < 150 THEN ROUTE TO stream_one, WHEN TO_INT(src.data[1]) >= 150 THEN ROUTE TO stream_two, WHEN meta(src,"TableName").toString() like 'QATEST.TABLE_%' THEN ROUTE TO stream_one,ELSE ROUTE TO stream_else;Exploring other possible ways to resolve the above issue - Is it possible to write the above as a Boolean logic?  CREATE OR REPLACE ROUTER myRouter INPUT FROM mySourceStream AS srcCASE WHEN meta(src,"TableName").toString() like 'QATEST.USERS' THEN ROUTE TO stream_one OR WHEN meta(src,"TableName").toString() like 'QATEST.ACCOUNTS' THEN ROUTE

Dear All,i am trying to create 2 pipelines from Oracle to Postgres.the first one is initial Oracle to Postgres, it worked very well, and schema conversion tool migrated 2 example tables to postgres. but i have an issue with Oracle CDC.i have logminer user on oracle which is striim and i have table owner which is scale_user and i have 2 tables scale_data and scale_data2.i am not using container and PDB on 21C, striim and scale_user are common user.i am receieving an error like below when i insert a data to the tables after commit.i see that reader is looking for tables like CDB$ROOT.TEST.SCALE_DATA but i am not using container so how can resolve the issue.There was no problem with initial load, the problem is related with CD process. Thanks in advance. [{ "_id" : null, "timeStamp" : 1707166962232, "originTimeStamp" : 1707166964000, "key" : null, "sourceUUID" : { "uuidstring" : "01eec465-3101-b301-b854-42010a9c000a" }, "data" : [ "862412", "1", "1", "460" ], "metadata" : { "RbaSqn" : "50

we’ve observed a number of lost updates when running CDC. The state of initial load seems fine, but later on we came across NO_OP_UPDATES. I’ve ignored the exception for the CDC, but that resulted in some of the updates being lost and records left in stale state.It seems that it might be connected with updates being in the same batch as the initial insert. How are events ordered within a single batch? Have you observed such scenarios? Source is SQL Server and target is Postgres in case thats relevant. 

I’d like to convert a timestamp from location specific one (in areas that have summer time change) to UTC. What would be the best way to do it within Striim? I assume it’s doable using Joda API and I can see in the reference that “Striim supports all date functions natively associated with Joda-Time.” but I didn’t find an example how to call those Joda Time functions

Hi All, Greetings! We need to migrate data from Oracle to PostgresSQL using striim. In this case does striim provides data reconciliation report post loading the data in the target system. Regards, Mahesh

Hi all, I’m trying to set up a CDC from Postgres(GCP Cloud SQL if it makes any difference) of a table with a UUID column to a SQL Server table with uniqueidentifier column. The wizard says it’s not possible. I’ve tried mapping the tables manually, but all the rows end up being discarded. Is there any way to make it work? Similar migration in the opposite direction works. 

We are using Striim to replicate data from Oracle to BigQueryI would like to know how can I find out for UIcurrent archived logs being mined by log miner The current DDL ( LCR , logical count record ) being processed)  Number of DDLs or LCR in the current Transaction or SCNThank You

How do I handle soft deletes in Striim? Does Striim performs an update process to mark some data as deleted instead of physically deleting it from a table in the database?

What are the key steps to launching a new CDC pipeline successfully? Wanted to get some ideas from the community on how to best approach that.