- - Knowledge base overview
Product Updates

Home
Community overview

The Striim Community

Featured Topics

Recently active
Help others

janeyleeNew Participant

Company announcements

Striim Cloud on Google Cloud

This article was originally posted on May 17, 2022 Today, we launched the availability of Striim Cloud on Google Cloud, the fastest way for you to deliver real-time data and insights to power business intelligence and decision-making to meet the needs of the digital economy. Striim Cloud is the industry’s first and only fully-managed software-as-a-service (SaaS) platform for real-time data streaming and integration. With a few clicks, you can easily build real-time data pipelines to stream trillions of events every day, backed by enterprise-grade operational, security, and management features. Striim Cloud on Google Cloud delivers multiple capabilities for digital transformation to the enterprise: Striim Cloud delivers instant access to what’s happening right now across multiple applications Striim Cloud delivers the simplicity, elasticity, and scalability of the cloud Striim Cloud super-charges enterprise innovation To read more about Striim Cloud on Google C

0

1 month ago

DiegoPafuNew Participant

Company announcements

What's new in Striim 4.1.2

Web UIThe web UI has been substantially redesigned, including improved Home and Files pages and new pages for managing property sets, property variables, and vaults. For more information, see the Web UI Guide.Application development You can create and manage property sets, property variables, and vaults in the web UI. Schema evolution supports TRUNCATE TABLE when the source is OJet (see Handling schema evolution). Sources and targets Database Reader can read from multiple MariaDB or MySQL databases and supports Oracle VARRAY. JMS Reader supports Transaction Policy with IBM MQ. Salesforce Reader will, in all modes, read objects without a CreatedDate field. (Previously this field was required in Incremental mode.) ServiceNow Reader reads ServiceNow tables. BigQuery Writer supports the Storage Write API (see BigQuery > Documentation > Guides > Batch load and stream data with BigQuery Storage Write API). Cosmos DB Writer can process inserts and updates as upserts. Da

0

1 month ago

DiegoPafuNew Participant

Cool Content

Striim version 4.1.2

Striim released the latest version 4.1.2The new version offers users tools to help with their streaming use cases, management tasks, and configurations, seeking to increase team collaboration with automation.Take a look at what is new in this version:New Features in Striim 4.1.2. New Features in Striim Cloud 4.1.2. Enjoy!

0

1 month ago

S

sriram.pasamCommunity Manager

Recipes

Streaming Change Data Capture from MongoDB to ADLS Gen2 Parquet format

Real-time data analytics is proving to be the next big wave in Big data and Cloud computing and in a computing context, there’s an increasing demand to derive insights from data just milliseconds after it is available or captured from various sources.NoSQL databases have become widely adopted by companies over the years due to their versatility in handling vast amounts of structured and unstructured streaming data with the added benefit to scale quickly with large amounts of data at high user loads. Why MongoDB?MongoDB has become a prominent powerhouse among NoSQL databases and is widely embraced among many modern data architectures. With its ability to handle evolving data schemas and store data in JSON-like format which allows us to map to native objects supported by most modern programming languages. MongoDB has the ability to scale both vertically and horizontally which makes it a prime choice when it comes to integrating large amounts of data from diverse sources, delivering data

450

S

3 months ago

Sweta GaraiCommunity Manager

Recipes

Stream Data from PostgreSQL to Google BigQuery with Striim Cloud - Part 1

OverviewStriim is a next generation Cloud Data Integration product that offers change data capture (CDC) enabling continuous replication from popular databasessuch as Oracle, SQLServer, PostgreSQL and many others.In addition to CDC connectors, Striim has hundreds of automated adapters for file-based data (logs, xml, csv), IoT data (OPCUA, MQTT), and applications such as Salesforce and SAP. Our SQL-based stream processing engine makes it easy toenrich and normalize data before it’s written to targets like BigQuery and Snowflake.Traditionally Data warehouses that required data to be transferred use batch processing but with Striim’s streaming platform data can be replicated in real-time efficiently.Securing the in-flight data is very important in any real world application. A jump host creates an encrypted public connection into a secure environment.In this tutorial, we’ll walk you through how to create a secure SSH tunnel between Striim cloud and your on-premise/cloud databases with an

340

4 months ago

Sweta GaraiCommunity Manager

Recipes

Real-Time Hotspot Detection For Transportation with Striim and BigQuery

OverviewTransportation services like Uber and Lyft require streaming data with real-time processing for actionable insights on a minute-by-minute basis. While batch data can provide powerful insight on medium or long-term trends, in this age live data analytics is an essential component of enterprise decision making. It is said data loses its importance within 30 minutes of generation. To facilitate better performance for companies that hugely depend on live data, Striim offers continuous data ingestion from multiple data sources in real-time. With Striim’s powerful log-based Change Data Capture platform, database transactions can be captured and processed in real-time along with data migration to multiple clouds. This technology can be used by all e-commerce, food-delivery platforms, transportation services, and many others that harnesses real-time analytics to generate value. In this post, we have shown how real-time cab booking data can be streamed to Striim’s platform and processed

460

4 months ago

john.smithCommunity Manager

What's New in Data

The Modern Data Team with Abhi Sivasailam

A discussion with Abhi Sivasailam – a Growth & Analytics leader (Flexport, Hustle, Keap, Honeybook) – on "The Modern Data Team" shortly before his talk at dbt Labs' Coalesce conference in New Orleans. Abhi dives into real world data leadership and engineering management topics such as applying Domain-driven design on data teams, producer-defined models (plus why he thinks they're better than consumer-led), and adhering to SLAs across the business. Abhi also provides a future-facing view of the data industry: eliminating arbitrary uniqueness in analytics engineering. Can we all align on common data models? Is this what 'modern data teams' will look like? Tune in to learn more!About Abhi Sivasailam:Abhi Sivasailam is a Growth & Analytics leader who previously led those functions at Flexport, Hustle, Keap, and Honeybook. He currently invests in and advises companies on their data strategies and coaches operators. Follow Abhi on Twitter for more insights.

johnNew Participant

Streaming to kafka topic in confluent cloud

Are there any examples of using Striim’s KafkaWriter to stream data to a topic in Confluent Cloud?

johnNew Participant

How do we flatten JSON in Striim?

I have a JSON Field in my PostgreSQL database with this format I want to take all the fields in this flat JSON structure and turn each of them into fields in a typed stream. How would I go about doing that? I tried using the ‘makeJSON’ function on the JSON string column but I’m unable to run JSONNode function on it. Running the above query results in a ‘CRASH, cannot map’ exception.

1

S

6 months ago

john.smithCommunity Manager

Cool Content

Beers with Data Peers: Striim Co-host event with Databrick, dbt, Monte Carlo, and Snowplow

Striim is crossing the pond this year for Big Data London!Join the networking reception at Big Data London that focuses on creating a complete customer 360 view. Chat with the industry’s leading voices about the need for data stack operationalization and unification; the democratization of data, and the importance of making your data lakehouse your single source of truth for your reliable data. Connect with your data peers Enjoy food, drinks and a nice reprieve from the conference floor Mingle with industry leaders from across the Modern Data Stack Hosted by Databricks, dbt, Monte Carlo, Striim and SnowplowWednesday, September 21st | 5:00 – 7:30pm BST@ The Albion, 121 Hammersmith Rd (4 minutes from the Olympia) RSVP Link: https://snowplow.io/events/beers-with-data-peers/?BigData_LDN_Source=Striim

johnNew Participant

Streaming to kafka topic in confluent cloud

Are there any examples of using Striim’s KafkaWriter to stream data to a topic in Confluent Cloud?

4

5 months ago

Need More Help?

Contact Support

Reach out to our world class support team

Talk To Us

Need additional support? We have a network of certified partners eager to help!

Striim |

Legal |

Privacy Policy

Powered by inSided

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

Login with SSO

or

Username *

E-mail address *

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the community

No account yet? Create an account

Login with SSO

or

Username or Email

Password

Remember me

Forgot password?

Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.

Username or e-mail

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK