Skip to main content

Modern Data Stack Discussion

Share all these things data

5 Conversations
john
johnCommunity Manager
posted in Cool Content
CDC Best Practices with a 'Read Once, Stream Anywhere' Pattern

Note: To follow best practices guide, you must have the Persisted Streams add-on in Striim Cloud or Striim Platform.IntroductionChange Data Capture (CDC) is a critical methodology, particularly in scenarios demanding real-time data integration and analytics. CDC is a technique designed to efficiently capture and track changes made in a source database, thereby enabling real-time data synchronization and streamlining the process of updating data warehouses, data lakes, or other systems.Change Data Capture to Multiple SubscribersIt is common for organizations to stream transactional data from a database to multiple consumers – whether it be different lines of the business or separate technical infrastructure (databases, data warehouses, and messaging systems like Kafka). However, a common anti-pattern in CDC implementation is creating a separate read client for each subscriber. This might seem intuitive but is actually inefficient due to competing I/O and additional overhead created on t

560
john
1 year ago
DiegoPafu
DiegoPafuNew Participant
posted in Cool Content
Striim version 4.1.2

Striim released the latest version 4.1.2The new version offers users tools to help with their streaming use cases, management tasks, and configurations, seeking to increase team collaboration with automation.Take a look at what is new in this version:New Features in Striim 4.1.2. New Features in Striim Cloud 4.1.2. Enjoy!

320
DiegoPafu
1 year ago
john.smith
john.smithNew Participant
published in What's New in Data
The Modern Data Team with Abhi Sivasailam

 A discussion with Abhi Sivasailam – a Growth & Analytics leader (Flexport, Hustle, Keap, Honeybook) – on "The Modern Data Team" shortly before his talk at dbt Labs' Coalesce conference in New Orleans. Abhi dives into real world data leadership and engineering management topics such as applying Domain-driven design on data teams, producer-defined models (plus why he thinks they're better than consumer-led), and adhering to SLAs across the business. Abhi also provides a future-facing view of the data industry: eliminating arbitrary uniqueness in analytics engineering. Can we all align on common data models? Is this what 'modern data teams' will look like? Tune in to learn more!About Abhi Sivasailam:Abhi Sivasailam is a Growth & Analytics leader who previously led those functions at Flexport, Hustle, Keap, and Honeybook. He currently invests in and advises companies on their data strategies and coaches operators. Follow Abhi on Twitter for more insights. 

1100
john.smith
2 years ago
john.smith
john.smithNew Participant
published in Cool Content
Beers with Data Peers: Striim Co-host event with Databrick, dbt, Monte Carlo, and Snowplow

Striim is crossing the pond this year for Big Data London!Join the networking reception at Big Data London that focuses on creating a complete customer 360 view. Chat with the industry’s leading voices about the need for data stack operationalization and unification; the democratization of data, and the importance of making your data lakehouse your single source of truth for your reliable data.  Connect with your data peers Enjoy food, drinks and a nice reprieve from the conference floor Mingle with industry leaders from across the Modern Data Stack  Hosted by Databricks, dbt, Monte Carlo, Striim and SnowplowWednesday, September 21st | 5:00 – 7:30pm BST@ The Albion, 121 Hammersmith Rd (4 minutes from the Olympia) RSVP Link: https://snowplow.io/events/beers-with-data-peers/?BigData_LDN_Source=Striim

260
john.smith
2 years ago
john.smith
john.smithNew Participant
posted in What's New in Data
Whats's New In Data Snowflake Summit & Data in a Recession

Matt Turck from FirstMark Capital joins us on a live episode of ‘What’s New In Data’ from Snowflake Summit. We recap the summit, talk about the state of the data industry, and look ahead to how a potential recession will play a role.

180
john.smith
2 years ago

Badge winners

Show all badges
Terms & ConditionsCookie settings