Senior Software Engineer - Clickpipes (CDC/Streaming)
About this role
Note:. We are hiring for this role remotely in any country ClickHouse has a hiring presence.
About the Team
The ClickPipes - Database Integrations team builds the platform that enables real-time data replication from databases into ClickHouse at petabyte scale.
As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks. We work in the open — our database integrations are built on PeerDB, an open-source CDC platform we actively maintain and contribute to.
See some of our recent work:
ClickPipes for Postgres now supports failover replication slots
Under the Hood: Building MySQL Change Data Capture in ClickPipes
What You’ll Do:
Build data-intensive systems
Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (BigQuery, Snowflake).
Handle edge cases in real-world production scenarios: unconventional database setups, internals of data types, database upgrades/failovers, large transactions, etc.
Design integration solutions to enable users to fully harness ClickHouse's performance and throughput.
Own end-to-end reliability
Debug complex issues in production leveraging runtime diagnostics (e.g. pprof, parca) and observability tools (e.g. metrics, logging, tracing).
Build and improve infrastructure and tools to increase system reliability, reduce incident response time, and simplify/automate operations.
Write clear documentation, both publicly and internally.
Participate in on-call rotation.
Drive product innovation
Work directly with customers to understand integration requirements and discover gaps in existing product.
Collaborate cross-functionally with internal teams to ensure operational efficiency.
Lead technical discussions and influence product roadmaps.
About You:
5+ years of industry experience building data-intensive software solutions.
Proficient in Go, or experienced in systems programming with willingness to ramp up quickly in Go.
Cloud-native experience deploying and operating services on at least one major cloud platform (AWS/GCP/Azure).
Practical experience with Kubernetes.
Strong problem solver and solid production debugging skills.
Clear communication in writing (design docs, code review) and verbally (technical discussions, customer calls, incident response).
Bonus Points
Experience with database replication technologies (CDC, logical replication).
Experience with durable execution frameworks (Temporal).
Experience with data formats and protocols (Avro, Parquet, Protobuf).
Experience with modern data processing frameworks (e.g. Kafka, Spark, Flink).
Experience with maintaining/contributing to open-source software.
Why Join Us
Work on challenging problems at the intersection of database technologies, distributed systems, and cloud-native architecture.
Work on a team that builds software in the open (PeerDB), and that cares about the craft of engineering, documentations, and continuous learning.
Be part of a high-visibility team that delivers meaningful impact to customers in a dynamic, hyper-growth environment.
#LI-remote
Perks
Flexible work environment - ClickHouse is a globally distributed company and remote-friendly. We currently operate in over 25 countries.
Healthcare - Employer contributions towards your healthcare.
Equity in the company - Every new team member who joins our company receives stock options.
Time off - Flexible time off in the US, generous entitlement in other countries.
A USD$500 Home office setup if you’re a remote employee.
Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites.
Culture - We All Shape It
As part of a rapidly scaling start-up, you will be instrumental in shaping our culture.
Are you interested in finding out more about our culture? Learn more about our values here. Check out our blog posts or follow us on LinkedIn to find out more about what’s happening at ClickHouse.
Equal Opportunity & Privacy
ClickHouse provides equal employment opportunities to all employees and applicants and prohibits discrimination and harassment of any type based on factors such as race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Please see here for our Privacy Statement.
Find Jobs in Germany on Arbeitnow
