Freelance Senior Databricks Platform Engineer

adesso Belgium, who are we? We are an IT (start-up) provider working under the adesso umbrella with proven track record in different industries. The new Belgian entity of adesso is part of the expansion and growth strategy of the adesso group.

Requirements

Start date: ASAP- Remote work

Duration: 6 months

Rate: TBD- depending on your location

For one of our international customers, we are urgently looking for a senior Databricks Platform engineer.

The role we are currently looking for is closer to a Databricks Platform Engineer than a traditional Data Engineer or BI consultant. The objective is to help design and build a Data Product Platform on Databricks, with a strong focus on platform architecture, governance, Infrastructure as Code, CI/CD, security, and enabling multiple teams to build and operate data products.

Your Role in projects:

Design & build data platforms

• Design and implement Lakehouse architectures on Databricks (medallion / bronze‑silver‑gold patterns, Delta Lake, Unity Catalog).

• Build robust batch and streaming data pipelines using PySpark and Spark SQL, orchestrated via Databricks Workflows / Jobs.

• Model data for analytics use cases (e.g. star schema for BI, curated datasets for data science).

Ingest, transform & govern data

• Ingest data from APIs, files, databases and SaaS sources into data lakes and lakehouses.

• Implement clear and testable transformation logic (data quality checks, deduplication, SCD, CDC, business rules).

• Apply data governance best practices (cataloguing, lineage, RBAC, masking of sensitive data).

Operate & optimize

• Set up CI/CD and deployment pipelines (Azure DevOps / GitHub) for Databricks assets (notebooks, jobs, pipelines, workflows).

• Using Terraform to automated IaaC setup and reusability

• Monitor, optimize and troubleshoot pipelines and clusters for performance, robustness and cost efficiency.

• Help define and implement best practices, coding standards and reusable components within the team.

Your profile - Required technical skills & knowledge:

Proven experience in:

• Databricks platform architecture

• Unity Catalog and governance

• CI/CD and DevOps for Databricks - Enterprise GitHub

• Terraform / Infrastructure as Code

• Lakehouse architecture

• Data Product Platform enablement

• The Knowledge Graph, ontology and agentic AI are considered a strong plus.

• Unity catalogue, CICD, IAC and terraform skills in mode implementation and integration

Why join adesso Belgium?

• Work in an international group with strong local expertise in Belgium.

• Collaborate with cross-functional teams within the international data & AI adesso community.

• Flexible freelance setup with the support of a growing adesso Belgium community.

Originally posted on Himalayas