Novi Sad, Serbia

Hybrid

Senior Data Engineer

SmartCat is an AI-driven company that tackles complex data challenges with innovative solutions. Our expert team collaborates on carefully selected projects that deliver measurable, positive impacts on businesses, everyday life, and society.

Position Overview:

We are seeking a highly skilled Senior Data Engineer to join our team. In this role, you will focus on building and optimizing our data lakehouse infrastructure using Spark and Databricks. You will be responsible for designing and implementing robust, scalable data pipelines and ensuring the efficient processing and storage of large datasets.

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines using Spark and Databricks.
  • Develop and optimize data lakehouse architectures to support data analytics and machine learning workflows.
  • Implement data models and structures that ensure data quality, consistency, and accessibility.
  • Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
  • Ensure data security and compliance with relevant regulations.
  • Monitor and troubleshoot data pipeline performance and reliability.
  • Continuously improve data engineering processes and best practices.
  • Collaborate with cross-functional teams, provide technical guidance, and mentor junior engineers.

Requirements:

  • Extensive experience with Python or Scala/Java.
  • Advanced knowledge of SQL.
  • Proven experience with Apache Spark and Databricks.
  • Strong understanding of data lakehouse concepts and architecture.
  • Solid grasp of distributed systems fundamentals.
  • Strong data modeling and data warehousing skills.
  • Experience with cloud-native data architectures, particularly on platforms such as AWS, Azure, or GCP.
  • Experience with Kafka or Flink is a plus.
  • Experience with Kubernetes is a plus.
  • Experience with Vector Databases is a plus.
  • Experience with Machine Learning is a plus.
  • You enjoy learning new things and trying different solutions.
  • You value a healthy work-life balance; we don’t like overtime.
  • You know when and how to ask for help; we work together as a team.

What we offer:

  • Clearly defined pay grades: from L1 (talented junior) to L10 (principal)
  • The career path that connects these grades – you know where your life is going (at least here with us)
  • Loyalty coefficient: 10% on net compensation after 3 years in SmartCat, 20% on net compensation after 5 years
  • Knowledge budget: extra money for conferences, books and training of your choice
  • Flexible working hours and work from homeĀ 
  • End of the year bonus programĀ 
  • We are transparent – from L-levels to salary, strategy, financial reports, and beyond
  • You will have our full support towards gaining expertise
  • An excellent team of senior engineers and data scientists