DataLead Consulting

Senior data engineer (Baş məlumat mühəndisi)

По соглашению 1208
Полн. занятость
Баку, Азербайджан
19.12.24 - 19.01.25

O работе

  • Scope, design, and build scalable, resilient components for the Data Lakehouse and other distributed systems;
  • Build product definition and leverage your technical expertise to drive toward the right solutions;
  • Utilize programming languages like Go, Python, Java or other modern object-oriented languages, SQL, and NoSQL databases;
  • Communicate complex data engineering concepts effectively to non-technical stakeholders;
  • Assemble large, complex data sets that align with business requirements;
  • Identify, design, and implement internal process improvements to enhance data operations;
  • Employ Container Orchestration services including Docker and Kubernetes;
  • Share best practices consistently and improve processes within and across teams;
  • Mentor other engineers and provide leadership and guidance in our engineering practices;
  • A competitive salary and benefits package;
  • A leadership role in an innovative and supportive environment that promotes professional growth;
  • Flexible working arrangements, including the option for remote work.

Требования

  • Deep expertise in designing and developing Data Lakehouse platforms, with proficiency in open-source table formats such as Apache Iceberg, Delta Lake, and Apache Hudi, and skilled in using Apache Spark, MinIO, Apache Flink, Trino, Amazon Redshift, Google BigQuery, and Airflow for building, managing, and optimizing Data Lakehouse architectures;
  • Demonstrated leadership in managing large-scale data projects and in fostering innovation within technology teams;
  • At least 6 years of professional experience in data software development, including significant contributions to open-source projects and cloud solution architectures;
  • Proficiency in Go, Python, Java, SQL, NoSQL databases, Docker, Kubernetes, and Azure;
  • Application Process: Interested candidates are invited to submit a resume and a detailed cover letter that showcases their experience and contributions to data lakehouse projects, to us. 

Похожие вакансии