DevJobs

Senior Data Engineer

Overview
Skills
  • SQL SQL
  • Scala Scala
  • Python Python
  • Java Java
  • Spark Spark
  • Kafka Kafka
  • CI/CD CI/CD
  • Git Git
  • AWS S3
  • AWS SageMaker
  • AWS Cloud
  • RDS
  • Glue
  • OpenSearch
  • No-SQL
  • MLOps
  • AWS EKS
  • AWS Athena
  • AWS DataZone
  • AWS Document DB
  • Parquet
  • AWS DRS
  • AWS Glue
  • IceBerg
  • AWS ElasticCahe
  • Avro
  • AWS QuickSight
  • AWS OpenSearch
  • AWS Managed Airflow
  • AWS Lake Formation

We are looking for a Lead Data Engineer

Come join our CTO Developer Experiences Platform Team and lead the implementation of our vision to build Data Lake House & MLOps on the AWS cloud.


You have an amazing opportunity to be part of the Generative AI revolution and build Generative AI products and services.

We are looking for builders who are not afraid to explore the unknown and take big risks with new tech!


Responsibilities :

☑️ Plan and build Data Lake House in the AWS cloud.

☑️ Design, develop, deploy, measure and maintain our data platform.

☑️ Research and build Generative AI services and applications.

☑️ Collaborate Data engineers/Scientists

☑️ Communicate complex architectural concepts and recommendations effectively

☑️ Participate in the software engineering, processes and standards with an impact on the whole delivery organization.


Requirements :

☑️ 5+ years experience as Data Engineer.

☑️ Experience developing large scale distributed data systems and services, experience in Big Data tools.

☑️ Experience working with AWS Cloud and services (RDS, SPARK, Glue, OpenSearch and more).

☑️ Expertise in the Software design and architecture process.

☑️ Experience with SQL and No-SQL.

☑️ Experience working with programming languages: Python, Java, or Scala.

☑️ Good understanding and experience of CI/CD practices and Git, including MLOps practices.


Our Tech Stack :

Python, Java, Spark, Kafka, Parquet, IceBerg, Avro, AWS S3, AWS Glue, AWS Athena, AWS DataZone, AWS Lake Formation, AWS SageMaker, AWS Document DB, AWS ElasticCahe, AWS OpenSearch, AWS DRS, AWS QuickSight, AWS EKS, AWS Managed Airflow.

MalamTeam