DevJobs

Senior Data Engineer

Overview
Skills
  • SQL SQL
  • Kafka Kafka
  • Spark Spark
  • RDBMS RDBMS ꞏ 5y
  • Elasticsearch Elasticsearch ꞏ 2y
  • MySQL MySQL
  • PostgreSQL PostgreSQL
  • MongoDB MongoDB
  • Cassandra Cassandra
  • Azure Azure
  • Data Architecture ꞏ 5y
  • Non-relational Databases ꞏ 2y
  • Azure Data Factory
  • Databricks
  • ELT
  • ETL
  • Hadoop
  • MSSQL
As a Senior Data Engineer within our development team, you will play an important role in design, implementation, and ongoing performance optimization of anything data oriented in the R&D department, including ETL/ELT processes, working closely with architects and development teams.

Your duties and responsibilities include:

  • Lead the design and implementation of scalable data architecture solutions.
  • Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems).
  • Identify ways to improve data reliability, efficiency, and quality.
  • Collaborate with data scientists, data analysts, and other stakeholders to achieve optimal data performance.
  • Optimize complex SQL queries and perform performance tuning.
  • Participate in Scrum and Agile development processes.
  • Implement and manage relational and non-relational databases.

Requirements:

Must-have Qualifications

  • 5+ years of experience leading, designing, and implementing data architecture at an enterprise level.
  • 5+ years of experience working with relational databases (for example, PostgreSQL, MSSQL or MySQL).
  • 2+ years of experience working with Elasticsearch.
  • 2+ years of experience working with non-relational databases (for example, MongoDB or Cassandra).
  • Be exceptionally strong in SQL development - complex queries and performance tuning.
  • Implement and manage ETL/ELT processes for data integration and transformation.
  • Proficiency in Azure and Azure Data Factory for data integration and transformation.
  • Experience with Databricks or similar data processing platforms.
  • Experience with Scrum and Agile methodology.
  • Fluent in spoken and written English.

Advantages

  • Experience with big data technologies such as Hadoop, Spark, or Kafka.
  • Familiarity with data warehousing solutions.
  • Knowledge of data governance and data security practices.
  • Certification in Azure or other relevant technologies.
  • University or college degree in Computer Science or a related discipline.
CodeValue