Infra Data Engineer Job Description:

As a Senior Infra Data Engineer, you’ll join our data engineering team, working alongside software engineers, backend engineers, frontend engineers, and the data team.

In this crucial role, you will take part in building our next-generation data platform that will advance

Artlist as a data-driven company.

You will work with cutting-edge technologies and build a solid foundation of a data platform that will serve the company’s internal and external sources and eventually enable the business stakeholders to make decisions based on accurate and enriched data.

Responsibilities:

• End-to-end development of the company data infrastructure.
• Build and design high-performance, real-time/near real-time streaming data pipelines incorporating current and new data stack tools such as Airflow, AWS,  Snowflake, Spark, Redis, and Kafka.
• Build and design an autonomous platform that will produce data that will be served by multiple consumers 3rd parties and internal
• Build and design a self-recovery platform that will reduce downtime to a minimum.

Requirements:

• 4+ years of experience in data engineering or backend engineering roles - must
• Proven experience in designing and building real-time events platform solution-must  
• Strong knowledge of backend programming languages such as Python, Java, Scala, or similar - must
• Deep knowledge and strong experience deploying distributed data technologies and systems (Spark, Kafka, airflow, or similar) - must
• Strong and proven knowledge of working with data lakes, lakehouses, and data warehouses in the cloud (Snowflake or similar)
• Advanced proficiency in working with SQL / NoSQL databases
•  Strong experience with ETL/ELT processes, data ingestion, data transformation, data

modeling, and monitoring.