We are looking for a talented and experienced Data Engineer with a strong interest in data science to join our team. The ideal candidate will have a solid background in both data engineering and backend development, with a passion for optimizing deployed models and building data infrastructure tools.
This role will involve working closely with the data science team to develop data science tools, streamline processes for dataset management, and create frameworks that automate data science tasks.
Responsibilities
- Work closely with the data science team to optimize deployed models and improve overall performance.
- Develop and maintain data infrastructure tools and processes for efficient dataset management, ensuring easy access and organization of data resources.
- Manage and maintain data pipelines, ensuring reliability and scalability.
- Develop data science tools and frameworks to improve efficiency and productivity within the team.
- Design and develop efficient ETL processes.
- Collaborate with backend developers to ensure a strong focus on data and data science within the team.
Qualifications
- 5+ years of experience in backend/data engineering roles, with a proven track record of deploying code in production environments.
- Familiarity with machine learning algorithms and frameworks (such as PyTorch, HuggingFace, Sklearn).
- Experience with big data technologies, such as DataBricks, Snowflake, BigQuery, Kafka, and Spark.
- In-depth understanding of public cloud platforms (GCP/AWS/Azure) and application architectures and technologies.
- Hands-on experience with existing MLOps tools (e.g., Airflow, Prefect, DVC) and a passion for building custom tools from scratch.
- Ability to take a task from concept to full implementation, working both independently and collaboratively within a team.
- Experience and proficiency in designing ETL processes.
Direct apply link: https://www.comeet.com/jobs/cyera/17.008/senior-data-engineer/D8.B3C?coref=1.10.r23_018&t=1692278683836