We’re seeking a Senior Data Engineer to Take full ownership of designing, building, and deployment of data infrastructures, work with researchers, data scientists and product managers, Create a new industry-altering product from its inception to production level.
Requirements:
- At least 5 years of demonstrated experience in software development.
- At least 4 years of experience in building data stream pipelines and ETL using Big Data frameworks such as Spark, Apache Airflow, and BigQuery.
- Advanced proficiency in Python and SQL.
- Extensive experience with various types of databases.
- Skilled in using Python data analysis libraries (e.g., Pandas, Numpy, Arrow).
- Proven experience in deploying pipelines on the cloud (GCP preferred), including testing, staging, and monitoring.
- Proficient in applying software engineering best practices, including coding standards, code reviews, - CI/CD, and testing
- B.Sc in Computer Science or a related scientific field.