We are looking for a data engineer to join our data and machine learning team to help us create and build our data infrastructure and artificial intelligence products.
This is a great opportunity to join an agile and dynamic technology team.
We're looking for a data engineer to help us build out a robust, extensible, and scalable cloud-based data collection and storage platform.
We need someone who can take features from start to finish. This role will cover the spectrum of our data product offerings, from data pipeline and security to extract, transformation and testing and will work closely with data scientist and algorithm engineers.
Requirements:
- B.Sc. in Computer Science,
- Experience with 1 of the languages: Java, Python, Go
- At least 1 year of experience with server-side programing.
- Experience with big data tools
- Development experience in a micro-services CI\CD environment.
- Outstanding analytical and problem-solving skills
- Advantage - Knowledge of math, probability, statistics and algorithms
- Advantage - Understanding and experience with Amazon Web Services (AWS).
Responsibilities:
- Develop BIG data pipelines and ETL’s
- Define, design, implement and maintain data architectures and infrastructure
- Automated client data collection
- Cleaning and transforming data
- Building/managing cloud DBs and tables
- Ensuring data quality before DB/table population
- Building/managing APIs for integration with different data sources
- Building/managing log system (Elastic search cluster)
Required Skills:
- Java, Python, Go.
- SQL
- Big data infrastructure Knowledge
- GIT
Bonus Skills & Experience::