Are you interested in working for one of the most exciting and fast-growing teams at Microsoft? Would you like to be part of one of the world’s most advanced cyber-security solutions and protect millions of users from thousands of active attacks every month? Then look at the Modern Protection and SOC (MPS) Engineering team. You will be working with a global team responsible for building cloud solutions to meet scales that few companies in the industry are required to support. The Modern Protection and SOC (MPS) team is responsible for delivering a constantly evolving set of services and solutions to meet the challenging landscape of our ever-evolving attackers. 

MPS is a set of security services responsible for automatically analyzing threat data across domains, providing customers with a unified view of attacks across their digital landscape, and detecting and thwarting attacks anywhere in the kill chain to return the organization to a secure state.  

We are searching for a Senior Data Engineer you will be working closely with MPS business leaders, product managers, data scientists, and analysts to build data pipelines, datasets, data-lakes, metrics, KPI’s that answer important questions about our business metrics and provide data on how to grow our business further.

Responsibilities

Ship high-quality, well-tested, secure, and maintainable code.

Design, develop, and maintain data pipelines and back-end services for real-time decisioning, reporting, optimization, data collection, and related functions.

Work collaboratively and communicate effectively with a small, motivated team of engineers and product managers.

Experiment with and recommend new technologies that simplify or improve the tech stack.

Participate in an on-call rotation and work occasional off-hours. 

Qualifications

Minimum Qualifications:

Bachelor’s degree in computer science, Math, Software Engineering, Computer Engineering,

or related field OR equivalent experience.

7+ years’ of experience in business analytics, data science, software development,

data modelling or data engineering work

Solid understanding of ETL concepts, data modeling, and schema design.

Strong Proficiency with distributed computing and cloud platforms (e.g., AWS, Azure, or GCP).

Strong proficiency in SQL and experience working with relational databases

Experience with big data processing frameworks and technologies

Familiarity with containerization using Kubernetes and experience deploying applications in Kubernetes clusters.

Architecting, building, and maintaining end-to-end, high-throughput data systems and their supporting services.

Designing efficient data structures and database schemas and working with distributed systems architecture

Incorporating data processing and workflow management tools into pipeline design. (ETL/ELT) Utilizing a variety of data stores, including data warehouses, relational database systems, in-memory caches, and searchable document databases. Using profiling tools, debugging logs, performance metrics, and other data sources to make code- and application-level improvements

Bonus Points For

Master’s degree in computer science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years’ experience in business analytics, data science, software development, data modelling or data engineering work

Experience working with large data sets using SQL/Azure Data Lake/Spark/Data bricks, etc., to derive actionable insights is highly desirable.

Experience with data visualization tooling

Developing for continuous integration and automated deployments.

#ILDC-MPS

#MSFTSECURITY

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.