Subject Matter Expert (Tools&Automation)

Job Summary

We are looking for a Microsoft Fabric Developer who combines strong data engineering fundamentals with applied Machine Learning (ML) and Deep Learning (DL) expertise. The role involves building and operationalizing data pipelines on Microsoft Fabric while embedding predictive and AI-driven capabilities into the platform.

Key Responsibilities

• Design, build, and maintain end-to-end data pipelines on Microsoft Fabric (Data Factory pipelines, Dataflows Gen2, Lakehouse, OneLake).
• Develop and productionize ML and DL models (time-series forecasting, clustering, classification, anomaly detection, and sequence models such as LSTM/transformers) for predictive use cases.
• Build and operationalize real-time analytics using KQL, Eventstreams, and Eventhouse for streaming data and automated alerting.
• Implement semantic models, Direct Lake datasets, and Power BI reporting layers to surface ML/DL outputs and platform KPIs.
• Integrate AI capabilities in Fabric (and complementary Azure ML/Databricks workloads) for data enrichment, feature engineering, and anomaly monitoring.
• Apply Microsoft Purview governance, RBAC/Entra ID security, workspace design, and data classification to meet enterprise security and compliance standards.
• Establish CI/CD, Git integration, and deployment pipelines for Fabric artifacts (notebooks, pipelines, semantic models).
• Collaborate with cross-functional teams to define data contracts, SOPs, and onboarding workflows for new use cases.

Skill Requirements

• 4–7 years of data engineering/AI-ML experience, with at least 2 years hands-on with Microsoft Fabric (OneLake, Lakehouse, Data Factory/Dataflows Gen2, Synapse Data Warehouse, Real-Time Intelligence/KQL).
• Strong programming skills in Python and PySpark; solid working knowledge of SQL/T-SQL and DAX.
• Hands-on Machine Learning expertise: supervised and unsupervised techniques (classification, clustering, regression, anomaly detection) using scikit-learn or equivalent.
• Deep Learning expertise: experience with TensorFlow or PyTorch, including sequence/time-series models (LSTM/GRU) and/or transformer-based architectures.
• Experience building ML pipelines for batch and real-time/streaming scenarios, including feature engineering and retraining workflows.
• Familiarity with Fabric's Data Science workload and/or Azure Databricks for model development and MLOps.
• Experience with Fabric governance and security: Microsoft Purview, Entra ID, RBAC, and row/object-level security.
• Working knowledge of API development (FastAPI or similar) and OAuth2/Entra ID-based authentication.
• Experience with Power BI (Direct Lake, semantic models, DAX).
• Understanding of CI/CD practices (Azure DevOps/Git) and deployment pipelines for Fabric items.
• Strong analytical, problem-solving, and communication skills.

Other Requirements

• Exposure to Microsoft Copilot Studio, Fabric Data Agents, or agentic AI frameworks.
• Experience with dashboarding and alerting tools beyond Power BI, and automated alerting for recurring issues.
• Familiarity with enterprise IT operations (ITOps/AIOps) datasets.
• Prior experience migrating workloads from Azure Synapse/Databricks to Microsoft Fabric.
• Microsoft Certified: Fabric Data Engineer Associate (DP-700) or equivalent certification.
• Experience designing reusable, configurable platform components across multiple business domains or data sources.