Engineer - Data & AI

About the Role:

We are looking for a Engineer – Data & AI to design, develop, and optimize modern cloud-native data platforms using Microsoft Fabric. The ideal candidate will have hands-on experience in building enterprise-grade data pipelines, Lakehouse architectures, and analytics solutions that enable business intelligence, advanced analytics, and AI initiatives.

You will work closely with Solution Architects, Data Engineers, Business Analysts, and Analytics teams to build scalable, secure, and high-performing data solutions using Microsoft Fabric and the Azure ecosystem. This role requires strong engineering fundamentals, cloud expertise, and a passion for delivering enterprise-scale data platforms.

Key Responsibilities

Microsoft Fabric Development

• Design and develop scalable data solutions using Microsoft Fabric.
• Build and manage Lakehouse, Warehouse, OneLake, and Data Engineering workloads.
• Develop ELT/ETL pipelines using Fabric Data Factory and Dataflows Gen2.
• Design reusable data ingestion, transformation, and orchestration frameworks.
• Implement enterprise-grade data quality, validation, and monitoring mechanisms.

Data Engineering

• Develop scalable batch and near real-time data pipelines.
• Build optimized data models supporting analytics and reporting workloads.
• Integrate data from ERP, CRM, APIs, databases, cloud storage, and enterprise applications.
• Perform performance tuning and optimization of Fabric workloads.
• Implement best practices for data security, governance, and lineage.

Analytics & Business Intelligence

• Develop semantic models and curated datasets for Power BI.
• Enable Direct Lake reporting and enterprise BI solutions.
• Support self-service analytics through reusable business-ready data models.
• Ensure high-quality, trusted datasets for reporting and AI use cases.

Cloud Engineering

• Work across Microsoft Fabric and Azure Data Services.
• Build scalable cloud-native data architectures.
• Implement CI/CD pipelines for Fabric deployments.
• Collaborate with DevOps teams for automated deployment and environment management.
• Optimize cloud infrastructure for scalability, performance, and cost.

Project Delivery

• Participate in solution design and technical discussions.
• Collaborate with architects and senior engineers during project implementation.
• Support testing, deployment, production rollout, and hypercare activities.
• Troubleshoot production issues and optimize existing solutions.
• Contribute to technical documentation and reusable accelerators.

Stakeholder Collaboration

• Work with Business Analysts, Product Owners, and Solution Consultants to understand business requirements.
• Translate functional requirements into scalable technical solutions.
• Communicate technical progress and implementation updates to project stakeholders.
• Contribute to knowledge-sharing initiatives and engineering best practices.

Skills Required

Microsoft Fabric, Data Engineering, SQL, Python, PySpark, Azure Data Factory, Lakehouse, MS OneLake, Data Warehousing, Azure Data Services, CI/CD

Role

Ideal Candidate Profile

• 4–7 years of experience in Data Engineering, Cloud Data Platforms, or Analytics Engineering.
• Strong hands-on experience with Microsoft Fabric.
• Experience with:

• OneLake
• Lakehouse
• Fabric Warehouse
• Data Factory
• Dataflows Gen2
• Power BI
• Real-Time Analytics
• Strong programming skills in:
• SQL
• Python
• PySpark
• Experience in:
• Data Modeling (Star Schema, Snowflake Schema, Kimball)
• ETL/ELT development
• Data Warehousing
• Delta Lake
• Experience integrating data from SQL Server, Azure SQL, Oracle, SAP, REST APIs, SharePoint, Dynamics 365, and cloud storage.
• Understanding of Azure services including Azure Storage, Azure Data Factory, Azure Synapse, Azure Key Vault, and Azure Active Directory.
• Familiarity with data governance, security, monitoring, and performance optimization.
• Strong debugging, analytical, and problem-solving abilities.
• Experience working in Agile/Scrum environments.

Preferred Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or related discipline.
• Microsoft Certifications preferred:

• DP-600 – Fabric Analytics Engineer Associate
• DP-700 – Fabric Data Engineer Associate
• DP-203 – Azure Data Engineer Associate
• Experience with:

• Azure DevOps
• Git
• Microsoft Purview
• Azure Monitor
• AI/ML data pipelines
• Generative AI integrations
• Knowledge of CI/CD, Infrastructure as Code, and DevOps best practices.

Education/Qualification

BE

Job Code

10929

Designation

Engineer - Data & AI