Data Engineer

 

About the Role

We are looking for a motivated and detail-oriented Data Engineer with 3–4 years of experience in data engineering and analytics solutions. The ideal candidate should have hands-on experience with Microsoft Fabric, strong PySpark skills, and a foundational understanding of Databricks. The candidate should be eager to learn, adaptable to new technologies, and passionate about building scalable data solutions.

Key Responsibilities

• Design, develop, and maintain data pipelines using Microsoft Fabric.

• Build and optimize ETL/ELT processes for ingesting, transforming, and loading data from multiple sources.

• Develop and maintain data transformation workflows using PySpark.

• Work with Lakehouse, Data Warehouse, and Data Factory components within Microsoft Fabric.

• Collaborate with business stakeholders, analysts, and data teams to understand data requirements.

• Ensure data quality, consistency, and reliability across data platforms.

• Monitor and troubleshoot data pipeline performance and resolve issues proactively.

• Support data modeling and reporting requirements for analytics and business intelligence initiatives.

• Participate in code reviews, testing, and deployment activities.

• Stay updated with emerging technologies and best practices in data engineering.

Required Skills

• 3–4 years of experience in Data Engineering or related roles.

• Hands-on experience with Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse, Notebooks, etc.).

• Strong proficiency in PySpark for data processing and transformation.

• Good understanding of ETL/ELT concepts and data pipeline development.

• Experience working with SQL and relational databases.

• Basic understanding of Databricks and Spark ecosystem.

• Familiarity with data lakes and modern cloud-based data architectures.

• Knowledge of data quality, performance tuning, and optimization techniques.

• Experience with version control tools such as Git.

Preferred Skills

• Exposure to Azure Data Services.

• Understanding of Delta Lake concepts.

• Experience with Power BI integration and reporting.

• Knowledge of CI/CD practices for data engineering projects.

• Familiarity with Agile/Scrum methodologies.

Educational Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

Desired Candidate Profile

• Strong analytical and problem-solving skills.

• Eagerness to learn and work on new technologies.

• Good communication and stakeholder management skills.

• Self-motivated, proactive, and a strong team player.

• Ability to work in a fast-paced and collaborative environment.

Nice to Have

• Microsoft Fabric certifications.

• Exposure to cloud platforms such as Microsoft Azure.

• Basic experience with Databricks notebooks and workflows.