Data Specialist - R01569712
Bengaluru · Senior
Applicants who checked fit first are 3.1× more likely to hear back
Your score for this role already exists
ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.
No credit card · 1 tap with Google
What we know about this role
HIGH
Brillio is actively reviewing profiles and moving candidates through the pipeline right now.
First 72 hours
Window passed - posted 49d agoEarly applicants get seen before the pile builds.
Not a repost
The first time we've seen this listing - it hasn't been closed and reopened.
Skills required
10 listedYou almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.
Job description
Specialization
Job requirements
Experience Range: With at least 5-6 years of experience in data engineering, including substantial hands-on expertise in Databricks and PySpark
Key Responsibilities:
1. Design and implement robust ETL pipelines using Databricks and PySpark to efficiently process large-scale datasets
2. Develop, optimize, and maintain complex SQL queries, stored procedures, and scalable data models to support analytics and reporting
3. Collaborate with data architects and business stakeholders to translate requirements into high-performance data solutions
4. Integrate data from diverse sources into data warehouses and modern data platforms, ensuring data quality and consistency
5. Troubleshoot and resolve issues related to data ingestion, transformation, and storage within Databricks environments
6. Enforce best practices in data warehousing, data modeling, and Databricks platform fundamentals
7. Monitor and tune performance of data processing jobs for optimal throughput and reliability
8. Document data engineering processes and provide technical guidance to team members on Databricks and PySpark usage
Required Skills:
1. Advanced proficiency in Databricks platform
2. Expertise in PySpark for distributed data processing and transformation
3. Strong SQL skills for analytics and data manipulation
4. Experience with data warehousing architectures
5. Hands-on experience designing and maintaining stored procedures
6. Proficiency in Apache Spark for large-scale data processing
Preferred Skills:
1. Experience with Azure Databricks or AWS Glue
2. Familiarity with CI/CD pipelines for Databricks workflows
3. Knowledge of Databricks performance optimization techniques
4. Exposure to data governance and security best practices in cloud environments
5. Experience with real-time data streaming frameworks such as Apache Kafka
Desired Qualifications:
1. Bachelor's degree in Computer Science, Information Technology, or a closely related discipline
2. Certification in Databricks or Apache Spark
3. Certification in SQL or data warehousing technologies
Free · no signup
Get tomorrow's jobs before you have to search
Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.
No spam. Just jobs and resources.
Why people use ASAI
Someone shared one job with you. ASAI keeps finding the rest.
Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.
More Data Engineer roles in Bengaluru
See allKeep browsing