Bengaluru · Mid Level
Applicants who checked fit first are 3.1× more likely to hear back
Your score for this role already exists
ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.
Always free · no credit card · 1 tap with Google
LOW
Our tracked job listings for dowjones show limited recent activity.
First 72 hours
Window passed - posted 30d agoEarly applicants get seen before the pile builds.
Not a repost
The first time we've seen this listing - it hasn't been closed and reopened.
You almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.
Job Description :
Key Responsibilities
The Data Engineer will primarily focus on the development, deployment, and operational
maintenance of the data pipelines.
● Pipeline Development & Maintenance: Develop, deploy, and maintain scalable ETL/ELT
pipelines in GCP using Cloud Composer and PySpark on Dataproc following established
architectural patterns.
● Performance Optimization: Implement and utilize BigQuery features like Partitioning,
Clustering, and Materialized Views to improve query performance and contribute to GCP
cost management.
● Data Integration: Assist in the implementation of BigLake components to ensure
structured and unstructured data is accessible with unified governance.
● Code & Infrastructure Deployment: Utilize Terraform and CircleCI for deploying and
managing pipeline code and related infrastructure to ensure a modular and reproducible
environment.
● Data Operations & Monitoring: Implement robust logging, alerting, and data quality
checks within pipelines to actively monitor data flow and ensure data reliability.
● Collaboration: Work with senior engineers and cross-functional teams to understand
business requirements and translate them into efficient data solutions.
● Skill Development: Proactively seek out and learn new GCP services and tools to enhance
data processing capabilities.
Skills & Competencies
● Experience: Mid Level - 2 - 4 years of hands-on Data Engineering experience.
● GCP Proficiency: Solid knowledge of GCP services with a focus on BigQuery, DataForm,
Cloud Composer, Cloud Storage, Cloud functions and Dataproc.
● Transformation Tools: Proficiency in Dataform for managing version-controlled SQL
workflows and modeling within BigQuery.
● Strong Coding: Excellent Python and SQL skills. You write modular code that is easy to
test and maintain.
● Architectural Knowledge: Solid understanding of Data Modeling (Star Schema,
Snowflake) and Data Operations.
● Automation Mindset: Experience with CI/CD tools and Infrastructure-as-Code is essential.
● Domain Knowledge: Experience in the News or Media industry is a strong plus.
Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status or any other protected characteristic.
Reasonable Accommodation
We are committed to providing reasonable accommodation for qualified individuals with disabilities in our job application and/or interview process. If you need assistance or accommodation in completing your application or participating in an interview due to a disability, email us at [email protected]. Please put "Reasonable Accommodation" in the subject line and provide a brief description of the type of assistance you need. This inbox will not be monitored for application status updates.
Please refer to the privacy notice at the bottom of this page for submitting any data access, deletion, or other data subject rights requests, where permitted under your local laws and regulations.
Your match score, skill map and tracker stay free.
Skip jobs with hidden dealbreakers. See what they actually need, what's easy to miss, and how they describe the team.
Ground Reality on every job, plus Insider Path, practice interviews and resume tailoring.
We help you find people there who worked or studied where you did, and draft your first message and follow-up.
Free · no signup
Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.
No spam. Just jobs and resources.
Why people use ASAI
Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.
More Data Engineer roles in Bengaluru
See allKeep browsing