TH

thoughtwin

Data Engineer

Indore · Entry Level

Older listing - lower visibility likelyVerified listingPosted 58d ago

Applicants who checked fit first are 3.1× more likely to hear back

Your match scoreFree · sign in

Your score for this role already exists

ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.

Always free · no credit card · 1 tap with Google

What we know about this role

Hiring pulse

LOW

Our tracked job listings for thoughtwin show limited recent activity.

Apply window

First 72 hours

Window passed - posted 58d ago

Early applicants get seen before the pile builds.

Not a repost

The first time we've seen this listing - it hasn't been closed and reopened.

Skills required

29 listed

Azure Data FactoryCI/CDStar SchemaSnowflake SchemaApache SparkApache AirflowAzure DevOpsPyspark+21 more

You almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.

Job description

We are looking for a Data Engineer with 1-4 yrs years of experience to design, build, and maintain scalable data pipelines and data platforms across cloud and big data ecosystems. The candidate should have hands-on experience with Hadoop, Spark/PySpark, Snowflake, data modeling, and workflow orchestration tools.

Key Responsibilities

Design, develop, and maintain ETL/ELT data pipelines.

Work with large-scale distributed systems like Hadoop and Spark.

Develop data pipelines using PySpark and Spark SQL.

Build and optimize data warehouses in Snowflake.

Perform data modeling (Star Schema, Snowflake Schema, SCD Types).

Implement workflow orchestration using tools like Airflow.

Work with cloud platforms such as AWS / Azure / GCP.

Optimize data pipelines for performance and cost.

Ensure data quality, data validation, and monitoring.

Work with structured and semi-structured data (JSON, Parquet, Avro, CSV).
Collaborate with Data Analysts, Data Scientists, and Business Teams.

Required Technical Skills

Big Data & Hadoop Ecosystem

Hadoop (HDFS, YARN, MapReduce)
Apache Spark
PySpark
Hive
HBase (optional)
Kafka (basic knowledge)

Cloud Platforms (At least one required)

AWS: S3, Glue, EMR, Redshift, Lambda, Athena
Azure: ADLS, Azure Data Factory, Synapse, Databricks
GCP: GCS, BigQuery, Dataproc, Dataflow, Composer

Data Warehousing

Snowflake
Redshift / BigQuery / Synapse (nice to have)

Data Modeling

Star Schema
Snowflake Schema
Slowly Changing Dimensions (SCD Type 1, 2, 3)
Fact & Dimension tables

Orchestration Tools

Apache Airflow
Azure Data Factory / AWS Step Functions / Prefect / Luigi

Programming

Python
PySpark
SQL (Advanced SQL required)
Shell Scripting (basic)

File Formats

Parquet
Avro
ORC
JSON
CSV

Version Control & CI/CD

Git
CI/CD pipelines (GitHub Actions / Jenkins / Azure DevOps)

Preferred Skills

Databricks
Delta Lake
Iceberg
Data Lake Architecture
Data Governance & Security
Docker
Kubernetes (basic)

Tools to land this role

Premium

Your match score, skill map and tracker stay free.

Ground Reality

Premium

Spot the dealbreakers in this 282-word post before you apply

Skip jobs with hidden dealbreakers. See what they actually need, what's easy to miss, and how they describe the team.

Ground Reality on every job, plus Insider Path, practice interviews and resume tailoring.

Insider Path

Premium

Find someone who can refer you here

We help you find people there who worked or studied where you did, and draft your first message and follow-up.

Free · no signup

Get tomorrow's jobs before you have to search

Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.

Join WhatsApp Join Telegram

No spam. Just jobs and resources.

Why people use ASAI

Someone shared one job with you. ASAI keeps finding the rest.

Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.

Two ways in

Applicants who checked fit first are 3.1× more likely to hear back

Your match scoreFree · sign in

Your score for this role already exists

ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.

Always free · no credit card · 1 tap with Google

Free · no signup

Get tomorrow's jobs before you have to search

Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.

Join WhatsApp Join Telegram

No spam. Just jobs and resources.

Why people use ASAI

Someone shared one job with you. ASAI keeps finding the rest.

Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.