TixelJobs
T
Technology Nextvia muse

ETL Data Engineer

REMOTEPosted 1w ago
Data EngineerMid LevelFull-time#remote

About the Role

**Role**: ETL Data Engineer – AI/ML \& LLM
**Experience**: 7\-8 Years
**Location**: Hybrid PAN India
**Timing** \-IST
**Employment** **Type** : C2C (Contractual)

**Job Summary:**

We are looking for an experienced ETL Data Engineer with strong expertise in Azure Databricks, Python, Apache Spark, and AI/ML/LLM technologies. The candidate should be capable of independently designing, developing, deploying, and optimizing large\-scale ETL/ELT data pipelines to support analytics, machine learning, and enterprise data solutions.

**Key Responsibilities**

Design and develop scalable ETL/ELT pipelines using Azure Databricks, Lakebase, Python, and Apache Spark.

Build and optimize data pipelines for analytics, BI reporting, machine learning, and predictive modelling.

Integrate data from multiple sources, including databases, APIs, FTP, and cloud storage.

Write complex SQL queries and perform performance tuning and optimization.

Ensure data quality, integrity, reliability, and pipeline efficiency.

Work on data architecture, modelling, and cloud\-based data engineering solutions.

Implement CI/CD and DevOps automation using Terraform and GitHub Actions.

Collaborate with AI/ML teams and integrate LLM\-based solutions.

Mentor junior data engineers and provide technical guidance.

***Required Skills***

Data Engineering \& ETL/ELT: 7\+ years of experience.

Python: 5\+ years of hands\-on experience.

Apache Spark: 2\+ years of experience with PySpark/Spark SQL.

Azure Databricks: 2\+ years of experience, including Unity Catalog.

AI/ML \& LLM: Practical experience working with AI/ML and LLM technologies.

**Additional Technical Skills:**

Azure Functions, Service Bus, Snowflake, and Lakebase.

Advanced SQL and data modelling.

Terraform and DevOps automation.

CI/CD: GitHub Actions, Git, Artifactory, and Sonar.

Delta Lake, Data Lake, and Data Warehousing.

Pay: ₹80,000\.00 \- ₹100,000\.00 per month

Experience:

* LLM: 6 years (Required)

Work Location: Remote
Share