G
Genpactvia muse
Lead Data Engineer - Data Engineering 4C
REMOTEPosted 2w ago
Data EngineerLeadFull-time#remote
About the Role
Lead Data Engineer**Ready to turn bold ideas into real\-world impact?**
At Genpact, we don’t just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we’re at the forefront of it. Genpact’s AI Gigafactory, our industry\-first accelerator, exemplifies how we scale advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. Whether tackling complex challenges through large\-scale models or agentic AI, our breakthrough solutions tackle companies’ most complex challenges.
If you thrive in a fast\-moving, innovation\-driven environment, love building and deploying cutting\-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment.
Genpact (NYSE: G) is an agentic and advanced technology solutions company. We leverage process intelligence and artificial intelligence to deliver measurable outcomes. With a strong partner ecosystem and decades of client trust, we provide innovative solutions that transform how businesses run. Powered by a team with an active learning mindset and client centricity at its core, we deliver lasting value for the world’s leading enterprises.
Get to know us at genpact.com and on LinkedIn, YouTube, X, and Facebook.
**Job Description**
\*\*Primary Focus\*\*: End\-to\-end Data Engineering, Data Modeling, Delta Lake \\\& Lakebase Optimizations, Secure Lakehouse Management, Production Migrations, and Complex Pipeline Debugging.
\*\*Role Overview\*\*
We are seeking an experienced Senior Data Engineer (Band 4C) to drive the design, development, optimization, and production deployment of our Finance1 Databrics platform. In this role, you will lead end\-to\-end data pipeline engineering, design scalable dimensional and lakehouse data models, manage end\-to\-end production migrations, and troubleshoot complex production issues. You will be responsible for query performance tuning, maintaining Delta table optimizations, enforcing strict data governance via Unity Catalog, and ensuring zero\-downtime, high\-availability data delivery across environments.
\*\*Key Responsibilities\*\*
* Data Modeling: Design, build, and maintain enterprise\-grade data models (Dimensional/Star Schema) alongside comprehensive Source\-to\-Target Mappings (STTM) and Seed Data Management.
* Core Databricks \\\& Lakehouse Pipeline Engineering: Build robust batch ingestion/processing pipelines using PySpark, Delta Lake, Lakebase, and Databricks Workflows.
* Production Migration \\\& Environment Management: Lead end\-to\-end production migrations, environment promotions (Dev/QA/Prod), historical data backfills, schema migrations, and legacy system transitions onto the Databricks Lakehouse platform with minimal downtime.
* Production Debugging \\\& Operational Support: Troubleshoot and resolve complex production pipeline failures, memory leaks, Spark driver/worker OOM (Out Of Memory) issues, data skewness, schema drift, and performance bottlenecks.
* Performance Tuning \\\& Optimization: Perform execution plan analysis, query tuning, and compute optimization across Serverless/Classic SQL Warehouses, Delta table layout optimizations (Z\-Ordering, Liquid Clustering, Compaction), and caching strategies.
* Governance \\\& Security: Implement and enforce enterprise\-grade data security, column/row\-level access controls, data masking, and audit lineage using Databricks Unity Catalog.
* CI/CD \\\& Lakehouse Automation: Implement automated deployment pipelines for Databricks assets using Git, Databricks Asset Bundles (DABs), and DevOps practices.
\*\*Required Qualifications \\\& Technical Skills\*\*
* Experience: 6 to 10 years of core Data Engineering experience with strong, hands\-on expertise on the Databricks Lakehouse platform.
* Production \\\& Debugging Expertise: Proven track record of managing production data pipelines, debugging complex distributed systems, analyzing Spark UI/DAG logs,
At Genpact, we don’t just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work, and we’re at the forefront of it. Genpact’s AI Gigafactory, our industry\-first accelerator, exemplifies how we scale advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. Whether tackling complex challenges through large\-scale models or agentic AI, our breakthrough solutions tackle companies’ most complex challenges.
If you thrive in a fast\-moving, innovation\-driven environment, love building and deploying cutting\-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment.
Genpact (NYSE: G) is an agentic and advanced technology solutions company. We leverage process intelligence and artificial intelligence to deliver measurable outcomes. With a strong partner ecosystem and decades of client trust, we provide innovative solutions that transform how businesses run. Powered by a team with an active learning mindset and client centricity at its core, we deliver lasting value for the world’s leading enterprises.
Get to know us at genpact.com and on LinkedIn, YouTube, X, and Facebook.
**Job Description**
\*\*Primary Focus\*\*: End\-to\-end Data Engineering, Data Modeling, Delta Lake \\\& Lakebase Optimizations, Secure Lakehouse Management, Production Migrations, and Complex Pipeline Debugging.
\*\*Role Overview\*\*
We are seeking an experienced Senior Data Engineer (Band 4C) to drive the design, development, optimization, and production deployment of our Finance1 Databrics platform. In this role, you will lead end\-to\-end data pipeline engineering, design scalable dimensional and lakehouse data models, manage end\-to\-end production migrations, and troubleshoot complex production issues. You will be responsible for query performance tuning, maintaining Delta table optimizations, enforcing strict data governance via Unity Catalog, and ensuring zero\-downtime, high\-availability data delivery across environments.
\*\*Key Responsibilities\*\*
* Data Modeling: Design, build, and maintain enterprise\-grade data models (Dimensional/Star Schema) alongside comprehensive Source\-to\-Target Mappings (STTM) and Seed Data Management.
* Core Databricks \\\& Lakehouse Pipeline Engineering: Build robust batch ingestion/processing pipelines using PySpark, Delta Lake, Lakebase, and Databricks Workflows.
* Production Migration \\\& Environment Management: Lead end\-to\-end production migrations, environment promotions (Dev/QA/Prod), historical data backfills, schema migrations, and legacy system transitions onto the Databricks Lakehouse platform with minimal downtime.
* Production Debugging \\\& Operational Support: Troubleshoot and resolve complex production pipeline failures, memory leaks, Spark driver/worker OOM (Out Of Memory) issues, data skewness, schema drift, and performance bottlenecks.
* Performance Tuning \\\& Optimization: Perform execution plan analysis, query tuning, and compute optimization across Serverless/Classic SQL Warehouses, Delta table layout optimizations (Z\-Ordering, Liquid Clustering, Compaction), and caching strategies.
* Governance \\\& Security: Implement and enforce enterprise\-grade data security, column/row\-level access controls, data masking, and audit lineage using Databricks Unity Catalog.
* CI/CD \\\& Lakehouse Automation: Implement automated deployment pipelines for Databricks assets using Git, Databricks Asset Bundles (DABs), and DevOps practices.
\*\*Required Qualifications \\\& Technical Skills\*\*
* Experience: 6 to 10 years of core Data Engineering experience with strong, hands\-on expertise on the Databricks Lakehouse platform.
* Production \\\& Debugging Expertise: Proven track record of managing production data pipelines, debugging complex distributed systems, analyzing Spark UI/DAG logs,