TixelJobs
C
Clock Edge Technologies Pvt Ltvia muse

Senior Databricks Developer with AI Expertise

REMOTEPosted 1w ago
Data EngineerSeniorFull-time#remote

About the Role

\# DLTJP00064354 – Senior Databricks Developer with AI Expertise

\*\*Experience:\*\* 8\+ Years Overall (7\+ Years Relevant in Databricks)

\*\*Number of Positions:\*\* 1

\*\*Role Type:\*\* Individual Contributor (IC)

\*\*Work Locations:\*\* Hyderabad / Bangalore

\*\*Work Mode:\*\* Hybrid (Initially 5 Days Work from Office)

\*\*Interview Rounds:\*\* 2 Rounds

\*\*Interview Mode:\*\* Virtual

\*\*Rate Card:\*\* Maximum ₹2,000/hour

\#\# Position Summary

We are looking for a Senior Databricks Developer with deep expertise in Azure\-based data engineering and hands\-on experience designing, developing, and deploying enterprise AI, Large Language Model (LLM), and Generative AI solutions.

The role involves leading the design, architecture, and implementation of modern data platforms and AI solutions, including enterprise chatbots, conversational AI, automated executive reporting, AI\-driven data quality monitoring, and intelligent workflow automation.

\#\# Key Responsibilities

\- Design and build scalable, efficient, and reliable data pipelines to extract, transform, and load (ETL) data from various sources into data lakes or data warehouses.

\- Provide leadership on migration from Hadoop to Azure and guide data utilization across multiple portfolios, including AI and Generative AI capabilities in modern data platforms.

\- Develop and implement data models that optimize data storage, retrieval, and analysis.

\- Integrate data from databases, APIs, streaming platforms, third\-party systems, and AI/LLM\-enabled applications.

\- Perform data transformation, cleansing, preprocessing, and enrichment to ensure data quality and readiness for analytics, machine learning, and AI solutions.

\- Design and maintain data warehouses and data lakes for structured and unstructured data.

\- Implement data governance and security practices to protect sensitive data, ensure privacy, and support compliance with regulations such as GDPR and CCPA, including governance for AI and Generative AI solutions.

\- Monitor and optimize data processing and query performance, resolving bottlenecks to improve data retrieval, AI model performance, and analytical efficiency.

\- Collaborate with data analysts, data scientists, and AI engineering teams to provide reliable datasets for analytics, machine learning, and Generative AI initiatives.

\- Lead the design, architecture, and implementation of enterprise AI, Generative AI, and LLM solutions, including conversational AI, automated executive reporting, intelligent workflow automation, and AI\-driven data quality monitoring.

\#\# Mandatory Skills and Experience

\- 8\+ years of total experience, including 7\+ years of relevant Databricks experience.

\- Experience with Azure Cloud and Azure Databricks.

\- Strong programming and scripting skills in SQL, Spark, Scala, and/or Python.

\- Hands\-on experience designing, developing, and deploying enterprise AI, LLM, and Generative AI solutions.

\- Experience with Azure OpenAI, OpenAI, or similar LLM platforms.

\- Knowledge of prompt engineering, Retrieval\-Augmented Generation (RAG), vector databases, embeddings, and semantic search.

\- Experience with Jira, GitHub, and DevOps tools.

\- Familiarity with MLOps/LLMOps practices for AI deployment and lifecycle management.

\- Experience with data integration and ETL processes.

\- Knowledge of data modeling, dimensional modeling, and database schema design.

\- Experience with big data technologies and platforms.

\- Experience leading and implementing AI initiatives, including enterprise chatbots, conversational AI, AI\-powered leadership reporting, data quality monitoring, anomaly detection, and intelligent process automation.

\- Experience integrating AI and Generative AI capabilities with Databricks, enterprise data platforms, and cloud\-native services.

\- Understanding of data governance, data security, Responsible AI principles, and compliance requirements.

\- Strong problem\-solving, analyti
Share