S
Scry Analytics India Pvt Ltdvia muse
Data Engineer
DL, INPosted 1w ago
Data EngineerMid LevelFull-time
About the Role
**SCRY AI** is an innovative AI\-driven technology company focused on building intelligent, scalable, and high\-performance solutions. We work with modern technologies across Software Engineering, AI/ML, and Data to solve real\-world business problems and deliver impactful digital products. **Role Overview**
We are looking for a skilled **Data Engineer with 2\-3 years of experience** in building scalable data pipelines, backend services, and data processing systems. The ideal candidate should have strong hands\-on experience in **Python, SQL, ETL/ELT, API development, and database technologies**, with exposure to AI/ML applications, Agentic AI, and cloud or on\-premises deployments. **Key Responsibilities*** Design, develop, and maintain scalable **ETL/ELT pipelines** for processing structured and unstructured data.
* Build data ingestion and transformation workflows using **Python, SQL, and relevant data engineering frameworks**.
* Extract, clean, validate, normalize, and transform data from APIs, databases, files, and other sources.
* Design and optimize database schemas, data models, SQL queries, joins, indexes, and aggregations.
* Work with relational databases such as **PostgreSQL/MySQL** and NoSQL databases where required.
* Develop batch and incremental data processing pipelines with appropriate error handling and recovery mechanisms.
* Implement data quality checks, validation rules, deduplication, and reconciliation to ensure data accuracy and consistency.
* Integrate data pipelines and AI applications with **SQL/NoSQL databases, APIs, enterprise systems, and customer\-specific data sources**.
* Develop **Agentic AI and workflow automation** solutions using frameworks such as LangChain/LlamaIndex, including tool calling and external system integrations.
* Build and optimize backend services and APIs to support data processing, AI/ML workflows, and enterprise integrations.
* Work directly with customers and stakeholders to understand requirements, troubleshoot issues, demonstrate solutions, and translate business needs into technical implementations.
* Take AI/ML solutions from **POC to production**, focusing on scalability, reliability, latency, monitoring, and maintainability.
* Deploy and troubleshoot data and AI applications using **Docker across cloud, on\-premises, and customer environments**.
* Implement logging, monitoring, alerting, and performance optimization for data pipelines and production applications.
* Follow engineering best practices using **Git, CI/CD, automated testing, and documentation**, collaborating with Data Scientists, ML Engineers, Backend Engineers, and business teams.
**Key Qualifications*** **2\-3 years of experience** in Data Engineering, Backend Engineering, ETL development, or a related role.
* Strong proficiency in **Python and SQL**, including complex queries, joins, CTEs, window functions, and query optimization.
* Hands\-on experience building **ETL/ELT pipelines**, data ingestion workflows, and transformation processes.
* Experience with relational databases, preferably **PostgreSQL/MySQL**, and database design principles.
* Understanding of data warehousing, dimensional modeling, indexing, partitioning, and incremental data processing.
* Experience integrating REST APIs, databases, CSV/Excel files, JSON, and other data sources.
* Strong experience with **FastAPI/Flask, microservices, Docker, and backend architecture**; Kubernetes is a plus.
* Experience with **AWS/Azure/GCP and cloud or on\-premises deployments**.
* Knowledge of **CI/CD, automated testing, Git, logging, monitoring, production debugging, and AI/ML inference optimization**.
* Exposure to **LLMs, Agentic AI, tool calling, workflow automation, and frameworks such as LangChain/LlamaIndex**.
* Strong **problem\-solving, communication, customer\-facing, and collaboration skills**, with the ability to work independently in fast\-paced environments.
**Good to Have*** Experience with **Apache Spark/PySpark, Kafk
We are looking for a skilled **Data Engineer with 2\-3 years of experience** in building scalable data pipelines, backend services, and data processing systems. The ideal candidate should have strong hands\-on experience in **Python, SQL, ETL/ELT, API development, and database technologies**, with exposure to AI/ML applications, Agentic AI, and cloud or on\-premises deployments. **Key Responsibilities*** Design, develop, and maintain scalable **ETL/ELT pipelines** for processing structured and unstructured data.
* Build data ingestion and transformation workflows using **Python, SQL, and relevant data engineering frameworks**.
* Extract, clean, validate, normalize, and transform data from APIs, databases, files, and other sources.
* Design and optimize database schemas, data models, SQL queries, joins, indexes, and aggregations.
* Work with relational databases such as **PostgreSQL/MySQL** and NoSQL databases where required.
* Develop batch and incremental data processing pipelines with appropriate error handling and recovery mechanisms.
* Implement data quality checks, validation rules, deduplication, and reconciliation to ensure data accuracy and consistency.
* Integrate data pipelines and AI applications with **SQL/NoSQL databases, APIs, enterprise systems, and customer\-specific data sources**.
* Develop **Agentic AI and workflow automation** solutions using frameworks such as LangChain/LlamaIndex, including tool calling and external system integrations.
* Build and optimize backend services and APIs to support data processing, AI/ML workflows, and enterprise integrations.
* Work directly with customers and stakeholders to understand requirements, troubleshoot issues, demonstrate solutions, and translate business needs into technical implementations.
* Take AI/ML solutions from **POC to production**, focusing on scalability, reliability, latency, monitoring, and maintainability.
* Deploy and troubleshoot data and AI applications using **Docker across cloud, on\-premises, and customer environments**.
* Implement logging, monitoring, alerting, and performance optimization for data pipelines and production applications.
* Follow engineering best practices using **Git, CI/CD, automated testing, and documentation**, collaborating with Data Scientists, ML Engineers, Backend Engineers, and business teams.
**Key Qualifications*** **2\-3 years of experience** in Data Engineering, Backend Engineering, ETL development, or a related role.
* Strong proficiency in **Python and SQL**, including complex queries, joins, CTEs, window functions, and query optimization.
* Hands\-on experience building **ETL/ELT pipelines**, data ingestion workflows, and transformation processes.
* Experience with relational databases, preferably **PostgreSQL/MySQL**, and database design principles.
* Understanding of data warehousing, dimensional modeling, indexing, partitioning, and incremental data processing.
* Experience integrating REST APIs, databases, CSV/Excel files, JSON, and other data sources.
* Strong experience with **FastAPI/Flask, microservices, Docker, and backend architecture**; Kubernetes is a plus.
* Experience with **AWS/Azure/GCP and cloud or on\-premises deployments**.
* Knowledge of **CI/CD, automated testing, Git, logging, monitoring, production debugging, and AI/ML inference optimization**.
* Exposure to **LLMs, Agentic AI, tool calling, workflow automation, and frameworks such as LangChain/LlamaIndex**.
* Strong **problem\-solving, communication, customer\-facing, and collaboration skills**, with the ability to work independently in fast\-paced environments.
**Good to Have*** Experience with **Apache Spark/PySpark, Kafk