E
EXL Servicevia muse
Snowflake Data Engineer
Pittsburgh, PA, USPosted 2w ago
Data EngineerMid LevelFull-time
About the Role
Job Description: We are seeking a highly skilled Snowflake Data Engineer with deep expertise in Snowflake's modern AI and data platform capabilities. The ideal candidate goes beyond traditional data engineering — they are proficient in Snowflake Cortex AI, building intelligent agents, developing Streamlit\-based data applications, and leveraging Snowpark for advanced analytics. This role is central to our healthcare data modernization strategy and requires someone who can architect, build, and scale next\-generation data and AI solutions on Snowflake.
**Responsibilities: Snowflake AI \& Cortex (Core Focus)**
* Design and deploy AI\-powered solutions using Snowflake Cortex, including LLM\-based functions (COMPLETE, SUMMARIZE, SENTIMENT, TRANSLATE, CLASSIFY) for healthcare data use cases.
* Build and orchestrate multi\-step AI agents using Snowflake Cortex Agents and Cortex Analyst to automate data workflows and enable natural language querying of structured healthcare datasets.
* Leverage Cortex Search for semantic and hybrid search capabilities across unstructured clinical and operational data.
* Implement RAG (Retrieval\-Augmented Generation) pipelines using Snowflake's native vector embeddings and VECTOR data type for domain\-specific LLM grounding.
Use Arctic Embed and other Snowflake\-native embedding models to build scalable, cost\-effective AI features within the Snowflake perimeter.
*
**Streamlit \& Application Development**
* Build interactive, production\-grade data applications and internal tools using Streamlit in Snowflake (SiS) for business stakeholders and data consumers.
* Develop self\-service analytics dashboards and AI\-assisted exploration tools embedded directly in the Snowflake environment.
Create Streamlit\-based front\-ends for Cortex\-powered features — enabling clinical users and analysts to interact with AI outputs without leaving the Snowflake ecosystem.
*
**Snowpark \& Data Engineering**
* Develop complex data transformations, feature engineering pipelines, and ML preprocessing workflows using Snowpark for Python.
* Build and manage scalable ELT pipelines leveraging Snowflake Streams, Tasks, Dynamic Tables, and Snowpipe for real\-time and batch ingestion.
* Optimize Snowflake performance through micro\-partition pruning, clustering keys, materialized views, search optimization, and warehouse right\-sizing.
* Design and implement Data Vault or Medallion architecture patterns for healthcare data platforms.
Integrate Snowflake with upstream healthcare data sources and downstream BI platforms.
*
**Data Governance \& Security**
* Implement Snowflake\-native governance including row\-level security, column masking policies, object tagging, and data classification.
* Ensure HIPAA compliance and PHI data handling best practices across all Snowflake data assets.
Manage data lineage, cataloging, and access control in alignment with organizational governance frameworks.
*
**Collaboration \& Platform Ownership**
* Partner with data scientists, ML engineers, clinical analysts, and business stakeholders to translate requirements into robust Snowflake\-native solutions.
* Act as a Snowflake subject matter expert and internal champion — driving best practices, onboarding teams, and evangelizing new platform capabilities.
* Participate in platform roadmap planning and contribute to Snowflake feature adoption strategy.
* Qualifications: 5\+ years of data engineering experience, with at least 3\+ years of hands\-on Snowflake expertise.
* Proven experience with Snowflake Cortex AI features: LLM functions, Cortex Analyst, Cortex Search, and AI agent orchestration.
* Hands\-on experience building Streamlit in Snowflake applications deployed in production environments.
* Proficiency in Snowpark for Python — including custom UDFs/UDTFs, stored procedures, and DataFrame API usage.
* Strong SQL skills with deep understanding of Snowflake's execution engine, query profiling, and optimization tech
**Responsibilities: Snowflake AI \& Cortex (Core Focus)**
* Design and deploy AI\-powered solutions using Snowflake Cortex, including LLM\-based functions (COMPLETE, SUMMARIZE, SENTIMENT, TRANSLATE, CLASSIFY) for healthcare data use cases.
* Build and orchestrate multi\-step AI agents using Snowflake Cortex Agents and Cortex Analyst to automate data workflows and enable natural language querying of structured healthcare datasets.
* Leverage Cortex Search for semantic and hybrid search capabilities across unstructured clinical and operational data.
* Implement RAG (Retrieval\-Augmented Generation) pipelines using Snowflake's native vector embeddings and VECTOR data type for domain\-specific LLM grounding.
Use Arctic Embed and other Snowflake\-native embedding models to build scalable, cost\-effective AI features within the Snowflake perimeter.
*
**Streamlit \& Application Development**
* Build interactive, production\-grade data applications and internal tools using Streamlit in Snowflake (SiS) for business stakeholders and data consumers.
* Develop self\-service analytics dashboards and AI\-assisted exploration tools embedded directly in the Snowflake environment.
Create Streamlit\-based front\-ends for Cortex\-powered features — enabling clinical users and analysts to interact with AI outputs without leaving the Snowflake ecosystem.
*
**Snowpark \& Data Engineering**
* Develop complex data transformations, feature engineering pipelines, and ML preprocessing workflows using Snowpark for Python.
* Build and manage scalable ELT pipelines leveraging Snowflake Streams, Tasks, Dynamic Tables, and Snowpipe for real\-time and batch ingestion.
* Optimize Snowflake performance through micro\-partition pruning, clustering keys, materialized views, search optimization, and warehouse right\-sizing.
* Design and implement Data Vault or Medallion architecture patterns for healthcare data platforms.
Integrate Snowflake with upstream healthcare data sources and downstream BI platforms.
*
**Data Governance \& Security**
* Implement Snowflake\-native governance including row\-level security, column masking policies, object tagging, and data classification.
* Ensure HIPAA compliance and PHI data handling best practices across all Snowflake data assets.
Manage data lineage, cataloging, and access control in alignment with organizational governance frameworks.
*
**Collaboration \& Platform Ownership**
* Partner with data scientists, ML engineers, clinical analysts, and business stakeholders to translate requirements into robust Snowflake\-native solutions.
* Act as a Snowflake subject matter expert and internal champion — driving best practices, onboarding teams, and evangelizing new platform capabilities.
* Participate in platform roadmap planning and contribute to Snowflake feature adoption strategy.
* Qualifications: 5\+ years of data engineering experience, with at least 3\+ years of hands\-on Snowflake expertise.
* Proven experience with Snowflake Cortex AI features: LLM functions, Cortex Analyst, Cortex Search, and AI agent orchestration.
* Hands\-on experience building Streamlit in Snowflake applications deployed in production environments.
* Proficiency in Snowpark for Python — including custom UDFs/UDTFs, stored procedures, and DataFrame API usage.
* Strong SQL skills with deep understanding of Snowflake's execution engine, query profiling, and optimization tech