T
TRILOGY FEDERALvia muse
Data Engineer
REMOTEPosted 3d ago
Data EngineerMid LevelFull-time#remote
About the Role
Trilogy Federal drives innovative solutions for complex business challenges across financial management, healthcare, and government industries. Our collaborative, client\-first service approach, combined with our commitment to the rapid implementation of pragmatic solutions, has earned Trilogy an unparalleled reputation for delivering transformative results.
Trilogy Federal seeks an experienced **Data Engineer** to support the Department of Veterans Affairs (VA) Summit Advanced Tooling, Lakehouse, and Artificial Intelligence Services (Summit ATLAS) program. The Data Engineer will design, develop, and maintain scalable cloud\-based data pipelines and engineering solutions that enable enterprise analytics, reporting, and artificial intelligence and machine learning (AI/ML) capabilities.
This position will support modernization of VA's enterprise data environment by integrating diverse data sources into the Summit Data Platform, improving data reliability and accessibility, and delivering secure, high\-performance data engineering solutions.
**Please note, this position is contingent upon award (anticipated early 2027\)****.** **This role will also require 1\-2 domestic business trips per year.**
### **Primary Responsibilities:**
* Design, develop, and maintain scalable data ingestion and processing pipelines using Azure Data Factory (ADF), Azure Databricks, Apache Kafka, and related cloud technologies.
* Engineer and optimize data lakehouse solutions, including Delta Lake architectures, semantic models, conformed dimensions, and partitioning strategies that support enterprise analytics and AI/ML workloads.
* Integrate data from enterprise systems, legacy platforms, and cloud\-based sources using batch, streaming, and event\-driven ingestion patterns.
* Implement automated data validation, reconciliation, and monitoring to ensure data accuracy, completeness, consistency, and freshness.
* Support migration of data pipelines and analytical workloads to Summit, validating parity with source systems and ensuring production readiness.
* Optimize data processing performance, resource utilization, and cloud costs through workload tuning and efficient data architecture.
* Collaborate with data governance specialists to ensure ingested datasets are documented in the Enterprise Data Catalog (EDC), including required metadata, data definitions, and end\-to\-end lineage.
* Implement Government\-approved data governance requirements within engineering solutions, including access controls, data quality standards, and dataset publication criteria.
* Develop and maintain technical documentation, including pipeline specifications, architecture decisions, operational procedures, and troubleshooting guidance.
* Monitor production pipelines, investigate failures and performance issues, and implement corrective actions to maintain reliable data services.
### **Minimum Requirements:**
* Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related technical discipline, or an equivalent combination of education and relevant professional experience.
* Seven or more years of professional experience in data engineering, data integration, or enterprise data platform development.
* Demonstrated hands\-on experience with Azure Data Factory, Azure Databricks, and Apache Kafka.
* Strong proficiency in Structured Query Language (SQL) and Python for data processing, transformation, and pipeline development.
* Experience designing and maintaining Extract, Transform, and Load (ETL) and Extract, Load, and Transform (ELT) pipelines.
* Experience with cloud\-based lakehouse architectures, distributed data processing, and data modeling.
* Experience implementing automated data quality checks, pipeline monitoring, error handling, and performance optimization.
* Experience integrating data governance requirements into engineering workflows, including metadata management, data lineage, and policy\-based data access controls.
Trilogy Federal seeks an experienced **Data Engineer** to support the Department of Veterans Affairs (VA) Summit Advanced Tooling, Lakehouse, and Artificial Intelligence Services (Summit ATLAS) program. The Data Engineer will design, develop, and maintain scalable cloud\-based data pipelines and engineering solutions that enable enterprise analytics, reporting, and artificial intelligence and machine learning (AI/ML) capabilities.
This position will support modernization of VA's enterprise data environment by integrating diverse data sources into the Summit Data Platform, improving data reliability and accessibility, and delivering secure, high\-performance data engineering solutions.
**Please note, this position is contingent upon award (anticipated early 2027\)****.** **This role will also require 1\-2 domestic business trips per year.**
### **Primary Responsibilities:**
* Design, develop, and maintain scalable data ingestion and processing pipelines using Azure Data Factory (ADF), Azure Databricks, Apache Kafka, and related cloud technologies.
* Engineer and optimize data lakehouse solutions, including Delta Lake architectures, semantic models, conformed dimensions, and partitioning strategies that support enterprise analytics and AI/ML workloads.
* Integrate data from enterprise systems, legacy platforms, and cloud\-based sources using batch, streaming, and event\-driven ingestion patterns.
* Implement automated data validation, reconciliation, and monitoring to ensure data accuracy, completeness, consistency, and freshness.
* Support migration of data pipelines and analytical workloads to Summit, validating parity with source systems and ensuring production readiness.
* Optimize data processing performance, resource utilization, and cloud costs through workload tuning and efficient data architecture.
* Collaborate with data governance specialists to ensure ingested datasets are documented in the Enterprise Data Catalog (EDC), including required metadata, data definitions, and end\-to\-end lineage.
* Implement Government\-approved data governance requirements within engineering solutions, including access controls, data quality standards, and dataset publication criteria.
* Develop and maintain technical documentation, including pipeline specifications, architecture decisions, operational procedures, and troubleshooting guidance.
* Monitor production pipelines, investigate failures and performance issues, and implement corrective actions to maintain reliable data services.
### **Minimum Requirements:**
* Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related technical discipline, or an equivalent combination of education and relevant professional experience.
* Seven or more years of professional experience in data engineering, data integration, or enterprise data platform development.
* Demonstrated hands\-on experience with Azure Data Factory, Azure Databricks, and Apache Kafka.
* Strong proficiency in Structured Query Language (SQL) and Python for data processing, transformation, and pipeline development.
* Experience designing and maintaining Extract, Transform, and Load (ETL) and Extract, Load, and Transform (ELT) pipelines.
* Experience with cloud\-based lakehouse architectures, distributed data processing, and data modeling.
* Experience implementing automated data quality checks, pipeline monitoring, error handling, and performance optimization.
* Experience integrating data governance requirements into engineering workflows, including metadata management, data lineage, and policy\-based data access controls.