ompany  : SparkSupport Infotech Pvt Ltd

Designation: Data Engineer

Location     : Kochi

Requirements:

• Design, develop, and maintain scalable ETL/ELT pipelines using Microsoft Azure services and Microsoft Fabric.

• Implement watermark-based, incremental loading, and CDC (Change Data Capture) mechanisms for optimized data ingestion and processing.

• Develop and orchestrate end-to-end data workflows using Microsoft Azure Data Factory (ADF) and Fabric Pipelines.

• Build and manage enterprise-scale data pipelines for structured, semi-structured, and unstructured data.

• Design and implement Lakehouse and Data Warehouse solutions using Microsoft Fabric.

• Work with OneLake architecture for centralized and governed enterprise data management.

• Implement medallion architecture (Bronze, Silver, Gold layers) for scalable data transformation and analytics.

• Develop and optimize Spark and SQL-based data transformations within Fabric environments.

• Design, manage, and optimize Azure Data Lake solutions.

• Write and optimize complex SQL queries, stored procedures, views, and performance tuning scripts.

• Integrate data from multiple cloud and on-premise data sources.

• Monitor, troubleshoot, and optimize pipeline execution, workload performance, and data quality.

• Implement security, governance, lineage, and access controls across data platforms.

• Collaborate with business analysts, BI developers, architects, and stakeholders to deliver data-driven solutions.

• Support CI/CD implementation, Git integration, and deployment automation for data engineering projects. 

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field. 

• Strong analytical and problem-solving skills.

• Excellent communication and stakeholder management abilities.

• Ability to work independently and collaboratively in a fast-paced environment.

• Strong attention to detail and commitment to data quality and governance. 

Experience : 4 to 5 Years  

About Company

SparkSupport Infotech Pvt Ltd is one of the leading IT solution providers in India. We manage the most complex and mission critical infrastructure for organizations across the globe. Furthermore we develop scalable, micro-service based web applications using the back-end technologies like Python, PHP, Perl node.js and front-end technologies like angular, vue.js, react.js etc. Additionally we develop native apps in iOS and Android. On top of it, we also develop apps using PowerApps and visualization using PowerBI. Our skills cater to the end to end IT requirements of every customer. At spark you will enjoy an empathetic, cordial, dynamic, passionate attitude from every employee.