Ranking: 41
As a Data Engineer, you will be responsible for developing and maintaining large-scale data processing solutions, ensuring data reliability, performance, and scalability. You will work closely with analytics, engineering, and cloud teams to support data-driven decision-making across the organization.
Design, develop, and maintain data pipelines using Python, PySpark, and Pandas.
Implement and optimize distributed data processing solutions with Apache Spark.
Develop and optimize SQL-based data transformations.
Build and manage data workflows using Azure Synapse Analytics, Azure Data Factory, and other Azure data services.
Ensure data quality, performance, and scalability across platforms.
Collaborate with cross-functional teams to support analytical and business requirements.
4+ years of experience as a Data Engineer or similar role.
Strong programming skills in Python (PySpark, Pandas).
Solid understanding of Spark and distributed data processing concepts.
Advanced SQL skills.
Hands-on experience with Azure Synapse Analytics, Azure Data Factory, and Azure data services.
Experience working with large-scale data environments.
Experience with Azure Functions, Azure Virtual Machines, and Azure DevOps.
Familiarity with CI/CD pipelines and Infrastructure as Code (ARM templates).
Knowledge of data modeling, ETL frameworks, and data governance best practices.
Experience in streaming or near-real-time data processing environments.
As a Data Engineer, you will be responsible for developing and maintaining large-scale data processing solutions, ensuring data reliability, performance, and scalability. You will work closely with analytics, engineering, and cloud teams to support data-driven decision-making across the organization.
Design, develop, and maintain data pipelines using Python, PySpark, and Pandas.
Implement and optimize distributed data processing solutions with Apache Spark.
Develop and optimize SQL-based data transformations.
Build and manage data workflows using Azure Synapse Analytics, Azure Data Factory, and other Azure data services.
Ensure data quality, performance, and scalability across platforms.
Collaborate with cross-functional teams to support analytical and business requirements.
4+ years of experience as a Data Engineer or similar role.
Strong programming skills in Python (PySpark, Pandas).
Solid understanding of Spark and distributed data processing concepts.
Advanced SQL skills.
Hands-on experience with Azure Synapse Analytics, Azure Data Factory, and Azure data services.
Experience working with large-scale data environments.
Experience with Azure Functions, Azure Virtual Machines, and Azure DevOps.
Familiarity with CI/CD pipelines and Infrastructure as Code (ARM templates).
Knowledge of data modeling, ETL frameworks, and data governance best practices.
Experience in streaming or near-real-time data processing environments.
