Designation Azure Data Engineer

Location Bengaluru, India

Top Skills

• Cloud & Azure Technologies: Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, and Azure Databricks/Synapse for complex stored procedures

• Programming & Scripting: Proficiency in Python, SQL (compulsory), and Scala; hands-on experience with PLSQL

• Data Expertise: Data modelling, data warehousing, and data integration concepts

• Big Data & Infrastructure: Familiarity with Apache Spark, Hadoop, and cloud infrastructure management

• DevOps & Automation: Experience with Azure DevOps, PowerShell, and automation tools for deployment and monitoring

• Data Governance & Security: Robust understanding of data governance practices, data quality management, and security principles

• Soft Skills: Strategic planning, strong communication, collaboration, and problem-solving skills

Roles and Responsibilities

• Design & Implementation: Architect, implement, and optimize end-to-end data solutions on the Azure ecosystem.

• ETL Pipeline Development: Build and maintain efficient ETL pipelines using Azure Data Factory while ensuring data quality and integration with Azure Data Lake.

• Stored Procedures & Analytics: Develop and fine-tune complex stored procedures within Azure Databricks or Synapse to enable advanced analytics on large-scale data (exceeding 50TB).

• Data Management: Apply your expertise in SQL, PLSQL, and data modelling to manipulate, transform, and analyze data effectively.

• Collaboration: Work cross-functionally to support data-driven initiatives; utilize Azure Synapse Analytics to convert raw data into actionable insights.

• Optimization & Troubleshooting: Monitor and enhance data storage, processing, and retrieval mechanisms while addressing performance issues.

• Security & Governance: Enforce and maintain strong data governance, adherence to data security standards, and compliance with privacy regulations.

• Process Automation: Collaborate with DevOps teams to automate deployments, configurations, and monitoring using tools such as Azure DevOps and PowerShell.

Qualification

• Education: Bachelor’s degree in Computer Science, Engineering, or a related field (advanced degree preferred).

• Experience: 6–8 years of hands-on experience designing and implementing data engineering solutions in the Azure ecosystem.

• Technical Expertise:

  • Proficiency in developing solutions with Azure Data Factory, Azure Data Lake Storage, Azure Databricks, and Azure Synapse Analytics.

  • Extensive experience in SQL (compulsory) and PLSQL.

  • Strong background in data modelling, data warehousing, and data integration concepts.

  • Familiarity with big data frameworks such as Apache Spark or Hadoop is required.

• Certifications: Relevant Azure certifications (e.g., Azure Data Engineer Associate or Azure Solutions Architect Expert) are preferred.

• Industry Experience: Experience in a retail setup is a plus.

Employee Value Proposition Join the dynamic team at Landmark Digital and play a pivotal role in driving innovation through state-of-the-art data engineering practices. You’ll work with the latest Azure technologies to design, deploy, and optimize robust data pipelines that directly influence strategic, data-driven decision-making. This role offers a collaborative environment that fosters continuous learning, career growth, and the opportunity to impact retail transformation on a global scale.