Job Overview

Barclays is hiring a Cloud Data Engineer for its technology team in Pune. The role focuses on building and maintaining systems that collect, store, process, and analyse data, including data pipelines, data warehouses, and data lakes.

The position involves working on complex technical problems and delivering quality data solutions in collaboration with fellow engineers, business analysts, data scientists, and business stakeholders.

Key Responsibilities

• Build and maintain data architecture and pipelines that support the transfer and processing of complete, consistent, and durable data.
• Design and implement data warehouses and data lakes that support required data volumes and velocity while following security requirements.
• Develop processing and analysis algorithms suitable for the complexity and volume of the data.
• Work with data scientists to build and deploy machine learning models.
• Develop and implement complex ETL solutions and data integration processes in enterprise environments.
• Support data quality monitoring and data governance practices.
• Collaborate with engineers, business analysts, and business stakeholders to understand requirements and deliver technical solutions.

Required Skills

• Strong experience with ETL tools and technologies such as Ab Initio, AWS Glue, PySpark, Python, dbt, and Databricks.
• Advanced SQL knowledge across multiple database and data platforms, including Teradata and Hadoop environments.
• Experience with data warehousing concepts and dimensional modelling.
• Proficiency in scripting languages including Python, Perl, and Shell scripting for automation.
• Knowledge of big data technologies such as Hadoop, Apache Spark, and Apache Hive.
• Experience in ETL development and data integration.
• Proven experience implementing complex ETL solutions in enterprise environments.
• Experience with data quality monitoring and data governance practices.
• Knowledge of cloud data platforms including AWS, Azure, and Google Cloud Platform, along with their ETL services.

Preferred Skills

• Strong analytical and problem-solving skills.
• Ability to work with large and complex datasets.
• Excellent documentation skills and strong attention to detail.
• Commitment to data quality.
• Ability to work independently and as part of a team.
• Strong communication skills for explaining technical concepts to non-technical stakeholders.

Education

A Bachelor's degree in Computer Science, Information Systems, or a related field is required.

Technologies

• Python – Used for scripting and automation.
• SQL – Advanced SQL knowledge is required across multiple database and data platforms.
• Databricks – Listed among the ETL and data engineering technologies.
• Apache Spark – Required as a big data technology at a highly desirable level.
• Apache Hadoop – Knowledge of Hadoop-based big data technologies is highly desirable.
• Apache Hive – Included among the desirable big data technologies.
• Amazon Web Services (AWS) – Cloud data platform knowledge and AWS ETL services are required.
• Microsoft Azure – Cloud data platform knowledge is required.
• Google Cloud Platform – Cloud data platform knowledge is required.
• Apache Airflow – The supplied JD mentions ETL and data engineering tools, while Airflow is listed in the master technology data; it is not explicitly stated as a required technology in this JD.

Work Mode & Location

This role is based in Pune, India. The JD does not explicitly state a remote or hybrid work arrangement, so the configured work mode is onsite.

Role Focus

The role is centred on cloud data engineering, ETL development, data integration, data warehousing, data lakes, big data processing, data quality, and data governance. The position also involves collaboration with data scientists on machine learning model development and deployment.

How to Apply

Apply now through SoftoJobs to explore this opportunity.