Senior Data Engineer

Pune, India

Apply for job

Key information

Date live: 02/10/2026

Business Area: Markets Post Trade

Area of Expertise: Technology

Contract: Permanent

Reference Code: JR-0000097019

It’s happening at Barclays.

Be a part of a place where challenges are measured in billions, qubits and nanoseconds. Build your career in an environment where we’re advancing machine learning, leveraging blockchains, and harnessing FinTech. Working in Barclays technology, you’ll reimagine possibilities: learning and innovating to solve the challenges ahead, delivering for millions of customers.
We are shaping the future of financial technology.
Why not join us and make it happen here?

Where will you be located?

Explore location

At Barclays, we don’t just adapt to the future – we create it. Embark on a transformative journey as a Senior Data Engineer-VP, where you will play a pivotal role in architecting and implementing high‑performance data pipelines and data flows that enable low‑latency, high‑fidelity insights. This role requires a deep interest in large‑scale data ingestion and processing across diverse formats, sources, and frequencies. You should be proficient in handling heterogeneous datasets and committed to delivering high‑quality, reliable data products. Our goal is to construct an agentic, continuously flowing data ecosystem capable of powering advanced insight engines across Research. Barclays is advancing into the agentic era by developing a robust ecosystem of talent, tooling, and modern technology to support the next generation of our data and AI capabilities. We are seeking a Senior Data Engineer for the Investment Bank’s Research Data & AI organization to help drive this transformation. Barclays Research aims to deliver differentiated, original, and data‑driven analysis for our clients. We are redesigning our Research data foundation to align with the demands of the agentic era, scaling the platform under Data Mesh principles to support distributed ownership, flexible consumption, and greater system autonomy. Success in this role requires an experienced data engineer who has worked across the full spectrum of data ingestion paradigms—including real‑time streaming and batch processing—or a strong desire to operate across all of them. This position will directly influence the strategic direction of our ingestion architecture, optimizing the full data lifecycle from acquisition and landing to transformation, entitlement, distribution, and orchestration.

To be successful in this role , you should have experience with:

Extensive Python software engineering experience, including object‑oriented programming, package management, and scripting.
Strong proficiency in an OOP language such as Java or C++, with solid grounding in design principles, systems engineering, and large‑scale application development.
Deep knowledge of AWS, specifically core architecture services (S3, Route 53, EC2, EMR, EKS, Athena) and data‑processing services (AWS Glue, AWS Catalog, AWS Kinesis, Lake Formation).
Extensive experience with distributed processing engines such as Spark, including optimization strategies, cluster‑level scaling, and operational maintenance of complex data environments.
Practical experience orchestrating enterprise data workflows using tools such as Airflow, Dagster, Prefect or Autosys.
Experience designing, architecting, and deploying scalable, resilient, and portable data jobs in production environments.
Experience with large‑scale data quality frameworks such as Great Expectations or DeeQu.
Familiarity with Data Mesh concepts—including Data Product lifecycle, Data Contracts, and Data Domain modeling.
Experience troubleshooting, debugging, and re‑architecting data pipelines to improve efficiency, maintainability, and adherence to engineering standards.

Some of Highly Valued Skills may include:

Domain knowledge of financial‑sector data use cases and value creation within the Research and Alpha‑generation lifecycle.
Working knowledge of Apache Flink for real‑time distributed processing.
Experience working with unstructured data ingestion, curation, and storage.
Experience with data catalogs, ontology development, and taxonomy design.
Understanding of API and system‑level communication protocols (e.g., GRPC).
Experience with cloud‑native and containerization deployment models (e.g., Kubernetes).

You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills.

The location of the role is Pune, IN

Purpose of the role

To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Accountabilities

Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
Development of processing and analysis algorithms fit for the intended data complexity and volumes.
Collaboration with data scientist to build and deploy machine learning models.

Vice President Expectations

To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and escalate breaches of policies/procedures..
If managing a team, they define jobs and responsibilities, planning for the department’s future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements..
If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others..
OR for an individual contributor, they will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi-year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions..
Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment.
Manage and mitigate risks through assessment, in support of the control and governance agenda.
Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does.
Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business.
Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.
Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions.
Adopt and include the outcomes of extensive research in problem solving processes.
Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.

Barclays welcomes applications from all candidates and is committed to ensuring reasonable adjustments (accommodations) are put in place to allow for a fair and inclusive recruitment process. For more information and how to request one, please review Adjustments to the recruitment process.

We’re a global, vital and highly respected financial organisation with an inspiring Purpose. Operating in 39 countries and employing around 100,000 people across the world, we help communities, individuals and businesses thrive. And we’ve created financial solutions and technology that the world now takes for granted. A career with us can offer incredible variety, depth and breadth of experience, and the chance to learn from some of the best minds in technology and finance.

To find out more about Barclays' strategy please click here.

We are an equal opportunity employer and opposed to discrimination on any grounds. It is the policy of Barclays to ensure equal employment opportunity without discrimination or harassment on the basis of race, colour, creed, religion, national origin, alienage or citizenship status, age, sex, sexual orientation, gender identity or expression, marital or domestic/civil partnership status, disability, veteran status, genetic information, or any other basis protected by law.

Barclays is required by law to confirm that you have the Legal Right to Work in any role that you apply for. If you currently hold a work visa sponsored by Barclays, or you would require sponsorship from Barclays, you must declare this as part of your application. Sponsored visas are role and entity specific and any changes must be reviewed. It is important that you ensure you are working on the correct visa at all times. Failure to accurately disclose your visa status or Legal Right to Work may result in your application or any employment offer being withdrawn at any time.

Who succeeds in
Tech at Barclays?

For a career with us, you need to be prepared to take big steps forward, curious to face the challenges ahead, and driven to focus on the outcomes. We need people with the Barclays mindset to make it happen here.

What you'll get in return

Competitive holiday allowance

Life assurance

Private medical care

Pension contribution

Our technology

Supporting our 48 million customers and clients worldwide takes a lot of forward thinking. It means harnessing technology to support the economy. It means making a difference to people’s lives. And it requires the maintenance and development of a global, technological infrastructure. At Barclays, technology helps us keep transactions moving, manages data, and protects our customers. Join a world where your work creates unique moments of impact. Make it happen here.

This is Barclays Pune

Barclays Pune is the largest campus outside of Barclays’ global headquarters in London. Our aim is to build game-changing technology that supports businesses and functions across the globe, offering the highest quality service to our clients and customers.

It’s a state-of-the-art technology hub, and home to 9,000 colleagues across Operations, Technology and Functions.

Pune Campus provides opportunities for our colleagues to innovate, collaborate, and deliver great outcomes for customers and clients.

Our welcoming and inclusive culture supports you to bring your whole self to work, explore your potential and pursue your passions.

Pune is a million-square-foot environment-friendly, ultra-modern workplace with excellent facilities for work, socialising and leisure.

This is Barclays Pune

An innovative hub

It’s a state-of-the-art technology hub, and home to 9,000 colleagues across Operations, Technology and Functions.

Working better together

Pune Campus provides opportunities for our colleagues to innovate, collaborate, and deliver great outcomes for customers and clients.

A place where you can belong

Our welcoming and inclusive culture supports you to bring your whole self to work, explore your potential and pursue your passions.

An amazing place to work

Pune is a million-square-foot environment-friendly, ultra-modern workplace with excellent facilities for work, socialising and leisure.

Working flexibly

We’re committed to providing a supportive and inclusive culture and environment for you to work in. This environment recognises and supports your personal needs, alongside the professional needs of our business. If you'd like to explore flexible working arrangements, please discuss this with the hiring manager. Your request will be reviewed in-line with the requirements of the role/business needs of the team.

Hybrid working

We have a structured approach to hybrid working, where colleagues work at an onsite location on fixed, ‘anchor’, days, as set by the business area. Please discuss the working pattern requirements for the role you are applying for with the hiring manager. Please note that working arrangements may be subject to change on reasonable notice to ensure we meet the needs of our business.

Barclays is built on an international scale.

Our geographic reach, our wide variety of functions, businesses, roles and locations reflect the rich diversity of our worldwide customer base. All of which means we offer incredible variety, depth and breadth of experience. And the chance to learn from a globally diverse mix of colleagues, including some of the very best minds in banking, finance, technology and business. Throughout, we’ll encourage you to embrace mobility, exploring every part of our operations as you build your career.

Find more information