Azure Data Engineer

Functional areas
This job is no longer available
  • Eland House, 10 Bressenden Pl, London SW1E 5DH, UK
  • Full-time

Company Description

We believe in the power of ingenuity to build a positive human future.

As strategies, technologies and innovation collide, we create opportunity from complexity.

Our diverse teams of experts combine innovative thinking and breakthrough use of technologies to progress further, faster. Our clients adapt and transform, and together we achieve enduring results.

An innovation and transformation consultancy, we are over 4000 specialists in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. Our people are strategists, innovators, designers, consultants, digital experts, scientists, engineers and technologists.

We operate globally from offices across the UK, US, Netherlands and Nordics.

PA. Bringing Ingenuity to Life

Job Description

At the heart of our business are our people: strategists, technologists, digital specialists, consultants, designers, scientists, and engineers; all of whom bring real-world experience and apply it at pace. Our data engineering practice unlocks our client’s data, opening doors to new business opportunities, and we anticipate that you will be to bring passionate innovation to an already advanced capability.

We are searching for people who know what the data platform of the future looks like and know how it interacts with existing clients’ legacy architecture. As an end-to-end firm, we also hope that you will have a broad experience, and be comfortable with, providing advisory service alongside skilful delivery to ensure that our clients receive a solution that not only serves their needs but evolves their business.

When you join PA, we ask for your forward thinking, commitment, and authenticity. In return we’ll give you stimulating work that improves people’s lives, opportunities to learn from brilliant people, and a supportive culture where you can thrive. Additionally, through our Microsoft Gold Partner status, we offer a range of technical benefits including certification discounts and prototyping environments.


Required skills & experience

  • Contribution to internal offering development and capability growth initiatives
  • Highly skilled with SQL and SQL Server Management Studio (or alternative)
  • Expertise building and managing Azure Pipelines (ETL; ELT; ELTL), including:
    • designing and building data interfaces to source systems
    • combining and transforming data into appropriate storage formats
    • engineering data sets for analytics purposes
    • developing automated and robust pipelines with error handling
  • Experience handling Azure Data Lakes, Warehouses, and Factories, plus Blob Storage

Desirable skills & experience

  • Working to an Agile methodology and familiarity with Azure DevOps
  • Deep automation knowledge with Python, Bash, or PowerShell
  • Skilled in Spark or PySpark for Azure DataBricks workloads
  • Experience with data modelling and visualisation in Power BI (or alternative)
  • A strong understanding of architecting data platforms, BI, MI, or analytics solutions
  • High expertise using Big Data, relational, or streaming technologies
  • One, or more, of the following certifications:
    • Microsoft Certified: Azure Data Engineer Associate
    • Microsoft Certified: Azure Security Engineer Associate
    • Microsoft Certified: Azure Solutions Architect Expert

Additional Information


  • 25 days annual leave, with the option to buy 5 days and volunteer for 3 more
  • Sabbatical leave options after a 2-year tenure and enhanced, adjustable parental leave
  • Flexible private healthcare plans, plus dental insurance, eye tests, gym discounts, and Cycle-to-Work
  • Industry-benchmarked salary bundled with an annual bonus, travel allowance, and Give-As-You-Earn
  • Future proofing with a competitive pension, income protection, life assurance, and critical illness cover

Diversity & Inclusion

We believe that diversity makes us a stronger firm and seek people with different ideas, styles, and skillsets to encourage a stronger together. This variety in personal experience stimulates a rich, creative environment; one in which our people grow, and our clients enjoy enduring results. We’re committed to recruiting and rewarding our people solely based on their ability to deliver quality work and nurture internal progression, without regard to their sex, race, disability, religion, national origin, ethnicity, sexual orientation, age, or marital status. What makes us human is what makes us strong.

We welcome international applications, but we are unable to offer sponsorship for work permits. Therefore, to join our team, you will need to have the full right to live and work in the UK and unfortunately, your application will be automatically rejected if you do not have these rights.

Working From Home

Whilst PA is highly flexible on where you work, every employee is tied to a ‘home office’ due to the need to travel to our clients for in-person visits. This therefore means that we will be less likely to accept applications from candidates placed a significant distance from the named location on this application, or that wish to work from other countries for more than 30 consecutive days; temporary or permanent office relocation is a negotiable option. Beyond this ask, employees are welcome to work from home to their discretion and encouraged to manage their personal life needs as a priority, creating the work-life balance that allows them to be at their best.

Job information

Firm: PA Consulting

Location: London