Big Data Engineering Lead (Banking/Finance) | Sydney
Sydney, NSW, AU
Job Requisition ID: 36903
-
World class training and development.
-
Truly flexible work.
-
Hands-on mentoring on emerging technologies.
What will your typical day look like?
Deloitte AI & Data is changing the way that businesses leverage cloud-native technology to solve the toughest Data, Machine Learning and AI challenges faced by our customers! Join us as we continue to expand into a cloud-centric and AI driven future, working on some of the largest and most complex projects within AU.
About the team
Our Data & AI team comprises of over 500 specialist practitioners across Australia, each of whom are constantly curious and excited about combining their business acumen and technological expertise to create data-centric solutions that help solve complex problems and transform or reinvent our client’s business.
Our Data & AI team work with public and private sector clients helping them to design and implement world leading solutions and capabilities. From setting Data & AI strategy, building and scaling the platforms and tools to bring the strategy to life, through to accelerating our clients ability to develop and deploy GenAI models, we are the partner of choice for our clients.
Our technology relationships with leading vendors such as Amazon, Microsoft, Google, Databricks, Snowflake, Salesforce, and more enable our practitioners to be at the forefront of new and emerging capabilities and to deliver our suite of services at scale. We are consistently recognised as leaders in Cloud, Data, Analytics and AI, including in the latest analyst reports.
Enough about us, let’s talk about you.
We are seeking a highly capable Solution Engineer with strong Big Data engineering expertise and architectural thinking to design, develop, and deliver scalable data solutions on the Azure platform. You will play a pivotal role in bridging engineering and architecture—leading design discussions, guiding implementation, and ensuring the delivery of reliable and maintainable solutions aligned with enterprise data strategy.
- 12+ years of experience in Big Data engineering with at least 3 years in a solution design or architectural capacity.
-
Drive Data Mesh and Data Product architectures, with 2–3 successful implementations (preferably in Banking).
-
Architect and deliver end-to-end Big Data solutions using Azure Synapse (Spark & SQL pools), Databricks, Spark/PySpark, and SQL.
-
Lead Data Lake and Data Warehouse projects, translating business needs into scalable, high-performance architectures.
-
Develop and optimize ETL pipelines with strong data quality, validation, error-handling, and load assurance frameworks.
-
Establish CI/CD pipelines, promote DevOps best practices, and ensure cataloguing, lineage, auditability, and governance compliance (incl. RBAC).
-
Collaborate with product owners, analysts, architects, and governance/security teams to align solutions with business and regulatory goals.
-
Mentor engineers, contribute to reusable frameworks and technical documentation, and champion Data Governance principles.
- Sound understanding of Data Governance principles and Role-Based Access Control (RBAC) implementation.
Required Skills & Qualifications
-
12–15 years in Big Data engineering, including 3+ years in solution design/architecture
-
Deep technical expertise: Azure Synapse Analytics (Spark pools), Databricks, Apache Spark/PySpark, SQL/Spark SQL
-
Proven ETL pipeline development, data integration, validation, and modeling (ER, 3NF, dimensional)
-
Experience with CI/CD tools (Azure DevOps preferred), data cataloguing/lineage (Azure Purview), and data quality frameworks
-
Ability to design scalable, cost-effective, high-performance data architectures
-
Hands-on banking domain experience (finance & retail), including standard banking models
-
Strong leadership managing multiple squads/PODs, Onshore-Offshore delivery
-
Excellent business communication, stakeholder management, documentation, and presentation skills
-
Familiarity with Scaled Agile frameworks and managing projects using agile methodologies.
-
Nice to have:
-
Awareness or experience in data governance frameworks
-
Experience with security, compliance, and privacy in cloud data solutions
-
Why Deloitte?
At Deloitte, we focus our energy on interesting and impactful work. We’re always learning, innovating and setting the standard; making a positive difference to our clients and our society. We put coaching at the heart of what we do, helping our people grow their careers in any direction – whether it be up, moving into something new, or even moving across the world.
We embrace diversity, equity and inclusion. We have a diverse collection of people from different backgrounds, with different experiences, gender identities, abilities and thinking styles. What binds us together is a shared commitment to value everyone’s perspective and to cultivate inclusion; so that our work environment is a safe space we can all belong.
We prioritise flexibility and choice. At Deloitte, you get trust on Day 1. We know our people get their best work done when they’re in control of where and how they work, designing their work week around their client, team and personal commitments.
We help you live and work well. To support your personal and professional life, we offer a range of perks and benefits, including retail discounts, wellbeing leave, paid volunteering days, twelve flexible working options, market-leading parental leave and return to work support package.
Next Steps
Sound like the sort of role for you? Apply now, we’d love to hear from you!
By applying for this job, you’ll be assessed against the Deloitte Talent Standards. We’ve designed these standards so that you can grow in your career, and we can provide our clients with a consistent and exceptional Deloitte employee experience globally. The preferred candidate will be subject to background screening by Deloitte or by their external third-party provider.