Data Engineering Lead (AWS)
Sydney, NSW, AU
Job Requisition ID: 41231
- Access to free and confidential coaching for you and your family including wellbeing, financial and nutrition coaching.
- 18 weeks paid parental leave + 12 months return to work support (work 4 days and get paid 5).
- International PlaceFlex to work from select countries for a period.
What will your typical day look like?
As a Specialist Manager – within our AI & Data team, you’ll combine deep technical expertise with strong consulting skills to design, deliver, and optimise complex, large-scale data pipelines and platforms for our clients. You will play a critical role in shaping next-generation, cloud-native data solutions leveraging leading AWS and data/AI technologies.
You will lead multidisciplinary teams to address our clients’ most complex data challenges across data engineering, platform automation, DevOps best practices, CI/CD, data governance, and advanced analytics.
Your responsibilities will include:
- Designing and delivering scalable, secure AWS data platforms using services such as Glue, Redshift, Athena, RDS, Lambda, MSK (Kafka), Managed Flink, SageMaker, Airflow, and dbt.
- Embedding DevOps best practices including automation, infrastructure as code, CI/CD, and platform monitoring.
- Partnering with Solution Architects and stakeholders to translate business and platform requirements into fit for purpose technical solutions.
- Driving automation and platform optimisation to improve scalability, reliability, and cost efficiency.
- Building ETL/ELT pipelines using SQL, Python, and big data technologies across diverse, high volume data sources.
- Delivering data modelling, analytics, and AI/ML solutions to support batch and real time insights.
- Supporting data governance initiatives across data quality, security, testing, and compliance.
- Applying strong software engineering practices to modern data platform development.
- Advising clients on data integration, platform, and data quality challenges using best practice approaches.
You’ll also be responsible for coaching, developing, and inspiring your team, setting high standards for delivery excellence and technical leadership.
Beyond project delivery, you’ll collaborate with practice and alliance leaders to grow our capability and shape Deloitte’s data and AI offerings. This includes driving community initiatives such as technical forums, webinars, hackathons, and contributing to the development of new Deloitte IP and solutions.
About the team:
Our diverse AI & Data team comprises over 500 specialist practitioners across Australia, each of whom are constantly curious and excited about combining their business acumen and technological expertise to create data-centric solutions that help solve complex problems and transform, or reinvent our client’s business.
Our Data & AI teamwork with public and private sector clients helping them to design and implement world leading solutions and capabilities. From solving air and ground transport network issues through our industry-first Optimal Reality digital twin solution, bringing automation capabilities to vaccine rollout programs, to helping our clients move to a sustainable world, we are the partner of choice for our clients and our alliance vendors.
Our relationships with market leading vendors such as AWS, Databricks, Google, dbt Labs, Snowflake, Salesforce, and Informatica enable our practitioners to be at the forefront of new and emerging capabilities and to deliver our suite of services at scale. We are consistently recognised as leaders in Cloud, Data, Analytics and AI, including in the latest analyst reports.
Enough about us, let’s talk about you.
You are someone with:
-
5+ years’ experience delivering large-scale Data & AI platforms in a professional services environment.
-
Strong communication skills across technical and non-technical stakeholders.
-
Good understanding of AWS Data & AI services (e.g., SageMaker, QuickSight).
-
Strong in SQL and Python.
-
Experience building ETL/ELT frameworks using a metadata-driven approach.
-
Hands-on with big data frameworks: Spark, Storm, Flink.
-
Experience designing data pipelines and real-time streaming (Kafka).
-
Knowledge of stream processing, messaging, and scalable data stores.
-
Solid experience in data modelling, data warehousing, and data lakes.
-
Experience leading teams and driving change initiatives.
-
Built production-grade solutions on AWS, Databricks, Snowflake, or GCP.
-
AWS Certified Solutions Architect (Associate min, Professional preferred).
Why Deloitte?
At Deloitte, we focus our energy on interesting and impactful work. We’re always learning, innovating and setting the standard; making a positive difference to our clients and our society. We put coaching at the heart of what we do, helping our people grow their careers in any direction – whether it be up, moving into something new, or even moving across the world.
We embrace diversity, equity and inclusion. We have a diverse collection of people from different backgrounds, with different experiences, gender identities, abilities and thinking styles. What binds us together is a shared commitment to value everyone’s perspective and to cultivate inclusion; so that our work environment is a safe space we can all belong.
We value in-person connection with our clients and our colleagues. We offer several ways for you to work flexibly so that you can serve your clients, stay connected with your team, and manage your personal priorities.
We help you live and work well. To support your personal and professional life, we offer a range of perks and benefits, including retail discounts, wellbeing leave, paid volunteering days, twelve flexible working options, market-leading parental leave and return to work support package.
Next Steps
Sound like the sort of role for you? Apply now, we’d love to hear from you!
By applying for this job, you’ll be assessed against the Deloitte Talent Standards. We’ve designed these standards so that you can grow in your career, and we can provide our clients with a consistent and exceptional Deloitte employee experience globally. The preferred candidate will be subject to background screening by Deloitte or by their external third-party provider.