Data Engineer | Generative AI

Date:  10 Jul 2024
Location: 

Sydney, NSW, AU Melbourne, VIC, AU

Department:  Enabling Areas
Description: 

Job Requisition ID: 35018 

Data Engineer – Generative AI

 

  • Training and development to build your skills and career - at Deloitte we believe in investing in our best assets, our people! You will have access to world class training and funding towards industry and other professional certifications  
  • Flexible work arrangements - work in a way that suits you best  
  • Rewards platform - your hard work won't go unnoticed at Deloitte  

 

 

What will your typical day look like?  

The Data Engineer will be a key member of our team. This role involves constructing robust and scalable AI software data pipelines, exploring and implementing generative algorithms, and facilitating the seamless flow of data between computational systems. You will collaborate with a multidisciplinary team of Data Scientists & Machine Learning Engineers to meet organisational objectives and supports the AI/MLOpsLead in the execution of the GenAI SDT program of work. The ideal candidate will be prepared to assist in the end-to-end development of our AI solutions with a focus on pipeline development, infrastructure support, and taking prototype code into a production state.  

 

You will be responsible for:  

The design, development and maintenance of our platform and client solutions based on technologies including:  

  • UNIX/Linux, Docker, Kubernetes
  • Git 
  • Cloud technologies and platforms such as Amazon AWS and Azure 
  • Database technologies for RAG solutions (Postgres + pgvector, Elasticsearch)
  • API frameworks (FastAPI)
  • Transition to BaU plus ongoing development of client solutions   

 

Key Accountabilities: 

  • Data Architecture & Pipeline Development: Design, build, and manage advanced data solutions, including data lakes and databases with a focus on infrastructure-as-code.Manage full lifecycle of development from prototype to production code, CI/CD pipelines, and regression and unit testing.
  • Generative AI Implementation: Deploy and scale Generative AI models and resources to support production use cases.
  • Technical Leadership: Provide technical mentorship to junior team members and advise on best practices and technologies in the data engineering domain. 
  • Innovation and Research: Evaluate emerging technologies and methodologies in data engineering and Generative AI to ensure the organisation remains at the forefront of the industry. 
  • Data Governance: Understanding of data quality, data lineage, and data governance principles.
  • Communication Skills: Ability to convey complex information in an accessible manner to both technical and non-technical stakeholders.   

 

About the team 

A unique network of leading start-ups, wielding our assets and capabilities to translate the disruptive technologies into practical business solutions for the firm and our clients. Drawing on our expertise in all things tech and AI, we are an incubator that allows our clients to more easily tap the power of innovation. Our supportive and forward-thinking team is never satisfied with “good enough” and look to make an impact in everything that we do.

 

Enough about us, let’s talk about you.  

You may have all or some of the following skills / experiences:  

  • A minimum of 5 years professional experience in Data Engineering, preferably with a focus on Generative AI
  • Experience with platform and software development, release management in a mature managed services environment 
  • Cloud technologies and platforms such as Azure or Amazon AWS 
  • Software engineering experience in Python
  • Knowledge of and experience with DevOps tools and techniques, such as Infrastructure as Code and Immutable Infrastructure 
  • Experience with CI tools such as Jenkins, Hudson, Bamboo, Thoughtworks Go 
  • Security protocols such as OAuth, SAML or OpenID Connect 
  • Must have an ability to effectively communicate and work with people with a diverse range of skills and experience 

 

 

Why Deloitte?  

 

At Deloitte, we focus our energy on interesting and impactful work. We’re always learning, innovating and setting the standard; making a positive difference to our clients and our society. We put coaching at the heart of what we do, helping our people grow their careers in any direction – whether it be up, moving into something new, or even moving across the world.  

 

We embrace diversity, equity and inclusion. We have a diverse collection of people from different backgrounds, with different experiences, gender identities, abilities and thinking styles. What binds us together is a shared commitment to value everyone’s perspective and to cultivate inclusion; so that our work environment is a safe space we can all belong. 

 

We prioritise flexibility and choice. At Deloitte, you get trust on Day 1. We know our people get their best work done when they’re in control of where and how they work, designing their work week around their client, team and personal commitments.

 

We help you live and work well. To support your personal and professional life, we offer a range of perks and benefits, including retail discounts, wellbeing leave, paid volunteering days, twelve flexible working options, market-leading parental leave and return to work support package. 

 

Next Steps

Sound like the sort of role for you? Apply now, we’d love to hear from you!

 

By applying for this job, you’ll be assessed against the Deloitte Talent Standards. We’ve designed these standards so that you can grow in your career, and we can provide our clients with a consistent and exceptional Deloitte employee experience globally. The preferred candidate will be subject to background screening by Deloitte or by their external third-party provider.

 

 

 

 

 

 

By applying for this job, you’ll be assessed against the Deloitte Talent Standards. We’ve designed these standards so that you can grow in your career, and we can provide our clients with a consistent and exceptional Deloitte employee experience globally. The preferred candidate will be subject to background screening by Deloitte or by their external third-party provider.