Shape the future of data at a global technology group. This is a hands-on, high-impact role driving a major migration from AWS to Databricks. If you thrive on solving complex challenges and influencing architecture, this is your opportunity.
- High visibility and executive attention.
- Influence solution design and architecture.
- Work on a greenfield build while solving real-world challenges.
Company Overview
Join a global technology group elevating decision-making through trusted, accessible data. Work on design platforms that make quality information available when it matters most.
Role Overview
As the Lead Data Engineer, you’ll be the right-hand to our Data Platform Lead, taking ownership of a critical migration project. Your focus will be:
- Maintain and enhance AWS workflows (Glue, Lambda, ingestion pipelines).
- Design and implement solutions in Databricks, setting patterns and standards for the future.
- Plan and execute a phased migration, balancing technical debt and pragmatic solutions along the way.
Skills & Experience
- Cloud-native engineering experience (AWS - and ideally certified).
- Databricks experience and knowledge, or similar
- Strong Python and SQL; hands-on with PySpark/SparkSQL and Glue.
- Dimensional modelling knowledge; Data Vault exposure beneficial.
- ETL/integration across Lakehouse, Warehouse, and Lake architectures.
- Git and CI/CD; DevOps/DataOps/CloudOps; Agile/Lean with an SRE mindset.
- Comfort with APIs, JSON, flat files, and RDBMS; experience with SaaS/CRM/ERP integration.
- Empathy and understanding of the current landscape and knowing that the move is gradual. Pragmatism in creating fit-for-purpose solutions at every stage of transition.
- Clear communicator with stakeholder engagement and strong analytical skills.
- Proactive problem-solver who thrives in dynamic environments, adapts quickly, and finds practical solutions to deliver results.
What’s on Offer
An environment where people thrive because they own outcomes, learn quickly, and ship meaningful data products.
- 12-month contract with potential extensions.
- Hybrid work arrangements.
- Growth pathways and a chance to leave a lasting mark on a greenfield build.
We are committed to providing a supportive culture and positively contributing towards creating diverse and inclusive workplaces for our candidates & clients. We invite candidates of all ages, genders, sexual orientation, cultural backgrounds, people with disability, neurodiverse individuals, and Indigenous Australians to apply.
