Senior Data Engineer - Databricks Specialist
University of Otago · 1001-5000 employees
What the role involves
- Designing data pipelines
- Mentoring team members
- Optimizing performance
What they ask for
Deep hands-on expertise with Databricks and Spark, strong SQL and Python, cloud data experience (Azure preferred), data modelling, quality, governance, problem-solving, and right to work in New Zealand.
About the job
%3Cp style=%22font-family:Times New Roman;%22%3E%3Cspan style=%22color:#f4b142;font-family:arial, helvetica, sans-serif;font-size:18px;%22%3E%3Cstrong%3E%3Cimg src=%22https://www.otago.ac.nz/assets/humanresources/documents/Plaza.jpg%22 alt=%22%22 width=%22850%22 height=%22345%22%3E%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22font-family:Times New Roman;%22%3E%3Cspan style=%22color:#f4b142;font-family:arial, helvetica, sans-serif;font-size:18px;%22%3E%3Cstrong%3E_%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:14px;%22%3E%3Cstrong%3EINFORMATION SYSTEMS | TE POUTOKO TUKUTUKU%3C/strong%3E%3C/span%3E%3Cbr%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:14px;%22%3E%3Cstrong%3EDIGITAL DIVISION | RATONGA MATIHIKO%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EWho we are | Ko wai mātou%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EAt the University of Otago, our Digital Services Division is driving an ambitious transformation - building a modern, enterprise-scale data ecosystem that supports world-class teaching, research, and decision-making.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EWe’re collaborative, forward-thinking, and focused on doing meaningful work that has real impact across the University.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EThe role | Te mahi%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EWe’re looking for a Senior Data Engineer with Databricks expertise to help shape and deliver our modern data platform.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EIn this hands-on role, you’ll design and build high-quality data pipelines, ensuring they are scalable, reliable, and cost-effective within a cloud-first environment. You’ll tackle complex data challenges - diagnosing issues, improving performance, and contributing to the ongoing evolution of our platform, standards, and ways of working.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EYou’ll be working across a broad, enterprise landscape but day to day, you’ll be part of a small, collaborative team where your voice is heard and your expertise is valued. %26nbsp;As a senior engineer, you’ll also help lift capability across the team; mentoring and upskilling others as they grow their experience with Databricks.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EWhat makes this opportunity stand out is the balance. You’ll be solving meaningful, technically interesting problems in a sophisticated environment all while working in a culture that is supportive, flexible, and genuinely people focused.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Work from home up to 3 days a week.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Enjoy a small-team feel within a larger organisation.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Step out during the day - grab a coffee at a nearby café, walk the local sports grounds, or make use of the university gym just a short walk away.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EThis is a role where you can do great engineering work without compromising on the things that matter outside of it.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EWhat you’ll bring | Kā pūkeka me kā wheako%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Deep hands-on expertise with Databricks and Spark-based platforms.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Strong capability in SQL and Python (or similar data engineering languages).%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Experience working in cloud data environments (Azure preferred, AWS also valued).%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;A track record of building and improving data solutions at scale.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Practical knowledge of data modelling, data quality, and governance.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Strength in problem-solving, optimisation, and troubleshooting.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;A collaborative, pragmatic approach and confidence working across technical and business teams.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EFurther details | Pūroko%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EThis is a permanent, full-time (37.5 hours per week) position based on either our Dunedin, Christchurch or Wellington campuses.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EWe offer a salary aligned with current market rates, reflective of the skills and experience you bring, five weeks’ annual leave, and a 6.75% superannuation scheme - alongside a culture that truly supports balance and wellbeing.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EYou must have the right to live and work in New Zealand to be considered for this position.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EFor further information, or to discuss the role in confidence – please contact Terry Wilson via the email address below.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EApplication | Tono%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3ETo submit your application (including CV and cover letter) please click the apply button. Applications quoting reference number 2601683 will close on Sunday, 29 November 2026.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EApplications may be reviewed as they are received, the University reserves the right to close this vacancy at any time.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cspan class=%22subtitle%22%3EAdditional Information%3C/span%3E%3C/span%3E%3C/p%3E%3Cp%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EContact:%3C/strong%3E%3C/span%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E %3C/span%3E%3Ca href=%22mailto:terry.wilson@otago.ac.nz%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3ETerry Wilson%3C/span%3E%3C/a%3E%3C/p%3E%3Cp%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EPosition details:%3C/strong%3E%3C/span%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E %3C/span%3E%3Ca href=%22https://www.otago.ac.nz/_assets/humanresources/documents/2601683.pdf%22 target=%22_blank%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EJob Description%3C/span%3E%3C/a%3E%3C/p%3E%3Cp%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EFurther Information:%3C/strong%3E%3C/span%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E %3C/span%3E%3Ca href=%22https://www.otago.ac.nz/digital-services%22 target=%22_blank%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EDepartment Website%3C/span%3E%3C/a%3E%3C/p%3E%3Cp%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3ECreate an email with a link to this vacancy:%3C/strong%3E%3C/span%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E %3C/span%3E%3Ca href=%22mailto:?Subject=Vacancy at the University of Otago %26amp;body=Hello, this vacancy at the University of Otago might be of interest to you https://otago.taleo.net/careersection/2/jobdetail.ftl?job=2601683%22 target=%22_blank%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3ECreate email%3C/span%3E%3C/a%3E%3C/p%3E%3Cp%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3ELocation:%3C/strong%3E%3C/span%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E %3C/span%3E%3Ca href=%22https://www.otago.ac.nz/humanresources/join-otago/lifestyle-and-culture/dunedin/index.html%22 target=%22_blank%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EAbout Dunedin%3C/span%3E%3C/a%3E%3C/p%3E
Job Details
Primary Location: New Zealand
Employment Status: Permanent
Salary Level and Range: The University is offering a remuneration level commensurate with the responsibilities of the position.
Organisation: Information Systems
Job Function: Computer Network and Support
Applying for this job
What to show on your CV
- It names Databricks, Spark, SQL, Python, Azure and AWS. Use the same words on your CV for the ones you've used, so a search finds them.
- For the work it describes, like "Designing data pipelines", give an example from your own experience, with a result you can talk about at an interview.
Our guides to the New Zealand CV format, cover letters and interview questions cover the rest.