Software development

Senior Data Engineer - Databricks Specialist

University of Otago · 1001-5000 employees

Dunedin, Otago and 2 more3 days ago
HybridFull timeSenior

What the role involves

  • Designing data pipelines
  • Mentoring team members
  • Optimizing performance

What they ask for

Deep hands-on expertise with Databricks and Spark, strong SQL and Python, cloud data experience (Azure preferred), data modelling, quality, governance, problem-solving, and right to work in New Zealand.

About the job

%3Cp style=%22font-family:Times New Roman;%22%3E%3Cspan style=%22color:#f4b142;font-family:arial, helvetica, sans-serif;font-size:18px;%22%3E%3Cstrong%3E%3Cimg src=%22https://www.otago.ac.nz/assets/humanresources/documents/Plaza.jpg%22 alt=%22%22 width=%22850%22 height=%22345%22%3E%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22font-family:Times New Roman;%22%3E%3Cspan style=%22color:#f4b142;font-family:arial, helvetica, sans-serif;font-size:18px;%22%3E%3Cstrong%3E_%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:14px;%22%3E%3Cstrong%3EINFORMATION SYSTEMS | TE POUTOKO TUKUTUKU%3C/strong%3E%3C/span%3E%3Cbr%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:14px;%22%3E%3Cstrong%3EDIGITAL DIVISION | RATONGA MATIHIKO%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EWho we are | Ko wai mātou%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EAt the University of Otago, our Digital Services Division is driving an ambitious transformation - building a modern, enterprise-scale data ecosystem that supports world-class teaching, research, and decision-making.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EWe’re collaborative, forward-thinking, and focused on doing meaningful work that has real impact across the University.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EThe role | Te mahi%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EWe’re looking for a Senior Data Engineer with Databricks expertise to help shape and deliver our modern data platform.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EIn this hands-on role, you’ll design and build high-quality data pipelines, ensuring they are scalable, reliable, and cost-effective within a cloud-first environment. You’ll tackle complex data challenges - diagnosing issues, improving performance, and contributing to the ongoing evolution of our platform, standards, and ways of working.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EYou’ll be working across a broad, enterprise landscape but day to day, you’ll be part of a small, collaborative team where your voice is heard and your expertise is valued. %26nbsp;As a senior engineer, you’ll also help lift capability across the team; mentoring and upskilling others as they grow their experience with Databricks.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EWhat makes this opportunity stand out is the balance. You’ll be solving meaningful, technically interesting problems in a sophisticated environment all while working in a culture that is supportive, flexible, and genuinely people focused.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Work from home up to 3 days a week.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Enjoy a small-team feel within a larger organisation.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Step out during the day - grab a coffee at a nearby café, walk the local sports grounds, or make use of the university gym just a short walk away.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EThis is a role where you can do great engineering work without compromising on the things that matter outside of it.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EWhat you’ll bring | Kā pūkeka me kā wheako%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Deep hands-on expertise with Databricks and Spark-based platforms.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Strong capability in SQL and Python (or similar data engineering languages).%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Experience working in cloud data environments (Azure preferred, AWS also valued).%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;A track record of building and improving data solutions at scale.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Practical knowledge of data modelling, data quality, and governance.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;Strength in problem-solving, optimisation, and troubleshooting.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E•%26nbsp;%26nbsp;%26nbsp;%26nbsp;A collaborative, pragmatic approach and confidence working across technical and business teams.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EFurther details | Pūroko%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EThis is a permanent, full-time (37.5 hours per week) position based on either our Dunedin, Christchurch or Wellington campuses.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EWe offer a salary aligned with current market rates, reflective of the skills and experience you bring, five weeks’ annual leave, and a 6.75% superannuation scheme - alongside a culture that truly supports balance and wellbeing.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EYou must have the right to live and work in New Zealand to be considered for this position.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EFor further information, or to discuss the role in confidence – please contact Terry Wilson via the email address below.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EApplication | Tono%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3ETo submit your application (including CV and cover letter) please click the apply button. Applications quoting reference number 2601683 will close on Sunday, 29 November 2026.%3C/span%3E%3C/p%3E%3Cp style=%22text-align:justify;%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EApplications may be reviewed as they are received, the University reserves the right to close this vacancy at any time.%3C/span%3E%3Cbr%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cspan class=%22subtitle%22%3EAdditional Information%3C/span%3E%3C/span%3E%3C/p%3E%3Cp%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EContact:%3C/strong%3E%3C/span%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E %3C/span%3E%3Ca href=%22mailto:terry.wilson@otago.ac.nz%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3ETerry Wilson%3C/span%3E%3C/a%3E%3C/p%3E%3Cp%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EPosition details:%3C/strong%3E%3C/span%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E %3C/span%3E%3Ca href=%22https://www.otago.ac.nz/_assets/humanresources/documents/2601683.pdf%22 target=%22_blank%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EJob Description%3C/span%3E%3C/a%3E%3C/p%3E%3Cp%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3EFurther Information:%3C/strong%3E%3C/span%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E %3C/span%3E%3Ca href=%22https://www.otago.ac.nz/digital-services%22 target=%22_blank%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EDepartment Website%3C/span%3E%3C/a%3E%3C/p%3E%3Cp%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3ECreate an email with a link to this vacancy:%3C/strong%3E%3C/span%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E %3C/span%3E%3Ca href=%22mailto:?Subject=Vacancy at the University of Otago %26amp;body=Hello, this vacancy at the University of Otago might be of interest to you https://otago.taleo.net/careersection/2/jobdetail.ftl?job=2601683%22 target=%22_blank%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3ECreate email%3C/span%3E%3C/a%3E%3C/p%3E%3Cp%3E%3Cspan style=%22color:#060D87;font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E%3Cstrong%3ELocation:%3C/strong%3E%3C/span%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3E %3C/span%3E%3Ca href=%22https://www.otago.ac.nz/humanresources/join-otago/lifestyle-and-culture/dunedin/index.html%22 target=%22_blank%22%3E%3Cspan style=%22font-family:Arial, Helvetica, sans-serif;font-size:12px;%22%3EAbout Dunedin%3C/span%3E%3C/a%3E%3C/p%3E

Job Details

Primary Location: New Zealand

Employment Status: Permanent

Salary Level and Range: The University is offering a remuneration level commensurate with the responsibilities of the position.

Organisation: Information Systems

Job Function: Computer Network and Support

Applying for this job

What to show on your CV

  • It names Databricks, Spark, SQL, Python, Azure and AWS. Use the same words on your CV for the ones you've used, so a search finds them.
  • For the work it describes, like "Designing data pipelines", give an example from your own experience, with a result you can talk about at an interview.

Our guides to the New Zealand CV format, cover letters and interview questions cover the rest.

More jobs like this

CV examples for these jobs

Cover letter examples