Data Engineer

3 weeks ago


Auckland City, New Zealand Vector NZ Full time

Data Engineer
- Full-time
- Engagement type: Permanent - Employee
- Department: Digital Technology

**About Us**
If you love working with a diverse group of people who are all about putting the customer at the centre and enabling choice, you’ve found the right company. The energy sector is transforming at a rate of knots, and we want you to join us and be part of this transformation.

Vector operates a range of innovative businesses delivering energy and communication services to more than 600,000 homes and commercial customers across Aotearoa and the Pacific.

Because we live in a world that is changing fast, we must continue to identify and develop better solutions that will provide value, choice and service for our customers throughout New Zealand and beyond, so the environment and communities we love continue to thrive. To do this, Vector has a vision of creating a new energy future, which will help to deliver clean, reliable and affordable energy solutions for customers.

**About the role**
As a Data Engineer in our DevOps team, you will be responsible for the design and implementation of Vector's cloud-based data solutions. You will design, develop, and release Behavior Driven Development (BDD) and Test-Driven Development (TDD) data solutions to enable our data engineering, BI and data science teams to perform data transformation and analytical activities. You will design, build and/or implement:

- Data flow and processing pipelines for ingestion into AWS data lake using cloud-based tools and services such as Apache Spark, AWS Glue, EMR and Lambda
- Unit tests for the data processing pipelines as well as CI/CD pipelines in AWS cloud
- Data integration between machine learning models and other data processing pipelines using cloud-based services such as AWS Sage Maker

From time to time, you will also be required to provide DevOps support to the Enterprise Data Warehouse and BI Platform team as well as 24x7 on call support as and when is needed.

**Who we are looking for**
Ideally you’re a seasoned Developer with experience in a Data Engineer, Software Developer or BI Developer role and have worked in an agile environment. You’ve got experience and are capable of leading AWS cloud-based data engineering development, and have a comprehensive knowledge of Behaviour-Driven Development and Test-Driven Development.

You’ll have hands on and technical experience with modern data and analytics services and technologies, such as:

- Distributed Data Processing Framework such as Apache Spark
- AWS data lake technology stack (S3, Glue, Athena)
- Data integration services (AWS EMR, Lambda)
- CI/CD pipeline development (CodePipeline, Terraform)
- Programming languages (Scala, Java and/or Python)
- Unit testing frameworks
- Machine Learning service such as AWS SageMaker

In addition, you’ve worked on large-scale data engineering projects including requirements gathering, design and have working knowledge of Data Warehouse and Business Intelligence stack (SQL, ETL, database and dimensional modelling).

**What we can offer you**
We love working together to create a new energy future. If you want to be part of an organisation with a real and tangible purpose, Vector could be the place for you. We offer:

- A fun, flexible and stimulating work environment, full of interesting work being done by smart and innovative people.
- Flexibility, including the choice of working from home a couple of days a week, and flexible start and finish times so you can balance work and life.
- Health and wellbeing support
- Great benefits that reflect the importance of family.

Vector engages a workforce made up of people and teams with diverse skills, values, backgrounds, and experiences. We respect and value people who are different from each other, including gender, ethnicity, disability, age, sexual orientation, race, and religion. We are proud of what we have achieved so far
- First corporate Living Wage Accredited employer
- First Accessibility Tick employer
- Rainbow Tick accredited
- Winner of three gongs at the 2019 Diversity Awards NZ, including the Supreme Award in 2019 and 2020.



  • Auckland City, New Zealand Amazon Data Services New Zealand Limited Full time

    3+ years of server hardware management, network management and troubleshooting experience - Experience with Network Hardware: Copper and Optical Fiber Cabling, Switches, Routers - Experience with storage subsystems - Strong Linux administration knowledge and experience. Are you excited about server and networking technology and want to work in the world's...

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand ASB Bank Full time

    **Data Engineer** ***: - **Join ASB's Data Engineering community**: - ** We have a number of roles at varying levels to fit in with your skills, experience and career aspirations**: - ** Fantastic career opportunities for data, systems, BI, engineering experienced professionals**: - ** Albany or CBD location, competitive salary, income protection & life...

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand HAYS Full time

    Data Engineer 6-month contract. **Your new company** An exciting Data Engineer role has become available with a well-known NZX Top-50 company based in Auckland CBD fringe. The company is well known for providing top of the line services to their clients and have a reputation as a leader in their field. **Your new role** Our client is currently migrating...

  • Data Engineer

    2 weeks ago


    Auckland City, New Zealand HAYS Full time

    12-month contract for a Data Engineer **Your new company** They are an industry-leading organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer with experience with the Microsoft BI stack, and strong T-SQL and DAX skills to join a Data and...

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand HAYS Full time

    Data Engineer 03-month contract **Your new company** Through a well-reputed data consultancy you will be working with an organisation that has a large presence in the media and broadcasting space. **Your new role** As a data engineer, you will be working on a variety of initiatives that include SQL coding, collaborating with the data team and wider...

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand Auckland District Health Board Full time

    **Te whiwhinga mahi | The Opportunity** The Data Engineer is a key member of the Engineering & Integration team within Auckland’s Health Information Technology (HIT) team. They are an expert in traditional Data Warehouse development using tools such as WhereScape RED or Similar based on Microsoft SQL Server, but also familiar with the latest Cloud Data...

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand New Zealand Government Full time

    Opportunity to work with a supportive, inclusive and multiskilled team - Full time, permanent role (40h per week) - Remuneration between $112,026- $131,795 depending on experience Te whiwhinga mahi | The Opportunity The Data Engineer is a key member of the Engineering & Integration team within Auckland's Health Information Technology (HIT) team. They are an...

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand Te Whatu Ora - Health New Zealand Te Toka Tumai Auckland Full time

    Opportunity to work with a supportive, inclusive and multiskilled team - Full time, permanent role (40h per week) - Remuneration between $112,026- $131,795 depending on experience **Te whiwhinga mahi | The Opportunity** The Data Engineer is a key member of the Engineering & Integration team within Auckland’s Health Information Technology (HIT) team. They...

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand IAG New Zealand Full time

    Have a meaningful impact as a **Data Engineer**. As a part of the largest insurance group in Australia and New Zealand, we’re here for you. Are you ready? **Mō te Tūranga | About the Role** We’re looking for a Specialist, Data Engineer to join IAG’s Enterprise Data Domain. This permanent full-time role will be based at either Auckland, Wellington...

  • Data Engineer

    1 week ago


    Auckland City, New Zealand IAG New Zealand Full time

    Have a meaningful impact as a **Data Engineer**. As a part of the largest insurance group in Australia and New Zealand, we’re here for you. Are you ready? **Mō te Tūranga | About the Role** We’re looking for a Specialist, Data Engineer to join IAG’s Enterprise Data Domain. This permanent full-time role will be based at either Auckland, Wellington...

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand Consult Recruitment Full time

    **About the Company** Join an organisation renowned for its significant positive impact on the lives of New Zealanders. As a leader in it's field, our client is committed to innovation and excellence. They pride themselves on creating vibrant, supportive communities and offering a range of services to enhance the lifestyle and wellbeing of their clients....

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand Harrison Grierson Full time

    **About us** HG Digital lead our clients into the future. With clients spanning government ministries, local councils, property developers, transportation and tech companies, the projects we deliver are diverse. Leveraging our expertise in location intelligence and HG's rich history, we're reimagining how digital can play a role in creating communities and...

  • Data Engineer

    3 weeks ago


    Auckland City, New Zealand Robert Half Full time

    **The Company** Having been founded over 10 years ago, this stable and growing company develops a platform that is used for derivative trading with their clients being larger NZ corporates. **The Role** Reporting to the CEO, you will be working as part of a small team of three and will have responsibility for the data engineering function within the...

  • Data Engineer

    1 week ago


    Auckland City, New Zealand Alexander James Full time

    **Contract Type**: - Full Time**Location**: - Central Auckland - Auckland | Tāmaki-makau-rau**Industry**: - IT & Telecomms**Contact Name**: - Jen Brogan- **Contact Phone**: - Jen Brogan**Date Published**: - 30-Apr-2024**Client** *** Our client is constantly evolving to meet the ever-changing needs of their customers and local communities. Recognising...

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand Alexander James Full time

    **Contract Type**: - Contractor**Location**: - Central Auckland - Auckland | Tāmaki-makau-rau**Industry**: - IT & Telecomms**Contact Name**: - Amber Shaw- **Contact Phone**: - Amber Shaw**Date Published**: - 23-Nov-2023**Our client & the role**: Our client is seeking a solid data engineer to come on board and get stuck in for an initial 4-week...

  • Data Engineer

    2 weeks ago


    Auckland City, New Zealand HAYS Full time

    Data Engineer 4-month contract **Your new role** As a Data Engineer, you will work for an e-commerce project building and maintaining data pipelines using GCP tools. You should have experience with transformation using either DBT or Dataform in GCP and also be able to create microservices/cloud services. **What you'll need to succeed** - Good...

  • Data Engineer

    3 weeks ago


    Auckland City, New Zealand HAYS Full time

    Data Engineer **Your new company** Our client is a leader in healthcare services helping communities nationally. **Your new role** As a Data Engineer, you will work within a collaborative Business Intelligence team and will be responsible for executing the vision and strategy for Business Intelligence in your portfolio areas. Your day to day will cover...

  • Data Engineer

    4 weeks ago


    Auckland City, New Zealand IAG New Zealand Full time

    Have a meaningful impact as a **Data Engineer**. **Mō te Tūranga | About the Role** We’re looking for a Specialist, Data Engineer to join IAG’s Enterprise Data Domain. This permanent full-time role will be based at either Auckland, Wellington or Christchurch and allows you to work flexibility to work from both home and the office. We offer a...

  • Senior Data

    7 days ago


    Auckland City, New Zealand TOWER Insurance Full time

    Tower is currently recruiting for two vacancies: - Senior Data Engineer - Data Engineer **Why you'll love working with Tower** At Tower, we put our people first and pride ourselves on creating a diverse and inclusive space that provides opportunities for everyone to thrive. As a uniquely Kiwi and Pacific insurer operating for almost 150 years, with roots...


  • Auckland CBD, New Zealand Institute of Data Full time

    About the Institute of DataThe Institute of Data is a Professional Network of Data Scientists, Cyber Security Analysts and Software Engineering. In partnership with leading universities in Australia, New Zealand & America, the government of Singapore and hundreds of employers, we transform careers for a data-driven world.About the roleWe are looking for Lead...