Senior Data Engineer

7 days ago

Auckland City, New Zealand Basis Full time

**About Us**

Are you looking for an opportunity to make a real difference in your next role?

Why? As a society, we need to decarbonise and accelerate the transition to alternative energy sources. Existing solutions are expensive and disparate, with limited functionality.

Basis is driven by purpose, real innovation, and ambition. We have a talented team spread across New Zealand, with a creative space by the beach in Takapuna, and a Design Lab in Christchurch where our physical products come to life. We're more than happy to take on someone who wants to work remotely from a different location across New Zealand too, or wants to relocate.

We recently closed our Series A capital raise, so we're well-funded and ready to grow. Our team is smart, curious and has some big goals - so if you’re interested in joining a fast-growing and startup that is design-led and puts people at its core, then we’d love to hear from you

We're also currently in stealth mode, so check out our website and we'll share more with you during the recruitment process

**The Role**

We are on the lookout for a creative individual to join our world-class team and build data tools that can perceive and control the flow of electrical energy within homes and even entire countries. We’ve implemented systems to extract data from chips, custom sensors and massive cloud databases - and we need your help implementing data pipelines and algorithms to pick out the most important information You will help build electrical energy infrastructure that enables a future with ubiquitous and plentiful renewable energy. If that doesn’t sound exciting enough, some of the work you’ll do may be similar to real-time audio streaming, video processing or video game development. We want to make it just as interactive and fun as that work while making progress toward a renewable energy future.

Some of the things that you might be involved in include:

- Architect and implement data infrastructure for analytics, data science and machine learning in cloud and edge platforms
- Work with hardware and software teams to establish diverse data pipelines that compare required performance to measured results, helping demonstrate regulatory compliance
- Link our products' unique high-rate, high-resolution data with data from national and global climate, energy, and financial data streams to create an unprecedented perception of the flow of electrical energy
- Create robust processes for enforcing the quality, security, governance, and availability of data
- Extend our processes and documentation systems for robust software development to data engineering. Help host code and process documentation alongside data visualisation.
- Set up and maintain software test frameworks including continuous integration systems and data QC.
- Reviewing code written by Basis peers to ensure quality, collaboration and conformance

**About You**

We think you’ll be a fit for this role if possess the following skills or experience:

- 5+ years of experience in a data engineering role building end-to-end ETL pipelines, datasets, and working with data warehouses, data lakes and the associated infrastructure
- Experience building, maintaining and improving data batch and streaming data pipelines. Proficiency with streaming protocols such as MQTT or ZMQ a plus.
- Experience creating, managing and processing logs, especially with Fluentd
- Experience with databases (both SQL and NoSQL) and data storage solutions optimised for high-speed time series data.
- Experience implementing DevOps best practices within the data platform, including solutions for CI/CD, data observability, monitoring, and lineage
- An ability to write software in at least two of the following languages: C, C++, C#, Rust, Golang, Python, Javascript
- An understanding of the wider system beyond software, and an ability to articulate the impact of systems decisions on software and vice versa
- Comfort in working with uncertainty, using your initiative, and doing what it takes to solve problems. Experience or passion for working in a start-up environment
- A team player who is effective at working within a cross-disciplinary team, contributing to overall product creation

Some nice to haves include:

- Strong demonstrated interest in one or more of the following: signal processing, data science, audio/video processing, video game development.
- Deep knowledge of cloud platforms (e.g., AWS, Google Cloud Platform, Azure) and services (e.g., EC2, Lambda, BigQuery, S3).
- Has worked with custom electronics or real-time sensor data
- Experience with tools such as Petastorm, Amundsen, Great Expectations and Hugging Face Datasets & Model Hub
- Familiarity with machine learning frameworks such as PyTorch or TensorFlow
- Experience with embedded Linux

**Benefits**
- A competitive salary and employee share scheme (ESOP)
- A remote-first culture - work from home or come into the office, it's totally up to you
- Unlimited annual

  • Senior Data Engineer

    3 weeks ago

    Auckland City, New Zealand KiwiRail Full time

    **Come on board and become part of our One Winning Team!** - Senior level position - Focus on business strategy and analytics - Permanent, Auckland based **What you’ll do** Our Information and Communication Technology Group (ICT) provides a wide range of ICT planning, implementation, operation and support services across the KiwiRail Group. As a Senior...

  • Senior Data Engineer

    4 weeks ago

    Auckland City, New Zealand HAYS Full time

    Data Engineer (06-month contract) **Your new company** They are a healthcare organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer to deliver an end-to-end data solution. You will be responsible for ETL and Data Warehouse development, and...

  • Senior Data Engineer

    4 weeks ago

    Auckland City, New Zealand HAYS Full time

    Data Engineer 6-month contract **Your new company** They are an industry-leading organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer with experience with the Microsoft BI stack, and strong TSQL and DAX skills to join a Data and Analytics...

  • Senior Data Engineer

    4 weeks ago

    Auckland City, New Zealand HAYS Full time

    Data Engineer 12-month contract **Your new company** They are an industry-leading organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer with experience with the Microsoft BI stack, and strong T-SQL and DAX skills to join a Data and Analytics...

  • Senior Data Engineer

    4 weeks ago

    Auckland City, New Zealand Absolute IT Recruitment Specialists Full time

    Auckland Central- Data/Data Warehousing/Business Intelligence- NZD130000 - NZD150000 per annum, Benefits: $130000 - $150000- Full Time- Permanent- 17 Feb 2023- Permanent opportunity for an experienced Senior Data Engineer Expert - Interesting Kiwi medium size Organisation offering a flexible working environment - Attractive Salary, work life balance and...

  • Senior Data Engineer

    4 weeks ago

    Auckland City, New Zealand The New Zealand Automobile Association Inc. Full time

    **Senior Data Engineer**: - **Reference**: 32179 - **Posted on**: 30 Aug 2023 - **Closes on**: 18 Sep 2023 16:50 - **Locations**: Auckland - Central - **Job level**: IT - Senior (5 + years) - **Work type**: Full-time - **Additional info**: Senior Data Engineer - Position Description.pdf **About the AA** For over 110 years we've been helping kiwis on their...

  • Senior Data Engineer

    3 months ago

    Auckland City, New Zealand Talent International Full time

    new zealand auckland permanent negotiable**Opportunity knocks** - This is a permanent opportunity for a Senior Data Engineer with an organisation that is a leader in their field. You will work in a customer facing role solving real business problems and providing tangible solutions. - Can be a permanent or contract role depending on your preference! **Why...

  • Senior Data Engineer

    4 weeks ago

    Auckland City, New Zealand Potentia Full time

    Why you would like it: - Be part of building data and intelligence solutions on leading cloud platforms - Collaborative and inclusive work environment that fosters creativity and innovation - Work closely with Stakeholders Purpose: This business is a successful enterprise with an established name in its sector and is looking for a Senior Data Engineer...

  • Senior Data Engineer

    3 weeks ago

    Auckland City, New Zealand HAYS Full time

    Senior Data Engineer **Your new company** Our client is a SaaS company based in Auckland CBD and are well known in the services they are providing in predictions and solutions. **Your new role** You will work in a collaborative team to bring your wealth of knowledge in data engineering to lead and implement data engineering for platform/products, support...

  • Senior Data Engineer

    4 weeks ago

    Auckland City, New Zealand SkyCity Entertainment Group Full time

    **A bit about us**: SkyCity is one of Australasia's most popular casino and hospitality destinations who welcome and delight millions of customers each year. Our ICT Department is constantly looking at new and innovative ways of utilising cutting edge technology to enhance our offering to customers and staff and our ICT team work hard to succeed. Join our...

  • Senior Data Engineer

    4 weeks ago

    Auckland City, New Zealand Warner Bros. Discovery Full time

    **_Welcome to Warner Bros. Discoverythe stuff dreams are made of._** **Who We Are ** When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic content and beloved brands, are the _storytellers_ bringing our...

  • Senior Microsoft Data Engineer

    3 weeks ago

    Auckland City, New Zealand Absolute IT Recruitment Specialists Full time

    Auckland Central- Data/Data Warehousing/Business Intelligence- Salaries from $135 - 160k base + Benefits- Full Time- Permanent- 24 Aug 2023- Large Projects and evolving Cloud based Data Warehousing & Business Intelligence. All positions are Auckland Central with salaries to mirror your commercial capability._ - Multiple new roles, permanent employment...

  • Senior Data Engineer

    4 weeks ago

    Auckland City, New Zealand SkyCity Entertainment Group Full time

    **A bit about us**: SkyCity is one of Australasia's most popular casino and hospitality destinations who welcome and delight millions of customers each year. Our ICT Department is constantly looking at new and innovative ways of utilising cutting edge technology to enhance our offering to customers and staff and our ICT team work hard to succeed. Join our...

  • Senior Data Engineer

    2 weeks ago

    Auckland, Auckland, New Zealand KiwiRail Freight Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Come on board and become part of our One Winning Team Focus on business strategy and analytics Permanent, Auckland based What you'll do Our Information and Communication Technology Group (ICT) provides a wide range of ICT planning, implementation, operation...

  • Senior Data Engineer

    4 weeks ago

    Auckland City, New Zealand RWA Technology People Full time

    Huge technology transformation - Opportunity to create impact and influence the transformation - Auckland based, hybrid role Our client is a burgeoning success within the electricity, utilities and infrastructure space—they are growing fast across the country by serving the community a ranging array of expertise. With their growth, they are now looking...

  • Senior Data

    7 days ago

    Auckland City, New Zealand TOWER Insurance Full time

    Tower is currently recruiting for two vacancies: - Senior Data Engineer - Data Engineer **Why you'll love working with Tower** At Tower, we put our people first and pride ourselves on creating a diverse and inclusive space that provides opportunities for everyone to thrive. As a uniquely Kiwi and Pacific insurer operating for almost 150 years, with roots...

  • Senior Data Engineer

    2 weeks ago

    Auckland, Auckland, New Zealand KiwiRail Full time

    Other (Information & Communication Technology) Come on board and become part of our One Winning TeamFocus on business strategy and analyticsPermanent, Auckland basedWhat you'll doOur Information and Communication Technology Group (ICT) provides a wide range of ICT planning, implementation, operation and support services across the KiwiRail Group.As a Senior...

  • Senior Data Engineer

    3 weeks ago

    Auckland City, New Zealand Potentia Full time

    **Why You Would Like It**: - Collaborative environment where innovation thrives - Competitive remuneration package, including 8% KiwiSaver and bonus schemes - Central location with easy access and modern facilities ***The Opportunity**: Seize the chance to work amongst the best in the financial industry and use your expertise in.NET, Python, SQL, Data...

  • Senior Data Engineer

    7 days ago

    Auckland City, New Zealand Stuff Full time

    Be empowered to fulfill your potential and join us as **Senior Data Engineer** to ensure that we have **data** in the right format and the right places with the right tools to provide a compelling competitive advantage for **Stuff** and our customers. We're an Agile focused organisation, we put our customers at the heart of everything we do so you'll be...

  • Data Engineer

    2 weeks ago

    Auckland City, New Zealand HAYS Full time

    12-month contract for a Data Engineer **Your new company** They are an industry-leading organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer with experience with the Microsoft BI stack, and strong T-SQL and DAX skills to join a Data and...