Senior Data Engineer

2 months ago

Auckland City, New Zealand Groov Full time

**About Groov**:
We work with enterprises to understand their workplace problems and develop strategies and solutions that take advantage of opportunities to improve their core business. Key to this endeavor is the use of large dynamic data sets of passive and active data to build Statistical, Machine Learning and Artificial Intelligence models grounded in cutting edge science, to develop insights and interventions and then test, learn and optimize the efficacy of these insights and interventions. Groov has demonstrated the power that real time actionable insights can have on workplaces to improve both performance and employee care.

**Role Overview**:
We are looking for an experienced Senior Data Engineer to be part of our team and play a critical role in designing, implementing, and maintaining Groov's scalable and robust data infrastructure. This role is essential to empowering our data scientists, workplace scientists, and engineers with high-quality, reliable data pipelines and workflows. You will partner with cross-functional teams to ensure data is accessible, clean, and actionable, enabling Groov to deliver dynamic, real-time insights to our customers effectively.

This role provides an exciting opportunity to define the backbone of Groov’s data infrastructure, enabling cutting-edge workplace science and analytics.

**Key Responsibilities**:

- Architect Scalable Data Systems:
- Design, develop, and maintain scalable data pipelines and workflows for efficient data ingestion, transformation, and storage.
- Establish and maintain data environments for development, testing, and production to ensure seamless deployment.
- Enable Data Quality and Lineage:
- Implement data validation frameworks and ensure schema consistency across datasets.
- Set up tools for tracking data lineage, dependency management, and version control for reliable data workflows.
- Support Cross-Functional Teams:
- Collaborate with data scientists to define and implement data models for use in AI/ML systems.
- Evaluate and Integrate Tools and Platforms:
- Research and recommend managed data platforms and tools, such as Snowflake, Databricks, Fivetran, and dbt, to optimize data workflows.
- Enhance Groov’s AWS-based data stack, leveraging tools like Glue, Athena, S3, and Step Functions.
- Optimize Data Processes:
- Automate data pipeline testing and deployment through CI/CD workflows.
- Develop efficient ETL processes to support real-time and batch data workflows.
- Monitor and Improve Scalability:
- Identify bottlenecks and opportunities for optimization in existing pipelines.
- Ensure Groov’s data infrastructure is cost-effective, scalable, and reliable as data volume and complexity grow.

**Basic Qualifications**:

- Bachelor's degree in Computer Science, Data Engineering, or a related field.
- 5+ years of experience in data engineering or related roles.
- Experience with managing data lakes.
- Experience with evaluating and implementing managed data platforms like Snowflake or Databricks to optimize storage, querying, and analytics workflows?
- Proficiency in Python and SQL for developing ETL pipelines and data workflows.
- Experience with AWS services (Glue, Athena, S3) for data transformation and querying.
- Strong background in designing and maintaining scalable data architectures.
- Experience implementing data validation, lineage tracking, and environment separation for data systems.
- Knowledge of CI/CD workflows and version control tools like Git.

**Preferred Qualifications**:

- Master’s degree in Computer Science, Data Engineering, or a related field.
- 7+ years of experience in data engineering or related roles.
- Experience with big data tools (e.g., Apache Spark, Kafka, Hadoop) and transformation tools (e.g., dbt, Airflow).
- Proven ability to collaborate with cross-functional teams to define data models and drive data-driven decision-making.
- Knowledge of MLOps tools (e.g., MLflow, SageMaker) and deploying ML models in production environments.

  • Senior Data Engineer

    2 weeks ago

    Wellington City, New Zealand Precision Data Full time

    **Why we need you & what you will be doing** We are looking for 7 Software engineers to work with our team. This is a full time permanent role with 40 hours per week. **What we are doing**: Precision Data are working closely with a client who are doing a Risk assessment of payment transactions and this role is around upgrading their current platform, it...

  • Senior Data Engineer

    5 days ago

    Auckland City, New Zealand HAYS Full time

    Data Engineer (06-month contract) **Your new company** They are a healthcare organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer to deliver an end-to-end data solution. You will be responsible for ETL and Data Warehouse development, and...

  • Senior Data Engineer

    4 days ago

    Auckland City, New Zealand HAYS Full time

    Data Engineer 6-month contract **Your new company** They are an industry-leading organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer with experience with the Microsoft BI stack, and strong TSQL and DAX skills to join a Data and Analytics...

  • Senior Data Engineer

    1 month ago

    Auckland City, New Zealand SkyCity Entertainment Group Full time

    **A bit about us**: SkyCity is one of Australasia's most popular casino and hospitality destinations who welcome and delight millions of customers each year. Our ICT Department is constantly looking at new and innovative ways of utilising cutting edge technology to enhance our offering to customers and staff and our ICT team work hard to succeed. Join our...

  • Senior Data Engineer

    2 months ago

    Auckland City, New Zealand TVNZ Full time

    Reference: 44213 - Applications close on: 18 Dec 2024 17:00 - Location: Auckland - Work Type: Permanent full time - Expertise: Engineering - Hardware, Engineering - Network, Engineering - Software, Data, Product & Data - JOB DESCRIPTION: Senior Data Engineer JD - Nov2024.pdf **The opportunity - Te tūranga** In this role as Senior Data Engineer, you will...

  • Senior Data Engineer

    1 week ago

    Auckland City, New Zealand HAYS Full time

    Calling Data Engineers! Start your new year off with a contract working in the banking sector **Your new company** You will be working for an organisation that leads from the front in the data world. They invest in getting their contractors as much experience as possible in order to grow and to be exposed to different environments. You will be welcomed into...

  • Senior Data Engineer

    3 days ago

    Auckland City, New Zealand Serko Ltd Full time

    Serko is an award-winning business travel and expense software company that’s winning on a global scale. We’re already the established leader in Australasia and revolutionizing the way people do business travel in the USA and Europe - and we’re growing! We’re hiring people from different backgrounds, experiences, abilities and perspectives to help...

  • Senior Data Engineer

    2 months ago

    Auckland City, New Zealand Kiwibank Full time

    **Auckland **based opportunity - Banking benefits, health insurance, flexible working options and more - Join our growing Digital & Technology Team! **This is us. Where making an impact matters.** We're looking for a passionate and innovative Senior Data Engineer to join our Data Enablement team, as they continue to work on transforming the way the bank...

  • Senior Data Engineer

    8 months ago

    Auckland City, New Zealand RWA Technology People Full time

    Huge technology transformation - Opportunity to create impact and influence the transformation - Auckland based, hybrid role Our client is a burgeoning success within the electricity, utilities and infrastructure space—they are growing fast across the country by serving the community a ranging array of expertise. With their growth, they are now looking...

  • Senior Data

    1 week ago

    Auckland City, New Zealand TOWER Insurance Full time

    Tower is currently recruiting for two vacancies: - Senior Data Engineer - Data Engineer **Why you'll love working with Tower** At Tower, we put our people first and pride ourselves on creating a diverse and inclusive space that provides opportunities for everyone to thrive. As a uniquely Kiwi and Pacific insurer operating for almost 150 years, with roots...

  • Senior Data Engineer

    2 months ago

    Auckland, New Zealand Skycity Full time

    SkyCity is one of Australasia's most popular casino and hospitality destinations who welcome and delight millions of customers each year. Our ICT Department is constantly looking at new and innovative ways of utilising cutting edge technology to enhance our offering to customers and staff and our ICT team work hard to succeed. Join our dynamic team as a...

  • Senior Data Engineer

    7 months ago

    Auckland City, New Zealand Potentia Full time

    **Why You Would Like It**: - Collaborative environment where innovation thrives - Competitive remuneration package, including 8% KiwiSaver and bonus schemes - Central location with easy access and modern facilities ***The Opportunity**: Seize the chance to work amongst the best in the financial industry and use your expertise in.NET, Python, SQL, Data...

  • Senior Data Engineer

    7 months ago

    Wellington City, New Zealand New Zealand Government Full time

    **Type**: PermanentHours: Full timeLocation: Wellington Business Group: Te Waka Aukaha/Planning Design and Assurance Branch: Kāwai ki te Iwi / Service Delivery and OperationsSalary: $117,742 - $157,843 We're looking for a driven and experienced Senior Data Engineer to join our Business Intelligence & Insights team to enable advanced analytics solutions...

  • Senior Data Engineer

    4 days ago

    Auckland City, New Zealand Bupa Full time

    **Have you ever wanted a career with purpose?** Every day, in every way, we bring real heart to work. It’s what drives us to deliver our refreshingly different commitment to supporting the people who make a real difference in enriching the lives of our society’s most vulnerable. In New Zealand, we are making a difference through our 40 care homes and 35...

  • Senior Data Engineer

    2 months ago

    Auckland, New Zealand Skycity Entertainment Group Full time

    Developers/Programmers (Information & Communication Technology)Full timeSkyCity is one of Australasia's most popular casino and hospitality destinations who welcome and delight millions of customers each year. Our ICT Department is constantly looking at new and innovative ways of utilising cutting-edge technology to enhance our offering to customers and...

  • Data Engineer

    7 months ago

    Auckland City, New Zealand HAYS Full time

    12-month contract for a Data Engineer **Your new company** They are an industry-leading organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer with experience with the Microsoft BI stack, and strong T-SQL and DAX skills to join a Data and...

  • Senior Data Engineer

    4 months ago

    Wellington City, New Zealand New Zealand Government Full time

    Exciting opportunity to join our new Chapter model enabled by modern data platform! - Help embed our data principles within NZTA & deliver data driven vision at Waka Kotahi - Wellington or Auckland or Palmerston North Do you have proven experience as a Senior Data Engineer and are ready to make a difference? Are you interested in becoming part of our new...

  • Senior Data Engineer

    4 weeks ago

    Auckland, New Zealand Tsb Full time

    Database Development & Administration (Information & Communication Technology)Full timeAt TSB, you'll be part of a profit for purpose organisation, that empowers and enables you to be your best and make a positive difference for the people you work with, and the communities you are part of.About the roleWe're in search of a team-oriented and proactive IT...

  • Senior Data Engineer

    7 months ago

    Auckland City, New Zealand HAYS Full time

    Senior Data Engineer **Your new company** An organisation at the core of New Zealand's and Australia's economy, and one of New Zealand's largest private companies. Working culture at this organisation promotes responsibility and ownership, a relaxed and professional environment where you will have the opportunity to engage with end-users and senior...

  • Senior Data Engineer

    4 months ago

    Auckland City, New Zealand Genesis Energy NZ Full time

    Reference #- 26044- Posted on- 16 Sep 2024- Closes on- 25 Sep 2024 12:00- Location(s)- Auckland Office, Hamilton Office- Expertise- Information Technology- Job level(s)- Experienced- Work type(s)- Permanent full-time**About us** Genesis Energy is one of New Zealand's leading energy retailers, supplying electricity, natural gas and LPG to more than half a...