Senior Data Engineer

3 days ago

Auckland City, New Zealand Groov Full time

**About Groov**:
We work with enterprises to understand their workplace problems and develop strategies and solutions that take advantage of opportunities to improve their core business. Key to this endeavor is the use of large dynamic data sets of passive and active data to build Statistical, Machine Learning and Artificial Intelligence models grounded in cutting edge science, to develop insights and interventions and then test, learn and optimize the efficacy of these insights and interventions. Groov has demonstrated the power that real time actionable insights can have on workplaces to improve both performance and employee care.

**Role Overview**:
We are looking for an experienced Senior Data Engineer to be part of our team and play a critical role in designing, implementing, and maintaining Groov's scalable and robust data infrastructure. This role is essential to empowering our data scientists, workplace scientists, and engineers with high-quality, reliable data pipelines and workflows. You will partner with cross-functional teams to ensure data is accessible, clean, and actionable, enabling Groov to deliver dynamic, real-time insights to our customers effectively.

This role provides an exciting opportunity to define the backbone of Groov’s data infrastructure, enabling cutting-edge workplace science and analytics.

**Key Responsibilities**:

- Architect Scalable Data Systems:
- Design, develop, and maintain scalable data pipelines and workflows for efficient data ingestion, transformation, and storage.
- Establish and maintain data environments for development, testing, and production to ensure seamless deployment.
- Enable Data Quality and Lineage:
- Implement data validation frameworks and ensure schema consistency across datasets.
- Set up tools for tracking data lineage, dependency management, and version control for reliable data workflows.
- Support Cross-Functional Teams:
- Collaborate with data scientists to define and implement data models for use in AI/ML systems.
- Evaluate and Integrate Tools and Platforms:
- Research and recommend managed data platforms and tools, such as Snowflake, Databricks, Fivetran, and dbt, to optimize data workflows.
- Enhance Groov’s AWS-based data stack, leveraging tools like Glue, Athena, S3, and Step Functions.
- Optimize Data Processes:
- Automate data pipeline testing and deployment through CI/CD workflows.
- Develop efficient ETL processes to support real-time and batch data workflows.
- Monitor and Improve Scalability:
- Identify bottlenecks and opportunities for optimization in existing pipelines.
- Ensure Groov’s data infrastructure is cost-effective, scalable, and reliable as data volume and complexity grow.

**Basic Qualifications**:

- Bachelor's degree in Computer Science, Data Engineering, or a related field.
- 5+ years of experience in data engineering or related roles.
- Experience with managing data lakes.
- Experience with evaluating and implementing managed data platforms like Snowflake or Databricks to optimize storage, querying, and analytics workflows?
- Proficiency in Python and SQL for developing ETL pipelines and data workflows.
- Experience with AWS services (Glue, Athena, S3) for data transformation and querying.
- Strong background in designing and maintaining scalable data architectures.
- Experience implementing data validation, lineage tracking, and environment separation for data systems.
- Knowledge of CI/CD workflows and version control tools like Git.

**Preferred Qualifications**:

- Master’s degree in Computer Science, Data Engineering, or a related field.
- 7+ years of experience in data engineering or related roles.
- Experience with big data tools (e.g., Apache Spark, Kafka, Hadoop) and transformation tools (e.g., dbt, Airflow).
- Proven ability to collaborate with cross-functional teams to define data models and drive data-driven decision-making.
- Knowledge of MLOps tools (e.g., MLflow, SageMaker) and deploying ML models in production environments.

  • Senior Data Engineer

    6 months ago

    Auckland City, New Zealand HAYS Full time

    Data Engineer (06-month contract) **Your new company** They are a healthcare organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer to deliver an end-to-end data solution. You will be responsible for ETL and Data Warehouse development, and...

  • Senior Data Engineer

    6 months ago

    Auckland City, New Zealand HAYS Full time

    Data Engineer 12-month contract **Your new company** They are an industry-leading organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer with experience with the Microsoft BI stack, and strong T-SQL and DAX skills to join a Data and Analytics...

  • Senior Data Engineer

    8 months ago

    Auckland City, New Zealand Talent International Full time

    new zealand auckland permanent negotiable**Opportunity knocks** - This is a permanent opportunity for a Senior Data Engineer with an organisation that is a leader in their field. You will work in a customer facing role solving real business problems and providing tangible solutions. - Can be a permanent or contract role depending on your preference! **Why...

  • Senior Data Engineer

    6 months ago

    Auckland City, New Zealand Potentia Full time

    Why you would like it: - Be part of building data and intelligence solutions on leading cloud platforms - Collaborative and inclusive work environment that fosters creativity and innovation - Work closely with Stakeholders Purpose: This business is a successful enterprise with an established name in its sector and is looking for a Senior Data Engineer...

  • Senior Data Engineer

    6 months ago

    Auckland City, New Zealand Warner Bros. Discovery Full time

    **_Welcome to Warner Bros. Discoverythe stuff dreams are made of._** **Who We Are ** When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic content and beloved brands, are the _storytellers_ bringing our...

  • Senior Data Engineer

    6 months ago

    Auckland City, New Zealand SkyCity Entertainment Group Full time

    **A bit about us**: SkyCity is one of Australasia's most popular casino and hospitality destinations who welcome and delight millions of customers each year. Our ICT Department is constantly looking at new and innovative ways of utilising cutting edge technology to enhance our offering to customers and staff and our ICT team work hard to succeed. Join our...

  • Senior Data Engineer

    6 months ago

    Auckland City, New Zealand SkyCity Entertainment Group Full time

    **A bit about us**: SkyCity is one of Australasia's most popular casino and hospitality destinations who welcome and delight millions of customers each year. Our ICT Department is constantly looking at new and innovative ways of utilising cutting edge technology to enhance our offering to customers and staff and our ICT team work hard to succeed. Join our...

  • Senior Data Engineer

    2 weeks ago

    Auckland City, New Zealand Kiwibank Full time

    **Auckland **based opportunity - Banking benefits, health insurance, flexible working options and more - Join our growing Digital & Technology Team! **This is us. Where making an impact matters.** We're looking for a passionate and innovative Senior Data Engineer to join our Data Enablement team, as they continue to work on transforming the way the bank...

  • Senior Data Engineer

    6 months ago

    Auckland City, New Zealand RWA Technology People Full time

    Huge technology transformation - Opportunity to create impact and influence the transformation - Auckland based, hybrid role Our client is a burgeoning success within the electricity, utilities and infrastructure space—they are growing fast across the country by serving the community a ranging array of expertise. With their growth, they are now looking...

  • Senior Data Engineer

    4 weeks ago

    Auckland, New Zealand 261 Morrin Road Full time

    New!! Senior Data Engineer - 1-2 month contract - South Auckland We are looking for a Senior Data Engineer to help our client review their existing Data Warehouse instance, as well as rebuild and create new ETL pipelines from various sources and applications within the business. This contract role is for an experienced Data Engineer who is both consultative...

  • Senior Data Engineer

    6 months ago

    Wellington City, New Zealand Peoplebank Full time

    **Job Title: Senior Data Engineer** **Location**: Wellington **Team**: Data & Analytics Group **Reports To**: Team Leader - Data Collection Systems **About Us**: Join the forefront of innovation and excellence in the public sector, where the Data & Analytics Group is at the heart of driving transformative change. We are currently seeking a dynamic Senior...

  • Senior Data Engineer

    2 weeks ago

    Auckland, New Zealand Talent Vault Full time

    Engineering - Software (Information & Communication Technology)Contract/TempNew!! Senior Data Engineer - 1-2 month contract - South AucklandWe are looking for a Senior Data Engineer to help our client review their existing Data Warehouse instance, as well as rebuild and create new ETL pipelines from various sources and applications within the business.This...

  • Senior Data Engineer

    5 months ago

    Wellington City, New Zealand New Zealand Government Full time

    **Type**: PermanentHours: Full timeLocation: Wellington Business Group: Te Waka Aukaha/Planning Design and Assurance Branch: Kāwai ki te Iwi / Service Delivery and OperationsSalary: $117,742 - $157,843 We're looking for a driven and experienced Senior Data Engineer to join our Business Intelligence & Insights team to enable advanced analytics solutions...

  • Senior Data Engineer

    6 months ago

    Auckland City, New Zealand Potentia Full time

    **Why You Would Like It**: - Collaborative environment where innovation thrives - Competitive remuneration package, including 8% KiwiSaver and bonus schemes - Central location with easy access and modern facilities ***The Opportunity**: Seize the chance to work amongst the best in the financial industry and use your expertise in.NET, Python, SQL, Data...

  • Senior Data Engineer

    3 months ago

    Wellington City, New Zealand New Zealand Government Full time

    Exciting opportunity to join our new Chapter model enabled by modern data platform! - Help embed our data principles within NZTA & deliver data driven vision at Waka Kotahi - Wellington or Auckland or Palmerston North Do you have proven experience as a Senior Data Engineer and are ready to make a difference? Are you interested in becoming part of our new...

  • Data Engineer

    5 months ago

    Auckland City, New Zealand HAYS Full time

    12-month contract for a Data Engineer **Your new company** They are an industry-leading organisation that is currently on the lookout for a Senior Data Engineer to join their high-performing team. **Your new role** We are looking for a Senior Data Engineer with experience with the Microsoft BI stack, and strong T-SQL and DAX skills to join a Data and...

  • Senior Data Engineer

    2 weeks ago

    Auckland, New Zealand Skycity Full time

    SkyCity is one of Australasia's most popular casino and hospitality destinations who welcome and delight millions of customers each year. Our ICT Department is constantly looking at new and innovative ways of utilising cutting edge technology to enhance our offering to customers and staff and our ICT team work hard to succeed. Join our dynamic team as a...

  • Senior Data Engineer

    3 months ago

    Auckland City, New Zealand Genesis Energy NZ Full time

    Reference #- 26044- Posted on- 16 Sep 2024- Closes on- 25 Sep 2024 12:00- Location(s)- Auckland Office, Hamilton Office- Expertise- Information Technology- Job level(s)- Experienced- Work type(s)- Permanent full-time**About us** Genesis Energy is one of New Zealand's leading energy retailers, supplying electricity, natural gas and LPG to more than half a...

  • Senior Data Engineer

    3 months ago

    Wellington City, New Zealand Kiwibank Full time

    **Wellington **based opportunity - Banking benefits, health insurance, flexible working options and more - Join our Data Engineering Team! **This is us. Where making an impact matters.** We are seeking a Senior Data Engineer to join our team who are working on supporting the way the bank uses data. An exciting opportunity within our growing Digital &...

  • Senior Data Engineer

    6 months ago

    Auckland City, New Zealand Visa Full time

    Company Description Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure...