PySpark Consultant

5 days ago

Auckland, Auckland, New Zealand Avance Consulting Full time NZ$80,000 - NZ$120,000 per year

Job Description: PySpark Consultant – Data Engineer

Location: Wellington / Auckland, New Zealand

Job Type: Contract

We are seeking a PySpark Consultant – Data Engineer to join our New Zealand team, supporting large-scale SAS Modernization and Data Migration initiatives. The role requires hands-on expertise in PySpark, Spark SQL, Hadoop ecosystems, and a strong understanding of modern cloud data platforms (Azure, AWS, or GCP).

Key Responsibilities

  • Support SAS Modernization projects, migrating legacy systems to modern big data and cloud environments.
  • Design and implement PySpark and Spark SQL solutions for large-scale data processing and analytics.
  • Collaborate with architecture teams to define migration strategies across Hadoop and Cloud data ecosystems.
  • Ensure data quality, governance, and performance optimization in transformed environments.
  • Act as a technical developer throughout project delivery.

Required Skills & Experience

  • Strong hands-on experience in PySpark, Spark SQL, and distributed data processing.
  • Knowledge of Hadoop, Hive, and related big data components.
  • Exposure to cloud-native data platforms (Azure Databricks, AWS EMR, or GCP BigQuery).
  • Experience with SAS to modern data stack migration projects is highly desirable.
  • Excellent problem-solving and leadership skills to drive end-to-end project execution.

  • Azure Data Consultant

    5 days ago

    Auckland, Auckland, New Zealand Arinco Full time NZ$1,000 - NZ$15,000 per year

    Arinco is a leading Australian and New Zealand technology consulting business specialising in digital transformation for enterprise and SMB's. We live and breath the Microsoft ecosystem and we proudly deliver market leading solutions to our to customers in partnership with them. Last year we were announced as their 2024 Australian Partner of the Year and...

  • Data Engineer

    3 days ago

    Auckland, Auckland, New Zealand Deloitte New Zealand Full time NZ$80,000 - NZ$120,000 per year

    Company Description Join us. But be you. At Deloitte, you'll do more than just join something, you'll add something.  You've found a place that values your curiosity, passion, and desire to work alongside brilliant people on the things that really matter. There really is only one question: What impact do YOU want to make?Love analytics, insights and AI? Get...

  • Azure Data Consultant

    5 days ago

    Auckland , New Zealand Arinco Full time NZ$100,000 - NZ$130,000 per year

    Arinco is a leading Australian and New Zealand technology consulting business specialising in digital transformation for enterprise and SMB's. We live and breath the Microsoft ecosystem and we proudly deliver market leading solutions to our to customers in partnership with them. Last year we were announced as their 2024 Australian Partner of the Year and...