Senior Data Platforms Engineer

7 months ago

Christchurch, New Zealand Simple Machines Full time

**Position: Senior Data Platforms Engineer**
**Location: Christchurch, New Zealand**
**Travel: Potential travel within the ANZ region on occasion**
**Simple Machines. Data Engineered to Life**

Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and governments better connect with and understand their organisations, their people, their customers, and citizens. We are a team of creative engineers and technologists dedicated to unleashing the potential of data in new and impactful ways. We design and build bespoke data platforms and unique software products, create and deploy intelligent systems, and bring engineering expertise to life by transforming data into actionable insights and tangible outcomes. We engineer data to life.

**The Role**:
The Senior Data Platforms Engineer at Simple Machines is a dynamic, hands-on role focused on building real-time data pipelines and implementing data mesh architectures to enhance client data interactions. This position blends deep technical expertise in modern data engineering methods with a client-facing consulting approach, enabling clients to effectively manage and utilize their data. Within a team of top-tier engineers, the role involves developing greenfield data solutions that deliver tangible business outcomes across various environments.

**Requirements**:
**Technical Responsibilities**
- **Developing Data Solutions**: Implement and enhance data-driven solutions integrating with clients' systems using state-of-the-art tools such as Databricks, Snowflake, Google Cloud, and AWS. Embrace modern data architecture philosophies including data products, data contracts, and data mesh to ensure a decentralized and consumer-oriented approach to data management.
- **Data Pipeline Development**: Develop and optimise high-performance, batch and real-time data pipelines employing advanced streaming technologies like Kafka, and Flink. Utilise workflow orchestration tools such as Dataflow and Airflow.
- **Database and Storage Optimization**: Optimize and manage a broad array of database technologies, from traditional relational databases (e.g., PostgreSQL, MySQL) to modern NoSQL solutions (e.g., MongoDB, Cassandra). Focus on strategies that enhance data accessibility, integrity, and performance.
- **Big Data Processing & Analytics**: Utilise big data frameworks such as Apache Spark and Apache Flink to address challenges associated with large-scale data processing and analysis. These technologies are crucial for managing vast datasets and performing complex data transformations and aggregations.
- **Cloud Data Management**: Implement and oversee cloud-specific data services including AWS Redshift, S3, Google BigQuery, and Google Cloud Storage. Leverage cloud architectures to improve data sharing and interoperability across different business units.
- **Security and Compliance**: Ensure all data practices comply with security policies and regulations, embedding security by design in the data infrastructure. Incorporate tools and methodologies recommended for data security and compliance, ensuring robust protection and governance of data assets.

**Consulting Responsibilities**
- **Client Advisory**: Provide expert advice to clients on optimal data practices that align with their business requirements and project goals.
- **Training and Empowerment**: Educate client teams on the latest technologies and data management strategies, enabling them to efficiently utilise and maintain the solutions we have developed.
- **Professional Development**: Keep up with the latest industry trends and technological advancements, continually upgrading skills and achieving certifications in the technologies Simple Machines implements across its client base.

**Ideal Skills and Experience**
- **Core Data Engineering Tools & Technologies**: Demonstrates proficiency in SQL and Spark, and familiarity with platforms such as Databricks and Snowflake. Well-versed in various storage technologies including AWS S3, Google Cloud BigQuery, Cassandra, MongoDB, Neo4J, and HDFS. Adept in pipeline orchestration tools like AWS Glue, Apache Airflow, and dbt, as well as streaming technologies like Kafka, AWS Kinesis, Google Cloud Pub/Sub, and Azure Event Hubs.
- **Data Storage Expertise**: Knowledgeable in data warehousing technologies like BigQuery, Snowflake, and Databricks, proficient in managing various data storage formats including Parquet, Delta, ORC, Avro, and JSON to optimise data storage and retrieval.
- **Data Modelling Expertise**: Proficient in data modelling, understanding the implications and trade-offs of various methodologies and approaches.
- **Infrastructure Configuration for Data Systems**: Compete

  • Senior Platform Engineer

    3 months ago

    Christchurch, New Zealand Crescent Consulting Full time

    Added - 08/08/24 Senior Platform Engineer Information & Communication Technology Christchurch | PermanentAbout the Role:We are seeking an experienced and highly skilled Senior Platform Engineer to join a highly skilled team at a Christchurch institution and household name. This is initially a 3-month contract position with the potential for extension,...

  • Principal / Senior Data Engineers - Data Driven

    8 months ago

    Christchurch, New Zealand Simple Machines Full time

    Join Simple Machines and be part of our mission to help clients unlock the full potential of their data through the creation of cutting-edge business driven data platforms and software solutions. As we continue to expand our team across Australia and New Zealand, we are seeking Principal / Senior Data Engineers who are unafraid to challenge the status quo...

  • Senior Data Engineer

    2 days ago

    Christchurch, New Zealand Simple Machines Full time

    Simple Machines is looking to hire a talented Senior Data Engineer to join our amazing team. This is a full-time role to be based in Sydney or Christchurch. We need you to help us design and deliver a fantastic program of data focussed engineering projects for our globally distributed client base. **About the role**: You’ll work closely with our...

  • Senior Data Engineer

    4 weeks ago

    Christchurch, New Zealand Crew Technology Recruitment Full time

    The Company:Join a business that's dedicated to making a real difference in Aotearoa New Zealand! They're known for fostering a culture of inclusivity, wellbeing, and personal growth, encouraging employees to be their authentic selves. You'll be working in a modern team, knowing that your contributions have a direct impact on improving insights on projects...

  • Group IT Senior Data Engineer

    4 months ago

    Christchurch, New Zealand Fulton Hogan Full time

    Job Posting End Date September 14, 2024 Job Location Christchurch Job Description - The Fulton Hogan Life_ Life at Fulton Hogan is about making the most of the opportunities, taking responsibility, having a crack, being accountable and making it happen. We live by our REAL values - Respect, Energy & Effort, Attitude, Leadership - and we demonstrate...

  • Senior Software Engineer

    2 weeks ago

    Christchurch, Canterbury, New Zealand Jade Software Corporation Full time

    Experience the best of both worlds with Jade Software Corporation, a global technology leader in complex problem-solving and data-driven solutions. Our Christchurch-based HQ is complemented by offices in Auckland, Dunedin, Sydney, and York, UK.We're passionate about fostering a diverse and inclusive organisation that values our employees' unique...

  • Senior Software Engineer

    4 weeks ago

    Christchurch, New Zealand This Is An IT Support Group Full time

    People First. Dare to be Different. Live for the Future. Our values underpin everything we do. Social Culture: From Lego competitions and Bike week to Hackathons and Community Connect days, our team knows how to have fun. Certified B Corporation: We’re committed to high social and environmental performance. Location: Christchurch, Dunedin, Auckland or...

  • Senior Analyst Developer

    3 months ago

    Christchurch, New Zealand Statistics New Zealand Full time

    **Senior Analyst Developer - Data Engineering|Kaiwhakawhanake Tātari Mātāmua (12-month Fixed Term)** **_ Join an organisation contributing to meaningful outcomes, About Aotearoa, for Aotearoa - data that improves lives today and for generations to come._** - Technical leadership role in a fun, tightknit and collaborative team - Provide expert development...

  • Senior Software Engineer

    1 month ago

    Christchurch, New Zealand Jade Software Corporation Full time

    People First. Dare to be Different. Live for the Future. Our values underpin everything we do. Social Culture; From Lego competitions and Bike week to Hackathons and Community Connect days, our team knows how to have fun. Certified B Corporation: We’re committed to high social and environmental performance. Christchurch, Dunedin, Auckland or Remotely...

  • Senior Software Engineer

    1 month ago

    Christchurch, New Zealand Jade Software Corporation Full time

    People First. Dare to be Different. Live for the Future. Our values underpin everything we do. Social Culture; From Lego competitions and Bike week to Hackathons and Community Connect days, our team knows how to have fun. Certified B Corporation: We're committed to high social and environmental performance. Christchurch, Dunedin, Auckland or Remotely...

  • Senior Software Engineer

    4 weeks ago

    Christchurch, New Zealand This Is An It Support Group Full time

    People First. Dare to be Different. Live for the Future. Our values underpin everything we do.Social Culture: From Lego competitions and Bike week to Hackathons and Community Connect days, our team knows how to have fun.Certified B Corporation: We're committed to high social and environmental performance.Location: Christchurch, Dunedin, Auckland or Remotely...

  • Senior Software Engineer

    4 weeks ago

    Christchurch, New Zealand This is an IT support group Full time

    People First. Dare to be Different. Live for the Future. Our values underpin everything we do. Social Culture: From Lego competitions and Bike week to Hackathons and Community Connect days, our team knows how to have fun. Certified B Corporation: We’re committed to high social and environmental performance. Location: Christchurch, Dunedin, Auckland or...

  • Senior Software Engineer

    1 month ago

    Christchurch, New Zealand Jade Software Corporation Full time

    People First. Dare to be Different. Live for the Future. Our values underpin everything we do. Social Culture; From Lego competitions and Bike week to Hackathons and Community Connect days, our team knows how to have fun. Certified B Corporation: We’re committed to high social and environmental performance. Christchurch, Dunedin, Auckland or Remotely...

  • Senior Software Engineer

    4 weeks ago

    Christchurch, New Zealand This Is An It Support Group Full time

    People First. Dare to be Different. Live for the Future. Our values underpin everything we do.Social Culture: From Lego competitions and Bike week to Hackathons and Community Connect days, our team knows how to have fun.Certified B Corporation: We're committed to high social and environmental performance.Location: Christchurch, Dunedin, Auckland or Remotely...

  • Senior Data Engineer

    2 months ago

    Christchurch, New Zealand SONITEC Full time

    Work with cutting edge technology, making the world a safer and more secure place. Our Client offers an opportunity to solve some of world’s most challenging technical problems in the Electronic Warfare, Artificial Intelligence and Machine Learning, RF sensing, Sensor Fusion and distributed systems. Working with high profile customers across militaries,...

  • Senior Software Engineer

    4 months ago

    Christchurch, New Zealand Jade Software Full time

    **People First. Dare to be Different. Live for the Future **. Our values underpin everything we do. - **Social **Culture; **From Lego competitions and Bike week to Hackathons and Community Connect days, our team knows how to have fun. - **C **ertified B Corporation**:We’re committed to high social and environment performance. - **Christchurch, Dunedin,...

  • Senior Software Engineer

    3 weeks ago

    Christchurch, New Zealand Codematch Full time

    We seek the skill and talent of a Senior Software Engineer with a minimum of 5 years of commercial software engineering experience, to assist in the design and development of top quality applications for a well established, high profile brand based in Christchurch.There is a lot of variety in this role and the business prides itself in the understanding and...

  • Senior Software Engineer

    2 months ago

    Christchurch, New Zealand Jade Software Full time

    **People First. Dare to be Different. Live for the Future **. Our values underpin everything we do. - **Social **Culture; **From Lego competitions and Bike week to Hackathons and Community Connect days, our team knows how to have fun. - **C **ertified B Corporation**:We’re committed to high social and environment performance. - **Christchurch, Dunedin,...

  • Data Engineer

    1 month ago

    Christchurch, New Zealand Appetise Full time

    At Appetise, we're on a mission to revolutionise the way food companies understand their shoppers. Imagine being the first company in the world to track not just what people buy, but why and when they choose certain products. That's what we do. We're pioneering a brand-new approach called Share of Occasion, giving food brands real-time insights into consumer...

  • Senior Software Engineer

    3 weeks ago

    Christchurch, New Zealand CodeMatch Full time

    We seek the skill and talent of a Senior Software Engineer with a minimum of 5 years of commercial software engineering experience, to assist in the design and development of top quality applications for a well established, high profile brand based in Christchurch. There is a lot of variety in this role and the business prides itself in the understanding and...