Senior Data Platforms Engineer

2 weeks ago

Christchurch, New Zealand Simple Machines Full time

**Position: Senior Data Platforms Engineer**
**Location: Christchurch, New Zealand**
**Travel: Potential travel within the ANZ region on occasion**
**Simple Machines. Data Engineered to Life**

Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and governments better connect with and understand their organisations, their people, their customers, and citizens. We are a team of creative engineers and technologists dedicated to unleashing the potential of data in new and impactful ways. We design and build bespoke data platforms and unique software products, create and deploy intelligent systems, and bring engineering expertise to life by transforming data into actionable insights and tangible outcomes. We engineer data to life.

**The Role**:
The Senior Data Platforms Engineer at Simple Machines is a dynamic, hands-on role focused on building real-time data pipelines and implementing data mesh architectures to enhance client data interactions. This position blends deep technical expertise in modern data engineering methods with a client-facing consulting approach, enabling clients to effectively manage and utilize their data. Within a team of top-tier engineers, the role involves developing greenfield data solutions that deliver tangible business outcomes across various environments.

**Requirements**:
**Technical Responsibilities**
- **Developing Data Solutions**: Implement and enhance data-driven solutions integrating with clients' systems using state-of-the-art tools such as Databricks, Snowflake, Google Cloud, and AWS. Embrace modern data architecture philosophies including data products, data contracts, and data mesh to ensure a decentralized and consumer-oriented approach to data management.
- **Data Pipeline Development**: Develop and optimise high-performance, batch and real-time data pipelines employing advanced streaming technologies like Kafka, and Flink. Utilise workflow orchestration tools such as Dataflow and Airflow.
- **Database and Storage Optimization**: Optimize and manage a broad array of database technologies, from traditional relational databases (e.g., PostgreSQL, MySQL) to modern NoSQL solutions (e.g., MongoDB, Cassandra). Focus on strategies that enhance data accessibility, integrity, and performance.
- **Big Data Processing & Analytics**: Utilise big data frameworks such as Apache Spark and Apache Flink to address challenges associated with large-scale data processing and analysis. These technologies are crucial for managing vast datasets and performing complex data transformations and aggregations.
- **Cloud Data Management**: Implement and oversee cloud-specific data services including AWS Redshift, S3, Google BigQuery, and Google Cloud Storage. Leverage cloud architectures to improve data sharing and interoperability across different business units.
- **Security and Compliance**: Ensure all data practices comply with security policies and regulations, embedding security by design in the data infrastructure. Incorporate tools and methodologies recommended for data security and compliance, ensuring robust protection and governance of data assets.

**Consulting Responsibilities**
- **Client Advisory**: Provide expert advice to clients on optimal data practices that align with their business requirements and project goals.
- **Training and Empowerment**: Educate client teams on the latest technologies and data management strategies, enabling them to efficiently utilise and maintain the solutions we have developed.
- **Professional Development**: Keep up with the latest industry trends and technological advancements, continually upgrading skills and achieving certifications in the technologies Simple Machines implements across its client base.

**Ideal Skills and Experience**
- **Core Data Engineering Tools & Technologies**: Demonstrates proficiency in SQL and Spark, and familiarity with platforms such as Databricks and Snowflake. Well-versed in various storage technologies including AWS S3, Google Cloud BigQuery, Cassandra, MongoDB, Neo4J, and HDFS. Adept in pipeline orchestration tools like AWS Glue, Apache Airflow, and dbt, as well as streaming technologies like Kafka, AWS Kinesis, Google Cloud Pub/Sub, and Azure Event Hubs.
- **Data Storage Expertise**: Knowledgeable in data warehousing technologies like BigQuery, Snowflake, and Databricks, proficient in managing various data storage formats including Parquet, Delta, ORC, Avro, and JSON to optimise data storage and retrieval.
- **Data Modelling Expertise**: Proficient in data modelling, understanding the implications and trade-offs of various methodologies and approaches.
- **Infrastructure Configuration for Data Systems**: Compete

  • Senior Data Platforms Engineer

    2 weeks ago

    Christchurch, Canterbury, New Zealand Simple Machines Full time

    Position: Senior Data Platforms EngineerLocation: Christchurch, New ZealandTravel: Potential travel within the ANZ region on occasionSimple Machines. Data Engineered to LifeSimple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating...

  • Principal / Senior Data Engineers - Data Driven

    2 months ago

    Christchurch, New Zealand Simple Machines Full time

    Join Simple Machines and be part of our mission to help clients unlock the full potential of their data through the creation of cutting-edge business driven data platforms and software solutions. As we continue to expand our team across Australia and New Zealand, we are seeking Principal / Senior Data Engineers who are unafraid to challenge the status quo...

  • Senior Data Engineer

    1 week ago

    Christchurch, New Zealand Fulton Hogan Full time

    Job Posting End Date July 9, 2024 Job Location Christchurch **Job Description**: - The Fulton Hogan Life_ Life at Fulton Hogan is about making the most of the opportunities, taking responsibility, having a crack, being accountable and making it happen. We live by our REAL values - Respect, Energy & Effort, Attitude, Leadership - and we demonstrate...

  • Senior Data Engineer

    3 weeks ago

    Christchurch, New Zealand Simple Machines Full time

    There is nothing ordinary about Simple Machines. We have a team of inspiring technical leaders in Data Engineering, Machine Learning, and Artificial Intelligence. We focus on data-driven projects that drive impactful business results. We create cutting-edge business-driven data platforms and software solutions to help our clients unleash the full potential...

  • Senior Software Engineer

    2 months ago

    Christchurch, New Zealand Seequent Full time

    **The Company** A better understanding of the Earth creates a better world for all. Seequent brings together industry-leading earth modelling, geo-data management, and team collaboration software. Because when everyone can see the full picture, they can make better decisions that benefit people and the planet. Every day, our customers in over 100...

  • Senior Software Engineer

    1 day ago

    Christchurch, New Zealand Seequent Full time

    **The Company** A better understanding of the Earth creates a better world for all. Seequent brings together industry-leading earth modelling, geo-data management, and team collaboration software. Because when everyone can see the full picture, they can make better decisions that benefit people and the planet. Every day, our customers in over 100...

  • Solutions Architect

    2 months ago

    Christchurch, New Zealand Simple Machines Full time

    Simple Machines is looking to hire a talented Solutions Architect to join our amazing team. This is a full-time role to be based in Christchurch office. Sound good so far? **Requirements**: **About You** You will be the interface between product owners, managers, and implementation team to support the design and delivery of compelling market leading...

  • Software Engineer

    3 weeks ago

    Christchurch, New Zealand Canonical - Jobs Full time

    Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops a full range of data stores and data technologies, spanning from big data, through NoSQL, cache-layer capabilities, and analytics; all the way to structured SQL...

  • Data Engineering Manager

    3 weeks ago

    Christchurch, New Zealand Fulton Hogan Full time

    Job Posting End Date February 18, 2024 Job Location Christchurch **Job Description**: - We're all about Good Work_ You've probably seen us around - on the roads, building sites, and in cities, towns, and locations all over New Zealand. We build and maintain infrastructure that improves the quality of life across New Zealand and Australia. Everything,...

  • Platform Engineer

    2 weeks ago

    Christchurch, Canterbury, New Zealand Sourced Full time

    Significant career opportunity with South Island wide focus Senior role, large enterprise setting Get involved early in a large cloud transformation programme Significant career opportunity with South Island wide focus Senior role, large enterprise setting Get involved early in a large cloud transformation programmeOur client plays a vital role in the lives...

  • Data Engineer- Nz

    4 weeks ago

    Christchurch, New Zealand IAG New Zealand Full time

    **We value impact.** As a Data Engineer you can make their world a safer place. Join the largest insurance group in Australia and New Zealand. We’re here for you. Are you ready? **THE ROLE** As a Data Engineer you’ll grow the presence of the Cloud Data Platforms team in New Zealand. You won’t be alone as this role sits within one of our largest...

  • Software Engineer

    4 weeks ago

    Christchurch, New Zealand MenuAid Full time

    MenuAid exists to improve the world of food. We provide FMCG brands with game-changing behavioural insights that show WHY & HOW their products are used in the real world. We do this by leveraging the data captured from our shoppable recipe platform, which is the preferred way to grocery plan and shop for 40,000+ Kiwis & Aussies. But don’t take our word...

  • Software Engineer

    1 day ago

    Christchurch, New Zealand MenuAid Full time

    MenuAid exists to improve the world of food. We provide FMCG brands with game-changing behavioural insights that show WHY & HOW their products are used in the real world. We do this by leveraging the data captured from our shoppable recipe platform, which is the preferred way to grocery plan and shop for 40,000+ Kiwis & Aussies. But don’t take our word...

  • Data Engineering Manager

    2 weeks ago

    Christchurch, Canterbury, New Zealand Fulton Hogan Full time

    Job Posting End DateFebruary 18, 2024Job LocationChristchurchJob Description: We're all about Good Work_You've probably seen us around - on the roads, building sites, and in cities, towns, and locations all over New Zealand.We build and maintain infrastructure that improves the quality of life across New Zealand and Australia. Everything, from roads and...

  • Platform Engineer

    3 weeks ago

    Christchurch, New Zealand Sourced Full time

    Significant career opportunity with South Island wide focus - Senior role, large enterprise setting - Get involved early in a large cloud transformation programme - Significant career opportunity with South Island wide focus - Senior role, large enterprise setting - Get involved early in a large cloud transformation programme Our client plays a vital role...

  • Technical Ba

    2 months ago

    Christchurch, New Zealand Simple Machines Full time

    Simple Machines is looking to hire a talented Technical Business Analyst - Data Platforms to join our Christchurch team. This is a full-time hybrid role to be based in our Christchurch offices. We need you to help us design and deliver a fantastic program of data focused engineering projects for our globally distributed client base. **About the Role** We...

  • Azure Cloud Architect

    4 weeks ago

    Christchurch, New Zealand Theta Full time

    We are a highly regarded, New Zealand owned technology company where you will be surrounded by innovative, brilliant minds and thought leaders. We offer a creative and stimulating work environment and we value and respect inclusivity and diversity. Our team is a true melting pot of over 30 nationalities and our people are our greatest asset. About this role...

  • Development Platform Engineer

    2 weeks ago

    Christchurch, Canterbury, New Zealand Seequent Limited Full time

    Seequent builds world-leading subsurface software, helping create a better understanding of the underground to ensure a better world for all. We are constantly evolving at the forefront of technology to transform how geoscientists work, eliminating barriers to understanding the earth's challenges by connecting teams with the answers they need. Every day,...

  • Software Engineer

    3 weeks ago

    Christchurch, New Zealand Canonical - Jobs Full time

    Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops a full range of data stores and data technologies, spanning from big data, through NoSQL, cache-layer capabilities, and analytics; all the way to structured SQL...

  • Senior Systems Engineer

    4 weeks ago

    Christchurch, New Zealand CodeMatch Full time

    **Join Our Team as a Senior Systems Engineer!** Are you ready to take on a dynamic role where you'll spearhead cutting-edge solutions and propel our client's infrastructure into the future? If so, we have the perfect opportunity for you! **About the Role**: As a Senior Systems Engineer, you'll be at the forefront of managing and enhancing our client's...