Skip to main content

Senior Data Engineer

Senior Data Engineer
Westbury Partners
8 months 2 weeks ago

Job Description

  • Design, Implement, Optimize Data Infrastructure, Architect Data Strategy.
  • Key skills: Python, SQL, ETL, DWH, Cloud, AWS, Data Pipelines.
  • Positive environment & culture. Career path to Tech Lead, to Management.

Company

Our client is a successful, global trading firm operating in markets across Asia, Europe, and North America, offering excellent technology solutions along with access to the best pricing providers available in the market. The firm offers the ability to trade Forex, CFD, Commodities either manually or automated. They are about to initiate a series of technology project initiatives and require several, senior technologists across multiple tech verticals to drive these projects to fruition.

Role

As the Senior Data Engineer, you will be responsible for designing and implementing the firm’s data infrastructure. You will be instrumental in crafting data strategy, ensuring the integrity of said data, with an emphasis on reliability and performance optimization. A key element of this role is to assess the current environment and then generate a plan and roadmap to improve the stability, reliability and performance of the firm’s hosted, business-critical applications and services. There is a clear career path to ‘Tech Lead’ in the short to mid-term, and a longer term path to a ‘Head of’ position for the motivated, capable and ambitious engineers out there.

Requirements

  • 5 – 8yrs Data Engineering & Architecture experience, expertise with Python & SQL.
  • Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, MSSQL).
  • Strong understanding of data architecture principles, data modelling techniques, and database design concepts.
  • Experience with data warehousing technologies (e.g., Snowflake, Amazon Redshift, Google BigQuery).
  • Familiarity with data integration tools and ETL processes (e.g., Apache NiFi, Talend, Informatica).
  • Knowledge of cloud platforms (e.g., AWS, Azure, Google Cloud Platform) and hands-on experience with cloud-based data solutions.
  • Project management skills and the ability to prioritize and manage multiple tasks effectively.
  • Ability to establish / mature Data Engineering ‘best practice’.
  • Polished Communication and Interpersonal skills along with a can-do attitude.
  • Bachelor’s or master’s level degree in computer science, mathematics, or relevant field.
  • A history of good tenure in your career history (e.g., 2+ years average).
  • Ideal industry experience: betting, banking, payments, financial markets / trading.

This role would be ideal for a senior data engineer with Python & SQL expertise in a high-volume transactional environment e.g. betting, banking, payments, financial markets / trading. Someone with ‘project lead’ experience and/or on the cusp of moving to a tech lead position.

#Data Engineering #Python #SQL #DWH #ETL #Cloud #Amazon Web Services #AWS #Optimisation #Performance #Stability #Reliability #Betting #Banking #Trading #Payments

Expertise level

Work arrangement

Key skills

Similar Jobs in Australia

Similar Jobs in New South Wales

Similar Jobs in Sydney