Middle Data Engineer

International consulting firm seeking a Middle Data Engineer to design and maintain scalable data pipelines on Google Cloud Platform. The role focuses on supporting trading, risk, and analytics teams with real-time and batch data solutions while ensuring regulatory compliance.

• Design, build, and maintain scalable data pipelines primarily within Google Cloud Platform
• Develop integration and transformation workflows between cloud data services and on-prem Oracle databases
• Work closely with trading, risk, and analytics teams to understand data requirements and deliver real-time and batch data solutions
• Optimise and monitor performance of data systems to support latency-sensitive trading applications
• Collaborate with cross-functional teams using Agile/Scrum methodologies to deliver business-critical data projects
• Ensure robust data governance, lineage, and compliance including MiFID II, FCA, and other regulatory standards
• Automate data workflows using Terraform, CI/CD pipelines, and containerisation tools (Docker/Kubernetes)

• Strong experience with Google Cloud Platform (GCP) including BigQuery, DataPlex, DBT, Pub/Sub, Dataflow, S3, Glue, Redshift
• Expertise in Oracle SQL, PL/SQL, and working with complex stored procedures and large datasets
• Proficiency in programming languages such as Python, Java, or Scala
• Experience with streaming and messaging systems (e.g. Jenkins, GitLab), and container orchestration (Kubernetes)
• Experience working with Infrastructure as Code, preferably Terraform, to manage cloud data infrastructure
• Deep understanding of data modelling, data warehousing, and ETL/ELT design patterns
• Familiarity with Agile development practices (Scrum, Kanban, Jira)
• Exposure to financial markets, trading systems, or related high-performance environments is a strong plus
• Nice to have: GCP certification, AWS experience, knowledge of regulatory reporting, Apache Airflow, data security practices and compliance frameworks

Financial services environment with focus on high-performance trading systems. Collaborative team setting using Agile/Scrum methodologies. Business-critical projects requiring strong attention to regulatory compliance and data governance.