Data Engineer, Parameta Solutions

• Design, build, and maintain performant batch and streaming data pipelines to support both real-time market data and large-scale batch processing (Apache Airflow, Apache Kafka, Apache Flink).
• Develop scalable data warehousing solutions using Snowflake and other modern platforms.
• Architect and manage cloud-based infrastructure (AWS or GCP) to ensure resilience, scalability, and efficiency.
• Enhance and optimise CI/CD pipelines (Jenkins, GitLab) to streamline development, testing, and deployment.
• Monitor and maintain the health and performance of data applications, pipelines, and databases using observability tools (Prometheus, Grafana, CloudWatch).
• Partner with stakeholders across functions to deliver reliable data services and enable analytical product development.
• Contribute actively in agile ceremonies (stand-ups, sprint planning, retrospectives) to align on priorities and delivery.

This role helps provide clients with access to global financial and commodities markets, improving price discovery, liquidity, and distribution of data through responsible and innovative solutions, though the posting does not explicitly describe positive social or environmental change.

• Demonstrated, professional experience in data engineering or a closely related role.
• Proficiency in Python (with frameworks such as Pandas, Dask, PySpark) and strong SQL skills.
• Experience building and scaling API-driven data platforms (e.g., FastAPI).
• Hands-on experience with AWS, Snowflake, Kubernetes, and Airflow.
• Knowledge of monitoring and alerting systems (Prometheus, Grafana, CloudWatch).
• Strong understanding of ETL processes and event streaming (Kafka, Flink, etc.).
• Comfortable with Linux and command-line operations.
• Excellent communication skills, with the ability to collaborate across technical and business teams.
• Bachelor’s degree in Computer Science, Engineering, Mathematics, or related technical field.

No specific compensation, perks, or culture highlights mentioned in the posting.

TP ICAP Group is a world leading provider of market infrastructure that provides clients with access to global financial and commodities markets, improving price discovery, liquidity, and distribution of data through responsible and innovative solutions. Parameta Solutions is the Data & Analytics division of TP ICAP Group, providing clients with unbiased OTC content and proprietary data, insights across price discovery, risk management, benchmark and indices, and pre and post-trade analytics.