FxPro Logo

FxPro

Senior Streaming Data Engineer

Posted 19 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in Greece
Senior level
Remote
Hiring Remotely in Greece
Senior level
Design, build, and operate on-prem streaming ingestion and ETL/ELT pipelines on Linux VMs. Maintain Kafka-based ingestion, Redis caching, and analytical storage (ClickHouse). Ensure reliable relational DB ingestion, monitoring, security, and collaborate with BI, Analytics, and Data Science teams to deliver production-grade datasets.
The summary above was generated by AI

Join FxPro: a leading international fintech company. Be a part of our expanding international team, with offices in Limassol, London, Nassau, and Dubai. FxPro boasts a diverse workforce of over 500 employees representing 40 nationalities, making it an exciting and dynamic workplace. At FxPro, we see each team member as an integral part of our success story.

As a Senior Streaming Data Engineer, you will be responsible for building, operating, and scaling our on-premise data platform running on Linux virtual machines. You will also enable streaming data ingestion from multiple sources and ensure reliable, production-grade data availability for analytics and machine learning use cases.

Responsibilities

  • Build and operate streaming ingestion pipelines from multiple sources into on-premise systems and databases hosted on Linux VMs
  • Design, implement, and optimize end-to-end ETL/ELT pipelines
  • Implement and maintain Kafka-based ingestion patterns, including topics, partitions, consumer groups, and reliability strategies
  • Use Redis where appropriate for caching, buffering, and real-time processing patterns
  • Maintain and optimize analytical storage solutions (e.g., ClickHouse or similar) used for BI and analytics workloads
  • Ensure reliable data ingestion from relational databases (PostgreSQL, MS SQL)
  • Implement monitoring, logging, alerting, and operational runbooks for pipelines and data systems
  • Ensure secure access and auditability across services and databases
  • Collaborate with BI, Analytics, and Data Science teams to deliver reliable datasets

Requirements

  • Strong Linux administration skills, including troubleshooting and production operations
  • Strong Python skills for building production-grade data services, automation, and testing
  • Strong SQL skills (PostgreSQL and/or MS SQL), including performance tuning
  • Hands-on experience building and operating ETL/ELT pipelines in production environments
  • Hands-on experience with Kafka and streaming data systems in production environments
  • Good understanding of core data engineering concepts such as  data quality, schema evolution, partitioning, and idempotency
  • Experience working with analytical databases such as ClickHouse or similar technologies

Nice to have

  • Experience with CDC tooling or patterns (e.g., Debezium or equivalent approaches)
  • Familiarity with observability tools such as Prometheus, Grafana, ELK, or OpenSearch
  • Experience working in security-constrained production environments 

Interview steps

  1. Recruiter screen (30 minutes) 
  2. Technical Interview (1 hour)
  3. Final Interview with manager (30 minutes) 

Our benefits

  • Excellent compensation package
  • Medical insurance
  • Provident fund
  • In-house gym with a personal trainer
  • Free daily lunch catering, snacks, and beverages
  • Company discount card for various products & services
  • 21 days of annual leave and 10 days of sick leave annually
  • Shuttle bus service from Limassol
  • Birthday gift
  • Relocation bonus and visa/work permit support

Top Skills

Linux,Python,Postgresql,Ms Sql,Kafka,Redis,Clickhouse,Debezium,Prometheus,Grafana,Elk,Opensearch

Similar Jobs

Internship
Cloud • Software
Conduct hands-on research on BGP using large-scale routing data. Apply statistics, data science, and AI/ML to characterize routing behavior, prototype algorithms, and produce research outputs and reports that can influence products and operator practices.
Top Skills: Ai/MlBgpData ScienceDnsHTTPMrtNumpyPandasPythonRoute CollectorsRouting TablesRouting UpdatesScikit-LearnTcp/Ip
Mid level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
The role involves managing risk assessments and compliance activities, including documentation and administrative functions related to governance, risk, and compliance in technology assurance.
Top Skills: ArcherGrc Tools
3 Days Ago
In-Office or Remote
8 Locations
Mid level
Mid level
Machine Learning • Natural Language Processing
The Hebrew Linguist manages translation quality and processes, coordinates linguists, performs edits, and ensures client satisfaction while meeting project deadlines.
Top Skills: Cat ToolsJIRAOffice ApplicationsSdl StudioWindowsXtm

What you need to know about the Bristol Tech Scene

Along with Gloucester, Swindon and Bath, Bristol is part of the "Silicon Gorge" tech hub, a region in the U.K. renowned for its high-tech and research-driven industries, with a particular emphasis on sustainability and reducing environmental impact. As the European Green Capital, Bristol is home to 25,000 cleantech companies, including Baker Hughes and unicorn Ovo Energy. The city has committed to achieving net-zero emissions within the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account