Photon Logo

Photon

Data Engineer | London, UK

Reposted 3 Months Ago
Remote
Hiring Remotely in United Kingdom
Mid level
Remote
Hiring Remotely in United Kingdom
Mid level
Support ledger migration and data lake cleanup by extracting, transforming, reconciling and validating large datasets. Develop and validate SQL queries, batch jobs and processing logic, perform regression testing, document mappings and validation rules, and collaborate with engineering, product and business teams to ensure production readiness and post-migration validation.
The summary above was generated by AI

Role Summary 

We are looking for experienced Data Engineers / Data Analysts to support a ledger migration and data clean-up initiative across the data lake, reporting and downstream feeds. The role will involve working on large-scale batch processing, data validation, regression testing and migration readiness activities within a financial services environment. 

Key Responsibilities 

  • Support ledger migration activities, including data extraction, transformation, reconciliation and validation. 

  • Work on data lake clean-up, data quality checks, reporting pipelines and downstream feeds. 

  • Develop, enhance and validate SQL queries, batch jobs and data processing logic. 

  • Perform regression testing on batch processes to ensure data accuracy and completeness before and after migration. 

  • Collaborate with engineering, product and business teams to understand migration requirements and resolve data issues. 

  • Document data mapping, validation rules, test results and migration exceptions clearly. 

  • Support production readiness, defect triage and post-migration validation activities. 

Required Skills and Experience 

  • Strong hands-on experience with SQL and data analysis across large datasets. 

  • Experience with batch processing, batch regression testing and data reconciliation. 

  • Working knowledge of Spark or similar distributed data processing technologies. 

  • Experience working with data lakes, reporting platforms, feeds and data migration programmes. 

  • Ability to identify data inconsistencies, investigate root causes and support remediation. 

  • Strong understanding of data quality, controls, validation and auditability in enterprise environments. 

  • Good communication skills with the ability to work across engineering, business and product stakeholders. 

Preferred Experience 

  • Prior experience in financial services, banking, ledger systems or regulatory data environments. 

  • Experience supporting enterprise-scale migration, modernisation or platform transformation programmes. 

  • Exposure to reporting, dashboards, data views and operational data feeds. 

  • Ability to work in distributed teams across London, Bangalore and Singapore. 

Similar Jobs

5 Hours Ago
Remote or Hybrid
United Kingdom
Mid level
Mid level
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Supports the enterprise data governance program by developing policies, enabling data ownership and stewardship, governing metadata and data quality, coordinating compliance activities, facilitating stakeholder engagement, tracking governance initiatives, and reporting KPIs. The role promotes adoption of data catalogs, business glossaries, data standards, privacy requirements, retention controls, and governance best practices across business and technology teams.
Top Skills: AlationCollibraInformatica CdgcInformatica Data CatalogMicrosoft PurviewSQL
13 Hours Ago
Easy Apply
Remote or Hybrid
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Leads hands-on software engineering for Samsara’s telematics products, guiding ambiguous initiatives from customer discovery through production and scale. Responsibilities include writing critical-path code, setting technical direction, making architecture decisions, ensuring reliability and performance, and mentoring engineers. The role partners closely with customers, Product, Design, and other engineering teams to build and grow customer-facing products, while hiring and developing an inclusive, high-performing team.
Top Skills: APIsIot
Yesterday
Remote or Hybrid
United Kingdom
Entry level
Entry level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Supports Pfizer CentreOne’s inside sales and marketing activities by reviewing and routing marketing-qualified leads, executing outreach sequences, documenting activity in Salesforce, and assisting with campaigns, content, meetings, reporting, and marketing projects. The role develops commercial expertise across marketing, inside sales, and business development while progressing leads toward initial meetings and BD handoff.
Top Skills: HubspotExcelMicrosoft OutlookMicrosoft PowerpointMicrosoft SharepointMicrosoft TeamsMicrosoft WordSalesforce

What you need to know about the Bristol Tech Scene

Along with Gloucester, Swindon and Bath, Bristol is part of the "Silicon Gorge" tech hub, a region in the U.K. renowned for its high-tech and research-driven industries, with a particular emphasis on sustainability and reducing environmental impact. As the European Green Capital, Bristol is home to 25,000 cleantech companies, including Baker Hughes and unicorn Ovo Energy. The city has committed to achieving net-zero emissions within the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account