Bits In Glass Logo

Bits In Glass

Senior Data Platform Engineer

Posted 11 Days Ago
Be an Early Applicant
Hybrid
London, Greater London, England
Senior level
Hybrid
London, Greater London, England
Senior level
Designs, builds, and operates secure, scalable GCP data platforms for financial-sector clients. Develops batch and streaming pipelines, architects data lake and warehouse solutions, manages infrastructure through Terraform and CI/CD, and implements governance, security, monitoring, and data quality practices. Collaborates with stakeholders, communicates architecture decisions, mentors engineers, and promotes DataOps and engineering standards.
The summary above was generated by AI

Bits In Glass (BIG) operates as a rapidly expanding AI and automation consultancy, maintaining presence throughout Canada, the United States, India, and Great Britain. The firm's technical scope encompasses over ten primary platforms across artificial intelligence, cloud infrastructure, data management, automation solutions, and enterprise software.


Honoured internationally as a Great Place to Work and recipient of various partner achievement awards, BIG emphasizes team collaboration, technological innovation, and tangible client outcomes. Our staff consists of skilled engineering professionals dedicated to tackling difficult technical problems, driving joint success, and guiding enterprise organizations through digital transformation with certainty.


Bits In Glass UK is seeking a Senior Data Platform Engineer to design, build and operate secure, scalable data platforms on Google Cloud for financial sector clients. Working closely with client teams, architects and internal stakeholders, you will deliver batch and streaming pipelines, modern data warehouse and lakehouse solutions, and robust governance and security controls using infrastructure-as-code and DataOps practices.

This opportunity suits an experienced GCP data engineer with a strong security mindset, who enjoys solving complex data challenges, mentoring others, and communicating clearly with both technical and non-technical audiences.

Roles and Responsibilities

  • Design, build, and maintain scalable data platforms on Google Cloud Platform for financial sector clients.
  • Develop and optimize batch and streaming data pipelines using services such as Dataflow, Dataproc, Pub/Sub, and Cloud Composer.
  • Architect data lake, data warehouse, and lakehouse solutions, including data modeling and performance tuning in BigQuery.
  • Provision and manage data infrastructure using Terraform and CI/CD pipelines.
  • Implement data governance, lineage, quality, and cataloging frameworks to meet regulatory and client requirements.
  • Apply security best practices across data environments, including IAM, encryption, KMS, data masking, and access controls.
  • Monitor, troubleshoot, and resolve platform performance, reliability, and data quality issues.
  • Collaborate with client teams, architects, and internal stakeholders to translate business needs into technical solutions.
  • Mentor engineers, contribute to technical standards, and promote DataOps and engineering best practices across the team.
  • Communicate architecture decisions, progress, and analysis clearly to technical and non-technical audiences.

Required Skills

  • 7+ years of experience in data engineering or data platform engineering, with at least 3 years in a senior or lead capacity.
  • Strong hands-on experience building and operating data platforms on GCP.
  • Working experience with GCP data services such as BigQuery, Dataflow, Dataproc, Cloud Composer (Airflow), Pub/Sub, Cloud Storage, Bigtable, and Cloud SQL.
  • Proficiency in Python and SQL, with experience in Spark or Apache Beam.
  • Experience designing data warehouse and data lake architectures, including data modeling.
  • Working experience with Terraform and CI/CD tooling such as Jenkins, GitHub, or Cloud Build.
  • Strong understanding of data security in regulated environments.
  • Strong knowledge of DevOps/DataOps and Agile delivery practices.
  • Excellent written and verbal communication skills.
  • Strong analytical, debugging, and problem-solving skills.

Nice to Have

  • GCP Professional Data Engineer or Professional Cloud Architect certification.
  • Experience in banking, insurance, or other regulated financial services environments.
  • Experience with data governance and quality tools such as Dataplex, Data Catalog, dbt, or Great Expectations.
  • Experience with containerization and orchestration (Docker, Kubernetes/GKE).
  • Exposure to other data platforms such as Snowflake, Databricks, or Kafka.
  • Experience supporting AI/ML workloads or Vertex AI pipelines.

Bits In Glass (BIG) operates as a rapidly expanding AI and automation consultancy, maintaining presence throughout Canada, the United States, India, and Great Britain. The firm's technical scope encompasses over ten primary platforms across artificial intelligence, cloud infrastructure, data management, automation solutions, and enterprise software. Our staff consists of skilled engineering professionals dedicated to tackling difficult technical problems, driving joint success, and guiding enterprise organizations through digital transformation with certainty.

Similar Jobs

17 Days Ago
In-Office
Senior level
Senior level
Fintech • Payments • Financial Services
Design and maintain scalable data platform infrastructure, ingestion pipelines, ETL/ELT workflows, data models, governance, reliability, and observability. Collaborate with analytics and engineering teams, support data warehouse architecture, participate in on-call incident response, document operational processes, and establish strong engineering practices for analytics and future AI capabilities.
Top Skills: AirbyteAirflowApache IcebergCi/CdDbtDltDockerFlinkGitJavaKafkaKafka ConnectKubernetesPythonSnowflakeSQLTerraform
11 Days Ago
In-Office
Senior level
Senior level
Professional Services • Real Estate • Financial Services
Build and operate a production Azure data and AI platform. Responsibilities include Azure landing zones, network architecture, identity, governance, monitoring, Databricks and Unity Catalog administration, data integrations, MLOps pipelines, model deployment, CI/CD, infrastructure as code, security scanning, self-service tooling, documentation, and on-call support. The role requires hands-on Terraform, Azure, Databricks, containerization, observability, and Python or PowerShell experience.
Top Skills: Adls Gen2SparkApi ManagementApplication GatewayApplication InsightsAzure Cognitive ServicesAzure DatabricksAzure DevopsAzure Front DoorAzure Hub-Spoke NetworkingAzure Kubernetes Service (Aks)Azure Landing ZonesAzure Management GroupsAzure MlAzure MonitorAzure OpenaiAzure PolicyAzure SqlAzure SynapseBicepCi/CdDastDelta LakeDependency ScanningDockerFinopsGithub ActionsInfrastructure ScanningKubernetesLog AnalyticsAzureMicrosoft Entra IdMicrosoft PurviewMlflowPowershellPythonRbacSastSecrets ManagementTerraformUnity Catalog
11 Days Ago
In-Office
Senior level
Senior level
Insurance
Build and operate an Azure-based data and AI platform through hands-on infrastructure engineering. Responsibilities include designing Azure landing zones and networks, managing governance and identity, deploying Databricks and data services, building MLOps pipelines, implementing DevSecOps practices, creating self-service tooling, and supporting platform incidents. The role requires Terraform, Azure, Databricks, CI/CD, containerization, security, observability, and Python or PowerShell expertise.
Top Skills: Adls Gen2SparkApplication InsightsAzure Api ManagementAzure Application GatewayAzure Cognitive ServicesAzure DatabricksAzure DevopsAzure Front DoorAzure Kubernetes Service (Aks)Azure Machine LearningAzure MonitorAzure OpenaiAzure PolicyAzure RbacAzure SqlAzure SynapseBicepDastDelta LakeDockerGithub ActionsKubernetesLog AnalyticsAzureMicrosoft Entra IdMicrosoft PurviewMlflowPowershellPythonSastTerraformUnity Catalog

What you need to know about the Bristol Tech Scene

Along with Gloucester, Swindon and Bath, Bristol is part of the "Silicon Gorge" tech hub, a region in the U.K. renowned for its high-tech and research-driven industries, with a particular emphasis on sustainability and reducing environmental impact. As the European Green Capital, Bristol is home to 25,000 cleantech companies, including Baker Hughes and unicorn Ovo Energy. The city has committed to achieving net-zero emissions within the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account