Kainos Logo

Kainos

Senior Data Engineer

Reposted 2 Months Ago
In-Office or Remote
Hiring Remotely in UK
Senior level
In-Office or Remote
Hiring Remotely in UK
Senior level
As a Senior Data Engineer, you will design and develop large-scale data processing software, manage technical components, and mentor team members, while ensuring code quality and operational readiness.
The summary above was generated by AI
Join Kainos and Shape the Future 

At Kainos, we’re problem solvers, innovators, and collaborators - driven by a shared mission to create real impact. Whether we’re transforming digital services for millions, delivering cutting-edge Workday solutions, or pushing the boundaries of technology, we do it together.

We believe in a people-first culture, where your ideas are valued, your growth is supported, and your contributions truly make a difference. Here, you’ll be part of a diverse, ambitious team that celebrates creativity and collaboration.

Ready to make your mark? Join us and be part of something bigger.

MAIN PURPOSE OF THE ROLE & RESPONSIBILITIES IN THE BUSINESS:

As a Senior Data Engineer (Senior Associate) at Kainos, you will be responsible or designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems . You will work within a multi-skilled agile team to design and develop large-scale data processing software to meet user needs in demanding production environments.

Your responsibilities will include:

  • Working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test and defect resolution.

  • Working with Architects and Lead Engineers to ensure the software supports non-functional needs.

  • Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality.

  • Working with operations teams to ensure operational readiness

  • Advising customers and managers on the estimated effort and technical implications of user stories and user journeys.

  • Coaching and mentoring team members.

MINIMUM (ESSENTIAL) REQUIREMENTS:

  • Strong software development experience in one of Java, Scala, or Python

  • Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks.

  • Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment 

  • Proficient in SQL and SQL extensions for analytical queries

  • Solid understanding of ETL/ELT data processing pipelines and design patterns

  • Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats

  • Able to write quality, testable code and has experience of automated testing

  • Experience with Continuous Integration and Continuous Deployment techniques

  • A Keen interest in AI Technologies

DESIRABLE REQUIREMENTS:

  • Experience of performance tuning

  • Experience of data visualisation and complex data transformations

  • Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products

  • Expertise in continuous improvement and sharing input on data best practice

  • Practical experience with AI technologies, tools, processes and delivery

Embracing our differences   

At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive.   We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are.   We also believe every candidate deserves a level playing field. 

Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out. 

We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.


Similar Jobs

2 Days Ago
Remote
United Kingdom
Senior level
Senior level
Professional Services • Consulting
Own production Python data pipelines, ETL/ELT workflows, and the ontology powering an AI platform. Integrate warehouses and business applications with graph databases and vector stores, while managing deployment tooling, cloud infrastructure, monitoring, and security. The role begins as hands-on individual contribution and develops toward technical leadership through mentoring and architecture ownership.
Top Skills: Ai/MlCi/CdCloud InfrastructureCloud SecurityData WarehousesEtl/EltGCPGraph DatabasesInfrastructure As CodeMonitoringPythonVector Stores
3 Days Ago
Remote
United Kingdom
Senior level
Senior level
Software • Consulting
Design, develop, and support cloud-based data solutions across AWS and Azure. Build ETL/ELT pipelines, data integrations, migration processes, warehouses, lakes, and lakehouses. Perform data profiling, quality assessments, validation, reconciliation, troubleshooting, and root-cause analysis. Collaborate with technical and business stakeholders while supporting governance, security, compliance, and technical documentation.
Top Skills: Amazon AthenaAmazon QuicksightAmazon RedshiftAmazon S3AWSAws GlueAws LambdaAws Step FunctionsAzure Data FactoryAzure Data Lake StorageAzure SqlAzure Synapse AnalyticsEltETLAzureMicrosoft FabricMicrosoft Sql ServerMySQLOraclePostgresSQL
8 Days Ago
Remote
England, GBR
Senior level
Senior level
eCommerce • Information Technology
Build and maintain Python data ingestion pipelines for Reach’s AWS data lake, integrating APIs, S3, and SFTP sources. Design and operate AWS infrastructure, implement Infrastructure as Code and observability, and work with Athena, Glue, Lambda, ECS, and Redshift. Collaborate with analysts, product managers, and business teams, while documenting solutions, enforcing unit testing, and improving data quality and reliability.
Top Skills: Amazon EcsAmazon RedshiftAmazon S3Apache IcebergApache ParquetAPIsAws AthenaAws GlueAws LambdaAws WranglerData Pipeline ObservabilityInfrastructure As CodePandasPythonSftpSQLUnit Testing

What you need to know about the Bristol Tech Scene

Along with Gloucester, Swindon and Bath, Bristol is part of the "Silicon Gorge" tech hub, a region in the U.K. renowned for its high-tech and research-driven industries, with a particular emphasis on sustainability and reducing environmental impact. As the European Green Capital, Bristol is home to 25,000 cleantech companies, including Baker Hughes and unicorn Ovo Energy. The city has committed to achieving net-zero emissions within the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account