Input Output Logo

Input Output

Data Engineer - Technical Intelligence

Posted 6 Days Ago
Be an Early Applicant
United Kingdom
Mid level
United Kingdom
Mid level
As a Data Engineer on the TechInt team, you will develop and maintain automated data ingestion pipelines, design a cloud-native data warehouse, collaborate with data scientists, and ensure system performance and reliability while simplifying existing data processes.
The summary above was generated by AI

Description

Who are we?

IOHK, is a technology company focused on Blockchain research and development. We are renowned for our scientific approach to blockchain development, emphasizing peer-reviewed research and formal methods to ensure security, scalability, and sustainability. Our projects include decentralized finance (DeFi), governance, and identity management, aiming to advance the capabilities and adoption of blockchain technology globally.

We invest in the unknown, applying our curiosity and desire for positive change to everything we do. By fueling creativity, innovation, and progress within our teams, our products and services are designed for people to be fearless, to be changemakers.

What the role involves:

You will be part of the Technical Intelligence (TechInt) team. The team’s main function is to recon the blockchain industry and feed the company with new trends and projects. The TechInt team has automatized the recon process by utilizing a data lake and machine learning. The team currently harvests data from a variety of different sources. This data gets fed into different systems that then show this data as a report.

You are responsible for maintaining and setting up data solutions and services. A key part would be to aid in the maturation of the data ingestion pipeline and processes. Moreover, you would be expected to create a state-of-the-art data warehouse which would be cloud-native. In your daily job, you do a mix of data engineering, and cloud infrastructure management. 

  • Develop and maintain automated data ingestion (API or crawling) pipelines from source code repositories, social media, and on-chain analytics. 
  • Simplify existing data pipelines - re-architecting where necessary.
  • Research existing datasets to figure out their relevance - and remove irrelevant data pipelines and sources.
  • Design a data warehouse that can be queried by analysts and APIs, and that will serve as a data backend for a reporting web application.
  • Collaborate with data scientists to operationalize ML models and deploy them into production environments.
  • Work closely with leadership to understand and define requirements, ensuring alignment with the department’s strategy and roadmap.
  • Collaborate with a Data Scientist and an Intelligence Engineer to implement technical solutions that meet project goals.
  • Ensure systems are functional, available, and carefully monitored for continuous performance and reliability.
Requirements

Who you are:

  • BSc/MSc in a Computer Science field, or equivalent practical experience. 
  • 4+ years of work experience in data and software engineering : data storage, data manipulation, front-end and back-end development for software applications and data systems.
  • Preferable work experience with blockchain.
  • Professional English.
  • Knowledge of big data processing platforms (such as Spark, Databricks, Google BigQuery), data orchestration (such as Airflow), and data manipulation libraries (such as Pandas, Polars).
  • Knowledge of cloud services management: AWS services (such as Amazon S3, RDS, Redshift, Lambda, Glue, Athena, DynamoDB) or GCP.
  • Knowledge of relational databases (such as PostgreSQL, Oracle, Mssql) and writing highly optimized SQL.
  • Knowledge of docker container orchestration (such as Kubernetes, ECS).
  • Knowledge of Continuous Integration and Continuous Delivery (CI/CD) pipelines (such as GitHub Actions, Travis, Jenkins).
  • Knowledge of Infrastructure as code (such as Terraform, AWS CloudFormation, AWS CDK).
  • Knowledge of blockchain on-chain data representation.
  • Ability to communicate well both verbally and in writing, with both technical and non-technical partners.


Are you an IOGer?

Do you find yourself questioning the status quo? Do you tinker with ideas and long to turn those ideas into solutions? Are you able to spark thoughtful debates, bringing out the inquisitiveness in others? Does the promise of continuously growing excite you? Then get ready to reimagine everything you thought wasn’t possible because that’s what it means to be an IOGer - we don’t set limits, we break them. 

Benefits
  • Remote work
  • Laptop reimbursement
  • New starter package to buy hardware essentials (headphones, monitor, etc)
  • Learning & Development opportunities
  • Competitive PTO 

At IOG, we value diversity and always treat all employees and job applicants based on merit, qualifications, competence, and talent. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Top Skills

Python
SQL

Similar Jobs

Be an Early Applicant
2 Days Ago
Belfast, County Antrim, Northern Ireland, GBR
Hybrid
850 Employees
Senior level
850 Employees
Senior level
Fintech • HR Tech • Payments • Social Impact • Financial Services
As a Data Engineer II, you will build and maintain ETL and data pipelines, support data reporting and analytics dashboards, optimize database performance, and implement data testing and scaling. You will also participate in code approvals for analytics engineering efforts.
Be an Early Applicant
9 Days Ago
London, England, GBR
6,000 Employees
Senior level
6,000 Employees
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Senior Data Engineer at Capco, you will design and develop robust data pipelines, collaborate with clients to interpret requirements, and adhere to best engineering practices. You will work on data transformation projects for leading banks, optimizing data engineering processes, and broadening your skills through exposure to diverse technologies.
Be an Early Applicant
10 Days Ago
Glasgow, City of Glasgow, Scotland, GBR
Hybrid
289,097 Employees
Mid level
289,097 Employees
Mid level
Financial Services
As a Data Engineer III, you will design and deliver data collection and analytics solutions. You will develop, test, and maintain data pipelines, and ensure data protection and model updates based on new use cases. Collaborate with teams to tailor data extraction tools according to business needs.

What you need to know about the Bristol Tech Scene

Along with Gloucester, Swindon and Bath, Bristol is part of the "Silicon Gorge" tech hub, a region in the U.K. renowned for its high-tech and research-driven industries, with a particular emphasis on sustainability and reducing environmental impact. As the European Green Capital, Bristol is home to 25,000 cleantech companies, including Baker Hughes and unicorn Ovo Energy. The city has committed to achieving net-zero emissions within the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account