Senior Kafka Engineer

Industry - Other
Level - Senior
  • Apache Kafka
  • Docker
  • Azure
Employment - Full time
Work Model - Hybrid

Client - STARK

Our vision is to be the most trusted business-to-business distributor of heavy materials in Northern Europe. We take responsibility for the entire value chain in our industry by providing the best terms possible for our customers and suppliers.

Highlights

At STARK we have embarked on a digital journey and with own established development teams and involving our entire value chain from sourcing to sales and every IT system that helps serve our customers better. We therefore require Data Engineers to help build the Data Platform upon which we build the rest of our new IT landscape. Our data integration and analytics pipelines are based on event-first and streaming-first principles, so we we’re building a team that will have a focus on developing and maintaining our CDC tools, Kafka platform (Confluent Cloud) and the stream processing pipelines. As part of that team, this role will help define and govern the standards and patterns for our streaming tools and pipelines, as well as help implement solutions on behalf of our domain teams.

Lisbon, Portugal

Responsibilities

Your main responsibilities will be:
• Develop, maintain, and govern the STARK Kafka platform (Confluent Cloud), including performance, access models and cost models;
• Develop, maintain, and govern the patterns and standards for our data pipelines and services in the STARK Kafka platform (CC), including the docker setup for those services;
• Develop, maintain, and govern the CDC patterns and tools, which integrate STARK source systems and the Kafka platform (CC);
• Collaborate with the Enterprise Architects, Solution Architects, and Technical Leads to establish the most effective way of processing data in an event-driven architecture;
• Support establishing the practices and ways of working in a data mesh architecture in STARK;
• Implement solutions and services within our stream and batch processing pipelines.

Main challenges:
• Very ambitious project. Data platform is also both Stark’s Analytics and Integration platform;
• Many projects will rely on this integration platform, making it the central point for all STARK’s data usage;
• This role will impact the overall Athene project. The person hired for this role has the possibility to influence all architecture;
• Be able to define standards and expectations on kafka.

Technologies and languages used in role:
• Kafka (Confluent Cloud);
• Stream processing technologies (e.g. Kafka Streams);
• Precisely CDC / Qlik Replicator / Debezium or other, similar CDC tools;
• Docker/K8S;
• Azure cloud.

Qualifications

Must-Have Skills:
• + 3 years of experience with Kafka;
• Experience with stream processing technologies.

Good-to-have:
• Experience with Precisely CDC, Qlik Replicator, or other, similar CDC tools;
• Experience with AKS/Docker;
• Experience with working in a software development environment with many dependencies towards other teams and stakeholders;
• Experience with Microsoft Azure DevOps (or similar) and Git;
• Experience with cloud development practices, ideally on Azure.

Soft Skills Requirements:
• Creative Problem solver and negotiator;
• You have a flexible and organized work style;
• You have experience working on an international scale with a variety of cultures.

Other Requirements:
• Ability to communicate professionally in English.

Education

Bachelor or Master’s degree in Sc/BA degree in computer science, engineering or related discipline OR relevant years of experience in required skills.

Remarks

Stark vision is to be the most trusted business-to-business distributor of heavy materials in Northern Europe. We take responsibility for the entire value chain in our industry by providing the best terms possible for our customers and suppliers.

http://www.stark.dk

Cookies make our website work properly and better for you

We use cookies to improve your experience on our website.
By continuing to browse this site, by default you agree to the use of cookies.
You can change your preferences using the preferences button below.

Visit our Cookies Policy to learn more.

COOKIES