We are looking for Data Engineer to work with mission critical systems accounting for around 150 million Euros in advertising revenue. Advertising Solutions is a relatively new area in Media organisation which houses engineering teams for our back-office systems used by various sales organisations at Schibsted. These systems include Rose which is used to book advertising campaigns and Vantage which provides campaign reporting.
We are now looking to establish a team to own and operate the Advertising API that underpins these products, along with others within Schibsted. You will be off to a running start and will have to learn the ropes of existing systems with the help of our established teams, plan and execute on the hand-over from the current team in London. Expect initial travels to London and/or hosting the London team members locally.
Once you learn the system you and your teammates will continuously work on its technical evolution, scaling and simplification. You will be expected to be an active participant when deciding how to implement new features together with the neighbouring teams that depend on you for their work.
We handle more than 250000 campaigns, 100000 advertisers, and more than 140 publishers across 20 different countries. About 1.5 TB of data is processed every day using more than 100 Spark jobs.
Our data pipeline is built on top of AWS EMR, Spark, Yarn, Airflow and microservices based on Twitter Finatra framework. Apache Avro and Parquet are used for data serialization and schema definition/evolution.
We don't expect you to have experience with all the technologies that we use but it would be good if you know at least some of them or have worked with similar ones.
You should be deeply interested in data processing and data storage in general. You need to be well-versed in the area of databases - mainly SQL, optimization of them, schema design and indexes. Perhaps you enjoy writing Spark jobs as well.
You should have an understanding of such Big Data concepts as map reduce, CAP theorem and big table.
This role does not require cooperation with data science, at least at this point. And our scale is substantial but rather not huge.
Social benefits (multisport, health care etc)
Individual training budgets
Yearly bonus depending on performance
In-house English lessons
Flexible working hours
4 additional vacation days
2 additional weeks of paternal leave
Modern tools and needed equipment
Schibsted Tech Polska is a programming hub, creating mobile & web applications for the best Scandinavian start-ups & media companies. With almost 170 employees combined in Kraków & Gdańsk, we're focused on developing news, marketplaces web & online applications, as well as helping Scandinavian startups to improve their business.
We're a Scandinavian company in mind - with a flat structure, modern technology stack and a mutual trust as a pillar of our great atmosphere.