If YOU :
are passionate about automatic infrastructures as a code
are cloud / aws / kube oriented with your infra vision
have practical approach for designing reliable
interested in tech infra excellence, curious about how things work
love good coding, simple solutions that render robust infra
like to help other people to learn and grow
are irritated when things are not working
like to make sure system is performant and as fast as it can be
love to dive into to have very deep understanding
Join us as Senior DevOps Engineer to grow Shareablee Team in Comscore, massive big data analytics platform.
Shareablee process terabytes of data to make sure our customers (Amazon, Facebook, NBA, FOX Sports or Manchester United) understand better their marketing actions.
We need you to :
MUST have at least one area of deep understanding, whatever this is database, programing language, whatever. You deployed postgresql once, that's not enough, you heard about rabbitmq, not enough.
If you have deep understanding we would expect you know the details, what is system layout, what are tradeoffs, different use cases and your experience with it.
You have set rabbitmq replicated cluster for 1MM / s, great. You can write python C extensions and do GC trics, great. You know how to tune postgresql filesystem and storage backend or use columnar storage inside, great.
know at least one programming language (whatever that is, whitespace lang is fine), python+bash combo is what we use daily mostly but we touch a lot of crazy stuff
know Linux quite well (bash, processes / threads, pipes, some basic tooling, troubleshooting)
Day-to-day stuff :
design practical solutions on infrastructure
cooperate with Database / Web / TechSupport teams to solve and troubleshoot infra issues
help other teams to design data pipelines to match infrastructure constraints and costs
work with tech like : Kube, Kafka, Airflow, Spark, AWS
guide other teams how to use infra
say NO when somebody wants to add mongodb to the stack (or other crazy ideas)
Our stack :
take a look at https : / / shareablee.github.io / blog / to see what we do
AWS (A LOT on machines)
quite a few kubernetes clusters
few terabyte databases (ES, C*, druid, rabbitmq, Kafka), some other places PB scale
github (separate app environment per PR, automatic unit and integration and acceptance test runs on each commit)
jenkins on autoscaled kube (for speed and parallelism)
separate test suits for react / django and integration tests + acceptance tests sets
working on linux mostly
docker-compose based local env
for local setup you can use whatever you want
jira / confluence
we have an oncall with weekly shifts. 99% of cases can be postponed to next day, over last 4 years we have 1 major outage a year so oncall is mostly watching alerts on slack (we are tunning alerting systems all the time so we don't have crap alerts, only important ones, probably once a week or less to react).
We offer :
doing real big data projects (we process terabytes), scale, automation, fun
laptop : Lenovo (highest CPU we can get + 32G RAM) + usb-c dock + 2 screens
working remotely or in office (Wrocław, Szewska 5)
private healthcare, multikafeteria
working on product (Comscore is product company, Shareablee is our main product focus, you are not switched to other projects every two months, you can dive deep into specific things and learn a lot)
20 days off included
PS. Correct Context is managing Comscore operations in Poland