Middle Big Data Engineer

KITRUM, a tech company with a "People First" approach. Our mission is simple: bring together top development teams that share our values.
We operate with a global footprint, boasting developer teams in multiple countries, including Ukraine, the USA, Poland, Kazakhstan, Spain, Brazil and etc. Our team has nearly 250 members, including 150 experienced developers.
We're looking for a Middle Big Data Engineer for an American project. It is an online library with 1.5 million users and 60 million materials. It's like YouTube for those who love to read.
Requirements
— 3+ years of experience in data engineering creating or managing end-to-end data pipelines on large complex datasets.
— Proficiency in Spark
— Expertise in Scala, and/or Python
— Fluency with at least one dialect of SQL
— Level of English: Upper-Intermediate
As a plus
— Experience with Streaming platforms, typically based around Kafka
— Experience in Terraform, Airflow
— Strong grasp of AWS data platform services and their strengths/weaknesses
— Strong experience using Jira, Slack, JetBrains IDEs, Git, GitLab, GitHub, Docker, Jenkins
— Experience using DataBricks
Responsibilities
— Manage data quality and integrity
— Assist with building tools and technology to ensure that downstream customers can have faith in the data they're consuming
— Cross-functional work with the Data Science or Content Engineering teams to troubleshoot, process, or optimize business-critical pipelines
— Work with Core Platform to implement better processing jobs for scaling the consumption of streaming data sets
Benefits
— High compensation according to your technical skills
— Long-term projects (12m+) with great Customers
— 5-day working week, 8-hour working day, flexible schedule
— Democratic management style & friendly environment
— WFH mode
— Annual Paid vacation
— 30 b/days + unpaid vacation
— Paid sick leaves
— 6 b/days per year
— Corporate Perks (external training, English course, business speaking club, corporate events/team buildings)
— Professional and personal growth