We are in search of a skilled Data Engineer to join our team working on projects for clients across Europe. In this role, you will be responsible for designing, implementing, and supporting data pipelines, collaborating closely with teams across various regions including the EU, US, Brazil, and others. Proficiency in English is essential for effective communication with these diverse teams and clients, hence please ensure your CV is submitted in English.RequirementsWe are seeking candidates who possess:Extensive experience in designing, constructing, and testing data pipelinesProficiency in Python for data manipulation tasks such as data gathering, cleaning, transformation, and processing data frames in various formatsAdeptness at quickly learning new frameworksFamiliarity with Cloud platforms, particularly AWS GlueStrong understanding of Infrastructure as Code principlesEagerness to work with diverse technologies and a commitment to continuous learningAbility to mentor and share knowledge with junior team membersPrimary responsibilities include, but are not limited to:Developing code on Cloud platforms (AWS) to facilitate data aggregation and processing tasksProviding support, troubleshooting, and resolving issues in existing data pipelinesDesigning, constructing, and delivering high-quality data pipelinesParticipating in the Data Validation processDesigning and configuring Cloud infrastructureInstalling, testing, and maintaining data management systemsEnsuring that all systems meet business requirements and industry standardsIntegrating emerging data management and software engineering technologies into existing data architecturesEstablishing processes for data mining, modeling, and productionProposing improvements to enhance data reliability and qualityAnalyzing and structuring raw dataBuilding data marts for consumption by data scientists and visualization toolsIdeal candidates will possess knowledge in some, if not all, of the following areas:Understanding of non-functional requirements such as performance, security, privacy, and GDPR complianceFamiliarity with Cloud Data Platforms like AWS RedShift, AWS EMR, and SnowFlakeExperience with unit, integration, and end-to-end testingProficiency in using Python or other scripting languages for automating daily tasksFamiliarity with various SQL and NoSQL databasesBenefitsOur Benefits:Competitive Salary: Ranging from BRL 120,000 to BRL 200,000 per annumHealth and dental planMeal and food vouchersChildcare assistanceExtended paternity leaveGympassProfit sharingLife insurancePartnership with an online mental health platformCI& T UniversityDiscount clubSupport Program: financial; psychological guidance; nutritionist and moreExpectant parent and responsible fatherhood coursePartnership with online course platformsLanguage learning platformAnd many others
