SR Data EngineerImportant Information Location: BrazilJob Mode: Full-timeWork Mode: Work from homeResponsibilities and DutiesDesire to work at high level with stakeholders to devise, understand and communicate clearly requirements and architecture design for data platforms in an efficient manner;Large Experience with architecture, governance, security, design, business mapping and understanding, performance and tuning for data lake, data warehouse and other data storage systems and transformation;Experience with talking with customers and stakeholders and extracting business and technical requirements in high and low level;Strong knowledge of Data frameworks and tools: Hadoop (YARN, HDFS), Hive, Spark, Kafka, Pentaho, Airflow, Iceberg, parquet, AWS data tools (Glue, EMR, Athena, S3;Experience manipulating data using SQL, NoSQL and unstructured data sources, including metadata;Strong knowledge of ETL frameworks and workflow processes (data ingestion, clean up and preparation);Strong knowledge of Python and Pyspark code development;Experience in creating solutions in AWS.Highly Desirable Skills Experience with Java;Large experience with data modeling, data design and ETL optimization;System administration experience on Linux platforms;Financial and/or banking marketing knowledge is a plus. Additional Skills Experience with Snowflake and Data migration tools (DMS, metano, Fivetran, Airbyte);Machine learning algorithms and workflow;Pipeline and workflow orchestration (Oozie, Luigi, Airflow);Experience with Kubernetes;Knowledge of DataOps and data pipeline monitoring.About EncoraEncora is the preferred digital engineering and modernization partner of some of the world's leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora's technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
