Senior Software Engineer - Data + Kafka - CREQ186273 Description Cloud Data Lead with very strong in Experience in Bigdata (Kafka, Elastic search,Logstash,Kibana) Required experience with Data Engineering and ETL/EDW Design Process and Practices. Experience in Data Modeling Experience in CDC process (Added Advantage if knowledge in Debezium or any CDC tools) On prem to Cloud Data Migration expertise Experience in Hortonworks Data Platform or Cloudera Distribution stacks AWS Development experience using these services ( RDS with Postgres SQL Experience,DynamoDb,Data Pipeline, Data Base Migration, AWS Kafka ) Experience with GIT / Bit Bucket / SVN configuration for code check-in/Check-out and CI CD knowledge. Experience with Source to Target mapping and Data Modeling practice. Experience with Rest API Process ( PUT/GET) Experience in Agile Methodology using SCRUM or Kanban Insurance domain experience is a plus. Handling Client experience will be added advantage Added Advantage if have Experience in Python and Spark Hands on SQL experience coding, optimization & finetuning Primary Location Colombo, Western Province, Sri Lanka Job Type Experienced Primary Skills Data-Talend with Hadoop, HDFS, Spark, Kafka, Airflow for orchestration., Python Years of Experience 5 Qualification Cloud Data Lead with very strong in Experience in Bigdata (Kafka, Elastic search,Logstash,Kibana) Required experience with Data Engineering and ETL/EDW Design Process and Practices. Experience in Data Modeling Experience in CDC process (Added Advantage if knowledge in Debezium or any CDC tools) On prem to Cloud Data Migration expertise Experience in Hortonworks Data Platform or Cloudera Distribution stacks AWS Development experience using these services ( RDS with Postgres SQL Experience,DynamoDb,Data Pipeline, Data Base Migration, AWS Kafka ) Experience with GIT / Bit Bucket / SVN configuration for code check-in/Check-out and CI CD knowledge. Experience with Source to Target mapping and Data Modeling practice. Experience with Rest API Process ( PUT/GET) Experience in Agile Methodology using SCRUM or Kanban Insurance domain experience is a plus. Handling Client experience will be added advantage Added Advantage if have Experience in Python and Spark Hands on SQL experience coding, optimization & finetuning Travel No
