Bi Engineer

Do you have a passion for building innovative data pipelines and transforming raw data into actionable insights? Are you an expert in programming languages like Spark, SQL, and Python, and thrive in a collaborative environment? If so, we want to hear from you!About the role:We are seeking a talented and experienced Data Engineer to join our growing team. In this role, you will play a key part in designing, developing, and maintaining the data pipelines that power our organization's data-driven decision making. You will work closely with data scientists, analysts, and other engineers to ensure that our data infrastructure is reliable, scalable, and secure.Responsibilities:Design, develop, and maintain scalable and efficient data pipelines using Spark, SQL, and PythonUtilize Databricks platform to build and manage data processing workflowsClean, transform, and integrate data from various sources into a unified and consistent formatImplement data quality checks and monitoring processes to ensure data accuracy and completenessCollaborate with data scientists and analysts to understand their data needs and develop solutionsDocument data pipelines and processes using clear and concise languageUtilize Git for version control and maintain a clean and collaborative development environmentFollow software development best practices, including unit testing, code reviews, and continuous integration/continuous delivery (CI/CD)Stay up-to-date with the latest advancements in data engineering technologies and best practicesQualifications:Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience)Minimum 2+ years of experience as a Data Engineer or similar roleStrong proficiency in SQL, Python, and SparkFamiliarity with Databricks platformExperience with data warehousing and data lakes (e.g., AWS Redshift, Snowflake) is a plusExperience with Git and software development best practices (unit testing, code reviews, CI/CD)Excellent communication and collaboration skillsAbility to work independently and as part of a team