Senior Data Engineer (Databricks)

Senior Data Engineer (Databricks)
Empresa:

Solvd, Inc.


Lugar:

Brasil


Função de trabalho:

Tecnologia da informação

Detalhes da Vaga

Project description:A tech firm revolutionizing scientific research by integrating lab instruments, software, and data apps in biopharma, fostering accelerated discoveries.Responsibilities:* Own, prototype, and implement customer solutions.* Research and prototype data acquisition strategy for scientific lab instrumentation.* Research and prototype file parsers for instrument output files (.xlsx, .pdf, .txt, .raw, .fid, and many other vendor binaries).* Design and build data models.* Design and build Python data pipelines, unit tests, integration tests, and utility functions.* Build visualization, report, and dashboards using Spotfire, Tableau, Jupyter notebook and etc.* Work with the customer to test and make sure the solution fulfills their requirementsand solves their need.* Coordinate project kickoff meetings; manage the customer relationship throughout the project, and conduct formal project closeout meetings.* Facilitate internal project post-mortems to identify areas of improvement on the next implementation.Mandatory requirements:* 8+ Sr. Engineer > 5 years in Python and SQL.* Passionate about science and building solutions to make the data more accessible to end-users.* Elasticsearch, science background, or experience with scientific instruments.* Experience with tools like Spotfire, Tableau, Jupyter notebook (any of them).* Undergraduate degree in Chemistry, Biology, Computer Science, Statistics, Public Health, etc.* Excellent communication skills, attention to detail, and the confidence to take control of project delivery.* Quickly understand a highly technical product and effectively communicate with product management and engineering.* Proactive problem-solving skills.* High-bandwidth: thrives when managing multiple simultaneous projects.* Intellectually curious unwavering drive to learn more every day.* Ability to think creatively about how to solve projects risks.* Experience with Snowflake, Lakehouse, and Databricks architecture.Good to have: * Graduate degree in Chemistry, Biology, Computer Science, Statistics, Public Health, etc.Tech stack:* Databricks* AWS* AWS REDSHIFT (hands-on experience required)* ECS* S3* Athena* RDS* ETL/ATL (Airflow)Python:* Python Pipelines Jobs* Python 3+DB/SQL:* SQL/TSQL* Databases MySQL, MariaDB, Aurora, PostgreSQL, ±MS SQL* Key-Value Databases* Non relational DBS


Fonte: Whatjobs_Ppc

Função de trabalho:

Requisitos

Senior Data Engineer (Databricks)
Empresa:

Solvd, Inc.


Lugar:

Brasil


Função de trabalho:

Tecnologia da informação

Technical Support Engineer (Solar/Pv) Based In Brazil

About Runergy Runergy New Technology was established on 2013 and has become a leading PV cell manufacturer in the world. We achieved a significant milestone ...


Desde Runergy Solar - Brasil

Publicado 14 days ago

Consultor .Net

Sobre a vagaA PSM Company é especializada na identificação de Talentos para as áreas de TI / Telecom como também para as áreas operacionais e administrativas...


Desde Psm Company - Brasil

Publicado 14 days ago

Oracle Adf Developer

A PrimeIT é uma empresa de referência, focada na prestação de serviços tecnológicos de IT, Telecomunicações e Engenharia. Potenciamos o negócio dos nossos pa...


Desde Primeit - Brasil

Publicado 14 days ago

Analista De Pré-Vendas De Tecnologia

Vaga: Analista de Pré-Vendas de TecnologiaSobre o Centro de Pesquisas Avançadas Wernher von Braun:O Centro de Pesquisas Avançadas Wernher von Braun é uma ins...


Desde Von Braun Labs - Brasil

Publicado 14 days ago

Built at: 2024-05-01T17:05:44.551Z