DATA ENGINEER

JOB DESCRIPTION

RESPONSIBILITIES:

DESIGN, DEVELOP, AND MAINTAIN DATA PIPELINES USING PYTHON
BUILD AND OPTIMIZE ETL / ELT PROCESSES FROM VARIOUS DATA SOURCES
DEVELOP AND MANAGE DATA WAREHOUSES AND DATA LAKES
ENSURE DATA QUALITY, CONSISTENCY, AND RELIABILITY
COLLABORATE WITH DATA ANALYSTS, DATA SCIENTISTS, AND SOFTWARE ENGINEERS
MONITOR, TROUBLESHOOT, AND OPTIMIZE DATA PIPELINE PERFORMANCE

REQUIREMENTS:

PROVEN EXPERIENCE AS A DATA ENGINEER OR SIMILAR ROLE
STRONG PROGRAMMING SKILLS IN PYTHON
ADVANCED SQL SKILLS
EXPERIENCE WITH DATA PROCESSING FRAMEWORKS (PANDAS, PYSPARK, AIRFLOW)
SOLID UNDERSTANDING OF DATA MODELING, DATA WAREHOUSING, AND ETL CONCEPTS
EXPERIENCE WITH RELATIONAL AND/OR NOSQL DATABASES
FAMILIARITY WITH VERSION CONTROL SYSTEMS (GIT)

NICE TO HAVE:

EXPERIENCE WITH CLOUD PLATFORMS (GCP, AWS, OR AZURE)
EXPERIENCE WITH BIG DATA TECHNOLOGIES (SPARK, KAFKA)
KNOWLEDGE OF DOCKER, CI/CD, OR INFRASTRUCTURE AS CODE
BACKGROUND IN ANALYTICS OR MACHINE LEARNING PROJECTS