Hi there,

We are seeking a Senior Data Engineer to work remotely. The ideal candidate should have proven experience in delivering and organizing data with expertise in ETL processes, data warehouse design, and quality control; technical skills include SQL, Python, proficiency in databases (Clickhouse, PostgreSQL, Greenplum), and experience with Big Data technologies (Hadoop, PySpark, Airflow).

Requirements:

Data delivery organization from sources to the data warehouse
Development of data processing and transformation processes in the DWH
Designing data warehouses and data marts
Design, development, and maintenance of ETL processes
Quality control of loaded data (manual and automated DQ tests)
Integration of new data sources
Understanding of Spark architecture, HDFS, and Airflow
Strong experience in optimizing Spark applications
Team collaboration with system analysts

Programming Languages: SQL, Python Experience with one or more databases: Clickhouse, PostgreSQL, Greenplum Experience with ETL tools: Apache Airflow Experience with Hadoop Experience with PySpark jobs, Apache Zeppelin Experience with GIT

Nice to have: Experience with Azure and/or Yandex Cloud infrastructure Experience with Apache Kafka Knowledge of Apache NiFi ETL tool Proficient in written English

Current Stack: Yandex Cloud, Hadoop Ecosystem, Airflow, Spark/PySpark, Spark Streaming, PySpark Flink, Python, SQL.

Why Join Us:

Collaborate with top-tier professionals in the field.
Competitive salary in USD/ RUB.
Opportunities for professional growth and development.
Work in a supportive and innovative environment.
100% remote work.

We look forward to receiving your application. Please share you CV with telegram and we will contact you promtly!