Data Engineer

Оплата не указана

Вакансия находится в архиве

Advantage Solutions

г. Москва

Требуемый опыт работы

От 3 до 6 лет

Тип занятости

Полная занятость

График работы

Удаленная работа

Responsibilities:
  • Create ETL processes and data marts.
  • Design linearly scalable client wrappers for interacting with exchange APIs, brokers, data aggregators, vendors, and blockchains.
  • Work with FIX, HTTP, WebSocket, and gRPC protocols.
  • Configure monitoring systems to ensure the reliability of ETL processes.
  • Develop BI dashboards/reports using data visualization tools such as Grafana, Tableau, Lightweight Charts, and Google Sheets.
  • Analyze and compare diverse data sources, their costs, and the amount of effort required to obtain them.
  • Search for data from non-normalized sources, such as news, social media, or websites.
Requirements:
  • Strong proficiency in SQL: aggregations, joins, subqueries, window functions (first, last, candle, histogram), indexes, query planning, and optimization.
  • Proficiency in Python.
  • Experience in designing database schemas: normalization/denormalization within the scope of OLAP/OLTP.
  • Understanding of different data storage architectures (Data Warehouse, Data Lake).
  • Experience working with databases such as PostgreSQL + TimescaleDB or ClickHouse.
  • Experience with raw data, including cleaning, normalization, and enrichment (CSV, JSON, PCAP, FIXML, etc.).
  • Experience with large datasets (1TB+) and understanding of data architecture for high-load systems.

Nice to have

  • Proficiency in Docker, Airflow, and Kafka tools.
  • Experience and/or willingness to transition to Go, Rust.
  • Experience with the Hadoop ecosystem (HDFS, Hive, Spark).
  • Knowledge of financial markets and basic trading statistics.
  • Experience with real-time data processing and streaming data technologies.
We offer:
  • Work in a modern international technology company without bureaucracy, legacy systems, or technical debt.
  • Excellent opportunities for professional growth and self-realization.
  • We work remotely from anywhere in the world, with a flexible schedule.
  • We offer compensation for health insurance, sports activities, and non-professional training.

Контактная информация

Advantage Solutions

Вакансия опубликована 24.10.2024 в г. Москва.

Похожие вакансии

#

Middle

Москва

Полный день

Подробное описание

22 августа

#

Москва

Полный день

Подробное описание

25 апреля

#

Не указана

Москва

Алексеевская

Полный день

Подробное описание

21 октября