senior python developer (backend, MLOPS, trading)

Текущий статус/должность: senior python developer (backend, MLOPS, trading).

Мои компетенции и опыт

I am a software engineer with more than 10 years of experience in developing and leading projects. Throughout my career, I have built and managed systems from small to large mostly in trading-related industry, including big data and cloud-based solutions. For example:

Samokat, Senior data engineer, нужен доступ к резюме - present, 2y:

Project/Role - Senior data engineer, нужен доступ к резюме - present, 1m:

 Data analysis pipelines for marketing related systems.

Tools and libraries used:

 Python / airflow / Spark / mssql / postgreSQL / kafka / clickhouse / bigquery / elastic search.

Challenges / Problems solved:

 Implemented over a 100 ETL pipelines on 700 vcores / 3 tb ram / 450 tb disk space cluster using python / airflow / spark.

 Accelerated data loading by several orders of magnitude from nultiple sources including MSSQL, Greenplum, and Elasticsearch.

Proprietary trading firm, Senior developer, нужен доступ к резюме - нужен доступ к резюме , 1y 3m:

Project/Role - Senior developer, нужен доступ к резюме - нужен доступ к резюме , 1y 3m:

 Data preparation pipeline for trading related ML system.

Tools and libraries used:

 Python / pandas / AWS EMR / Spark.

Challenges / Problems solved:

 Developed complex data preparation pipeline using standalone and Spark instances improving performance by more than 10 times.

Project/Role - Senior developer, нужен доступ к резюме - нужен доступ к резюме , 1y:

 Market surveillance system based on orders.

Tools and libraries used:

 Python / pandas / AWS EMR / Spark.

Challenges / Problems solved:

• Implemented order book rebuild algorithm processing up to 50 million of daily orders for about one hour.

Project/Role - Senior developer, нужен доступ к резюме - нужен доступ к резюме , 9m:

 Market surveillance system based on trades (1-2kk trades/day).

Tools and libraries used:

 Python / pandas / sqlite.

Challenges / Problems solved:

• Developed market surveillance system based on trades processing 1-2 million trades per day improving initial performance by more than 100 times.

Project/Role - Senior developer/Team Lead, нужен доступ к резюме - нужен доступ к резюме , 2y 7m:

 ML system for analysis and prediction of new errors based on application log files.

Tools and libraries used:

 Python / sklearn / pandas / sql alchemy / mySQL / postgreSQL / asyncio.

Challenges / Problems solved:

• Engineered data processing pipeline to handle up to one terabyte log files per day.

And another 20 years of software development experience using almost every mainstream programming language. For details please take a look at my attached resume.