Gleb Danichev
Портфолио
s3 group job
Developing from zero to prod ETL job on Golang. This job transfers JSON rows with modifications from one S3 bucket to another in various formats (Parquet, CSV, JSON). I speed this job up several times, each by 3-10 times. Maintain high stability of this job.
streaming system in Avito
Developed, implemented, and maintained a distributed data processing system with 300m online enriched events per day. Built API for 1,3 trillion documents Elastic cluster. Built API for reading Kafka topic with 150k/s events. Built a reporting system. Migrating hundreds of Parquet TB from Vertica to Elastic.
Crypto Exchange
Developed backend of the Exchange. Maintain real-time statistics data structures. Build REST and Web Socket API over them.