← В ленту
Регистрация: 17.03.2022

Портфолио

3

3

2

2

1

1

Скиллы

Apache Spark
Databases
Hadoop
Java
Kafka
Scala
SQL
Warehouse

Опыт работы

IT Director
с 10.2021 - По настоящий момент |VTB Bank
Hadoop (Cloudera, Arenadata), Spark (DeltaLake, Hudi, Iceberg, Carbondata), Java/Scala, Kafka
- Architect at data delivery acceleration project, from ODS into Data Lake/Hadoop platform. Tech stack: Oracle, Kafka, Airflow, Spark+DeltaLake. - Architect at data mart migration project to a new Hadoop platform. Tech stack: Arenadata Hadoop, Cloudera CDH, Airflow, Spark, and others. - Participation in architecture approach development for Data Lake, platform requirements gap analysys, creating development roadmap for the data platform.
Lead Solution Architect
02.2019 - 09.2021 |Rosbank (Societe Generale Group)
HDP 3.1 (Spark, Hive, Kafka, HBase, Sqoop), Debezium, IBM CDC, Scala, Java, Python
- Created and launched Data Lake Hadoop platform (tech stack: HDP 3.1, Spark, Hive, Kafka, HBase, Sqoop, IBM CDC, Debezium, Scala, Java, Python). Participation in the development of key platform components (extract+apply logic at batch/cdc capture modes, data monitoring, and other tools) - Leading activities (within DataLake): IT architecture, technical leadership, evolution planning/estimations, infrastructure sizing/capacity, fault tolerance and disaster recovery, DevOps, team hiring. - Participating in pilots: 1 - MPP/central DWH platform (Greenplum/Arenadata DB), 2 - customizing retail offers with streaming platform (Drools, Flink, Ignite).
Solution Architect
01.2016 - 02.2019 |GlowByte Consulting
Confluent Platform, HBase/Phoenix, Spark (CDH), Impala, Sqoop, Spark, Flume, SAS HPDM, HBase
- VTB24, launched a pilot streaming project to calculate online offers and discounts depending on customer transactions. Tech stack: Confluent Platform (Kafka), HBase/Phoenix, Spark (CDH). - VTB24, participation in project to offload historical data from Teradata DWH to Hadoop. R&D, estimate, POC's, technical consulting (Hadoop administration & maintenance, documentation), prepared and performed Hadoop study courses, prepared and performed SQL stress tests. Tech stack: Impala, Hive, Sqoop, Kafka, Spark, Flume, SAS HPDM. - Sberbank, pilot project to choose appropriate graph database. Done market research, scored appropriate vendors, perfomed stress tests, prepared presentation and research report. Tech stack: Titan/DataStax EG, OrientDB, ArangoDB, bash. - «Home Credit and Finance Bank», participation in Data Lake and credit scoring projects. Tech stack: Cloudera CDH/Hadoop, HBase, Kafka, Java, SAS.
Senior Software Developer, Solution Architect
09.2013 - 01.2016 |FORS Developer Center
Hadoop (CDH), Java, MapReduce, Apache Hive, HBase, Spark, Sqoop, Oozie, HUE, Oracle 12
- Alfa-bank: architect and developer in project of Hadoop-based system for elastic loading scoring data from Oracle into Hadoop. Tech. stack: Java, MapReduce, Apache Hive, Sqoop, Oozie, HUE, Oracle Loader&Connector for Hadoop, Kerberos, Sentry. - Participation in development and maintenance of DWH for Moscow Department of Transport and Road Infrastructure Development (Oracle RDBMS + ODI ETL); - Participation in pilot projects of loading and processing data from social networks (parse, identification, classification) using Hadoop (HBase, Hive/Impala and others); - Participation in developing ETL processes at Federal Tax Service CDWH. Tech stack: Oracle, GoldenGate, Data Guard, Exadata, Informatica ETL. - Research activity towards Big Data (HBase, Spark, Oracle NoSQL and others)
Senior Software Developer
02.2011 - 08.2013 |Trading System Administrator of Wholesale Electricity Market
Oracle RDBMS, Java, GWT
Modifying and maintenance request processing system, received from Russian wholesale market participants. Optimizing code and architecture, integration, patch coordination.
Senior Software Developer
05.2006 - 02.2011 |FORS Developer Center
Delphi, Oracle PLSQL, ASP.NET, JSP, Tomcat
- Federal Financial Monitoring Service: DWH maintenance and improvements, develop GUI tools for analytics (main analytical system – Delphi + Oracle, +thin client - ASP.NET, reports in Excel, Oracle Reports). Close work with customer, writing technical docs. Participated in project of migration to a new DWH (Oracle PL/SQL, Oracle Designer, OWB), develop and maintain ETL (PL/SQL), optimizing DWH and applications. Created own tool for 5-stage data quality improvement at DWH (Oracle, PL/SQL, Delphi). - Federal Customs Service: modify Oracle RDBMS & Delphi/C# GUI for inner organization system, intensive command work (SVN, JIRA). - Trading System Administrator, OJSC: maintenance of monthly electricity calculation system (PL\SQL, JSP, Tomcat).
Software Developer
03.2004 - 05.2006 |New Computer Technologies
Delphi, Oracle RDBMS, ASP.NET
Developed and maintained fuel card payment system, developed several small GUI programs and utilities

Образование

Computers, complexes, systems and networks (Бакалавр)
1999 - 2005
National Research Nuclear University (previously Moscow Engineering Physics Institute, MEPhI)

Языки

АнглийскийВыше среднегоРусскийРодной