← В ленту
Senior
Регистрация: 17.03.2022

Скиллы

Java
Hadoop
SQL
Databases
Warehouse
Apache Spark
Kafka
Scala

Опыт работы

IT Director
с 10.2021 - По настоящий момент |VTB Bank
Hadoop, Spark, Java, Scala, Kafka, Airflow
● Architect at data delivery acceleration project, from ODS into Data Lake/Hadoop platform. Tech stack: Oracle, Kafka, Airflow, Spark+DeltaLake. ● Architect at data mart migration project to a new Hadoop platform. Tech stack: Arenadata Hadoop, Cloudera CDH, Airflow, Spark, and others. ● Participation in architecture approach development for Data Lake, platform requirements gap analysys, creating development roadmap for the data platform.
Lead Solution Architect
02.2019 - 09.2021 |Rosbank
HDP 3.1, Spark, Hive, Kafka, HBase, Sqoop, Debezium, IBM CDC, Scala, Java, Python
● Created and launched Data Lake Hadoop platform (HDP 3.1, Spark, Hive, Kafka, HBase, Sqoop, IBM CDC, Debezium, Scala, Java, Python). Participation in the development of key platform components (extract+apply logic at batch/cdc capture modes, data monitoring, and other tools) ● Leading activities (within DataLake): IT architecture, technical leadership, evolution planning/estimations, infrastructure sizing/capacity, fault tolerance and disaster recovery, DevOps, team hiring. ● Participating in pilots: 1. MPP/central DWH platform (Greenplum/Arenadata DB), 2. Customizing retail offers with streaming platform (Drools, Flink, Ignite).
Solution Architect
01.2016 - 02.2019 |GlowByte Consulting
SQL, HBase/Phoenix, Spark (CDH), Impala, Sqoop, Spark, Flume, SAS HPDM, HBase
● VTB24, launched a pilot streaming project to calculate online offers and discounts depending on customer transactions. Tech stack: Confluent Platform (Kafka), HBase/Phoenix, Spark (CDH). ● VTB24, participation in project to offload historical data from Teradata DWH to Hadoop. R&D, estimate, POC's, technical consulting (Hadoop administration & maintenance, documentation), prepared and performed Hadoop study courses, prepared and performed SQL stress tests. Tech stack: Impala, Hive, Sqoop, Kafka, Spark, Flume, SAS HPDM. ● Sberbank, pilot project to choose appropriate graph database. Done market research, scored appropriate vendors, perfomed stress tests, prepared presentation and research report. Tech stack: Titan/DataStax EG, OrientDB, ArangoDB, bash. ● «Home Credit and Finance Bank», participation in Data Lake and credit scoring projects. Tech stack: Cloudera CDH/Hadoop, HBase, Kafka, Java, SAS.
Senior Software Developer / Solution Architect
09.2013 - 01.2016 |FORS Developer Center
Hadoop, Java, MapReduce, Apache Hive, HBase, Spark, Sqoop, Oozie, HUE, Oracle 12
● Alfa-bank: architect and developer in project of Hadoop-based system for elastic loading scoring data from Oracle into Hadoop. Tech. stack: Java, MapReduce, Apache Hive, Sqoop, Oozie, HUE, Oracle Loader&Connector for Hadoop, Kerberos, Sentry. ● Participation in development and maintenance of DWH for Moscow Department of Transport and Road Infrastructure Development (Oracle RDBMS + ODI ETL). ● Participation in pilot projects of loading and processing data from social networks (parse, identification, classification) using Hadoop (HBase, Hive/Impala and others). ● Participation in developing ETL processes at Federal Tax Service CDWH. Tech stack: Oracle, GoldenGate, Data Guard, Exadata, Informatica ETL. ● Research activity towards Big Data (HBase, Spark, Oracle NoSQL and others).
Senior Software Developer
02.2011 - 08.2013 |Trading System Administrator of Wholesale Electricity Market
Oracle RDBMS, Java, GWT
● Modifying and maintenance request processing system, received from Russian wholesale market participants. ● Optimizing code and architecture, integration, patch coordination.
Senior Software Developer
05.2006 - 02.2011 |FORS Developer Center
Delphi, Oracle PLSQL, ASP.NET, JSP, Tomcat
● Federal Financial Monitoring Service: DWH maintenance and improvements, develop GUI tools for analytics (main analytical system – Delphi + Oracle, +thin client - ASP.NET, reports in Excel, Oracle Reports). Close work with customer, writing technical docs. Participated in project of migration to a new DWH (Oracle PL/SQL, Oracle Designer, OWB), develop and maintain ETL (PL/SQL), optimizing DWH and applications. Created own tool for 5-stage data quality improvement at DWH (Oracle, PL/SQL, Delphi). ● Federal Customs Service: modify Oracle RDBMS & Delphi/C# GUI for inner organization system, intensive command work (SVN, JIRA). ● Trading System Administrator, OJSC: maintenance of monthly electricity calculation system (PL\SQL, JSP, Tomcat).
Software Developer
03.2004 - 05.2006 |New Computer Technologies
Delphi, Oracle RDBMS, ASP.NET
● Developed and maintained fuel card payment system, developed several small GUI programs and utilities

Образование

Computers, complexes, systems and networks (Бакалавр)
2000 - 2006
National Research Nuclear University, MEPhI

Языки

АнглийскийВыше среднегоРусскийРодной