Nikolay Krupiy - CV Data Engineer

18

MSTU CA

SQL Python Spark Hadoop Java T-SQL Prefect ETL DWH

-

• Proficient in SQL, with experience in writing complex queries for Spark, SQL Server, and Oracle databases. Skilled in query plan analysis and optimization.
• Extensive experience in Python development, including creating custom libraries and frameworks for automating data processing processes using tools such as Spark, Pandas, HDFS CLI.
• Developed production ETL processes on a team developed Java based framework on Spark (but for my opinion Python+Scala is better choice)), with using comporate Oozie-based ETL orchestrator and DevOps pipeline of Jenkins.
• Familiar with Docker, PostgreSQL, GCP, BigQuery, Prefect, dbt, Spark streaming, Kafka, Scala in the case of studing DE courses (DE Zoomcamp 2023, in progress and NewProLab DE courses)
• Some expirience with PyTest, FastAPI/Flask, aiogram, BeautifulSoup, Selenium, loguru, fastcore, deployment automation applications to Heroku
• Experienced in data modeling and developing various variants of Enterprise Data Warehouse (EDW) architectures, including Kimball star schema, 3NF-core, DataVault and the like to last team-developed data modeling method.
• Extensive experience in T-SQL development, including development with team-built ETL T-SQL-driven framework, development a custom utils to speed up development, automation, working with metadata, system storage procedures and views, and dynamic code generation, working with tSQLt framework. Familiar with RedGate products (as data schema compare tool).
• Extensive experience with SSAS Multidimensional, SSIS, SSRS and a little in SSAS Tabular. Also familiar with visualization tools such as Power BI, Tableau and Qlik Sense.
• Skilled in working with Oracle and complex PL/PLSQL development (old experience).
• Familiar with Agile, Scrum, and Kanban methodologies, with experience in their implementation and work on them.
• Experienced in working with GitHub, BitBucket, SourceTree, flyway, Jenkins.
• Experienced in working with project management tools such as Jira, Trello and Redmine.
• Experienced in corresponding and negotiating with colleagues and customers in English.
• Experienced a Team Lead in HH processes as recruiting, including writing job descriptions, creating questionnaires, selecting and interviewing candidates, and evaluating their skills and qualifications.
• Experienced as a Team Lead and Senior Developer in leadership, mentoring, setting and monitoring the implementation of tasks, motivation for results and development, coaching, and facilitation.
• Basic knowledge of classical ML obtained during the MADMO 2021 course.