Bio
Senior data engineer with over 5 years of experience in creating data warehouses (DWH) and data lakes. Worked on various projects related to consulting, banking, telecommunications and food technology. Created ETL/ELT processes on Apache Spark on Python/Scala and with DBT in the Kubernetes environment. Developed DQ systems, which helped prevent loading data with incorrect business information. Created a local testing system for Spark applications, which helped speed up development and reduce the load on the dev cluster. Configured CI/CD for testing code, building a DBT project and deploying it to Kubernetes. Created monitoring and alerting systems for quick response to incidents. Mentoring for junior specialists.