About

I am a Data Engineer with a strong background in designing and optimizing large-scale data pipelines and migrations, delivering scalable and reliable solutions for complex data challenges. I have experience in software development, ETL processes, and cloud-based big data technologies, with a focus on improving performance, reliability, and data integrity. I hold a Cloud Computing for Big Data certification from Lambton College, Toronto, and a BSc (Hons) in Computer Science from London Metropolitan University, UK... Learn More...

Basic Information
Email:
upretidiwash09@gmail.com
Phone:
+1-416-882-4378
Address:
North York, Toronto
Language:
Nepali, English, Hindi
Professional Skills
Python
90%
SQL
90%
PySpark
90%
Tableau
70%
Talend
90%
GCP
60%
Data Modeling
90%
Java
60%
Recent Projects
Influenza Data Analytics
Netflix Data Analysis
Covid Data Analysis
Sales Data Analysis
SFO Flights Analytics
Experience

May 2023 – Current

Scotiabank Toronto
Data Engineer

• Built and enhanced 50+ data pipelines using Spark, SQL, Python, and Talend, ingesting data into operational data stores and data lakes, with validation, reconciliation, and audit controls across diverse file and database sources.

• Executed TSYS legacy migration for Credit Cards & LOC products, and applied Spark /DB2 optimizations that reduced end-to-end pipeline runtimes by ~60%.

• Implemented CI/CD pipelines with Jenkins, Git, and Bitbucket; scheduled and monitored jobs via Autosys, Tidal, TAC/TMC, and integrated Unix scripts to improve logging, error handling, and production reliability.

December 2019 - October 2021

Level 9 Tech
Software Engineer

• Participated in the technical design and development of an internal GraphQL service to provide app extension recommendations on the App Store.

• Updated the Core platform to adhere to internal API patterns, ensuring data integrity when communicating between various platforms.

• Experienced in developing and managing web applications and participating in networking and quality assurance while prioritizing and managing personal workload in an agile environment.

May 2018 - May 2019

Cloud Factory
Data Specialist

• Collected and managed customer data on expense tracker project and ensured proper ETL process after performing data cleansing

• Accomplished working under pressure to increase effectiveness and interventions by updating database of thousands of users.

• Promoted to team lead; in partnership with senior management, reorganized team production metrics leading to 10 percent boost in team productivity in Q1 2019.

Education

2022 - 2023

Post Graduate
Cloud Computing For Big Data

Lambton College, Toronto

2018 - 2020

Bachelor's Degree
Bsc Bachelor's In Computing

Islington College, Kathmandu, Nepal

Contact Me
Feel free to contact me

Address

Toronto, Canada

Phone

+1-416-882-4378

Email

upretidiwash09@gmail.com

Diwash Upreti

©Diwash Upreti. All rights reserved.