I am a Data Engineer with a strong background in designing and optimizing large-scale data pipelines and migrations, delivering scalable and reliable solutions for complex data challenges. I have experience in software development, ETL processes, and cloud-based big data technologies, with a focus on improving performance, reliability, and data integrity. I hold a Cloud Computing for Big Data certification from Lambton College, Toronto, and a BSc (Hons) in Computer Science from London Metropolitan University, UK... Learn More...
May 2023 – Current
• Built and enhanced 50+ data pipelines using Spark, SQL, Python, and Talend, ingesting data into operational data stores and data lakes, with validation, reconciliation, and audit controls across diverse file and database sources.
• Executed TSYS legacy migration for Credit Cards & LOC products, and applied Spark /DB2 optimizations that reduced end-to-end pipeline runtimes by ~60%.
• Implemented CI/CD pipelines with Jenkins, Git, and Bitbucket; scheduled and monitored jobs via Autosys, Tidal, TAC/TMC, and integrated Unix scripts to improve logging, error handling, and production reliability.
December 2019 - October 2021
• Participated in the technical design and development of an internal GraphQL service to provide app extension recommendations on the App Store.
• Updated the Core platform to adhere to internal API patterns, ensuring data integrity when communicating between various platforms.
• Experienced in developing and managing web applications and participating in networking and quality assurance while prioritizing and managing personal workload in an agile environment.
May 2018 - May 2019
• Collected and managed customer data on expense tracker project and ensured proper ETL process after performing data cleansing
• Accomplished working under pressure to increase effectiveness and interventions by updating database of thousands of users.
• Promoted to team lead; in partnership with senior management, reorganized team production metrics leading to 10 percent boost in team productivity in Q1 2019.
2022 - 2023
Lambton College, Toronto
2018 - 2020
Islington College, Kathmandu, Nepal
Address
Toronto, Canada
Phone
+1-416-882-4378
upretidiwash09@gmail.com
