Data Engineer with 8+ years of combined experience in backend development and big data systems, specializing in designing and optimizing high-volume ETL/Reverse ETL pipelines using Apache Spark. I architect scalable solutions that efficiently process 2+ TB/day, while improving the pipeline performance and reliability (between 3%-25% of time optimization and 50% in reduction of number of workers). My technical expertise in distributed systems and data infrastructure is complemented by strong collaboration skills, enabling me to work effectively across teams to translate business needs into robust technical implementations.
Contact
Email juanes_filo@hotmail.com
Phone (300) 318-3373
LinkedIn
juan-esteban-agudelo-agudelo
Github
JuanEstebanAgudelo
Gitlab
JuanEstebanAgudelo
Location
Rionegro,
Antioquia
054040
CO
Work
Scotia GBS
Data Engineer
2023-07
— Present
Nequi
Data Engineer
2023-04
— 2025-07
- 50+ data products design and implementation using Apache Spark processing 1+ TB daily.
- Optimization of 85% in ETL processing time and 50% reduction in number of workers by design, implementation and deployment using Apache Spark.
- Desing and implementation of third party data integration frameworks.
Lovelytics (previous Datalytics)
Data Engineer
2022-08
— 2023-03
Perficient
Java Developer
07/2021
— 07/2022
Ealax
Java Developer
01/2020
— 06/2021
Sapiencia
Backend Developer
07/2019
— 12/2020
- Reduction of the dead portfolio in 12% (almost COP 500 millon) by the use of a custom reporting tools.
One Consultants
Senior Software Developer
01/2016
— 05/2019
- Reduce by 25% the picking dead time by tuning WMS of a direct sell company ally (Marketing Personal)
- Reduce by 20% the soldout order items by a Order prefilling of a direct sell company ally (Marketing Personal)
Education
Politécnico Colombiano Jaime Isaza Cadavid
06/2024
— 06/2025
Data Analytics Specialist, Specialist Degree
Politécnico Colombiano Jaime Isaza Cadavid
02/2008
— 10/2015
Control Engineer, Bachelor
Publications
Publication
2014-10-01
Published by Company
Description…
Skills
Web Development
HTML, CSS, and JavaScriptLanguages
English
Intermediate (B2)
German
Basic (A2)
Spanish
Native Speaker