About Me

I'm a Data Engineer from Jakarta, Indonesia, currently based in Singapore. My work revolves around data pipeline construction and web development. I take pride in transforming complex problems into simple, reliable, and customer-centric solutions.

🔭 I’m currently employed at Quadrant.io, a global leader in mobile location data, POI data, and corresponding compliance services. My role involves building and maintaining data technologies that support the company's operations. Why Quadrant.io? Here's a fun fact to explain 👇:

⚡ Fun fact: The field of mobile location and POI data is constantly evolving, with a wide range of innovations being explored. As a data engineer, I am tasked with ensuring that our data streams are efficient, reliable, and credible. This involves continually refining our algorithms and infrastructure to handle large volumes of data swiftly and accurately.

🤔 So that: The scope for growth in this field is immense. Beyond the immediate challenges of data streaming, there are numerous other aspects to consider, such as monitoring, logging, cost optimization, and setting up alerts for incidents or anomalies in the data.

What I'm Doing

Data Architecture

The most modern and high-quality data architect made at a professional level.

Web Development

High-quality development of sites at the professional level.

Mobile Apps

Professional development of applications for iOS and Android.

Content Creator

I am a part time content creator in the field technology and startups.

Testimonials

David Christianto

Helfi is a rising star in our data team. We’ve joined hands on several projects for around one-half year, and Helfi is one of the best people I had as a colleague. He proves his interest in data fields by solving and proposing lots of ideas and looking for outside-the-box opportunities for our data stakeholders. I highly recommend his determination to learn something new to any person looking for a data engineer. He is the most profound person I have met, and his ability to tackle any problem is remarkable. Any data team would be lucky to have Helfi, and I can’t wait to see where the future takes him.

Senior Data Engineer at Bukalapak

Rizki Dermawan

Helfi is a fast learner, team player, and ambitious engineer. When he joined Bukalapak, he switched careers to a data engineering role. Helfi learned many things during his first year in data engineering. He grows from someone that knows nothing to someone that I can rely on. In Bukalapak, a data engineer needs to know end-to-end. From how the data is generated to how the data are gonna used and Helfi managed to handle most of them. I certainly would recommend him as Data Engineer. Best wishes on your new adventure!

Data Engineering Manager at Bukalapak

Mukti Ageng Wicaksono

he is so great

Business Development at S-gala.com

Fauzan Hilmi

Helfi Pangestu is one of the best people I've ever worked with. He is always punctual, his knowledge is vast and extensive. Excellent and result driven. Works towards maximal customer satisfaction. He was always able to successfully complete any tasks with favorable results despite deadline pressure. Helfi Pangestu will find a way to weather any storm with a smile. He is an asset to any business.

Software Engineer at Doyobi Singapore

Sandy Nugraha

Helfi is a person with great skills and profound experience of business solutions. His abilities in leadership makes him to see solutions instead of problems. He showed a high level of ownership, motivating technical skills and was a valuable contributor to our projects. Dedicated and goal oriented strategist that cannot be overestimated. I certainly would recommend him as Data engineer.

Partnership Senior Manager at PT. Alto Network

Derry Indrawan

It was amazing to work together with Helfi, who was an excellent Software Engineer. Broad-minded Software Engineer - his exceptional work flow, skills, imagination and understanding of change requests made the project a dream. Helfi is extremely enthusiastic about his work which is infectious. His leadership and organizational skills have been invaluable to the company. The success achieved in his job required extensive knowledge and dedication. I have constantly felt Helfi was one of the most effective team mates I have ever had the privilege of working with.

Product Owner / Delivery Owner at PT. Prudential Indonesia

Companies

Resume

Education

Brawijaya University

2014 — 2018

Computer Science

Experience

Quadrant.io

Oct 2022 — Present

Data Engineer
- Successfully refactored code and built CI/CD for easy preparation of data for clients and also initial unit testing.
- Successfully set up a Kubernetes self-hosted runner for GitHub Actions, which has been utilized for all CI/CD processes in Data Engineering Team.
- Successfully built and implemented an architecture for a daily pipeline using AWS Managed Workflows for Apache Airflow (MWAA). This involved designing and configuring the pipeline to extract, transform, and load large volumes of data efficiently. By leveraging the power of AWS MWAA, I ensured seamless orchestration and scheduling of data processing tasks, resulting in improved data reliability and accuracy.
- Implemented LLM (OpenAI API) to streamline the debugging process in AWS MWAA. By integrating LLM, I developed a solution that reduced the time spent on troubleshooting and provided intelligent recommendations to fix pipeline errors. This significantly enhanced the efficiency and productivity of the development team.

Programming Language: Python, Java
Database: MySQL
Big Data Platform: YARN, Spark, Kafka
Cloud Services: AWS
Provisioning Tools: Terraform, Helm Chart
Container Orchestration Framework: Kubernetes
Version Control System: Git

Bukalapak

Feb 2021 — Sep 2022

Data Engineer
- Successfully reduced the percentage of the number of incidents or data discrepancies per month starting from 40% to be 0%
- Successfully reduce cost ~IDR 200 Million / month by optimizing Kubernetes node, reducing logging to all services data, and setting lifecycle rules for our dataset in GCS.
- Successfully create an architecture for data pipeline which using Dataproc custom images which prevent job failure when installing dependencies library on cluster
- Successfully reduce the Datadog monitoring cost from $5k to $5 per month and implement it to all monitoring in Bukalapak services
- Successfully implement Data Quality Check and Data Anomalies Check for KPI Tables in Bukalapak

Programming Language: Python, Java, Scala, Go
Database: Cassandra, PostgreSQL, MySQL, MongoDB
Provisioning Tools: Ansible, Terraform
Big Data Platform: Hadoop, YARN, Spark, Kafka, Delta Lake
Cloud Services: GCP Dataproc, GCS, CloudSQL, BigQuery, Azure Databricks
Container Orchestration Framework: Kubernetes
Version Control System: Git
Others: Airflow, Prometheus, Grafana

Futuready

Nov 2018 — Feb 2021

Software Engineer
- Automate the issuance of insurance policies in the Grab Driver and Grab Customer projects
- Integrate payment gateway (OVO, Gopay, Bank Transfer, etc) using Midtrans, Faspay, and Direct API OVO for payment transaction in Futuready Products
- Build cms internal futuready and support making private javascript framework futuready using node js, koa js, MySQL DB, and serverless.
- Build a customer service dashboard using CodeIgniter Framework to support their priorities in calling customers, recording customer responses, and making decisions about customer interests in buying insurance policies.
- Manage and build contact center Futuready Thailand with twillio flex and integrating with Zoho CRM

Programming Language: Python, NodeJS, PHP
Database: PostgreSQL, MySQL, MongoDB
Provisioning Tools: -
Cloud Services: AWS Cognito, AWS SNS, AWS SQS, AWS Lambda, AWS EC2, AWS S3
Container Orchestration Framework: Kubernetes
Version Control System: Git
Others: Zoho One, Twillio, Qontak

Data Engineer
- Build machine learning & business intelligent using R Language to integrated google big data, google analytics, oneBox customer support data, and futuready database in one portal management report.
- Build ETL Process using python from Futuready Data Lake to be Publication Sets for Analyst

Programming Language: Python, NodeJS, R Language
Database: PostgreSQL, MySQL, MongoDB
Provisioning Tools: -
Big Data Platform: Spark
Cloud Services: AWS CloudWatch, AWS EMR, AWS Athena, AWS Glue, AWS Lambda, AWS EC2, AWS S3, AWS Step Function, Google Big Data
Container Orchestration Framework: Kubernetes
Version Control System: Git

Happy Pet Group

Aug 2020 — Dec 2020

IT Specialist
Providing solutions for Internal Projects Happy Pet Group especially for Finance Division.

Programming Language: Python, NodeJS
Database: MySQL
CRM: Zoho One

WIR Group

Jan 2018 — Nob 2018

Backend Engineer
As a Backend Developer, my responsibility is to provide Rest API for frontend developers. But, I involve in different roles and do some additional things, that are:
- Design and implementation of data storage solutions
- Lead engineers and code review for them
- Managing server for handling Incidents
- Build Continuous Integration and Continuous delivery
- Build Load Balancers
- Create Application Programming Interface using PHP Framework (CodeIgniter)
- Integration of user-facing elements developed by a front-end developer with server-side logic

App Store: https://play.google.com/store/apps/details?id=com.slingshot.minar&hl=in
Web: http://getminar.com/id/home-id/
Tools: PHP, CodeIgniter, VueJS, MySQL, Unity3D, JenKins.

PT. Adicipta Inovasi Teknologi

May 2017 — Aug 2017

Software Engineer
Build a web application for multi finance companies using java spring framework that has been modified by PT. AdIns (Adicipta Invoasi Teknologi). The purpose of the web application development is to optimize the company's operations in developing internal products and solve problems that are still manual.

Tools: Java

Design Skills

Web Design80%

Web Design

Adobe Premiere75%

Adobe Premiere

Photoshop90%

Photoshop

Illustrator50%

Illustrator

Sketch80%

Sketch

Blender30%

Blender

Unity3D35%

Unity3D

Coding Skills

Python90%

Python

Java75%

Java

Scala70%

Scala

Go55%

PHP95%

PHP

Node JS90%

Node JS

React JS75%

React JS

Svelte80%

Svelte

Portfolio

Select category

Category
All
Documentation
Design
Life

Blog

Mar 26, 2023

How to Set Up Kubernetes for Self-Hosted Runners on GitHub

In this article, I want to share an interesting approach to setup Kubernetes self-hosted runner on GitHub when I working at Quadrant.io. This approach is quite simple and can be easily understood, even if you don’t have experience in DevOps. Additionally, this article will focus on using AWS as a cloud provider.

Oct 2, 2022

How to Improve Data Quality with Deequ

Introduction to Data Quality with a Deequ scala library, and how I when at Bukalapak utilize data quality to increase the confidence of our data to stakeholders.

Feb 25, 2020

ACA Cloud Computing Certification

I want to share my knowledge about Fundamental Alicloud or Aliyun which I got from training Cloud Associate at Alibaba Indonesia. I hope you all can get helped after reading this post. And I will guide you on how to register the exam for certified Alibaba cloud associate.

Nov 9, 2018

Opini Untuk Generasi Y

Saya ingin menyampaikan opini saya terkait gen “Y” yang selalu membuat “heboh” ditahun-tahun ini.

Contact

Feel free to contact me! Please don't afraid to contact with me i swear i am not bite 🤣
Email: helfipangestu12@gmail.com
Instagram: @tuanmudahelfi
linkedIn: helfipangestu