Type: Data Engineering InternshipMonth-Year: May-July 2023Recommendation:
Created ~50 SQL queries to power product insights on top of a BigQuery database with ~500 tables.
Migrated ~15 manually operated ETL Google Collab scripts to automated data pipelines. Built using a combination of backend endpoints deployed on Google Cloud Run along with Google Cloud Scheduler for orchestration. This saved 2 hours of manual effort every day.
Setup CI/CD on the data pipeline using Cloud Build and Github Actions.
Built impactful customer facing and internal dashboards by leveraging Explo and Google Looker Studio.
Developed a Slack notification system for key business metrics like acquisition, churn, updation.