Thrasio - SDE Intern
Internship, New York, June 2022 - August 2022,
- Prototyped data ingestion pipelines handling 20 billion rows for Amazon using Snowflake, S3, SQS.
- Implemented the deduping process for such large tables using dbt tool.
- Designed a service to handle incoming data from various sources that helped reduce the developer resources allocated by 50%.