Does your company receive data payloads as attachments in emails? Do people manually download these, massage them in Excel, and upload them to Google Drive for wider internal use? It sure would be great if you could get the data through an API in an automated way but sometimes that's just not the way the cookie crumbles.

We've developed a lightweight system for automating receiving and processing payloads attached to emails to eliminate manual processing and get your data into your warehouse quickly and efficiently.

Now more than ever, CSV structure can change quickly according to business need. Learn how to set up ingestion logic to consume CSV files with an arbitrary number of columns.

Reflections & thoughts after six months of consulting in the data world.

You never know for sure where you'll end up when you venture out and do your own thing. Six months in, and I can definitively say starting Big Time Data has been a once in a lifetime experience. While there have been some curveballs, late nights, and paperwork frenzies, this journey is far better than I could have ever imagined. The most rewarding part by far has been the community Big Time Data has been supported by: our team, clients, partners, advisors, and a pretty cool lawyer.

How a seemingly insignificant meeting of two data superheroes sparked the chain of events that led to the creation of Big Time Data.