What happens if the analyst wants to analyze the data before it gets into Redshift? Also, what do you do when the underlying data's schema changes (i.e., the API tier gets upgraded and new fields appear in S3 but not in Redshift).
For QA:
The MySQL ETLs are brittle. They depend on a certain schema. If it changes, part of the ETL will break.
Sometimes definitions in the logs change. So far everytime this has happened and I wasn't notified, their effects are quite clear. Ex a metric doubling on a certain day.
Really useful piece. I am only a new Data Scientist but currently finding my work is similarly in finding ways for less technical staff to have access to and analyse data sources. Perescope sounds like a really good tool, but I was unable to find any pricing on their website - would you be able to give a rough idea of how much it costs?
