Allow manual refresh of Cloud Amplifier / Federated dataset schema

James Gossling - Bispoke

I would love a quick 'Run Now' button on this dropdown for Cloud Amplifier and Federated datasets. When building new models where I'm making frequent changes and adding cloumns, I have to wait and wait for the schema to auto refresh from the database for my data to show up again.

I think the main workaround now is to lower the data freshness setting on the cloud amplifier connector but that affects all my datasets. Most don't need super frequent refreshes, just new datasets that I'm adding.

daniel_echeverria

This is so much needed. We would appreciate the Domo team enhancing this or providing an alternative solution.
I often fix tables in Databricks, and I want those changes to be reflected in cards. I cannot find a way to refresh manually other than waiting until it refreshes itself.

Joseph_Peterson

Since joining Domo a little over a month ago, I've heard a few requests for a manual "Refresh Now" button. I see the need for it – when building / testing MagicETL data flows as well as in other areas.

This is on our roadmap, and I'm hoping to get it scheduled for dev in the coming months.

Another enhancement that we're planning – for which we already have mockups – is the ability to define separate caching TTL rules for tables / datasets individually or in groups … instead of having just one TTL setting that applies to all tables / datasets within a Cloud Amplifier integration. This way, some datasets could be scheduled to update frequently (to avoid staleness) while others be cached for longer periods (to reduce costs in the underlying CDW).

Even with fine-grain control of caching on a per-table basis, I still think there is a need for manual "Refresh Now" in ad hoc prototyping and testing.

James Gossling - Bispoke

@Joseph_Peterson That sounds incredible. There are definitely some datasets where TTL/freshness could be set to days and others where I would need 10 min updates.

This would really uncork the potential of cloud amplifier. Manual refresh is mostly helpful when in the creation/iteration process of a new data model where columns are changing frequently.

Thank you for looking at this idea and providing feedback!