Monitoring dataset size in datacenter?
How can we monitor dataset size in the data center? E.g. if data set size decreases after data upload or dataflow run, can we get an alter, if not, is there any way around to get informed about this kind of scenarios?
Best Answer
-
I've been playing with a card that shows the "profile" of a data set lately. I set it to show the count of rows over time and trended that over the course of the data set. Depending on how your data set works (append, replace) you could set alerts on the card if your data set ever decreases (and you would not expect it to do so), or if it doesn't increase (and it should increase every day).
Hope this helps.
0
Answers
-
I've been playing with a card that shows the "profile" of a data set lately. I set it to show the count of rows over time and trended that over the course of the data set. Depending on how your data set works (append, replace) you could set alerts on the card if your data set ever decreases (and you would not expect it to do so), or if it doesn't increase (and it should increase every day).
Hope this helps.
0 -
Thanks for your reply. However, how to I get the total number of rows in the card?
0 -
Pick any column and count the number of rows. If you've got a batch id, or a column that has values that are never null, you can quickly summarize the size by counting the total.
0 -
Perfect, thanks
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 297 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 616 Datasets
- 2.2K Magic ETL
- 3.8K Visualize
- 2.5K Charting
- 729 Beast Mode
- 54 App Studio
- 40 Variables
- 678 Automate
- 173 Apps
- 451 APIs & Domo Developer
- 46 Workflows
- 8 DomoAI
- 34 Predict
- 14 Jupyter Workspaces
- 20 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 121 Manage
- 118 Governance & Security
- Domo Community Gallery
- 32 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive