Calculate Average and Standard Deviation with missing dates in time series

buzz_boom · November 2016

When calculating the average usage and standard deviation for a list of parts based over a time series the results are not what is expected. The problem is not having a complete list of dates for each part number. I would need to generate the missing dates for each item number with a value of zero for the equations to work correctly. See attachment for better explanation. I am unsure of how to accomplish this in Domo.

AdamT · November 2016

In Domo, you could use the SQL function IFNULL(), and configure it something like this IFNULL(`Quantity`,0) so that if the Quantity is NULL then it will be replaced with a 0.

AdamT · November 2016

Hi @buzz_boom - This is a great question, and a common challenge. To work around this in Domo, we have a "calendar" dataset that you can leverage to join against to fill in the days that are not included in your dataset. To get this calendar dataset set up in your Domo instance, you can simply Buzz "@DomoSupport" and request it.

Let me know if you would like any other pointers on the joining itself.

buzz_boom · November 2016

Thank you for the quick response. I have a calendar that I am matching against to smooth the data already. By smooth I mean I push Saturday and Sunday usage to the previous Friday. Could you you tell me how I should be joining the data?

My first step is to join by usage table with my calendar table by the date fields. On the calendar table there is a field called "Report Date" which performs the smoothing of weekends to Fridays. So in my example 10/29 and 10/30 would be pushed TO 10/28. See updated attachment. In Excel when this calculation is done we do a pivot table and then replace blanks with 0. I would assume a similar operation in available in Domo.

AdamT · November 2016

In Domo, you could use the SQL function IFNULL(), and configure it something like this IFNULL(`Quantity`,0) so that if the Quantity is NULL then it will be replaced with a 0.

Unknown · November 2016

@buzz_boom, did any of the above replies help you out?

Ops · July 2020

Hi LizWR and AdamT,

I was going to help answer this question to see if this Calendar Dataset will resolve this problem as I'm facing something simular.

Avg Number of Sales VS Avg over Week (5days).jpg

However, this Post is pretty old (2016), just checking if anything has changed since then. Do we still need to buzz support for this Calendar ? I checked the Data Connectors area I got a handful of Domo-related Connectors, but nothing on Calendars ... though Google Calender showed up when just searching on "calenders".

Data Connectors - searched with Domo.jpg