Partitioning

We've noticed that if we change the update method of an existing dataset to Partition from replace, we end up with two records in the dataset for every new one (and both of them look identical, down to the field we're using for partitioning): it was quite the shock to see a dataset I expected to have 91 million rows…

Hi Domo Community, I’m currently working with a dataset (via MongoDB Connector) that operates on a 12-month rolling window, where data older than 12 months is deleted on the 1st of each month. Long story short, I cannot change this configuration. But, I would like to retain some of this older data using partitioning before…

Can someone point me to a good step by step guide to setting up partitioning in Workbench 5.2? I have a very large dataset (currently 5.8 million rows) that gets updated daily with a full replace. As you can imagine it takes a HOT MINUTE to run. On average there are 12.5k new records and 100 records updated or deleted…

We have an ETL set up to a partitioned output. Now that we are far enough into 2024 I'm being told that we can reduce the size of this dataset by removing all 2022 data from it. What would be the best way to go about doing this?

Hello! I am trying to replicate an excel formula to determine the number of times a caller calls within 4 days, 3 days, 2 days, and 1 day. I would like to create a field for each of these time windows. If someone calls 6 times within 4 days, I would like the 6th call to have the number 5 in it in the "4 day window" flag.…

Hello all, I'm tiring to pull large amount of data via Workbench, previously this was done with SSIS for loop container pulling only fraction of the time frame data at a time, and appending the results. is there way to achieve this in workbench as I'm not able to find the proper documentation.

I use several connectors that do not currently have partitioning capabilities. Is there a way to rebuild them to allow this capability? For example, Facebook, LinkedIn, etc do not have the merge option.

I've got access to the partitioning beta and trying to figure out where to start. I have a number of legacy datasets (marketing platforms like Facebook, LinkedIn, Google Ads and Google Analytics) and dataflows that are clunky at best and go the long route to handle recursive data. I'm looking to simplify and make these…

I need help implementing a particular use case for partitions: importing selected partitions from a dataset, modifying the records, then outputting the data back into it's original partition (or a new partition) in the original dataset. There are two uses for this I can think of off the bat: A dataset can have a maximum of…

Good afternoon. Typically, to not do full replaces of data pulls into Domo from our databases, we have used recursive dataflows with ETL. I am trying to think of a way of accomplishing this using the partitioning features in ETL and/or workbench to avoid the ETL still having to process the whole set of updated+historical.…

At the base, my dataset is broken up by employeeID, months, and planID. For each of the employees, month and plan; the employee receives a $ value based on performance, called "Earned" and they also have a column "Funded" that indicates what they were funded for the plan and month. I am trying to create a card that…

The objective is to get the closer's best week of sales without creating an ETL as we want this to be dynamic with the date range selected on the card. We have a list of sales (each have a unique opportunity Id) with project sale dates and closer names. I had thought this formula may work but I'm having issues: RANK() over…

Do the fixed functions actually work with Count Distinct? I'm trying to leverage them to ignore some filters, but they're not producing the right results (always significantly higher). The example below does not include the filter bit since I can't even get the base of the function to work correctly. The window function I…

Rewatch the presentations from the September In-person user group in Utah. If you'd like access to public data files, see this post on how to join the Dojo Domo instance. To view presentation from past user groups, bookmark THIS PLAYLIST on YouTube. Ashleigh Stevenson, Business Intelligence Developer at CAE Defense: Course…