Best Of
Re: Magic ETL | Remove Duplicates Tile | Select all fields option
I'd love to see a "select all" option in the remove duplicates tile, sort of like the same button on Select Columns where it loads up all the fields but then you can go back still and remove the ones you don't need or care about.
I see plenty of cases where there's a junky input (wonky APIs, spreadsheets uploaded directly from hell with way to many columns, etc.) that needs a quick/easy button to cleanup/massage things before starting to explore the rows.
The downside is it could easily pick up a null column and with existing behavior, return a zero row output. Bonus feature if the dedupe could skip null columns from inspection.
Billobi
Re: Data sharing rules
I think if you create the right PDP policies, you can prevent this type of sharing from happening:
Re: Using variable on Workflow assignment
Yes, you can assign variables that are of the Person or Group type from that drop down.
Re: Flexible SUM Aggregates With Duplicate Values in Dataset
@jmmc you can do this with SUM(DISTINCT ())
SUM(DISTINCT Price) FIXED (BY Product ID)
Yields the following results. You can see that the column fixed1 only includes the total once per id.
Re: Nested fixed functions
I accepted @ArborRose's answer. We found a way to what we needed without using the fixed function, though not in the same way - we used case statements for each year and added those up rather than the nested fixed function.
Re: SQL View of DataSets
Is there a way to get the Apache Spark output or some other text summary from a Magic ETL? It is very cumbersome to click into each individual icon to see what columns were selected/renamed, how things were joined, and all the different potential functions. We are trying to move some of our modeling into dbt and also build out a dictionary of metrics, and our ETLs generally include 5-13 inputs.
Re: Adding a new dataset after creating a Custom App
@MattTheGuru - great points, but if he is using the default vanilla JS hello world template example rather than the React template, there isn't going to be a package.json file or a build step.
@NCRivera - your dataset definition in the manifest looks right to me. If you run domo publish after saving that file, you should be able to see multiple dataset connections in the wiring screen. I'd check that first. If it doesn't seem to have added the additional alias, then you may want to doublecheck that you're id in the manifest file is right and that you're publishing to the right App Design.
I'd also be happy to jump on a call and have a look if you're still stuck.
Re: domo.onFiltersUpdate to include Variables with DDX Brick
This is a huge one! I'd add for @TannerGarrett and the PM team - one of the key blockers here is to make sure the Data API supports variables. It currently supports beastmodes but not if they include variables.
Re: Lag() function for previous value over unpredictable rows counts of each partition
@emmanuelfabre_1 you're welcome! Next time you are in Utah let me know and I'll take you up on that!
