Best Of
Re: How to Remove Duplicate rows in analyzer?
@SaloniShah is the data actually duplicated in your dataset? If so that's probably something to be concerned about if it's not intentional.
Take a look at the connector that's bringing in the data, is it set to APPEND or REPLACE?
Is the data actually duplicated or are just a few rows duplicates? If you run the connector multiple times do you accumulate a copy of the dataset each time? (if so that implies that you're running an APPEND instead of REPLACE in your connector settings.
Sometimes Domo's datasets are 'broken', to deduplicate a row, you can use "remove duplicates" tile in Magic ETL or use a rank_window tile and apply a row_number to each row partitioned on date then apply a filter. (remove duplicates is probably conceptually easier to understand, rank_window is more precise).
Re: Why are my filters not working in Magic ETL?
Hi @damen does it return no rows when you save and run the dataflow, or just when you run a preview? If you haven't done so already, try running the entire dataflow and see if you get different results.
Previews do not process every row in order to save processing power, so it is possible that the more recent rows are not being included in your preview. You can also adjust how many rows your want to include in your preview using the drop-down on the top of the ETL editor.
Re: Convert null numeric values to '0' in Magic ETL
This is an old thread - BUT - Magic ETL2 has more efficient ways of handling null -
on input click on data handling, then the settings to set null values to Nil (0)
Alternatively, if nulls are generated in the flow use the Alter Columns tile - select columns to handle Null also as Nil
Re: ¿How can I classify an object based on conditions?
To rank at the [Basic] level you must use at least 2 tools, it doesn't matter if you use it at least 1 time.
The tools for level 1 are: News, content and questionnaires.
If a course uses at least one tool from the basic level, it would be advisable to classify it in the basic level even if it does not meet the conditions because the idea is that it does not remain unclassified. For a case that does not use any tools then it is classified [No Use].
Thank you very much for your help.
I apologize if my translation is not correct. 😳
Re: Has anyone had success pulling in useful BLS data from the BLS data connector?
Hi MErrichetti, you can also pull a lot of the same data from the St. Louis Fed (which is what we did because there is a lot more data out there).
https://research.stlouisfed.org/docs/api/fred/
You can register for a free API key and we use the JSON connector to pull it. It should have all the BLS data there as well as data from the Census Bureau and a multitude of other sources. (85 sources: https://fred.stlouisfed.org/sources?pageID=1)
You can search here for the dataset name: https://fred.stlouisfed.org/
For example, the Civilian Unemployment Rate from the BLS is UNRATE. You use this when setting up the JSON connector.
Let me know if you need additional info.
jstan
Re: MySQL Indexing Issues
#1 is writing a SQL statement, like
ALTER TABLE t1 ADD INDEX('t1.COLUMN')
Re: ¿How can I classify an object based on conditions?
@andersson_morales19 You're case when statement isn't working because of the waterfall. CASE WHEN statement go through each part of the statement and once a condition is met, it doesn't evaluate anything else. So in the case of your beast mode, if a row meets the 'Basico' condition, it assigns it as 'Basico' and won't evaluate it further, even if it meets other conditions in the statement. So level two and level three will always meet level one conditions, so as you have it right now, you'll never find level two and three, everything will just be level one. You would need to reorganize your case when statement to start with the conditions for level three, then level two, and end with level one. Hope that makes sense!
Re: "current year, current month" and "previous year, current month" Beast Modes
@damen Current month:
case when YEAR('Transaction Date') = YEAR(CURDATE()) and MONTH('Transaction Date') = MONTH(CURDATE()) then 'amount' end
Previous year, current month (assuming this means same month last year):
case when YEAR('Transaction Date') = YEAR(CURDATE()) -1 and MONTH('Transaction Date') = MONTH(CURDATE()) then 'Amount' end
Re: "current year, current month" and "previous year, current month" Beast Modes
@damen Just noticed that the beast mode you posted of what you're using, you put:
then 'amount' end
You're using 'amount' as a string so you're saying when the row meets that condition put in the word 'amount' and since the column is intergers, it comes in as nothing. You need to use whatever column contains your values.
Re: "current year, current month" and "previous year, current month" Beast Modes
@damen The beast mode you have is for current month, not current year. It will only have values for the current month (2022-Sep).