Magic ETL

Magic ETL

Decimals in Input Dataset not carrying over to Output Dataset

Hi all,

I am working on creating a DataFlow as I needed to format a column from text to a date. During this process, it changed 'Net Change USD' from a Fixed Decimal to an Integer if I don't alter the column. I have altered the column to show 'Net Change USD' as a fixed decimal but it changed to just a decimal with the values still getting dropped (screenshot attached). Below is a screenshot of the column from the input and then output dataset. I also attached a screenshot of my dataflow including the formula I use for a different column incase that is causing the issue. I don't touch Net Change USD anywhere else, so I am not sure why the fixed decimal values are not carrying over.

Welcome!

It looks like you're new here. Members get access to exclusive content, events, rewards, and more. Sign in or register to get started.
Sign In

Best Answer

  • edited September 2024 Answer ✓

    I am guessing something else is happening in your dataflow unrelated to the alter columns tile because casting the data type in the alter columns tile shouldn't cause the output you are seeing. What else is going on in your ETL? Is it just what you screenshot above? The second line (-43,413.64) going to -41,412.00 makes no sense at all - that isn't even the proper rounding.

    If I solved your problem, please select "yes" above

Answers

  • Try switching to floating decimal instead of fixed.

    If I solved your problem, please select "yes" above

  • Member
    edited September 2024

    @ColemenWilson

    Thank you for the quick response but that didn't fix it. Here is a screenshot of the input dataset and the output dataset. For whatever reason the data is not the carrying over correctly.

  • edited September 2024 Answer ✓

    I am guessing something else is happening in your dataflow unrelated to the alter columns tile because casting the data type in the alter columns tile shouldn't cause the output you are seeing. What else is going on in your ETL? Is it just what you screenshot above? The second line (-43,413.64) going to -41,412.00 makes no sense at all - that isn't even the proper rounding.

    If I solved your problem, please select "yes" above

  • I would have thought @ColemenWilson was on the right track. If changing the type didn't fix it, it might be causes by something in your transformations. Sometimes, applying transformations in Domo (like STR_TO_DATE() for date formatting) may unintentionally cause type casting issues in other columns.

    1. CAST(`Net Change USD` AS DECIMAL(10,2))

    ** Was this post helpful? Click Agree or Like below. **
    ** Did this solve your problem? Accept it as a solution! **

  • edited September 2024

    Also, what if you scrap this ETL and instead convert your string to date in a beastmode? Using STR_TO_DATE() or I guess the same formula you are using in your formula tile?

    If I solved your problem, please select "yes" above

Welcome!

It looks like you're new here. Members get access to exclusive content, events, rewards, and more. Sign in or register to get started.
Sign In