Domo comparison with ETL Tools

vibhusharma2210
vibhusharma2210 Member
in SQL DataFlows

Does Domo has all capabilities which modern ETL tools like Azure Data Factory, Apache Airflow, Informatica etc.

Answers

  • GrantSmith
    GrantSmith Coach

    Domo has a wide variety of capabilities. No two ETL tool has feature parity so I'd be interested in knowing if there are specific capabilities you're interested in learning if Domo is capable of?

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • vibhusharma2210
    vibhusharma2210 Member

    As of now I can think of below three

    1. Handling large amount of data coming from source systems ( ~ GBs)
    2. Flexible to perform any transformations using SQL
    3. Single ETL Pipeline which takes data ranging from 0-5 years as input and gives output to store data in multiple target tables conditionally based on different time intervals e.g. target table T1 for storing 0-6 months data , target table T2 for storing 6 months -1 year data and similarly target table T3 for storing more than 1 year data

  • GrantSmith
    GrantSmith Coach

    Domo can do all three of those things.

    Regarding #2 Domo does have a MySQL type dataflow where you can utilize SQL queries to transform your data however there is also their drag and drop Magic ETL tool which does allow for some SQL like syntax as well in a formula tile and would be more performant than a MySQL dataflow.

    #3 Domo allows for a pipeline to have multiple dataset outputs and recently has enabled partitioning on datasets as well so you can either have 3 physical datasets like you're describing or a single dataset with partitions

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • vibhusharma2210
    vibhusharma2210 Member
    edited September 2023

    Please share video or document tutorial so that I can try to implement below related with #3 in Domo by following the steps mentioned in that tutorial

    a) Pipeline with multiple dataset outputs

    b) 3 physical datasets using partitions

  • GrantSmith
    GrantSmith Coach

    Partitioning in Magic ETL: https://domo-support.domo.com/s/article/000005150?language=en_US

    Magic ETL documentation: https://domo-support.domo.com/s/article/360055259234?language=en_US

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • vibhusharma2210
    vibhusharma2210 Member

    Can Domo perform near real time data processing with latency of (~ 6 minutes)?

  • GrantSmith
    GrantSmith Coach

    Domo has a feature called Federated data which will utilize your warehouse and query directly against it so you have realtime querying of data.

    https://domo-support.domo.com/s/article/360042932974?language=en_US

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • vibhusharma2210
    vibhusharma2210 Member

    It does not support ETL it seems as per below

    image.png

Categories