Backup of ETL

Options
froghunter
froghunter Member
in Magic ETL

I have a number of ETLs that may need to be extensively updated or removed. I would like to create a backup. I understand that there is a versioning capability built into Domo, but it would be very useful to have an offline backup as well. Besides manual work, is there a way to do this?

Tagged:

Best Answers

  • GrantSmith
    GrantSmith Coach
    Answer ✓
    Options

    You used to be able to do this with the CLI tool and specifically the backup command; however, it's since been deprecated per the documentation but you may be able to still utilize this

    > help backup

backup: Performs a backup operation, to AWS S3, for all Domo entities of type <t>.

  backup -k <S3 Key> -s <S3 Secret> -b <S3 Bucket> -p <S3 Path> -r <S3 Region> -t <Backup Type>

  usage:
    -a,--role-arn <role-arn>                            Role ARN
    -b,--bucket <bucket>                                AWS S3 bucket
    -cd,--card-dataset <card-dataset>                   Card Dataset Id
    -cda,--card-dataset-auth <card-dataset-auth>        Card Dataset Auth
    -cdd,--card-dataset-domain <card-dataset-domain>    Card Dataset Domain
    -d,--detail-dataset <detail-dataset>                Report Dataset
    -e,--external-id <external-id>                      Role External Id
    -k,--key <key>                                      AWS S3 key
    -m,--kms <kms>                                      KMS Key
    -n,--notifications <notifications>                  Notification List
    -p,--path <path>                                    AWS S3 path
    -r,--region <region>                                AWS S3 region
    -s,--secret <secret>                                AWS S3 secret
    -t,--type <type>                                    Backup Type
    -x,--summary-dataset <summary-dataset>              Report Dataset

    Alternatively, you can use the undocumented APIs to replicate the dataflow or utilize a third-party python package like https://pypi.org/project/domolibrary/

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • ColemenWilson
    ColemenWilson Coach
    edited December 2023 Answer ✓
    Options

    In addition, and perhaps this is what you meant by manual work, you can create copies of a dataflow with one click. I often do this if I can going to rip apart a dataflow as a backup.

    Screen Shot 2023-12-28 at 10.46.34 AM.png

    If I solved your problem, please select "yes" above

Answers

  • GrantSmith
    GrantSmith Coach
    Answer ✓
    Options

    You used to be able to do this with the CLI tool and specifically the backup command; however, it's since been deprecated per the documentation but you may be able to still utilize this

    > help backup

backup: Performs a backup operation, to AWS S3, for all Domo entities of type <t>.

  backup -k <S3 Key> -s <S3 Secret> -b <S3 Bucket> -p <S3 Path> -r <S3 Region> -t <Backup Type>

  usage:
    -a,--role-arn <role-arn>                            Role ARN
    -b,--bucket <bucket>                                AWS S3 bucket
    -cd,--card-dataset <card-dataset>                   Card Dataset Id
    -cda,--card-dataset-auth <card-dataset-auth>        Card Dataset Auth
    -cdd,--card-dataset-domain <card-dataset-domain>    Card Dataset Domain
    -d,--detail-dataset <detail-dataset>                Report Dataset
    -e,--external-id <external-id>                      Role External Id
    -k,--key <key>                                      AWS S3 key
    -m,--kms <kms>                                      KMS Key
    -n,--notifications <notifications>                  Notification List
    -p,--path <path>                                    AWS S3 path
    -r,--region <region>                                AWS S3 region
    -s,--secret <secret>                                AWS S3 secret
    -t,--type <type>                                    Backup Type
    -x,--summary-dataset <summary-dataset>              Report Dataset

    Alternatively, you can use the undocumented APIs to replicate the dataflow or utilize a third-party python package like https://pypi.org/project/domolibrary/

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • ColemenWilson
    ColemenWilson Coach
    edited December 2023 Answer ✓
    Options

    In addition, and perhaps this is what you meant by manual work, you can create copies of a dataflow with one click. I often do this if I can going to rip apart a dataflow as a backup.

    Screen Shot 2023-12-28 at 10.46.34 AM.png

    If I solved your problem, please select "yes" above

  • froghunter
    froghunter Member
    Options

    Thank you both for the replies. I'm checking out domolibrary now, as I would like to be able to back up offline and programmatically.

Categories