Backup of ETL

froghunter

I have a number of ETLs that may need to be extensively updated or removed. I would like to create a backup. I understand that there is a versioning capability built into Domo, but it would be very useful to have an offline backup as well. Besides manual work, is there a way to do this?

GrantSmith

You used to be able to do this with the CLI tool and specifically the backup command; however, it's since been deprecated per the documentation but you may be able to still utilize this

> help backup

backup: Performs a backup operation, to AWS S3, for all Domo entities of type <t>.

  backup -k <S3 Key> -s <S3 Secret> -b <S3 Bucket> -p <S3 Path> -r <S3 Region> -t <Backup Type>

  usage:
    -a,--role-arn <role-arn>                            Role ARN
    -b,--bucket <bucket>                                AWS S3 bucket
    -cd,--card-dataset <card-dataset>                   Card Dataset Id
    -cda,--card-dataset-auth <card-dataset-auth>        Card Dataset Auth
    -cdd,--card-dataset-domain <card-dataset-domain>    Card Dataset Domain
    -d,--detail-dataset <detail-dataset>                Report Dataset
    -e,--external-id <external-id>                      Role External Id
    -k,--key <key>                                      AWS S3 key
    -m,--kms <kms>                                      KMS Key
    -n,--notifications <notifications>                  Notification List
    -p,--path <path>                                    AWS S3 path
    -r,--region <region>                                AWS S3 region
    -s,--secret <secret>                                AWS S3 secret
    -t,--type <type>                                    Backup Type
    -x,--summary-dataset <summary-dataset>              Report Dataset

Alternatively, you can use the undocumented APIs to replicate the dataflow or utilize a third-party python package like https://pypi.org/project/domolibrary/

ColemenWilson

In addition, and perhaps this is what you meant by manual work, you can create copies of a dataflow with one click. I often do this if I can going to rip apart a dataflow as a backup.

GrantSmith

You used to be able to do this with the CLI tool and specifically the backup command; however, it's since been deprecated per the documentation but you may be able to still utilize this

> help backup

backup: Performs a backup operation, to AWS S3, for all Domo entities of type <t>.

  backup -k <S3 Key> -s <S3 Secret> -b <S3 Bucket> -p <S3 Path> -r <S3 Region> -t <Backup Type>

  usage:
    -a,--role-arn <role-arn>                            Role ARN
    -b,--bucket <bucket>                                AWS S3 bucket
    -cd,--card-dataset <card-dataset>                   Card Dataset Id
    -cda,--card-dataset-auth <card-dataset-auth>        Card Dataset Auth
    -cdd,--card-dataset-domain <card-dataset-domain>    Card Dataset Domain
    -d,--detail-dataset <detail-dataset>                Report Dataset
    -e,--external-id <external-id>                      Role External Id
    -k,--key <key>                                      AWS S3 key
    -m,--kms <kms>                                      KMS Key
    -n,--notifications <notifications>                  Notification List
    -p,--path <path>                                    AWS S3 path
    -r,--region <region>                                AWS S3 region
    -s,--secret <secret>                                AWS S3 secret
    -t,--type <type>                                    Backup Type
    -x,--summary-dataset <summary-dataset>              Report Dataset

Alternatively, you can use the undocumented APIs to replicate the dataflow or utilize a third-party python package like https://pypi.org/project/domolibrary/

ColemenWilson

In addition, and perhaps this is what you meant by manual work, you can create copies of a dataflow with one click. I often do this if I can going to rip apart a dataflow as a backup.

froghunter

Thank you both for the replies. I'm checking out domolibrary now, as I would like to be able to back up offline and programmatically.