FileMaker data needed to send to DOMO daily
I am working on sending over records from FileMaker each day on a update frequency. I have an API connection between the two sources but am having trouble finding the best possible method to send data to DOMO every 15 minutes. Right now I am using the import method but it will only replace data and not append. As this is not a problem right now, in a year I do not want multiple rows of data to be constantly replaced.
What are some options that I can utilize to make this process as efficient as possible.
Thanks
Best Answer
-
Feed the dataset into a magic ETL. Depending if you care about the possible duplicated records or not you can either set the output method on your output dataset as Append to just continually add the rows that were imported. Alternatively if you're using dates or some sort of partition that you'll be overwriting ever time you can utilize the partition output method and define your partition key.
Another method is to utilize a recursive dataflow to overwrite data to do a more upsert method (update the records if the key exists, insert/create a record if it doesn't). There's documentation on this method here:
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0
Answers
-
Feed the dataset into a magic ETL. Depending if you care about the possible duplicated records or not you can either set the output method on your output dataset as Append to just continually add the rows that were imported. Alternatively if you're using dates or some sort of partition that you'll be overwriting ever time you can utilize the partition output method and define your partition key.
Another method is to utilize a recursive dataflow to overwrite data to do a more upsert method (update the records if the key exists, insert/create a record if it doesn't). There's documentation on this method here:
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 102 SQL DataFlows
- 626 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 754 Beast Mode
- 61 App Studio
- 41 Variables
- 693 Automate
- 178 Apps
- 456 APIs & Domo Developer
- 49 Workflows
- 10 DomoAI
- 38 Predict
- 16 Jupyter Workspaces
- 22 R & Python Tiles
- 398 Distribute
- 115 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 130 Manage
- 127 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 11 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 110 Community Announcements
- 4.8K Archive