FileMaker data needed to send to DOMO daily
I am working on sending over records from FileMaker each day on a update frequency. I have an API connection between the two sources but am having trouble finding the best possible method to send data to DOMO every 15 minutes. Right now I am using the import method but it will only replace data and not append. As this is not a problem right now, in a year I do not want multiple rows of data to be constantly replaced.
What are some options that I can utilize to make this process as efficient as possible.
Thanks
Best Answer
-
Feed the dataset into a magic ETL. Depending if you care about the possible duplicated records or not you can either set the output method on your output dataset as Append to just continually add the rows that were imported. Alternatively if you're using dates or some sort of partition that you'll be overwriting ever time you can utilize the partition output method and define your partition key.
Another method is to utilize a recursive dataflow to overwrite data to do a more upsert method (update the records if the key exists, insert/create a record if it doesn't). There's documentation on this method here:
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0
Answers
-
Feed the dataset into a magic ETL. Depending if you care about the possible duplicated records or not you can either set the output method on your output dataset as Append to just continually add the rows that were imported. Alternatively if you're using dates or some sort of partition that you'll be overwriting ever time you can utilize the partition output method and define your partition key.
Another method is to utilize a recursive dataflow to overwrite data to do a more upsert method (update the records if the key exists, insert/create a record if it doesn't). There's documentation on this method here:
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 616 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 738 Beast Mode
- 57 App Studio
- 40 Variables
- 685 Automate
- 176 Apps
- 452 APIs & Domo Developer
- 47 Workflows
- 10 DomoAI
- 36 Predict
- 15 Jupyter Workspaces
- 21 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 124 Manage
- 121 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive