FileMaker data needed to send to DOMO daily
I am working on sending over records from FileMaker each day on a update frequency. I have an API connection between the two sources but am having trouble finding the best possible method to send data to DOMO every 15 minutes. Right now I am using the import method but it will only replace data and not append. As this is not a problem right now, in a year I do not want multiple rows of data to be constantly replaced.
What are some options that I can utilize to make this process as efficient as possible.
Thanks
Best Answer
-
Feed the dataset into a magic ETL. Depending if you care about the possible duplicated records or not you can either set the output method on your output dataset as Append to just continually add the rows that were imported. Alternatively if you're using dates or some sort of partition that you'll be overwriting ever time you can utilize the partition output method and define your partition key.
Another method is to utilize a recursive dataflow to overwrite data to do a more upsert method (update the records if the key exists, insert/create a record if it doesn't). There's documentation on this method here:
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0
Answers
-
Feed the dataset into a magic ETL. Depending if you care about the possible duplicated records or not you can either set the output method on your output dataset as Append to just continually add the rows that were imported. Alternatively if you're using dates or some sort of partition that you'll be overwriting ever time you can utilize the partition output method and define your partition key.
Another method is to utilize a recursive dataflow to overwrite data to do a more upsert method (update the records if the key exists, insert/create a record if it doesn't). There's documentation on this method here:
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0
Categories
- All Categories
- 1.7K Product Ideas
- 1.7K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 294 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.8K Transform
- 97 SQL DataFlows
- 607 Datasets
- 2.1K Magic ETL
- 3.8K Visualize
- 2.4K Charting
- 707 Beast Mode
- 49 App Studio
- 39 Variables
- 667 Automate
- 170 Apps
- 446 APIs & Domo Developer
- 44 Workflows
- 7 DomoAI
- 33 Predict
- 13 Jupyter Workspaces
- 20 R & Python Tiles
- 391 Distribute
- 111 Domo Everywhere
- 274 Scheduled Reports
- 6 Software Integrations
- 115 Manage
- 112 Governance & Security
- Domo Community Gallery
- 31 Product Releases
- 9 Domo University
- 5.3K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 103 Community Announcements
- 4.8K Archive