beast mode processing limitations
Our Domo instance is limited with federated data, but I noticed I can create case statements in beast mode to create a new field with associations with case statements. For example, I can map customers to an account manager with a statement, e.g. (CASE WHEN `Customer` = 'Joe Harris' THEN 'Mark Smith'), and I can use that beast mode in domo to manage around associations. I was able to get it to work with a sample of like 10, but when I tried to run around 1600 case statements, it timed out. I'm guessing its simply too much processing, but it doesn't give me any error to know for sure. I welcome any thoughts.
Answers
-
That's a pretty large case statement. I would suggest create a lookup table in a web form or Excel file and then join it to your main dataset in a Magic ETL dataflow. This will process much faster and be easier to maintain.
**Check out my Domo Tips & Tricks Videos
**Make sure to any users posts that helped you.
**Please mark as accepted the ones who solved your issue.0 -
@MarkSnodgrass, Federated datasets can't be utilized in an ETL.
https://domohelp.domo.com/hc/en-us/articles/360042932974-Using-the-Federated-Data-Solution#1.2.
There shouldn't be much of a performance hit from a Domo standpoint. Do you have access to your database logs to see if your server is able to handle processing your query?
https://domohelp.domo.com/hc/en-us/articles/360042932974-Using-the-Federated-Data-Solution#5.0.0.4.
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0 -
@user095459 recall. with Federated Query domo is passing the lift of processing the query back to your source system. This is no longer an Adrenaline question.
This is a Your Database question. The Federated Query Adaptor will have timeout rules etc built into it's configuration, that may be what you're running into.
That said, talk to your CSM and ask what your options are. With the new Data Fabric option, it theoretically should be possible to do ETL into your DataCenter (per @MarkSnodgrass 's idea)
Jae Wilson
Check out my 🎥 Domo Training YouTube Channel 👨💻
**Say "Thanks" by clicking the ❤️ in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 102 SQL DataFlows
- 626 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 755 Beast Mode
- 61 App Studio
- 41 Variables
- 693 Automate
- 178 Apps
- 456 APIs & Domo Developer
- 49 Workflows
- 10 DomoAI
- 38 Predict
- 16 Jupyter Workspaces
- 22 R & Python Tiles
- 398 Distribute
- 115 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 130 Manage
- 127 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 11 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 110 Community Announcements
- 4.8K Archive