Best Of

Re: ETL Fails = "Illegal Number of Inputs"

It just started happening to another ETL now. I'll definitely open a ticket as soon as I figure out how! Thanks.

I will say that I've noticed it is only happening on some ETLs where I have a SQL tile. I'll review those tiles again to make sure there isn't anything funky. They are still in the beta phase, apparently.

TheBeard

1

Re: How can I efficiently identify specific columns in a large dataset using Domo’s AI/ML tools?

Whew. That's a bunch of columns. Whether you do it through Domo's AI or externally….you can feed AI a list of column names and ask it the question. It may have a limit on how many you can give it at one time. You may need to feed it a hundred or so at a time and limit the answers down til you get what you need.

Let's say I go to ChatGPT or in a Domo question box….and say exactly as below:

"Working with Domo, I have a dataset with the following columns/fields:
record type,financialcategoryname,batchtimestamp,projectid,plannedcost
Can you please identify the column that best represents date, and the column that best represents amount?"

It will respond with something like this:

Certainly! Based on the column names provided:

Column representing date:
- batchtimestamp: This column likely contains date and time information. It is the best candidate for representing date and time.
Column representing amount:
- plannedcost: This column likely represents financial values or costs, making it the best candidate for representing an amount.

So, batchtimestamp is your date column, and plannedcost is your amount column.

ArborRose

1

Re: How to Use Partitioning to Retain Data in a Monthly Rolling Window Dataset

You can configure a MagicETL dataflow Output Dataset tile to use a Partition update method and specify the month field as your key. This will keep around any data that is no longer being pulled in from your source dataset.

This is a beta feature so you may need to reach out to your account executive.

GrantSmith

1

Re: Can Domo Workbench Support TCP/IP Over SSH for Secure Database Connections?

I've typically utilized a VPN connection to have a secure layer to process data through on the Workbench server.

GrantSmith

1

Re: How to filter column by a specific language

Hello @Mansa_TCC,

If the title in Portuguese or Spanish contains only standard English letters, this might be why you can't filter them.

This can be done with Domo Jupyter if you have access to this function.

Here is the script:

pip install langdetect
from langdetect import detect

#Function to detect language
def detect_language(title):
try:
return detect(title)
except LangDetectException:
return 'Unknown'

#Apply the function to create the 'Language' column

sample['Language'] = sample['title'].apply(detect_language)

#Display the DataFrame with the new column
sample

Here is the result:

You can then write to the dataset with the new column.

I can't think of any other solution. Unfortunately, I don't see 'langdetect' as part of the Python in ETL and you can't do it from there. If you need, I can help you with the rest of the steps.

Manasi_Panov

2

Re: Count number of character occurrence in string

You can calculate the length of the string, remove the character you want, recalculate the length and take the difference.

LENGTH(`Color`) - LENGTH(REPLACE(`Color`, ',', '')) + 1

GrantSmith

5

Re: Cache configuration

Hi @LearningNinja!

The cache for federated queries will save the query results for a specific query for up to 24 hours (this is the TTL mechanism and is configurable by user)
Cache is stored at the query level on card queries, and only caches query results. Because this cache is at the query level, if multiple users view the same card in Domo that produces the same query under the hood, then those query results could be returned for multiple users.

If using an OAuth configuration for your federated connection that requires users to authenticate to the cloud warehouse before it can return queries, those queries result caches would not apply across users, as each user potentially has different levels of data access.

Data previews on the dataset details page are not cached
See above
See response for #1

JoshMillheim

1

Re: i would like to color the table text

Domo's ability to color text in cells is pretty limited. But you can work around it. One way would be to use an HTML table with custom formatting.

This thread may give some insight:

https://community-forums.domo.com/main/discussion/67852/html-table-conditional-formatting

I believe you can also do the following:

<p style="color: 

    {{#if (condition)}} 

        red; 

    {{else}} 

        green; 

    {{/if}}">

    Your conditional text here

</p>

<p style="color: {{#if (data > 50)}} green; {{else}} red; {{/if}}">

    Your metric value is: {{data}}

</p>

ArborRose

1

Partitioning for Dummies?

Can someone point me to a good step by step guide to setting up partitioning in Workbench 5.2? I have a very large dataset (currently 5.8 million rows) that gets updated daily with a full replace. As you can imagine it takes a HOT MINUTE to run. On average there are 12.5k new records and 100 records updated or deleted daily. Clearly I don't need to do a full replace, but my brain is just not grasping how to get the partitioning set up correctly. The knowledge base articles just aren't detailed enough. Can someone point me towards Domo Partitioning for Dummies?

ARosser

1

Re: How to get last date

@ageibe You can do this with the Group By tile in Magic ETL.

In section #1 (select what columns identify the grouping) put your name and patient Id columns in that section.

In section #2 enter the name you want to give the most recent date column

In section #3 choose the encounter date column and then choose maximum for the aggregation type.

This will give you the most recent encounter date for each patient.

MarkSnodgrass

2