dkonig Member

Thanks. I think I may have figured it out. I guess the nomenclature they use for joins where you are adding rows didn't quite make sense to me when all I wanted to do was add and alter a column. I am doing some data validation now to see if I got the result I expected. I'll be back if I have any other questions.

Oh wait. There is my error. I just swapped back to the filter tile and noticed that there is an option to use a formula. I missed that last time. Putting the formula in the filter tile seems to work. Thanks for the help.

I swapped out the filter tile for the formula tile and used the formula you provided.

Tried that. I am also noticing that not only does it remove 'Total' but the formula removes any text based values. I'm just not sure what is going on here.

Interesting. The formula works and moves the rows with 'Total' but then converts the column to an integer from text.

In addition I am finding a 'Total' value in the Marketing Category column for every of data in the report.

This row And this is the rule I am using

Ah. Yes. I had to update it further based on @marcel_luthi's earlier answer where it would find the value anywhere in the campaign name and not just at the start. Like this: ^.\b([MC]?\d{5,}).$

REGEXP_SUBSTR doesn't appear to be an available function

@GrantSmith This is the case statement I finalized on with some help from ChatGPT but this does not give me the expected result of returning just the match. Instead the entire campaign name is copied. What am I missing? CASE WHEN REGEXP_LIKE(`name`, '(M\d{5,}|C\d{5,}|\d{5,})') THEN REGEXP_REPLACE(`name`,…

I think this might suffice right for a RegEx that would capture any value that starts with and A or B followed by any number of digits or just a series of digits that is t least a minimum of 5? ^.\b(A\d+)|(B\d+)|(\d{5,}).$ If the it is always a minimum of 5 digits then this might be even better or perhaps there is an even…

@GrantSmith I"m not sure I completely understand your CASE statement. This will create a new columns and put the extracted value in it? Does 'field' need to be replaced with the column/field name?

@marcel_luthi Very helpful. I was just informed today that they plan on dropping the first letter. Of course they needed to complicate this more. Can this be modified to find the string of numbers regardless of whether it starts with an A or not? And tRegex would be the regex to use in the CASE statement @GrantSmith…

Hmm. I think, while the Split Column tile is simple, that in my case there is a little more complexity. I think this might be a case to use the Add Formula tile? I also found out that older campaign names sometimes have the A1234567 at some other location in the campaign name. Like this campaign1 - Google Ads - A1234567 -…

@colemenwilson I completely missed there was an option for 'custom' when choosing a delimiter. I swear looked for it. But this only solves part of my problem. If the first value does not begin with a letter followed by a number then those values would also be added to the new column. Is there a way to prevent that and…

In addition to my last question, what if there is no date selection option? Just Append or Replace?

Thanks. How would you set up an optional rank function? And for the weekly update that would be a separate ETL that runs once a week after this daily ETL?

@MichelleH Does my previous comment make sense or am I still not grasping?

Hmm. Ok. So if the connector is doesn't have merge then it's going to either replace or append no matter what. I only gain the benefit of partitioning in MagicETL if I need to use that data for other reporting. The partitioning allows me to update the partitions I want. For example let's take Google Ads. There is usually…

Maybe I'm just not understanding how/why to use partitioning. With a connector that only has append and replace options can you even use partitioning to pull in new data and replace(update), let's say, the last 30 days?

This video is from back in January. It definitely mentions the use cases I am interested in but I am still not sure exactly how to configure things. I'm still unclear on what to partition on especially when a dataset that are created with connectors without partitioning are used in the dataflow

Yes. I remember this video. I'll need to go back and re-watch since I saw it before I got beta access.

I haven't circled back to this yet but that sounds like an option. I was also going to give Chat GPT a try and see what it can whip up for me.

Which language should I be using to write this connector?

Ok. I'll need to read through that. If I understand this then I would need to create multiple connectors depending on the data I need? And what language do I use?

Thanks for the feedback. I need to check on how the reports are shared. I kind of think the jump into the template they have created and filter based on project and then share that on a call. Perhaps they print it out to PDF or something like that as well. I guess how it is shared will play a big roll on how this is built.…

Perfect. I'll give it a try and see what I work out. Much appreciated.

Can you move things between the sandbox and production? I would hate to have to rebuild everything in production.

Ok. Now that is an interesting option. Can you think of a way to share/move what I play around with in the Sandbox with the owners of the production Domo instance in my company?

Yeah. My mistake. I was told I was an admin but I am only privileged. Back to fight for admin rights or at least data admin rights.