AndreaLovesData Contributor

Hi! Just wanted to follow up here. I spoke with our engineering team about this idea, and I learned something new about Magic ETL. Apparently, the reason that the feature does not exist is because it's not needed in Magic ETL. Magic already optimizes which columns are loaded into the DataFlow based on whether or not the…

@user031170 This is on my shortlist of things I'm reviewing with the team. I heard a lot of good feedback and requests for this feature at Domopalooza as well.

Updating the status as the SQL Tile for Magic ETL is now in beta. Reach out to your account team to get on the list for the SQL Tile beta.

@trafalger Got it! This is definitely on my radar and something I'm exploring with the team. :)

Just wanted to update you - development for this is in progress and we're aiming for a beta in May or June.

I love this idea! It's similar to another idea I've heard, which is to be able to save snippets of Magic ETL DataFlows as "recipes" for use in other DataFlows. These are things that my team is actively reviewing.

This is a good idea, and one that has been requested by a few different customers. It's currently under review by my team as a potential enhancement to general organization capabilities for the Magic ETL authoring canvas.

This is a cool idea - I'll review with the team. Thanks!

This is a great idea! I love the idea of the checkbox to allow users to opt into the behavior. I will definitely review with the team.

Good idea! I will review this with the team.

I love this idea, and it's something I've been thinking about as well. I will review with the team. I had a follow-up question - would you want to see these row counts while you're authoring the DataFlow (as part of the Preview process), or after the DataFlow runs in the DataFlow Execution Details?

This is a good idea, and something I've heard a few times now. I will be reviewing with my team. I think it would also be nice to have this same feature on any tile where you have the option to select columns.

Yes! I love these ideas. These are things I would love, as a Magic user myself, and they're frequent asks from other customers as well. I'm actively reviewing these ideas with my engineering team.

This is an excellent idea and a frequent ask from other customers as well. I am reviewing with my engineering team. I think this should be an option for any tile where you're given the option of selecting columns.

This is a good idea. It's a relatively small thing, but can create quite a bit of friction when editing a DataFlow. I'll add this to my list of desired authoring canvas updates.

Good news - this is in beta now. Look for more info at Domopalooza!

@RobynLinden please do! And rumor has it I may or may not have some Magic ETL specific flair to pin on your lanyard, so definitely hit me up for that too. :)

This is a great callout, and one that we are in the process of resolving. We are working on including Window Functions in v2 of the SQL Tile (v1 is in a very limited beta now). I anticipate we will have Window Functions available in the SQL Tile around the end of the year.

This is such a good idea, and something I've definitely had on my personal Magic wishlist for a long time. I will be reviewing this soon with the team.

Such a good callout. I am going to review this with the team. Like Jae said - it probably makes sense to have an "add all" for any tile where you can add columns one at a time.

@trafalger Can you give me a little more detail or an example? I've definitely run into the issue with it not including all columns by default, but I'm a little unsure of the "include all rows" case. I'd like to take it to the team to review but could use a bit more detail first. Thanks!

Good idea - I get what you're saying. This is something I've run up against too. I'll review with the team.

Great idea! I'll review this with the team.

This is a great idea, and I can see it fitting in well with some of the other improvements I'm currently looking at for the Magic canvas (including commenting, more robust on-canvas markup etc). I will add it to my list for review.

Wanted to update you that we haven't lost sight of this and will be reviewing again soon.

This is a great idea! I am going to review this with the team for inclusion on the roadmap.

Good news - this is in beta now! Look for more detail at Domopalooza.

Good news - this is in beta now! Look for more detail at Domopalooza.

Good idea. I've always wondered about this feature too. I'll make sure to review it with the team.

As a Magic user myself, this is one of my most desired features as well. It was one of the first things to go on my "want it soon" backlog when I took over the Magic PM role this year. I feel like I've been seeing a lot of noise around this again recently, so I will be reviewing this again for roadmap inclusion soon.