Get MySQL on latest version

MarkSnodgrass

Currently, Domo's MySQL is on version 5.6, which is approaching end of support. There are also a number of commonly used features that people want to use in MySQL, but can't because it is still on version 5.6. Please upgrade to the latest version.

avataraang

I use window functions all the time in redshift, but can't use them in MySQL because they weren't introduced until version 8.0

ST_Superman

This needs to get implemented. MySQL 5.6 is over 8 years old. Even the latest version MySQL 8 is 3 years old.

Lewis

This really needs to move forward.. we need to be able to use CTE to optimize queries.

ST_Superman

Any updates for this?

Sean_Flores

Another significant addition to later versions is the JSON parser! Probably one of the most underrated functions added that would be especially helpful for most of our source datasets coming from connectors that cant flatten nested objects or more importantly, we bring in the data still nested to keep the row count low on each call.

pydomoguy

Aside from missing windows and JSON functions in MySQL 5.6 there are security flaws to consider. This is pretty sad that we are still stuck on MySQL version 5.6.37-82.2-82.2. While I realize that Magic ETL is all that there are still a lot of people who find the MySQL dataflows to be their preference.

So I drop my token in the basket to please upgrade MySQL when possible. Hopefully in 2023.

🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏

AnwarBham

Any update on this. I also noticed the ppt plugin is on .net 4.5 is this a trend

trafalger

This would be great!

JordanJensen

We absolutely hear this signal on MySQL 5.6. Here are a few thoughts on how we see things:

1. The expressive power of SQL is great. We know some of you (or others in your org) prefer SQL to MagicETL tiles. (Often we do, too!) We don’t see the two as direct competitors, but rather as different tools for different people or use cases.
2. To that end, we are working on a SQL tile for MagicETL. This brings the expressive power of SQL to MagicETL (beyond the existing formula tile). We anticipate starting a beta of this feature later this year. We are working on an “Open with MagicETL” option for MySQL and Redshift DataFlows to help you easily port any existing flows to MagicETL, as desired. (And also a “Save as…” option so you can easily create a copy for testing before migrating your production DataFlow.)
3. The SQL support being added to MagicETL will introduce non-equi joins to MagicETL as well as richer windowing function support. Common table expressions (CTEs) will also be available. These address some of the main areas where MagicETL is not a viable option today. A JSON tile is also coming soon to MagicETL. We will be evaluating the opportunity to expose the power of that tile within the SQL syntax, as well.
4. MagicETL has the benefit of running all of your transform steps in a streaming/parallel fashion as frequently as possible. This is one of the many reasons you see faster processing times with MagicETL. A full database like MySQL or Redshift carries additional overhead that isn’t necessary with MagicETL. So, if we can hit the mark with SQL in MagicETL, we feel like you can end up with the best of both worlds. Also, with MagicETL, the automatic optimizations within MagicETL will continue to work when using the SQL tile in MagicETL. That means current or future optimizations to reduce processing time will be available automatically without any additional effort on your part.
5. For any remaining use cases that cannot be solved in MagicETL, we feel that Adrenaline DataFlows may be your best next stop. That said, we know there may always be a spot where MySQL best suits your needs. In that case, we think exposing a modern MySQL engine within MagicETL will provide a powerful experience. While moving data into a MySQL instance for tasks that can be accomplished using the native MagicETL SQL tile will typically perform more slowly (and likely disable automatic optimizations), we’d like to make it easy for you to make that choice and seamlessly move your data into or out of MySQL to accomplish any processing steps that you’d prefer to run there.
6. In order to avoid breaking existing pipelines, if we were to provide a modern MySQL version in the current experience, it would likely be exposed as a version picker within the existing MySQL DataFlow UI. Our hope, though, is to simplify the experience by moving towards fewer engines and UIs to choose from for data transform needs.
7. On the subject of security, every MySQL DataFlow today gets its own MySQL instance running in a sandboxed environment without network access. We recognize that MySQL 5.6 has reached end of life, but have taken steps to keep your data pipelines secured and running without interruption.

AndreaHenderson

Updating the status as the SQL Tile for Magic ETL is now in beta. Reach out to your account team to get on the list for the SQL Tile beta.

BSovers

This must be yet another way that Domo is trying to force us to the consumption model. Otherwise the SQL Tile for Magic ETL is not available (or maybe it is still a BETA product 4 months later!.)

By the way… What SQL parser / engine is used for the SQL Tile? Is it still MySQL 5.6???

I have tried to determine what "flavor" of SQL is used for the dataset views explorer, and have been unable to determine, based on the limited functionality. Hopefully the SQL Tile is NOT using the same.

AndreaHenderson

@BSovers Sorry for any confusion, this is not tied to consumption at all. The SQL Tile is still in beta as we are actively receiving feedback from beta testers and making changes based on that feedback (along with fixing some bugs and making sure the desired features are completed in the tile). It's a very complex feature, and we're taking our time in beta to make sure we're putting something fully baked out to GA. That being said, we've broadened the beta significantly, so if you'd like to join the beta program we could add the tile to your instance.

Re: the flavor of SQL, it is its own Magic-specific syntax. It accepts much of MySQL, much of Redshift, as well as just general ANSII-standard SQL. One notable thing that is not currently available in the tile is window functions (those will come as a follow-on). We did not want to hold the tile back until we got analytic functions, though, so those will not be in the first release. We will have documentation that gives insight into the SQL functionality for the tile, but if you are looking for a super-set of functions that are available in the tile today, you can look at the functions available in the formula writer in the Group By tile (it's a superset of functions from the Formula tile + the aggregation functions from the Group By).

Let me know if you have further questions, or would like to join the the beta for the SQL Tile.

BSovers

I was just informed by our Account Executive that the SQL Tile will only be available to consumption model accounts, so it does ME no good to try and get into the beta. Though if the "brew-your-own" SQL is all that will be available, then it probably will not be able to do what I need. I need windowing functions, recursive CTEs, etc.. I.e. modern SQL querying!

I get more and more disappointed with Domo every day.

AndreaHenderson

@BSovers I'm sincerely sorry to hear that. I'm getting clarity on why you might have been told it's consumption only, as that is not my understanding. I have sent you a DM and we can chat a bit more about this if you'd like.