Specify different date formats for multiple sources in ETL
I am combining a number of data sources with date columns using an ETL before performing other calculations on them.
Some of the sources have Australian date format (DD/MM/YYYY), and others have US format (MM/DD/YYYY).
The ETL gives me results in YYYY-MM-DD format, where it's actually incorrectly converted some of the dates to YYYY-DD-MM by assuming the wrong input date format. This means I end up with results from the future (eg 2018-12-03).
What's the best way to ensure the ETL always knows the correct input date format?
Comments
-
Hi. @artywah
Is it possible to avoid by replacing the date that is incorrectly converted by using regex?
Set Column Type
Column : DateColumn
Data Type: Text
Pattern A YYYY-MM-DD (TEXT)
Set Column Type
Column : DateColumn
Data Type: Date
Format : Year first
Pattern B YYYY-DD-MM (TEXT)
Replace Text
Column : DateColumn
Search "Use Regex": ^([0-9]*)-([0-9]*)-([0-9]*)
Replace : $1-$3-$2
Set Column Type
Column : DateColumn
Data Type: Date
Format : Year first0 -
Unfortnately this isn't working. It seems Domo is being too smart and processing the format before I can do anything with it in an ETL.
It seems I need to set the date format as Domo imports the data (before I can perform an ETL on it)
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 297 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 614 Datasets
- 2.2K Magic ETL
- 3.8K Visualize
- 2.5K Charting
- 729 Beast Mode
- 53 App Studio
- 40 Variables
- 678 Automate
- 173 Apps
- 451 APIs & Domo Developer
- 46 Workflows
- 8 DomoAI
- 34 Predict
- 14 Jupyter Workspaces
- 20 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 121 Manage
- 118 Governance & Security
- Domo Community Gallery
- 32 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive