Can we import .avro file?

Hi Guys

Has anyone been able to import .avro files into Domo?

I see the blob storage connector but not sure if this would be the correct one. Some guidance would be much appreciated.

Best Answer

  • ArborRose
    ArborRose Coach
    Answer ✓

    To my knowledge, Domo does not natively support .avro files through its connectors.

    If your .avro files are stored in a cloud storage service like Azure Blob Storage or AWS S3, you can use the Blob Storage connector in Domo to access them. However, this will only allow you to access the files; you would need to process the .avro files into a format that Domo can work with such as CSV, JSON, or Excel.

    Using Python, something like this:

    import fastavro
    import pandas as pd

    # Read the .avro file
    with open('your_file.avro', 'rb') as f:
    reader = fastavro.reader(f)
    records = [record for record in reader]

    # Convert to DataFrame
    df = pd.DataFrame(records)

    # Save to CSV
    df.to_csv('your_file.csv', index=False)

    Once you have converted your .avro file to a compatible format, you can upload it to Domo:

    1. Manual Upload: If you have a CSV or Excel file, you can manually upload it through the Domo interface.
    2. Data Connector: If you need to automate the process, you can use Domo’s file connectors to periodically pull in your converted files.

    ** Was this post helpful? Click Agree or Like below. **
    ** Did this solve your problem? Accept it as a solution! **

Answers

  • ArborRose
    ArborRose Coach
    Answer ✓

    To my knowledge, Domo does not natively support .avro files through its connectors.

    If your .avro files are stored in a cloud storage service like Azure Blob Storage or AWS S3, you can use the Blob Storage connector in Domo to access them. However, this will only allow you to access the files; you would need to process the .avro files into a format that Domo can work with such as CSV, JSON, or Excel.

    Using Python, something like this:

    import fastavro
    import pandas as pd

    # Read the .avro file
    with open('your_file.avro', 'rb') as f:
    reader = fastavro.reader(f)
    records = [record for record in reader]

    # Convert to DataFrame
    df = pd.DataFrame(records)

    # Save to CSV
    df.to_csv('your_file.csv', index=False)

    Once you have converted your .avro file to a compatible format, you can upload it to Domo:

    1. Manual Upload: If you have a CSV or Excel file, you can manually upload it through the Domo interface.
    2. Data Connector: If you need to automate the process, you can use Domo’s file connectors to periodically pull in your converted files.

    ** Was this post helpful? Click Agree or Like below. **
    ** Did this solve your problem? Accept it as a solution! **