Warm tip: This article is reproduced from serverfault.com, please click

Google Cloud Data Fusion ingest Excel to Bigquery

发布于 2020-12-17 13:50:05

I am trying to create a simple pipeline to ingest Excel from GCS and push to Bigquery. Used Wrangler to create the parse as Excel directive, where the data came back perfectly. Issue is when deploying and running the pipeline, error collector captures the following - Error encountered while executing 'parse-as-excel' : Error encountered while executing 'parse-as-excel' : Column 'body' should be of type 'byte array' or 'ByteBuffer'

Incoming data type(GCS Source) when marked as blob and byte fails in wrangler. I am certain something basic is amiss, any help is appreciated.

Questioner
Anthony Gomes
Viewed
0
Anthony Gomes 2020-12-23 04:07:28

To solve this, the incoming data body had to be set to byte(from source GCS). For some reason this was selected as string, causing issues when deployment of the pipeline was effected.