Error Exporting Table Using Parquetwrite (multidimensional array)

Question

Ethan Buchanan am 19 Okt. 2023

0
Verknüpfen

Direkter Link zu dieser Frage

https://de.mathworks.com/matlabcentral/answers/2035574-error-exporting-table-using-parquetwrite-multidimensional-array

Kommentiert: Walter Roberson am 23 Okt. 2023

gTruth.mat

I have a 2x200 table I am trying to export it as a parquet file and I have been recieving the following error after calling:

parquetwrite('test.parq',gTruth)

Error using parquetwrite

T.Apple{1} is a multidimensional array. Nontabular cell array elements must be empty or 1-dimensional.

I realize that this is due to the formatting of the 2nd column. I need to keep the 4x1 format of the values in the 2nd cell as they represent bounding boxes. Each cell holds the locations of objects corisponding to the image located at the associated file path. How could I restructure my table to export this data? I attached the table in the file below.

Thank you ahead of time for suggestions!

0 Kommentare
-2 ältere Kommentare anzeigen-2 ältere Kommentare ausblenden

Melden Sie sich an, um zu kommentieren.

Melden Sie sich an, um diese Frage zu beantworten.

Answer 1

dpb am 19 Okt. 2023

0
Verknüpfen

Direkter Link zu dieser Antwort

https://de.mathworks.com/matlabcentral/answers/2035574-error-exporting-table-using-parquetwrite-multidimensional-array#answer_1336694

Verschoben: dpb am 19 Okt. 2023

In MATLAB Online öffnen

gTruth.mat

parquetwrite

load gTruth
for i=1:height(gTruth), gTruth.Apple(i)={gTruth.Apple{i}(:)};end
parquetwrite('test.parq',gTruth)
t2 = parquetread("test.parq");
head(t2)
                          imageFilename                              Apple    
    _________________________________________________________    _____________

    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0065 - Copy.JPG"    {32×1 double}
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0066 - Copy.JPG"    {32×1 double}
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0067 - Copy.JPG"    {48×1 double}
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0068 - Copy.JPG"    {24×1 double}
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0070 - Copy.JPG"    { 8×1 double}
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0071 - Copy.JPG"    { 8×1 double}
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0072 - Copy.JPG"    {20×1 double}
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0073 - Copy.JPG"    { 4×1 double}
for i=1:height(t2), t2.Apple(i)={reshape(t2.Apple{i},[],4)};end
head(t2)
                          imageFilename                                 Apple       
    _________________________________________________________    ___________________

    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0065 - Copy.JPG"    { 8×4 double      }
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0066 - Copy.JPG"    { 8×4 double      }
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0067 - Copy.JPG"    {12×4 double      }
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0068 - Copy.JPG"    { 6×4 double      }
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0070 - Copy.JPG"    { 2×4 double      }
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0071 - Copy.JPG"    { 2×4 double      }
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0072 - Copy.JPG"    { 5×4 double      }
    "C:\Users\etbuc\OrBot\AppleAITestImg\IMG_0073 - Copy.JPG"    {[259 132 215 222]}

I'd never heard of a parquet file before...looks like you would have to reshape the 2D arrays to 1D to write with MATLAB toolset; whether there's a way for a parguet file to contain a 2D array if one had more capable toolset I dunno. But, while somewhat inconvenient, it's not too difficult to rearrange to write; of course you'll have to rearrange back on reading...