CSV form for DAYCLI

[KashifProg]

Hello,

To convert DAYCLI data into BUFR using csv form I followed the steps given here https://training.wis2box.wis.wmo.int/practical-sessions/converting-csv-data-to-bufr/ but it generates an error of datetime (screen shot attached), did anyone else also got this error? any suggestion to solve this issue? I was using the sample file given on the training page and edited WIGOS station id and also day and month.

daycli-example.csv

[maaikelimper]

Hi thank for our message.

My apologies for the confusion the CSV Form in the wis2box-webapp is not compatible with daycli-data as it is hard-coded to use the aws-template (https://github.com/wmo-im/csv2bufr-templates/blob/main/templates/aws-template.json)

We will work to update the training-materials to avoid confusion for others in the future.

[KashifProg]

Ok I understand CSV Form does not support DAYCLI csv file structure but is the csv2bufr tool integrated in latest branch of wis2box-api also not support conversion from daycli.csv to bufr? I tried using command line but it generates similar error as it was generated on CSV Form
root@0fbde65248b5:~# csv2bufr data transform --bufr-template daycli.json daycli-example.csv

Error (Error: invalid datetime) encoding BUFR, BUFR set to None
CLI: ..... 'None' found in BUFR output, no data written
CLI: End of processing, exiting.

Any suggestions?

Thanks,

Kashif

[maaikelimper]

Hi this means there is an issue with the "daycli.json" being used as the bufr-template.

Could you please write us an e-mail at wis2-support@wmo.int so we can assist you with debugging the input file ?

[maaikelimper]

Please note that you can find the latest version of the example-template for daycli here:
https://github.com/wmo-im/csv2bufr-templates/blob/main/templates/daycli-template.json

[KashifProg]

The json file daycli.json in the command I sent earlier was generated using following command
csv2bufr mappings create 307075 --output daycli.json

Now, executing command again using the one you sent I see different error

root@0fbde65248b5:~# csv2bufr data transform --bufr-template daycli-template.json daycli-example.csv

CLI: ... Transforming daycli-example.csv to BUFR ...
Error: Expecting value: line 7 column 1 (char 6)
root@0fbde65248b5:~#

Thanks,

Kashif

[david-i-berry]

Hi Kashif,

I'm having trouble reproducing the error using the csv file you uploaded at the start of this discussion and the json mapping file linked by Maaike. Can you compare the following two files with what you are using and confirm that they are the same:

daycli-template.json (md5sum 9dde8740422e265f1e934f51bcd8fafc)
daycli-example.csv (md5sum 67fcd75c01af99e39c638097d4111e39)

I've included the md5sum of the files above as this may be quicker than trying to compare line by line. Alternatively, or if the md5sums are different, the output of the command diff may help in tracking the issue.

Can you also share the output of the command csv2bufr --version.

Thanks,

David.

[maaikelimper]

Please note that the CSV Form in the wis2box-webapp will be removed in wis2box release 1.0.0