Golang port / Miller 6 tracking issue

[johnkerl]

Split out from #369. See also https://github.com/johnkerl/miller/blob/master/go/README.md.

Pre-release/rough-draft docs are at http://johnkerl.org/miller6.

Things which may change:

As noted in go/README.md, I want to preserve as much user experience as possible. That said:

• --jvstack and --jsonx will still be supported as command-line flags, but JSON output will be pretty-printed (like --jvstack) by default.
• --csvlite will still be different from --csv, as detailed below.
• emitf and emitp were invented before I had for-loops in the DSL. If people really want to keep
  these and are using these, I can keep them; but maybe we're better off leaving them behind. Please
  let me know.
• CR vs CR/LF (line-endings) will be platform-appropriate using Go's own portability -- Windows files will be written correctly on Windows, and likewise for Linux and MacOS. That said, I don't know if we need any longer to preserve CR/LF-to-CR/LF even on Linux (line endings which are non-standard for the platform) -- again, please let me know.
• mlr put -S and mlr put -F will become unnecessary since string-conversion will be done just-in
  -time as suggested by @gromgit on [REQ] JIT numeric conversion in mlr put, part 2 of 2 #151.

Please include here any thoughts you have on the Go port.

[aborruso]

• --csvlite will no longer be different from --csv although --csvlite will still be accepted at the command line, to avoid breaking existing Miller scripts.

Many times csvlite saved my days, because often I have this kind of input data:

idImpianto;Gestore;Bandiera;Tipo Impianto;Nome Impianto;Indirizzo;Comune;Provincia;Latitudine;Longitudine
39241;STAZIONE ANDROMEDA DI VIVIAN LUCIANO & C. - S.N.C.;Agip Eni;Altro;stazione andromeda;c.so romita ang.via Galvani  15121;ALESSANDRIA;AL;44.901887213841604;8.619216307997704
22975;AN.GI DI ANTONIO LECCE S.A.S.;Api-Ip;Altro;Stazione di Servizio "IP" - An.Gi di Antonio Lecce;LUNGO TANARO SOLFERINO 7 15121;ALESSANDRIA;AL;44.91939743419402;8.61233416718187
27453;NEW ENERGY DI RRUSHI ERMIRA E C. S.N.C.;Agip Eni;Altro;STAZIONE DI SERVIZIO ENI NEW ENERGY SNC;VIA CASALE  28 15122;ALESSANDRIA;AL;44.9321969901607;8.58518036837404

The fs is ;, and inside a field I have some ". In example Stazione di Servizio "IP" - An.Gi di Antonio Lecce.

I'm able to read it via csvlite mlr --icsvlite --ifs ";" cat input. It might be a problem not to have it.

If I use --csv I have mlr: syntax error: unwrapped double quote at line 2

[johnkerl]

OK cool thank you!! This is exactly what I was looking for. :)

[aborruso]

OK cool thank you!! This is exactly what I was looking for. :)

Only a note: to give you more help, I need the GO version of miller. If there was mlr.go.linux.x86_64, it would be perfect.

Thank you

[johnkerl]

Yes, I can build you one for Linux or Mac quite easily ad-hoc. (If anyone needs a Windows build, let's chat on how to work together on that ... .)

That said, if you would be OK with cloning the Miller repo, cd go, and ./build, it would be useful to me to see how that works for you.

Also maybe for future Miller 5 releases I can just attach a go binary as well, if that's what you mean -- ? Super-good idea! :)

[aborruso]

Hi @johnkerl ,
I have tested the latest go binary

echo '"hello, my dear john, thank you for Miller"' | mlrgo --c2x -N put '$regex=sub($1,"^(.+?),(.+)","\1")'

and I have

mlrgo: cannot parse DSL expression.
Parse error on token ""\1" at line 1 columnn 29.
Expected one of:
  { field_name $[ braced_field_name $[[ $[[[ full_srec oosvar_name @[ braced_oosvar_name
  full_oosvar non_sigil_name float int + - .+ .- ! ~ ( ) string_literal int_literal
  float_literal boolean_literal const_M_PI const_M_E panic [ ctx_IPS ctx_IFS
  ctx_IRS ctx_OPS ctx_OFS ctx_ORS ctx_NF ctx_NR ctx_FNR ctx_FILENAME ctx_FILENUM
  env

I think you know it, but if it were not so, I add it.