Structured Data in Oil

Oil will parse text so you don't have to!

Links / Use Cases

• What is a Data Frame? (In Python, R, and SQL) (blog)
• Git Log in HTML (blog)
  • After that I wrote Structured Data Over Pipes
  • And Unix Tools
• Oil and the R Language
• Other Oil Use Cases:
  • release.sh generates releases.html
  • benchmarks/*.{sh,R} generates osh-parser report, etc.
• lobste.rs comment on Oil philosophy for structured data

Design Docs

• TSV2 Proposal
• each Keyword in Oil -- augments xargs, uses TSV2
• Explicit Framing Protocol Proposal

Curiosities

• Shell Almost Has a JSON Analogue

Projects

All of these are obviously supported because Oil is a shell! But there are advantages to a built-in expression language. (It's deferred for 2020.)

• https://csvkit.readthedocs.io/en/1.0.3/
• https://github.com/BurntSushi/xsv
• https://www.gnu.org/software/recutils/
• https://github.com/sustrik/uxy
• https://github.com/aanastasiou/pyjunix
• http://jsonlines.org/ and http://ndjson.org/ -- what's the difference?
• https://relational-pipes.globalcode.info/v_0/index.xhtml -- binary format