Code

Serialization#255

Code

Open

GreyCat wants to merge 105 commits intomasterkaitai-io/kaitai_struct_compiler:masterfrom serializationkaitai-io/kaitai_struct_compiler:serializationCopy head branch name to clipboard

+2,378-288

Commits

Commits on Mar 24, 2017

• Added --read-write switch

  GreyCat

  committed
  de0938e

• JavaMain: ensure that exceptions are really thrown, even on compile stage

  GreyCat

  committed
  d24a36d

• Started PoC seq writer support in JavaCompiler

  GreyCat

  committed
  0b757b9

• JavaCompiler: very basic bytes writing support

  GreyCat

  committed
  93b37a1

• Allow simple serialization of FixedBytesType

  GreyCat

  committed
  75ec0c2

• Translators: added strToBytes, implemented in Java translator

  GreyCat

  committed
  eed5d07

• Added _i iteration number identifier

  GreyCat

  committed
  5cf4edd

• JavaTranslator: added translation of _i

  GreyCat

  committed
  4a3535f

• ClassTypeProvider: use constants + added ITERATOR_I handling

  GreyCat

  committed
  568964d

• Writing: added string handling, some repeat-expr handling, BytesEos handling

  GreyCat

  committed
  9e7bffa

Commits on Mar 27, 2017

• Serialization: basic support for user types and BytesLimitType

  GreyCat

  committed
  8fd1002

• Merge branch 'master' into serialization

  GreyCat

  committed
  0d73de2

• Serialization: implemented unprocess and slightly better user type writing that gets expression to write properly

  GreyCat

  committed
  ea06fec

Commits on Mar 28, 2017

• AllocateIOLocalVar: Added allocation of fixed and growing IOs

  GreyCat

  committed
  9c1793e

• Serialization: implemented fixed-size preallocated IO buffers

  GreyCat

  committed
  9f0e331

• JavaCompiler: generate new Readable/Writable interface implements

  GreyCat

  committed
  969401c

• Serialization: more intricate process-on-top-of-user-type support

  GreyCat

  committed
  885469f

Commits on Mar 29, 2017

• JavaCompiler: implemented writing of repeat-eos

  GreyCat

  committed
  0f3a2aa

• Serialization: implemented switch types support, reworked JavaCompiler to use new KaitaiStruct.* abstract classes

  GreyCat

  committed
  e4a56f1

Commits on Mar 30, 2017

• Added basic _check implementation, added checks for a proper number of members in a collection

  GreyCat

  committed
  44185e1

• Added String#to_b(encoding) and ByteArray#size methods + JavaTranslator implementations

  GreyCat

  committed
  769dabc

• Added limited byte / string sizing checks

  GreyCat

  committed
  040b689

• Translators: added BytesType#first and #last, implemented for Java

  GreyCat

  committed
  28e8d06

• GenericChecks: implemented tons of checks for BytesLimitType - boundary size checks, terminator inclusion checks, etc

  GreyCat

  committed
  1b66897

Commits on Apr 3, 2017

• Merge branch 'master' into serialization

  GreyCat

  committed
  7d2295f

Commits on Apr 4, 2017

• Merge branch 'master' into serialization

  GreyCat

  committed
  dd0880e

Commits on Apr 5, 2017

• JavaCompiler: only use ReadOnly when _read is public, i.e. when debug is true

  GreyCat

  committed
  d73ec6b

Commits on Apr 7, 2017

• Merge branch 'master' into serialization

  GreyCat

  committed
  2081fb2

Commits on Apr 27, 2017

• Merge branch 'master' into serialization

  GreyCat

  committed
  7dee284

Commits on Oct 27, 2019

• WIP

  generalmimon

  committed
  75729f7

Commits on Nov 3, 2019

• Merge branch 'master' into serialization

  generalmimon

  committed
  6e6bdda

Commits on Nov 10, 2019

• Merge pull request #177 from generalmimon/serialization

  Show description for 9eb2ab5
  GreyCat

  authored
  9eb2ab5

Commits on Nov 17, 2019

• Stop generating empty constructor when autoRead

  Show description for 2e2e985
  generalmimon

  committed
  2e2e985

• Use common loop for all repetitions

  generalmimon

  committed
  e46cc95

Commits on Dec 14, 2019

• Merge pull request #182 from generalmimon/serialization-common-loop

  Show description for 9d8f2d3
  GreyCat

  authored
  9d8f2d3

• Revert "Stop generating empty constructor when autoRead"

  Show description for e4ad9aa
  generalmimon

  committed
  e4ad9aa

Commits on Feb 2, 2020

• Disable autoRead automatically in readWrite mode

  generalmimon

  committed
  d8adcc5

Commits on Feb 3, 2020

• Merge pull request #180 from generalmimon/serialization-autoread-empty-ctor

  Show description for cfba0cc
  GreyCat

  authored
  cfba0cc

Commits on Sep 19, 2020

• Extract changes from #183 related to common repetitions

  generalmimon

  committed
  d26e37b

Commits on Aug 1, 2022

• Merge tag '0.10' into serialization

  generalmimon

  committed
  ead02a4

• Fix build errors after upgrading to the 0.10 codebase

  generalmimon

  committed
  5c70d8f

Commits on Aug 16, 2022

• Remove FixedBytesType as intended in the 0.9 valid design

  generalmimon

  committed
  0867d51

Commits on Aug 28, 2022

• Refactor EveryWriteIsExpression to use Ast.expr.InternalName

  Show description for 939cf98
  generalmimon

  committed
  939cf98

Commits on Sep 4, 2022

• Delete unused attrFixedContentsParse (_io.ensure_fixed_contents())

  generalmimon

  committed
  83b1fa7

• Fix writing of a field with terminator + consume: false

  generalmimon

  committed
  caea2b7

Commits on Sep 5, 2022

• Fix broken consistency check for repeated byte arrays

  Show description for c1d391a
  generalmimon

  committed
  c1d391a

Commits on Sep 10, 2022

• Java: fix bytesSubscript to give unsigned byte values (finally!)

  Show description for 43d044a
  generalmimon

  committed
  43d044a

• Drop expr argument of condIfFooter method

  generalmimon

  committed
  8404319

• Java: include term if include: true && terminator == pad-right

  Show description for 2acf924
  generalmimon

  committed
  2acf924

• Fix & add missing terminator/pad-right consistency checks

  Show description for 73b0347
  generalmimon

  committed
  73b0347

Commits on Sep 11, 2022

• Reuse the byte array write method for strings

  generalmimon

  committed
  d721d08

Commits on Sep 12, 2022

• Add repeat-until last element check

  Show description for 50d6556
  generalmimon

  committed
  50d6556

• Refactor access to the last array item in attrAssertUntilCond

  generalmimon

  committed
  72ca925

• Merge pull request #183 from generalmimon/serialization-repeat-until-check

  Show description for 426a38d
  generalmimon

  authored
  426a38d

• Extend repeat-until consistency check to all elements

  Show description for def6650
  generalmimon

  committed
  def6650

• Add consistency check for *non-empty* repeat: until array

  Show description for 306bfb2
  generalmimon

  committed
  306bfb2

Commits on Sep 13, 2022

• Fix "Object cannot be converted to byte[]" errors in type switches

  generalmimon

  committed
  849fc1c

Commits on Sep 14, 2022

• Fix locale-sensitive String#toUpperCase call in writeHeader

  Show description for 74d553c
  generalmimon

  committed
  74d553c

Commits on Sep 15, 2022

• Java: finally solve boxed numeric type casting issues consistently

  Show description for 604359d
  generalmimon

  committed
  604359d

Commits on Sep 17, 2022

• Add _invalidate*() for value and set*() for parse instances

  generalmimon

  committed
  f8bb577

• Add _write*() and _check*() for parse instances

  generalmimon

  committed
  16374cc

Commits on Nov 26, 2022

• Set write flags of parse instances at the beginning of _write

  generalmimon

  committed
  070391c

• _write(): use special loops for each repetition type again

  Show description for 9897818
  generalmimon

  committed
  9897818

• Java: make {_read,_write}{BE,LE}() private even if autoRead is off

  Show description for 69e4a12
  generalmimon

  committed
  69e4a12

• Fix instance write flags (previous attempt led to infinite recursion)

  generalmimon

  committed
  2710191

• Rename _write{,LE,BE}() methods to _write_Seq{,LE,BE}()

  generalmimon

  committed
  7dce0c3

• Rename {writeExprAsExpr=>itemExpr}(), move to EveryReadIsExpression

  generalmimon

  committed
  826b242

• Add _fetchInstances() method to recursively fetch parse instances

  generalmimon

  committed
  ca012b6

• Write substreams to parent only after all fields have been written

  Show description for 3b08efe
  generalmimon

  committed
  3b08efe

• Add set{Inst}_ToWrite() setter to select what instances to write

  generalmimon

  committed
  544cad0

Commits on Dec 23, 2022

• Add support for writing substreams with process and/or terminator

  generalmimon

  committed
  11da92f

• Fix handling size-eos: true with terminator/pad-right

  generalmimon

  committed
  175c278

Commits on Dec 28, 2022

• Java: call writeBitsInt{Be,Le}(), disable calls to alignToByte()

  Show description for b5c2e92
  generalmimon

  committed
  b5c2e92

Commits on Dec 31, 2022

• Move consistency checks from _check() to _write() if needed

  Show description for bda1842
  generalmimon

  committed
  bda1842

• Add a _write() check on EOF after a size-eos: true field

  generalmimon

  committed
  a5dd1f9

• Add a _write() check on EOF states of repeat: eos

  generalmimon

  committed
  ecb5757

• Generate byte array checks for substreams in _write()

  generalmimon

  committed
  37f432b

Commits on Jan 1, 2023

• Add write support for eos-error: false

  generalmimon

  committed
  4fdf21d

• Convert Identifier to id in ConsistencyError using humanReadable

  generalmimon

  committed
  a8e4c03

• Remove unused isRaw parameter in itemExpr method

  generalmimon

  committed
  08ac809

• Generate checks for SwitchType as well

  generalmimon

  committed
  cf26f3e

• Add checks for user params, set io/io[] params in _write()

  generalmimon

  committed
  37da6dd

Commits on Jan 2, 2023

• Add checks for _root and _parent built-in parameters

  generalmimon

  committed
  2accf38

• Add valid checks as in _read() to _check()/_write()

  generalmimon

  committed
  5afa962

Commits on Jan 3, 2023

• Add necessary fixes after testing on https://github.com/kaitai-io/kaitai_struct_formats

  generalmimon

  committed
  793f58b

Commits on Feb 13, 2023

• Going forward, starting 0.11-SNAPSHOT

  

  GreyCat

  authored and

  generalmimon

  committed
  533aaa8

Commits on Feb 14, 2023

• Fix superfluous footer in Lua, Perl, PHP, Python and Ruby

  Show description for 52812f9
  generalmimon

  committed
  52812f9

Commits on Feb 15, 2023

• Delete unused method attrWriteStreamToStream

  generalmimon

  committed
  203613b

Commits on Feb 26, 2023

• Port serialization support to Python

  generalmimon

  committed
  d1f16dd

• Fix Python 2 compatibility when creating a fixed stream

  generalmimon

  committed
  d986731

Commits on Mar 6, 2023

• Python: disable calls to alignToByte()

  Show description for fca43d9
  generalmimon

  committed
  fca43d9

Commits on Mar 7, 2023

• Python: use self as default _root only in top-level types

  Show description for e776c98
  generalmimon

  committed
  e776c98

Commits on Jul 27, 2023

• Add "implies --no-auto-read" to --read-write CLI option description

  generalmimon

  committed
  00c831f

• Add "Java and Python only" to --read-write CLI option description

  generalmimon

  committed
  f1dc857

Commits on Jul 31, 2023

• Merge branch 'master' into serialization

  Show description for 952c89c
  generalmimon

  committed
  952c89c

Commits on Aug 1, 2023

• Improve setting zeroCopySubstream to false in readWrite mode

  generalmimon

  committed
  9142a1b

• Bring back init of instance flags in non-readWrite mode (C++, C#)

  Show description for 2eca3de
  generalmimon

  committed
  2eca3de

Commits on Aug 5, 2023

• PythonCompiler: fix "{alignToByte => align_to_byte}()" in comment

  generalmimon

  committed
  a477800

• Remove alignToByte() insertion logic when writing

  Show description for 8b258e2
  generalmimon

  committed
  8b258e2

Commits on Aug 7, 2023

• Endianness.fromString(): revert incorrect case {None => _} change

  Show description for cb0c1eb
  generalmimon

  committed
  cb0c1eb

Commits on Sep 25, 2023

• Stop using _io when throwing validation errors from _check()

  Show description for 0179199
  generalmimon

  committed
  0179199

Commits on Oct 12, 2023

• Merge branch 'master' into serialization

  generalmimon

  committed
  31f1359

Commits on Oct 13, 2023

• Fix Java 7 compat: add final in allocateIOFixed()

  generalmimon

  committed
  7d830fa

Commits on Oct 21, 2023

• Merge branch 'master' into serialization

  generalmimon

  committed
  dea74e1

Commits on Jan 2, 2024

• Merge branch 'master' into serialization

  generalmimon

  committed
  4066d1e