Data Serialisation

Apr 3, 2021

ASN.1 - A formal notation used for describing data transmitted by telecommunications protocols, regardless of language implementation and physical representation of these data, whatever the application, whether complex or very simple. 🌐
Avro - Avro is a binary data serialization system which is characterised by encoding the schema together with the message. This avoids the burden of stub/skeleton generation stages. 🌐
ORC - Apache ORC is a self-describing, type-aware columnar file format for Hadoop workloads. It is optimised for streaming reads, but with integrated support for finding required rows quickly. 🌐
Parquet - A a columnar storage format available for the Hadoop ecosystem. 🌐
Protocol Buffers - Protocol Buffers is Google's answer to the need for a binary data serialization system. It relies in a custom schema language and static generation of code from it to target languages such as C++, Java, C#, Python and so on. Its main goal is interoperability among all the supported languages. 🌐
TLV - TLV (Type-Length-Value) is an encoding scheme used in data communication protocols. 🌐
Thrift - Thrift is Facebook's answer to the need for binary data serialization system. Like Google's Protocol Buffer, it relies on a schema and code generation paradigm. It is arguably distinguished by official support for a wider number of programming languages such as OCaml, Smalltalk, and Haskell. 🌐

Before You Leave

🤘 Subscribe to my 100% spam-free newsletter!