Threads for frankw

  1. 1
    Pentlander avatar Pentlander 10 months ago | link | on: Sneller: Vectorized SQL for JSON at scale: fast, simple, schemaless

    I don’t see any architecture docs or anything on the blog, I would be interested to know how it actually works.

    1. 2
      frankw avatar frankw 10 months ago | link

      Sneller founder here: We will have a blog out shortly describing in detail how the bytecode engine works

    1. 1
      JulianWgs avatar JulianWgs 10 months ago | link | on: Sneller: Vectorized SQL for JSON at scale: fast, simple, schemaless

      I‘m amazed about the advertised performance and overall architecture, but a little afraid that they written roughly 20% of their stack in assembly. Is this maintainable?

      1. 1
        agent281 avatar agent281 10 months ago | link

        Or portable?

        1. 2
          frankw avatar frankw 10 months ago | link

          We are planning on supporting more architectures, most notably ARM SVE2 (hopefully within months) and potentially RISC-V as well. Golang actually makes it easy to integrate multiple architectures in a single code base, so we’ll take advantage of that.

        2. 1
          frankw avatar frankw 10 months ago | link

          The low level primitives (about 250 right now) are all tested very extensively individually as separate building blocks. There is a simple “calling convention” (all based on registers, both Z for data and K for control). Effectively we are stichting them together as the result of parsing the SQL statement and this then become the “bytecode” program that executes the query. We will have a blog out shortly describing this in more detail. (disclaimer: Sneller founder here).