1. 4
  1.  

  2. 3

    Does ingest require a predefined schema? If not, how do you handle converting the schemaless data into Parquet?

    1. 1

      I’m working on something similar (log-store.com) and built a database to get around the issue of most databases and file formats requiring a schema… that and I like databases :-)

      1. 1

        Heh I’m also working on a schemaless log ingest and search tool written in Rust, which is why I’m asking.

      2. 1

        There is a MAP type and also a JSON/BSON type that would help. Maybe that’s what they use?