Threads for miselin

  1. 3

    I’ve been spending some time exploring web crawlers and building a custom search index. It’s been a good opportunity to learn some Go by building something more than a hello world app. I’ve also been transplanting learnings from the crawler into the Go static files server running my static files blog (the content on which I hope to work on this week too).

    Both of these have also been integrated with Prometheus with Grafana for graphing. I integrated Sentry today which is also useful for discovering significant errors during crawl without having to trawl through logs. So that’s been great, just building on all these different products to run a service and know what it’s doing at all times.

    1. 2

      http://ideasandcode.blogspot.com

      I’d love to blog more, but have had a lot of other things happening. Isn’t that always the case for blogs? :-)

      1. 2

        Is there an implementation of strings in a safe language like rust available? I would love to see a suite of tools like strings, objdump, and ldd written in a language I trust to parse hostile binaries.

        1. 2

          Could write them in Haskell safely without much trouble, I’m pretty sure. With the bytestring library and streaming IO and it should perform well too.

          1. 1

            I think a port of libbfd to Rust would be a huge win.

          1. 4

            Outside of work, I’m working on my Rust kernel project, Rustic - porting it to the Rasberry Pi and BeagleBoard, and turning it into more of a framework to build embedded applications for these kind of targets rather than a raw “operating system” project. Enabling people to implement their crazy ideas and run them on the raw hardware, without needing to write stacks of assembly and boring low-level support code, essentially :)

            Most of this week’s work on that will probably center around figuring out how to provide Rust’s concurrency primitives (eg, green threads, locking, etc) in code that can’t use libstd.

            1. 2

              Sounds awesome! I looked at Rustic before but skipped over it because I was trying to find something with ARM support. I’d like to help you with the porting if possible. I have a Cortex A9 board I could run it on. I’m a complete Rust noob, though, so I might take me a while to ramp up.

              1. 2

                Yup, it wasn’t very exciting as just a pure x86 kernel that didn’t do much :-) I wrote Rustic to learn Rust.

                Once the new code goes into the public repo, I’m definitely happy to accept PRs to add support for other boards and architectures.

                In the least, once the public repo is updated, having other people try and use the build system helps find chances to improve the build documentation and the build system itself :-)

            1. 2

              I almost wrote “There’s been three SSL bugs in one week. Three.” in a previous comment. Now I’m glad (?) I didn’t.

              1. 1

                If it weren’t for the fact these have all been security-related, it’d almost be comical. Sigh.