Threads for oats

  1. 10

    NB: I’m not the author, though the excellent @jvns is!

    I’ve written numerous tiny scripts and programs to mold my desktop workflow to my wants, one of my favorites a series of scripts that lets me search though files (filtering with rofi/dmenu) in predetermined locations in my homedir, and then pipes the file name to a custom plumber script (written in fennel) that uses file name and mime type to determine a program to open the file, it’s incredibly fast for finding random files! The script also has a few regexen for opening urls, it’s nice for things like opening youtube links directly in mpv.

    Another one is a screenshotting script that combines slurp (choosing windows/rectangles on screen), grim (wayland screenshotting), and uploading directly to an image pastebin for really fast screenshot sharing.

    In a similar spirit, I often end up writing many small elisp functions for individual projects to reduce the friction of the development cycle. I’m currently taking an undergraduate operating systems course, and I have a function that lets me quickly choose a user program to boot up the OS under qemu with gdb, of course taking advantage of emacs’ gdb mode. I love how easy emacs makes it to write tiny bits of software to support and integrate my workflows!

    1. 2

      That sounds a bit like “godothecorrectthing” (https://github.com/andrewchambers/godothecorrectthing), which acts on the clipboard’s content.

      1. 1

        regexen

        Love this!

      1. 14

        I think there are several reasons for regex hate and they’re slightly contradictory:

        First, a lot of ‘regex’ languages are more expressive than regular expressions. If I remember correctly, Perl regexes are actually Turing complete (or, at least, they’re push-down automata - I can’t remember which). This means that they’re a very dense and expressive language for writing parsers. This language, as a side effect of being so concise, is very hard to read. This is fine for single-use one liners but you don’t want to be stuck maintaining a complex regular expression.

        Second, the fact that there are a lot of regex languages. C++11 defined six different regex languages, with several additional modifiers and this didn’t include Perl-compatible regular expressions. Several regex languages use different syntax for the same thing or similar syntax for completely different things. This is hinted at in the article, which explicitly says that it’s using Vim’s regex syntax. Just because you’re familiar with regexes in one context doesn’t mean that you can correctly read them in another.

        Third, and in contradiction to the first point, regexes can parse only regular languages. A lot of things that you parse are not regular languages. The canonical example here is matching brackets, which requires counting and so can be parsed with a Turing Machine or a push-down automaton, but not with a finite state machine (regular expressions are an encoding of FSMs). This leads to horrible fragile hacks. For example, the Lisp syntax highlighting in Vim defines 10 (I think - it’s been over a decade since I looked) different syntax rules for brackets inside other brackets. Each one is coloured differently and so if you nest brackets up to 10 deep then you get different colours. After that, it breaks. This rule is trivial to express in any programming language (define a set of colours, count the bracket depth, increment when before you reach an open bracket, decrement after you reach a closed bracket, pick colour depth mod number of colours to colour any bracket) but cannot be expressed with regular expressions.

        Like many other things (object orientation, functional programming, machine learning, distributed systems, and so on), regular expressions are a fantastic tool for some problems and a complete disaster when applied to problems in the wrong domain.

        1. 2

          For example, the Lisp syntax highlighting in Vim defines 10 (I think - it’s been over a decade since I looked) different syntax rules for brackets inside other brackets. Each one is coloured differently and so if you nest brackets up to 10 deep then you get different colours. After that, it breaks.

          Couldn’t you just make it so that the last rule can contain the first?

          1. 3

            If vim is using proper regexes, you cannot. As mentioned above, regular expressions are equivalent to finite state machines, which mathematically cannot parse arbitrarily deep recursive structures in strings. Here’s a good article which covers this in its first part.

            1. 5

              But Vim’s syntax highlighting isn’t just regexes. It’s based on regexes, but they’re connected by a more sophisticated system.

            2. 1

              It might be possible outside of the regex system but that’s not how it was defined. Each of the rules was a single regex. If you are a pair of brackets with no brackets inside them, you are the first colour. If you are a pair of brackets with one pair of brackets inside them, you are the second colour. If you are… and so on. That’s all that you can do with regular expressions.

              1. 4

                Well, then they’re doing it wrong. Regexes are not meant to be used alone. Here is a fully functioning Vim script that highlights nested parentheses in alternating colors:

                syntax region StuffInParens1 matchgroup=Parens1 start=/(/ end=/)/ contains=StuffInParens2
                syntax region StuffInParens2 matchgroup=Parens2 start=/(/ end=/)/ contains=StuffInParens1 contained
                highlight Parens1 guifg=#ff0000
                highlight Parens2 guifg=#2222ff
                
          1. 2

            If I had never written Lisp and I wanted to attempt this in a Lisp-language which one would you suggest? Ideally I want something that I can learn quickly (the basics to solve some problems at least) and is batteries-included enough to let me parse strings or whatever without too much of a hassle.

            1. 5

              Personally I’d choose a Scheme variant if I was trying something Lisp-like for the first time. Probably Racket? https://racket-lang.org/

              Or you could go minimal and choose one of the R5RS schemes like Chicken. But Racket has nice tool support.

              1. 1

                Seconding racket. Massive standard library, maybe the most popular lisp these days alongside clojure.

              2. 3

                Racket is quite user friendly and has good docs. The standard library is massive too, it comes with a pretty good GUI library and an IDE written with it in its default distribution.

                1. 2

                  I completed the advent in Clojure last year, and found it very suitable to the task.

                  The standard library is comprehensive, but small; the batteries-included (persistent) data-structures are a real treat; and the sequence-processing primitives are well suited to the advent problems.

                  Clojure was my first lisp, and I’ve enjoyed every minute of it.

                  1. 1

                    I used Janet last year, and had a great time with it.

                  1. 28

                    Fennel lead developer here.

                    I’ve posted about Fennel a few times in the past (https://lobste.rs/s/11p7mn/fennel_0_2_0_released https://lobste.rs/s/6bphbw/fennel_programming_language_rationale https://lobste.rs/s/hppjix/making_fennel_compiler_self_hosting_with) on this site for previous milestones and have had some great discussion ensue; feel free to ask me anything!

                    1. 4

                      Congratulations on the milestone! I’ve only shipped plain-old-lua so far, but I’ve been smiling as I watched Fennel get better for a while now. Nicely done. And I look forward to the game jam where using Fennel turns out to be a good idea for me :)

                      1. 4

                        Thanks! Of course you can use Fennel for any game jam, but the big ones are the Lisp Game Jams held every April and October on itch.io: https://itch.io/jam/autumn-lisp-game-jam-2021 / https://itch.io/jam/spring-lisp-game-jam-2021

                      2. 2

                        I was just talking to a friend of mine who is a game dev and used to use Lua a lot when he worked in cryengine. He complained about global variables in Lua and how Lua can return null values when a value isn’t present in a collection. I had brought up Fennel, but I wasn’t sure if it tackled either of those issues. I know that Fennel is semantically very similar to Lua. Does it provide any protections against either of those types of bugs?

                        1. 7

                          On global variables: in fennel, only names bound with (global ...) produce global variables, all other binding mechanisms (pattern matching, let, var, local) all produce local variables. Very hard to accidentally make a global variable :P

                          On nil in tables, not directly. You’ll still get nil indexing into a table where there’s no value, but there is a macro like this: (?. tbl :foo :bar :baz) that will nil-check each index and short-circuit so you don’t accidentally index into nil, producing an error. You still have to nil-check individual indexing yourself though.

                          1. 2

                            Glad to hear that variables don’t default to globals!

                          2. 2

                            how Lua can return null values when a value isn’t present in a collection

                            This is honestly kind of an odd complaint since it’s also true of nearly every other dynamic language out there. (Racket and Erlang being the main exceptions I know of.) Lua’s behavior (and thus Fennel’s too) is sublty different in that nil is much more consistently used to represent the absence of data, rather than other languages where you can have absurd situations like “I put nothing in this list and now the list is longer than it used to be”. In Fennel/Lua there is no difference between [] and [nil]. This takes some adjusting to if you are used to the other behavior but once you learn it, it’s a lot less error-prone.

                            Fennel has a few advantages over Lua that make it easier to deal with nils when they do occur. The other comment mentions the nil-safe deep accessor macro ?. but there is also automatic nil-checks for function arguments with lambda as well as the fact that the pattern matching system defaults to including nil-checks in every pattern.

                            1. 3

                              This is honestly kind of an odd complaint since it’s also true of nearly every other dynamic language out there.

                              They’re primarily working in statically typed languages (C++, C#) so it’s not totally a dig against Lua. Just normal workflow mismatch vs dynamically typed paradigm. Also, it was in the context of video game designers using scripting languages (e.g., Blueprint), getting out of their depth, and losing a couple days on bugs.

                              (Racket and Erlang being the main exceptions I know of.)

                              Python also throws when you try to access a value that isn’t present in a dictionary. Always reminds me of this blog post:

                              I liken this to telling each language to go get some milk from the grocery store. Ruby goes to the store, finds no milk and returns no milk (nil). Python goes to the store, finds no milk and BURNS THE STORE TO THE GROUND (raises an exception)!


                              In Fennel/Lua there is no difference between [] and [nil]. This takes some adjusting to if you are used to the other behavior but once you learn it, it’s a lot less error-prone.

                              That is interesting! I didn’t know it did that.

                              Thanks for taking the time to respond! I don’t really work in the video game space, but fennel seems like an interesting choice for video games. Piggy backing off of Lua for embedding in game engines and using macros to create DSLs seems like an interesting niche.

                              E.g., I could imagine game designers editing rules in a minikanren DSL to affect changes in the game world.

                              1. 3

                                Haha; yeah can’t believe I forgot about Python. I listed Erlang and Racket there because they specifically do not even have a notion of nil/null in the entire language, whereas Python somehow manages to include null in their semantics, but not actually use it for this.

                                I liken this to telling each language to go get some milk from the grocery store. Ruby goes to the store, finds no milk and returns no milk (nil). Python goes to the store, finds no milk and BURNS THE STORE TO THE GROUND (raises an exception)!

                                On the other hand I’m actually somewhat sympathetic to this because nils are the most common type error in my experience by at least an order of magnitude, so I would characterize it differently. To me it’s more like you ask Ruby (or Clojure, or JS, or whatever) to go to the store to get some milk, it comes back, walks over to you, says “here’s what I got you”, holds out its empty hand, and drops nothing into your hand.

                                If a human did that it would be considered extremely disrespectful or overly sarcastic! Throwing an exception is indeed an overreaction, but there needs to be some middle ground where you don’t just pretend that the operation was successful, and most dynamic languages simply don’t have the ability to convey this. https://blog.janestreet.com/making-something-out-of-nothing-or-why-none-is-better-than-nan-and-null/

                                edit: the reason this works better in Erlang than other dynamic languages is that pattern matching is baked into the core of the language so it’s easy to represent success as a tuple of [ok, Value] which encourages you to match every time you have an operation which might in other languages return nil. Fennel has a pattern matching system which was in many ways inspired by Erlang.

                                1. 2

                                  the reason this works better in Erlang than other dynamic languages is that pattern matching is baked into the core of the language so it’s easy to represent success as a tuple of [ok, Value] which encourages you to match every time you have an operation which might in other languages return nil. Fennel has a pattern matching system which was in many ways inspired by Erlang.

                                  That’s great to hear! I haven’t used Erlang, but I’ve used a bit of Elixir and I really love that design. Jose Valim described assertive code in an article a while back and I appreciate that perspective. That’s another reason why I like python burning down the store so to speak. Having the option to say “hey, I really mean it this time” is always useful.

                                  I once spent a day (or more?) tracking down a bug in a poorly tested Node JS codebase. It turns out that the SQL Server stored procedure was returning ID and the Node process was looking for Id. Of course, JavaScript will happily work with whatever you give it so it was a pain to find. The exception occured way further down the line. It’s hard not to get little bitter after an experience like that.

                        1. 7

                          This is a great post. Props to the author for all of the explanations!

                          1. 6

                            Surprisingly in-depth. Great read for understanding how compilers work, especially for functional languages.

                          1. 2

                            The reMarkable is such a unique little device, I’ve had a lot of fun using my rM2 for reading and notes. I really appreciate the minimalism of the built-in software, and the open source community that’s developed around it is incredible. Look, other companies, at the kind of community you can have if you tuck root passwords into your devices’ settings app!

                            1. 4

                              well they were forced to via the license (GPLv3 by not paying QT) - support for rM2 OSS from the dev angle seems to be more of a polite gesture as long as the main ‘own’ display control is via binary hacks (LD_PRELOAD on their display server). I love my Rm2 hardware wise, a few thousand notepages in, but I also want their software out of it and run my own.

                              1. 2

                                Strong concur. As sold, the device is usable (with the very latest firmware) as an e-reader, a minimalist drawing/notepad setup, and a device specifically for reading and making marks on PDFs. That’s enough to be usable in certain workflows, since the display and the stylus input are really impressive, but it could be useful for so much more.

                            1. 1

                              Full time dvorak user. I got used the positions of hjkl. I try to minimize one-character movements, though.

                              1. 2

                                W and B, ctrl-D and ctrl-U with crtl on capslock, have become my friends using dvorak.

                              1. 7

                                Anyone know how this compares to Fennel, another Lisp-on-Lua language?

                                1. 9

                                  AFAIK Urn is effectively its own language with its own semantics, and Fennel I think is better thought of as a lisp-syntax-frontend for Lua. They both compile to Lua, sure, but I believe the Urn compiler is doing a lot more leg work.

                                  1. 6

                                    That’s correct. The big difference is that Urn does a lot more static analysis; I think at one point they were building a gradual type system into it? But some of that made interop with Lua less direct, and it also made it difficult to support interactive development with a repl. (I started using Urn a bit before I discovered Fennel, but the lack of a repl was rather problematic for me, even tho I liked a lot of other things about it.)

                                1. 12

                                  I backed for one of the second-generation Atreus boards, but you can also build your own first-generation right now.

                                  Tiny, “split”, ergonomic/ortholinear, mechanical, hackable. Really looking forward to getting it.

                                  1. 7

                                    (Atreus creator here) Thanks! I was just talking on #lobsters IRC about how I was working on a new scheme-based firmware for this that’s been a lot of fun: https://git.sr.ht/~technomancy/menelaus/tree/master/menelaus.scm

                                    Figured folks here might find that interesting. It’s fully functional in about 300 lines.

                                    1. 3

                                      It’s crazy how simple that is compared to some more popular firmwares written C… Lovely work as always

                                      1. 2

                                        I just backed - not sure if I’ll end up converted from my Kineses Advantage, but I sure would like a portable option :)

                                        1. 1

                                          That was definitely the original intent; it was designed to complement a larger board for when you’re away from your desk. (That said, I stopped using my larger board once I got used to it.) Enjoy!

                                      2. 2

                                        Also, a proud owner of Atreus here. I can say that assembling Atreus was a fun exercise, it’s a compact and very ergonomic keyboard. My touch typing on Atreus is still slow (and even slower when I type in my native language) after I switched from Pok3r, but I enjoy using it.

                                      1. 3

                                        I’ve hooked my Pi 4 to a 4TB usb drive and I’m using it as a borg-backup repository!

                                        1. 6

                                          I lurk, but I’m trying to post more stuff. @oats@mastodon.social

                                          I’m a linux enthusiast, bassoonist, computer engineering student, and amateur programmer!

                                          1. 1

                                            Oh, that’s lovely. I really like the look and feel of your website! Could you describe a little what you used to put it together?

                                            1. 4

                                              It’s based on a few things:

                                              It is a very boring Go app.

                                              1. 1

                                                Cheers!

                                            1. 3

                                              Wow! Impressive project, hardware and software wise. I wonder what the battery life is like.

                                              1. 2

                                                The creator on the reddit thread says about a week.

                                                1. 2

                                                  Wow that’s a lot more than I was expecting.

                                              1. 13

                                                I’m one of the lead devs for Fennel; been working on it for about a year now and having a ton of fun.

                                                We’ve got a free 1-day conference in Portland next month: https://conf.fennel-lang.org/2019

                                                Ask me anything!

                                                1. 2

                                                  I was curious why it was built on top of Lua specifically. Is that so Fennel can leverage its JIT’d VM and embedding? Or did you all also value Lua libraries wanting them? The latter I wonder about given Id guess there be lot more libraries for Pythkn, Ruby, etc.

                                                  1. 9

                                                    Good question. For me personally it started because I was using the Love2D framework for games, and I became very impressed by the speed and conceptual simplicity of Lua.

                                                    But there were still a few remaining annoyances despite its simplicity; the statement/expression distinction, the ease with which you can accidentally create a global, and the lack of arity checks in particular were the only complaints I had with it.

                                                    It wasn’t enough for me to do anything about, but when I found Fennel, I realized that creating a compiler that targets Lua doesn’t need to be a big deal. The source for the compiler is under 2kloc. Fennel introduces virtually zero runtime overhead, and the compiler output (with a few exceptions like pattern matching) looks very close to the input.

                                                    1. 3

                                                      Thanks for response. 2kloc? That’s impressive! That’s in bootstrapper territory.

                                                      Love2D looks neat. The first thing that jumped out is it runs on every major platform. Examples look easier than some GUI toolkits from long ago. So, my first thought is: “Could someone use this as a cross-platform, GUI toolkit with simple language to make great-looking interfaces?”

                                                      1. 5

                                                        Yeah, actually 2k isn’t just the compiler; it includes the stock macros and the repl.

                                                        Love2D is much easier than any other GUI work I’ve done on any platform, yeah. If you don’t need native widgets or the ability to display more than one window it could certainly be used for non-games. In fact, I created a text editor in about 1.2kloc which is a mix of Fennel and Lua: https://git.sr.ht/~technomancy/polywell

                                                        It’s loosely based on Emacs and has syntax highlighting, a buffer switcher, support for repl buffers, completion, tetris, etc.

                                                        1. 3

                                                          I’ve also had some success using imgui using the love2d bindings. It’s got a lot of handy UI widgets - I used it for game debug UI, but I could see it being used for non-game apps as well.

                                                  2. 2

                                                    Are you the same technomancy who created the Atreus keyboard?

                                                    1. 2

                                                      Yep, that’s me!

                                                      https://atreus.technomancy.us

                                                  1. 3

                                                    I’m thinking about buying some yarn and a hook and trying to learn crocheting. I’d like to make myself a nice winter hat, we’ve got some really cold weather coming and I lost my last nice one.

                                                    1. 0

                                                      Could someone help me understand what the use of this is?

                                                      1. 4

                                                        It is a font designed for use as placeholder text, but without actually displaying any text. This is useful because often non-designers will get hung up on the details of text or (if lorem ipsum is used) wonder what’s wrong with the design that it has all this gibberish in it.

                                                        1. 1

                                                          I think it’s pretty clear on the site

                                                          Scribble is great for Prototyping & Wireframing so you can focus on the form of the text and not the text meaning. Also it looks cool

                                                        1. 1

                                                          @arrdem, can I ask if you use a static site generator / template for your site? If so, which one? I really like the design…

                                                          1. 1

                                                            I do! This site (and others) are built on Jekyll. The theme I use is a copy of the Hyde theme I’ve hacked up over the last several years. The color scheme and logo were made with https://logojoy.com

                                                            1. 3

                                                              That actually seems like it would be more irritating than hard mode…

                                                            1. 1

                                                              Some of these don’t look bad and might even be pretty good on an e-ink display or an eReader type device.

                                                              1. 3

                                                                You learn something new every day! That’s good to know.