-
Working on finishing a single binary init system in Rust. Other then that I’m exploring youtube APIs so I can make some modifications to a distributed scraper I wrote. Planning to help an archiver try and scrape all meta-data off youtube.
-
Finishing up an infra move at work, putting the final touches on an HTTP server I wrote to be my personal homepages backend, and starting work on implementing my own ethereum virtual machine im rust.
-
Zero sympathy for those pwned.
-
-
Why? Because using etcd in the first place is probably a dumb decision, and if you (for some bizarre reason) actually need it, then anyone who calls themselves a “sys admin” should be prudent enough to not install software that exposes all of your most private and important credentials to the Internet. And if you do install such software, you should most definitely be aware of it and configure it properly — before it takes down everything.
If you’re not competent enough to do that, you have no business being a system administrator, you are a security threat to anyone who hires you.
-
-
-
- Spent a lot of time polishing some of my libraries to get them to 1.0 (with help from others).
- Rewrote my CSV library in Rust. Pretty sure it’s one of the fastest general purpose CSV parsers. It’s at 1.0-beta. Close to a 1.0 release.
- I managed to publish 1 blog post (on aforementioned CSV library), which keeps my pace going.
- Helped with the SIMD stabilization effort for Rust, but others have helped a ton too. We basically crowd-sourced writing implementations for all the various Intel vendor intrinsics (there are ~thousands) and it worked really well!
- Wrote a small CLI data entry tool to import data into a
ledgerformat. I still need to copy & paste tables from PDF files though on occasion. /sigh - Spent a significant amount of time working on a low level information retrieval (think Lucene, but one layer down) library. I have nothing to show for it so far. It’s hard.
- Began a giant refactor of Rust’s regex library internals that will probably take years. This year I almost finished a rewrite of the parser. The goal of the refactor is to make it easier to add optimizations and break apart the internals. A secondary goal is to support stream matching. I don’t know if I’ll succeed in either endeavor!
- Ported several hierarchical agglomerative clustering algorithms from C++/Python to Rust for fun/work. I’m proud to say that I matched performance and used zero
unsafe. - I started work on a principled approach (read: not some random mish mash of Python scripts) to parsing the Unicode Character Database, with the intent of using it to (mostly) provide complete support for level 1 Unicode support. I’m also casually building a tool to browse/search the UCD. I had been using a Go tool that someone else wrote, but it’s… surprisingly slow.
- Continued active maintenance of ripgrep. Interestingly, I didn’t add any new major features this year (perhaps UTF-16 support qualifies, but in terms of code changes, it was very small). I do still have some planned that I had hoped to get to this year, but that ain’t happening. :)
- I gave my first talk on ripgrep at the Boston Rust meetup. It went well.
- I discovered Dan Carlin and listened to all of his Hardcore History podcasts during my commute.
At $work, I did lots of stuff too. A big part of this year was spent adding access control to our system. I’m also working on a collaborative graph editing system (think Google Docs but for knowledge graphs) which has a ton of interesting problems in it.
-
-
Hmmm. I don’t know what you mean by that. It has its own format, just like Lucene has its own format. It isn’t going to support Lucene’s format is that’s what you mean.
The idea it’s to provide a library for creating and querying a single IR index. In Lucene terms, this is at the level of a single segment. It uses fsts for the term index, uses skip lists for the postings and all that. It is mostly just a prototype at this point. I’m struggling with what the API should look like. For example, you invariably need to talk about multiple segments for merging, even though I was trying to avoid that (merging needs knowledge of the format on disk to be fast). This in turn means making assumptions about identifiers. So it is a bit of a knot at the moment.
-
-
-
Currently working on writing a quick character generator for Cryptomancer in rust followed by releasing a more genericized crate for anyone who wants to do quick character generation for their trpg of choice. Otherwise it’s just setting up monitoring and backup scripts at work.
-
Continuing on with my automated penetration testing kit. Golang has been a god send for easily parallelizing connections and threads. Working on adding the fun stuff which will including worm like capability to spread among a network after gaining a foothold.
-
I use dokuwiki myself for long term storage, and google keep while mobile. Have a script set up to query google keep and add the content to my dokuwiki instance every night.
-
-
aleph
8 months ago
|
link
| on:
Do you back up internet on your own? What and how do you back up? How much space does it take?
I tend towards archiving, sorting and catalouging all my data. So I have full site rips of several science fiction blogs as well as textfiles.com, Bruce Scheiner’s blog, and quite a few others. Along with:
UC Berkely’s online Video lectures All of C3 All of Blackhat All of Defcon Several TB of full tv series Several thousand movies Twenty thousand plus books Full archives of byte, mondo, 2600 magazine, etc. And much, much more.
-
Admirable dedication.
I have to add that I hate when there are online video courses I bought that I cannot easily download, like from Thinkific. I know I can watch it anytime I want, but what if the site will go down, or the creator closes his account with all the courses she or he was selling? I don’t like it (just like I don’t like subscription model in software, because if I buy something, I want to have it accessible perpetually and obviously offline too).
I know it’s to prevent piracy, but typical thing with anti-piracy protections is that they make lives of users harder, while pirates will somehow grab the content anyway if they’ll be really willing to do it.
-
-
Just mundane work stuff, finishing up containerizing a few coin daemon’s for usage with our mining pool software and setting up rancher-nfs to use as a remote volume store for various client versions of their coins individual blockchain. Other then that I’m hashing out what instructions to include in my VMs instruction set, trying to find the nice cross section between minimal and featureful.
-
Plasma Mobile (and Hildon, because I’m an N900 nostalgist) is IMHO essential from turning this from just a toy that engineers play with to something that could affect change by allowing you do daily drive these old phones. (Unfortunately, I have concerns with that - mobile hardware wasn’t on the same plateau desktop computing is.)
-
-
I’ll seriously consider flashing the N900 and giving it another go, Unfortunately, the N900 is somewhat crippled by only having 256 MB RAM, (despite having 32 GB of flash - in 2009!) and I think there’s not a whole lot of ecosystem going on for Hildon nowadays. (Plasma Mobile is small, but will likely grow.)
-
Don’t quote me on this, but I think I have heard in the pmOS chat that Plasma Mobile will work on devices with 256MB of ram. One of the original Plasma Mobile demos was done on the N900 a few years back.
On a side note, I ran XFCE on mine with pmOS and another user had Sway going on Wayland. Mainly “just because we can”, though none of us are using those environments at the moment since most of our time is dedicated to further development of pmOS.
-
Hildon is just X11 though, so any of the qt/qml/gtk stuff being built for other environments can work there :)
Yeah, the RAM limits on the N900 are the only reason it’s not still my daily device, since web pages have mostly grown to require at least 1GB RAM to load :P
-
-
I can live without telephony so long as the data modem works ;)
-
-
For sure. Keep up the good work!
-
-
-
-
I’m very excited for a Hildon revival! I got my current device (Blackberry Q10) in part because the UI felt enough like Hildon to be familiar.
-
-
Yeah, I’m desperate to replace my Q10 with a Pyra!
-
I wanted a Pandora when they were new, but I kinda lost my enthusiasm for GNU/Linux along the way. (I still kinda want one anyways, though.) The thing with the Pyra is that it’s more like a laptop or even the pre-N900 NITs - a WiFi based tiny “MID” or gaming thing. Cellular might be possible on Pyra now, but the form factor seems clumsy for a phone replacement.
-
-
Well, I suppose it depends what you use a “phone” for. If you primarily make voice calls, it’s probably not for you (though with a bluetooth headset maybe even for that form factor matters less?)
For me, I’m mostly texting (well, XMPPing, really), some surfing, some ssh’ing
-
-
-
-
-
-
Ah, one of my favorite days of the year. :)
-
Been working on learning more of Golang after my refresher on C. Been working on a minimal iftop clone, and have also started preliminary work on implementing a ssh client. Planning to start porting my minimal C compiler clone to Go as welll after my ssh client is done. So much to do, so many rfc’s to read.
-
Happy New Years you crusty crustaceans. May 2017 be ever in your favor. :)
-
Aye, it’s a shame it was shut down. Haven’t seen a nexus for discovering and enjoying new and obscure artists like it for years. Although I’m sad to see it go, I’m excited to see what site shall take it’s place. Especially secure in the fact that a large amount of the original content released on the site is saved and planned to be reuploaded elsewhere.
-
Finishing up a meta data scraper for YT videos in an archival team up with archive team. Putting some finishing touches on my init system, and getting set up at my new job.