On macOS I use https://github.com/lox/alfred-github-jump to do the same but search from Alfred.
Even when I have over 12k repos starred, the results from the search are instant. I also modified it with modifiers to jump to issues/prs/create-new-issue/clone.
Sweet! Yeah Alfred is fantastic for this sort of stuff. I’m currently investigating how I can make this work with fzf and maybe add a quick clone shortcut or something not sure yet :)