Interesting! I think the advantage of style fine-tuning is that you might not have to provides that much context upfront. Also, it's kind of magical to have an LLM just do something out of the box. I'll compare my local fine-tuned models against the baseline with instructions and see how they fare.
Yes, TBH one of the reasons i want to try and finetune my own is to teach it stuff that now i have to explain before anything can be done :-P.
Unfortunately i only have a 24GB GPU - and an AMD one at that - so there isn't much i can do on that front. Supposedly a 24GB GPU is enough for finetuning a 24B model with 4bit QLoRA, though when i tried it with some finetuning app (in an official docker container) it barfed at Mistral's weird template or something and i lost interest after that.
I've heard about this but i prefer to avoid anything cloud based (not just for AI but in general). I try to avoid relying on stuff i have little to no control over.
I sometimes long for audio feedback when interacting with Claude, so I've made a Claude Code hook that makes Claude reply to negative feedback with sounds from a folder. You can use any sound you want.
@dang Is this item getting a lot of negative votes? I've no way of knowing, other than seeing my kharma increasing only slightly after all the points the story collected.
Votes (particularly on submissions over comments) do not directly translate to karma. I'm not sure if it's documented anywhere what the algorithm is, but it's something proportionate to the logarithm of post votes becomes profile karma. It's similar with comments, but I believe (anecdata and observation) the positive effect of votes on karma is also logarithmic, but the negative effects of downvotes is linear; so if you have a highly controversial comment that sits at 1-2 points, you can net lose account karma.
For a moment I pictured the Jesuits training their own LLM. If Arthur C. Clarke was still alive, we'd read a story like The Star, but with AI as the main plot device.
From the "Core Features" tab: "Trusted sourcebase: answers are consistent with Catholic Church Teaching and the most contemporary scholarship in science, philosophy, history, scriptural exegesis, social science, and theology."
The Jesuit priest behind this is Fr. Robert J. Spitzer, S.J., Ph.D.
I haven't used magisAI, but I've read a small to fair amount of Fr. Spitzer's writings, and also seen and heard some of his videos and podcasts (largely from his show Fr. Spitzer's Universe), and probably qualify as a big fan of his.
Ah, an opening to recommend The Sparrow by Mary Doria Russell, about a Jesuit going to space to speak with aliens. It won the Arthur C Clarke Award in 1998. I read it recently and it has stuck with me very strongly!
reply