Juraj

Juraj

@aksuno.bsky.social

Freelance software engineer, AI/ML researcher, and co-founder of https://vectorsight.net. Also rock-climber and occasional runner.

107 followers102 following41 posts

Every product owner or whoever manages feature descriptions in backlog should start vibe-coding. If you find yourself frustrated and struggling to describe the feature to the state-of-the-art coder model, please, stop for a while and think about how devs working with you must feel.

The LLM prompt is basically a set of constraints as in a constraint programming problem. The more details (constraints) are in your prompt, the less improvisation (and hallucination) will occur. This is direct analogy to solver landing in the local minima on the wrong side of search space.

Been tinkering with pipecat.ai lately. Such a well designed framework to work with. Trying to build multimodal context aware assistant one can self-host. 🤖 #pipecat #conversationalai #multimodal

Spent half day on inference script for image classifier. Is there a transformers-like pipeline for onnx models? I don’t want to install pytorch, so optimum won’t work here. #huggingface #onnx #pytorch

Having kids is obviously amazing. Don’t you love how your newborn wakes up the moment it touches the mattress after fifth round of you soothing it to sleep?

Juraj reposted

Replying to @simonwillison.net

LLMs are actually stateless. You put in the historic context as input. Chat is only a UI constraint to build this context iteratively.

Today is my last day at company I’ve worked for two years. Learned a lot, met some great people. Now, I’m ready to start new year with new challenges and am generally excited about how 2025 will turn out. 🙂 Fingers crossed 🤞.

Any recommendations for S3 compatible object storage inside EU regions? Looking for smaller vendor, reasonably priced, but reliable. Considering Hetzner 👀. #webdev #s3 #cloud

Juraj reposted

I'll get straight to the point. We trained 2 new models. Like BERT, but modern. ModernBERT. Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff. It's much faster, more accurate, longer context, and more useful. 🧵

Few network resources disappeared from resource group on Azure. No logs or traces. Spent hour on call with support, no clue what happened. Now my VM is just sitting there, bricked, floating in digital space, waiting for rescue. ☁️ Just another Monday.

You are up to date.