IS2511

IS2511

@is2511.com

๐Ÿ–ฅ coder, ๐Ÿง  thinking enthusiast, ๐ŸŽž youtube consumer, ๐Ÿค weeb ๐Ÿฆ€ Rust, โš™๏ธ C/C++, โ˜ TS/JS, ๐Ÿ”ฎ Lua ๐ŸŒ is2511.com Made ๐Ÿ‘‰ @chatis.is2511.com

180 followers357 following473 posts

It's hard for me to fully comprehend that there are people who believe LLMs are strictly useless in programming and/or strictly harm the quality of code/product. Makes me want to write a blog post about it... Various scattered ideas and notes off the top of my head (*not fact checked*):

View full thread

LLM as a smart(er) auto-complete. No, I'm not joking. This is about the level of responsibility it can handle (pretty "ok" at it). Propagating a small change with a clear pattern? Do once, TAB for the rest - an actual time save and convenience. Is that vibe-coding? I don't think so. LLM use? Yeah.

This is nowhere close to everything I want to write about LLMs and genAI, but it's kinda 4am... NOTE: *I'm not a machine learning expert.* The simplifications are what I arrived at based on other less simplified but also not totally accurate or full explanations. This might be ass and/or false.

It's hard for me to fully comprehend that there are people who believe LLMs are strictly useless in programming and/or strictly harm the quality of code/product. Makes me want to write a blog post about it... Various scattered ideas and notes off the top of my head (*not fact checked*):

View full thread

Of course, if the only thing that matters is shipping that code, to maximize shareholder value, and the business is pushing for "vibe-coded now, fix later/never", then it does make sense to vibe-code. Sacrifice ever achieving good for quickly achieving a working meh most of the time.

But there are other uses for LLMs in a developer's workflow. Doing vibe-coding the proper way still takes time and the result is bad. Time waste for a dev who wants to make good. But what about code review? Almost no time required, yet it has the *potential* to make good discoveries/suggestions.

It's hard for me to fully comprehend that there are people who believe LLMs are strictly useless in programming and/or strictly harm the quality of code/product. Makes me want to write a blog post about it... Various scattered ideas and notes off the top of my head (*not fact checked*):

View full thread

And model context plays into the quality too. Asking it to continue low quality text obviously makes low quality output more likely because in training data low quality text is usually surrounded with more low quality text. Having a bad codebase nerfs a model too, no matter how hard they "align" it.

The value proposition for vibe-coding from a developer's POV just doesn't make sense. Vibe-coding discourages ever going in to do something manually, basically locking them into vibe-coding the codebase, unless a developer wants to waste enormous amounts of time to understand garbage code (hard).

It's hard for me to fully comprehend that there are people who believe LLMs are strictly useless in programming and/or strictly harm the quality of code/product. Makes me want to write a blog post about it... Various scattered ideas and notes off the top of my head (*not fact checked*):

View full thread

Average quality of all code ever? Even just all code on GitHub? It's shit. Not extremely bad but pretty damn bad. An LLM can only reproduce that, so the output is obviously low quality code too. Power law, few popular repositories with high quality code vs many many low quality repositories, etc...

In training, model authors can feed it additional copies of what they consider good, making the output lean more towards that (simplified). But since a model is a black box, the approach has downsides. It screws with weights in unpredictable ways, usually decreasing model "stability" (simplified).

It's hard for me to fully comprehend that there are people who believe LLMs are strictly useless in programming and/or strictly harm the quality of code/product. Makes me want to write a blog post about it... Various scattered ideas and notes off the top of my head (*not fact checked*):

View full thread

So no matter how long and hard you train an LLM, the average output quality is going to hover around the average quality of the training data, maybe slightly above. Model weights are based on frequency (read "popularity") of input text (token chains) (simplified).

That is why LLMs can for example reproduce popular Wikipedia articles pretty accurately, sometimes exactly. Wikipedia is frequently quoted and copied, so it occurs pretty frequently in training data, which carves it into the LLM's memory more and more accurately, gives it more "weight" (simplified).

It's hard for me to fully comprehend that there are people who believe LLMs are strictly useless in programming and/or strictly harm the quality of code/product. Makes me want to write a blog post about it... Various scattered ideas and notes off the top of my head (*not fact checked*):

I myself have never vibe-coded, my biggest ever LLM usage in relation to code is generating a body of a small function. Vibe-coding from scratch gives shit results for obvious reasons - LLMs just predict the next most likely symbol (simplified) based on their training data. Garbage in - garbage out.

Every time I open my Bluesky feed it sends me down a thousand little rabbit holes, each no less than ten minutes long, with one eventually cascading into a full multi-hour web crawling session, just clicking on links and reading, reading, reading... It's 3am, again I'm so tired

It didn't fix it :(

IS2511@is2511.com

I think I figured out a fix (pending confirmation). I'm not sure what is causing the link downs, probably some hardware reliability issues at 10G, but I'm fine with it as long as it can recover, which it failed to do. The fail state was link up with only an IPv6 address. I present to you the fix:

Still, it appears to not work for Telegram for example. A *general* strategy, against *general* blocking methods. I guess for Telegram I would need something more custom... Probably not worth it since my main zapret2 instance is for LAN, but Telegram's main use-case is communication from anywhere.

I wanted to test a website behind Cloudflare (kinda blocked in Russia) before posting that the strategy is general/working, so I picked a random domain from my proxy filter (reason note "RU CF ECH ban?") - mpv.io. For some reason it's crazy flaky, refusing connections. And then this... Dial-up fr

Main router (OpenWrt) suddenly rebooted into recovery mode without me noticing 4 hours ago. Reboot didn't help. I so don't want to deal with this right now... I have a not entirely up to date configs backup, should've made one yesterday... Uptime was what, half a year without problems? Why now?

I think I figured out a fix (pending confirmation). I'm not sure what is causing the link downs, probably some hardware reliability issues at 10G, but I'm fine with it as long as it can recover, which it failed to do. The fail state was link up with only an IPv6 address. I present to you the fix:

IS2511@is2511.com

It was not in fact the motherboard port... :( Ok, the warnings are because of the WinBox itself. But what is up with all the link up and downs? This is after switching to an SFP28 port on a ConnectX-4 PCIe NIC.

Maybe I should set a static IPv4 address... The DHCP lease is static anyway. The IPv6 recovery seemed quick (SLAAC perhaps), especially compared to an IPv4 re-acquisition, probably bc of all the DHCP yap. I think the instant IPv6 re-acquisition made it skip IPv4, causing permanent connectivity loss.

> But why do you have IPv6 enabled if you ISP doesn't even support it? I like having stuff enabled if it's supported, ok? My LAN is IPv6-capable, even if I don't use it. Maybe I should. Maybe 50 years from now we will all finally migrate to IPv6 and I'll get some practice with it...

Optimizing away the creative process โค๏ธ

Michael Kamm@michaelkamm.games

Last year, miHoYo copied my puzzle game Ouros in Zenless Zone Zero. Because they are a recognized, billion-dollar studio and my game isn't well known, some people are now assuming that their version is the original, and mine is the clone. I hope this video clears that up.

It was not in fact the motherboard port... :( Ok, the warnings are because of the WinBox itself. But what is up with all the link up and downs? This is after switching to an SFP28 port on a ConnectX-4 PCIe NIC.

IS2511@is2511.com

Nvm, seems like it's just the PC having problems. Consistent minor trolling from the 10G Ethernet port on the motherboard...

View full thread

(bonus) Also, these cheap SFP+ 10G RJ-45 modules lie to the switch for some reason lol. They report being LC when they are clearly not. Wavelength? Bro, it's copper.

It was not in fact the motherboard port... :( Ok, the warnings are because of the WinBox itself. But what is up with all the link up and downs? This is after switching to an SFP28 port on a ConnectX-4 PCIe NIC.

IS2511@is2511.com

Nvm, seems like it's just the PC having problems. Consistent minor trolling from the 10G Ethernet port on the motherboard...

View full thread

(a day later) I was drafting this late yesterday and shelved until today. Now, no issues at all for like 12h+ already. Was it software? Was it an SFP module? I don't think anything changed besides the weather outside... Anyway, now I switched to an SFP28 DAC for better reliability, just in case.

And as I discovered in the original post, the switch only officially supports 4 SFP+ to RJ-45 modules (probably bc power), so swapping one of the modules for a DAC is a good idea all around. Now I'm at exactly 4 active modules. Was that the problem? This fixed itself before the swap, so no...? ๐Ÿคท

It was not in fact the motherboard port... :( Ok, the warnings are because of the WinBox itself. But what is up with all the link up and downs? This is after switching to an SFP28 port on a ConnectX-4 PCIe NIC.

IS2511@is2511.com

Nvm, seems like it's just the PC having problems. Consistent minor trolling from the 10G Ethernet port on the motherboard...

View full thread

I googled what could it be: 1. Spanning Tree Protocol (STP). ethtool | grep STP + cnping, compare, timing doesn't seem to match. 2. Failing auto-negotiation or bad cable. No? 3. Faulty link-state polling. Nope, dmesg is quiet. 4. Duplicate IP / ARP cache. Unlikely, skip. Filler ~~episode~~ post.

So. Intermittent 1 second long connectivity failures. Affects something between PC <-> switch <-> test-host. Not PC port/NIC, not test-host, these were all swapped. Probably not cables/SFP modules. There's only one problematic part left to test... Yep, failure only happens to the PC. It's software.

It was not in fact the motherboard port... :( Ok, the warnings are because of the WinBox itself. But what is up with all the link up and downs? This is after switching to an SFP28 port on a ConnectX-4 PCIe NIC.

IS2511@is2511.com

Nvm, seems like it's just the PC having problems. Consistent minor trolling from the 10G Ethernet port on the motherboard...

Decided to run some simple connectivity tests with cnping, and my god, what is this. Intermittent failures all around, usually for exactly one second. I don't think I've ever seen this before... Well, at least it looks like the failure has a distinct signature.

View full thread

Switched the cable to the Mellanox NIC, instantly feels more stable, poking the cable no longer causes instant DC. I didn't particularly trust the onboard 10G mobo NIC before, and trust it even less now. Man, enterprise/server hardware is so good... Much better than most consumer stuff.

Imagine if I could afford a Threadripper... 8 channel ECC DDR5... 32+ cores... 128 PCIe 5.0 lanes... ๐Ÿคค

Nvm, seems like it's just the PC having problems. Consistent minor trolling from the 10G Ethernet port on the motherboard...

For some reason that port is incredibly flaky, just touching the cable sends it into DC land, having to re-connect and re-negotiate, taking multiple seconds, sometimes longer... If it's the 10G motherboard port, I might just ditch it and switch to the free 25G port on my Mellanox ConnectX-4 NIC...

View full thread

New iteration of my usual rant that you should use Passkeys. Use Passkeys. And if you are stuck using passwords, please *at least* use a password manager (I use Bitwarden for example). Thread:

IS2511@is2511.com

How can convenience mean less secure? Sure, it might correlate, but it's not a causal link... Phone fingerprint scanners seems pretty secure to me while being more convenient than passwords. Apple Face ID is pretty good too.