Andrew Conner

Andrew Conner

@andrewconner.com

https://andrewconner.com/

481 followers164 following278 posts

I want to make a map of all the wellness clusters. There’s western science people. Then, we have the grounding/red light/nasal breathing people. But these are different from the traditional woo people (crystals, etc). Peaters, keto, anti-BCAA. Who else?

View full thread

I want to make a map of all the wellness clusters. There’s western science people. Then, we have the grounding/red light/nasal breathing people. But these are different from the traditional woo people (crystals, etc). Peaters, keto, anti-BCAA. Who else?

Conclusion from playing with potential What's Hot algorithms: people say they want to see cool smaller communities, but sampling randomly from smaller network clusters ends up being random and not useful.i.e., the useful pockets you'd like eventually get reflected in the follows/likes/replies graph.

View full thread

What typically happens: you find a couple people in each community that are interesting (from the platform, or from other sources). Those people like/repost in their community actively, thus your second-degree graph starts to include more of the communities you care about.

What you actually want is a "For You" algo that has good incentives. Instead of maximize engagement, maximize something else. Follows, likes, etc. The algo needs to be careful about accidentally optimizing for bubbles *and* outrage (ex: show an alt-right meme to a socialist, and they hate reply).

Conclusion from playing with potential What's Hot algorithms: people say they want to see cool smaller communities, but sampling randomly from smaller network clusters ends up being random and not useful.i.e., the useful pockets you'd like eventually get reflected in the follows/likes/replies graph.

Examples: you like 3 (disjoint) groups: math, generative art, and finance. Suppose you don't know of the finance community yet. Finding it is the same as randomly sampling from every similar group, and is *very* low signal. What's worse is that it provides intermittent reward — bad dopamine loops.

Been thinking about timeline algorithm design. Some thoughts, would love feedback. Algorithms are useful/needed bc the amount of content is too much even if you consider just your follows. ie, do you want every reply? every liked post? Content from people you don't follow can be good as well!

View full thread

Example: there's 1000 potential posts to show you, and algo wants to show 100. It ranks the 1000 (based on distance to poster, engagement, etc), picks the top 100, and displays those in a feed. Then, importantly, they're *there* statically —

Been thinking about timeline algorithm design. Some thoughts, would love feedback. Algorithms are useful/needed bc the amount of content is too much even if you consider just your follows. ie, do you want every reply? every liked post? Content from people you don't follow can be good as well!

View full thread

Social networks do this because they *want* infinite feeds that intermix new content with old. It provides an intermittent reward, even if you've read most of the existing posts. I've designed a lot of my content consumption around the concept of separating curation from consumption

Been thinking about timeline algorithm design. Some thoughts, would love feedback. Algorithms are useful/needed bc the amount of content is too much even if you consider just your follows. ie, do you want every reply? every liked post? Content from people you don't follow can be good as well!

Algorithms do two things: filter and rank. Ranking can, in effect, filter by lowering posts down a feed, but practically, low-ranked posts are never shown. Digg was the first time I remember seeing dynamic algorithmic ranking, though I'm sure it existed earlier. Reddit did it as well...

Every time you load the homepage you see the "best" posts. Reload, and it's re-computed. New posts emerge through the ranking. Overall, I think this is bad. You can never "catch up" on your feed. It's infinitely long, and if you wait an hour and come back, you'll see new posts mixed with old ones.

If anyone wants to play with the data set powering this, it's available here: https://huggingface.co/datasets/andrewconner/bluesky_profiles

David Gasquez@davidgasquez.com

Behold is the Bluesky World! Got "The Bluesky Dataset" from @andrewconner.com and used Graphext (from @victoriano.bsky.social) to visualize all the connections. It looks beautiful! 😍 The best thing is that you can explore it too! 👇 https://public.graphext.com/fe28f76fe67518ab/index.html

Andrew Conner reposted

Replying to @andrewconner.com

There's already a critical mass of people here, so if you're interested in chatting with other people hacking around on the Bluesky API, go here:

jesopo@jesopo.bsky.social

YOU THERE! BLUESKY-USING PROGRAMMER! we need YOU! if you're into front-end web development and would like to help out some community-driven projects aiming to fill gaps in bluesky's current UI, come hang out! https://discord.gg/ZwntSUDYnz

Updated my Bsky profile/follower sqlite database. Makes it pretty easy to see overall growth and what's happening in the network. Will post about follows cluster analysis later, but for now: how many unique people follow someone, per day? (Database is available if you want a copy, see below)

database access ↓

Andrew Conner@andrewconner.com

Would anyone like a sqlite database of the Bsky accounts and follow graph for data exploration? Includes account details (did, handle, followers, following), follows, and PageRank calculations for each account. Since no DMs here, DM me on Twitter: https://twitter.com/connerdelights

Andrew Conner reposted

Replying to @orpheas.bsky.social

Get hyped

youtube.comWatch SpaceX TEST Starship, the biggest rocket ever, LIVEThis is the first fully integrated full stack test flight of Starship and the mighty Super Heavy booster. At lift off, it will become the largest and most most powerful rocket to ever fly producing over twice as much thrust as the Saturn V that took humans to the moon. The goal of the test is to get as far along in the mission as possible with a handful of important goals such as; clearing the launch pad, reaching max Q, getting to stage separation, ignition of Starship, burn Starship's engines for 7 minutes and 20 seconds which would get Starship up to nearly orbital velocities and would place Starship on a suborbital trajectory that will cause it to reenter just north of Hawaii. This would allow the teams to test the reentry profile and heat shields for the first time from orbital velocities. Want more information? Check out our Prelaunch Preview written by Austin Desisto - https://everydayastronaut.com/starship-superheavy-orbital-flight-test/ Want to know where to watch this live? I made a video on how to visit Starbase and where to watch a launch from - https://youtu.be/aWvHrih-Juk -------------------------- Want to support what I do? Consider becoming a Patreon supporter for access to exclusive livestreams, our discord channel! - http://patreon.com/everydayastronaut Or become a YouTube member for some bonus perks as well! - https://www.youtube.com/channel/UC6uKrU_WqJ1R2HMTY3LIx5Q/join The best place for all your space merch needs! https://everydayastronaut.com/shop/ All music is original! Check out my album \
View full thread

- For PageRank, only considered accounts with more than 40 followers (there's ~30 follow spammers that follow everyone). This leaves 7k accounts with a score. - I don't reflect unfollows, so if I ever got a follow between two accounts, it's still there

And fun teaser: Bluesky has over a million following connections! It's a fun data set to explore because it's still small enough to do everything inefficiently and locally. follow ↔ follow joins are still possible without any significant latency.

Ways it's incomplete: - Profiles refreshed over past few days - Has 24.8k accounts, which is a couple thousand short of everyone - Prioritized accounts with more followers. Accounts with only mostly follow-spam follows may be incomplete - I mostly skip importing follows from top 30 follow spammers

Bsky network analysis Here's how many followers the entire Bluesky network has. Nearly every account gets 20-30 followers (follow spam), and then it drops off quickly. If you have 100 followers, you're in the top 93%. The top 1% has 430 followers.

View full thread

A peek into what I'm working on: a personalized, configurable trust score on Bluesky. Consider *just* people you follow and people they follow, build a PageRank trust graph. This is much smaller, and shows what accounts that your personal network trusts the most. Here's my most trusted accounts.

(This is a quite good "people you may know" implementation, once you follow several people.) Currently just using follows, but experimenting with likes now. Since it's calibrated to you, like spam isn't a problem.

Bsky network analysis Here's how many followers the entire Bluesky network has. Nearly every account gets 20-30 followers (follow spam), and then it drops off quickly. If you have 100 followers, you're in the top 93%. The top 1% has 430 followers.

View full thread

In fact, this seems like a decent way for future 3rd party clients to provide opt-in filters. Accounts that are significantly lower PageRank for their follower count likely have low quality followers (purchased, spammed, etc). Alternatively, this will help you find high value accounts to follow.

Aside: this has shown one thing clearly: distributed networks have to be resilient to hostile actors *by default*. Twitter can reduce follow spam easily because they're centralized. Bsky will eventually need tooling that filters out noise and orients towards quality. Like email, it's easy to spam!

Bsky network analysis Here's how many followers the entire Bluesky network has. Nearly every account gets 20-30 followers (follow spam), and then it drops off quickly. If you have 100 followers, you're in the top 93%. The top 1% has 430 followers.

View full thread

More PageRank analysis! Considering only accounts with more than 40 followers, here is the distribution of followers vs PageRank. This gives "trust" recursively: if your followers are largely empty accounts → low score, if largely active → high score. Explanation about what this means...

Andrew Conner@andrewconner.com

Ran PageRank on the bsky follower graph. Here are the top accounts. (My crawl is a little incomplete, but this should be directionally accurate)

I use percentiles for both followers and PageRank, because they have very different distributions. Here's a graph of the raw values. Clearly more followers → higher PageRank, but there are outliers. Most of the high followers / low page rank accounts follow spam, so have low-quality followers back

Bsky network analysis Here's how many followers the entire Bluesky network has. Nearly every account gets 20-30 followers (follow spam), and then it drops off quickly. If you have 100 followers, you're in the top 93%. The top 1% has 430 followers.

It's far more interesting if you remove the follow spammers. This is the same graph as above, but not considering the top 30 network-wide follow spammers. Way more cozy!

View full thread

Recrawling. My previous crawl method was starting from my network (and then going off without any specific limit), but I've found several follows clusters that were under-ranked just because it didn't stumble into it.

It prioritizes profile refreshes based on who looks popular—based on my current database, which is vulnerable to missing some clusters. So, if you have no relation to a certain highly networked cluster, hang tight! Also working on a "personalized PageRank", which values your own trust graph more.

(Continuing PageRank of Bsky people, click below for context) Playing around with "who is the most underrated", I kind of like sorting by (followers rank - PageRank rank). e.g., you're the 100th most followed, and 50th highest PR. This captures how far off your follower count is from PageRank.

grin@grin.io

Who has the highest pagerank/followers ratio?

View full thread

Another disclaimer: to speed up computation, I only consider accounts with 20 followers. Which means if you have a lot of followers that have less than 20 followers, you don't get credit for them. Spot checking, this doesn't change things too much (and makes the graph *way* smaller). But...

This actually works better than I expected for a "global trust" score. If I spot check people who are just follow spamming vs someone with a tight cluster, PageRank reflects it fairly well. I've also found several great people that I hadn't seen before.

Andrew Conner@andrewconner.com

Playing with a concept of "trust score" on bsky. Imagine a score existed that'd allow you to filter feeds / notifications by relevance (higher number, way more likely you care about that account). What matters most to you: personalized trust (how much *your* account trusts), or global trust?

Of interest, this isn't just accounts sorted by followers. A follower is worth more if they're followed by more people, etc. This isn't a great metric for "trust", but does indicate how much people invested in bsky follow them.