I've had failure rates as high of new BD discs, even.

The US BD pressing plant shut down a while ago and the new ones are very hit or miss, I've gotten several that were heavily scratched or otherwise unreadable – brand new in sealed case, from the only NA factory.

If they were a small or free service I wouldn't have much issue, but they do charge, I don't think it's too much to ask that they at least attempt to scrape the wider web.

Building their own database seems the prudent thing long-term, I don't doubt they could shore up coverage over Bing. They don't have to replace the other indexes wholesale, just supplement it.

They have smallweb and news indexing, but other than that AFAICT they rely completely on other providers. Which is a shame, Google allows submitting sites for indexing and notifies if they can't.

Running a scraper doesn't need to cover everything since they have access to other indexes, but they really should be developing that ability instead of relying on Bing and other providers to provide good results, or results at all.

Small web always returns 0 results for anything that isn't extremely broad, unfortunately.

I've been using Kagi for the last year+.

Personally, I wish they'd tone down the AI stuff that ruined Google, but at least you can turn most of it off.

Their results are okay, a little better than Bing, but obviously they're limited by their existing index providers, I wish they'd run their own spiders and crawl for their own data, since I think Bing fails on a lot of coverage of obscure websites.

In general I find the weighting of modern indexes to be subpar, though the SEO industry has made it a hard problem to tackle, I wish more small websites and forums were higher ranked, and AI slop significantly de rated.

Very interesting move, you really would think that a unified storage provider would scale very well, and hedges the business on both sides.

I've really liked WD, I exclusively use their enterprise HDDs and haven't had a single failure (bar one caused by incorrect shipping) and their SSDs been similarly good offerings.

Matrix is probably something worth looking at, at least from an intellectual standpoint, for you. It uses shared message state and a DAG, plus some fancy perfect forward secrecy (using Signal's Double Ratchet algorithm), which is at least interesting. There's also Tox (chat/protocol) if you want totally distributed chat.

Personally, I really like distributed models from a theoretical standpoint; but for end-user applications they pose very difficult constraints, we live in a world with ⪅50% publicly routed IP for one, they fundamentally require immense data replication, latency in peer-finding, bandwidth constraints, and ultimately sub-par UX. I thought IPFS with a way to pay nodes to pin content was a really neat idea, but hasn't caught on, for example. Not to discourage you, if you think it's workable then have at it, but I think it at least explains the current state of things.

I do think the other home server implementations gaining parity (production-ready) with the reference home server would go a long way. I haven't run a home server but I've heard from those that have that it really has a hard time scaling. (Though this serves as impetus to give it a try over spring break)

Which brings me to the caveats of the protocol, I personally don't think the design is ideal, it's more described as a distributed message bus, what I've read of the spec it's over engineered, it made good decisions wrt using modern web technologies (JSON, WebRTC), but it didn't scope itself to the particular task.

That said, I haven't written a federated protocol, and they have. But if I was going to, I'd really want to look at Discord and see how to copy a lot of that model, but break parts of it out to facilitate federation:

I originally wrote a huge hypothetical design here that I speculated would fare better, but honestly the specifics become less relevant, point is that the shared state of rooms is a real challenge, and one out of scope for just a federated instant messaging system, and I'm no longer certain it's viable.

I really wish Matrix had been more successful, but it has some pretty core problems that prevented it from gaining more traction.

It fell into the same trap as XMPP, though perhaps even worse, with a focus more on its protocol and specification than a single unified product vision. The reference server implementation is slow, and using a language not optimal for its purpose, with alternative server implementations left incomplete and unsupported. It took a long time for them to figure out voice and video and for it to work well, and the "user flow" still isn't at Discord levels.

I've rooted for Matrix for a long time, but as a former XMPP evangelist, to me the writing on the wall says it isn't suited for success either. I'd love to be wrong, but I don't see a way through.

No thanks, people hop from centralized platform to centralized platform thinking things will be different.

Consolidated power, especially when fully captured by market forces, will always enshitify, the only out is federation.

I've read this with concerning frequency, was SPF/DMARC/DKIM all in order? I also have to question if it was a matter of IP reputation, since shared hosting IP ranges are usually pretty thrashed.

I rent mailbox services (for a custom domain) from a local ISP and don't have problems with deliverability as such.

Rust By Example is very good for showing the ropes in a very practical way, that's how I got up and running with it.

Secondly is the O’Reilly book Programming Rust, which is probably closer to what you want, it explains the actual technical details of much of the language, and to me seems written for an audience that already knows programming. Lastly would be Rust for Rustaceans by No Starch Press, if you actually do want to pursue Rust further, as it discusses very, very in detail the systems of the language, and how they can be used to make something so powerful like Serde.

Maybe give it a try; it's my favorite language to write programs in now, it has an extremely good standard library, and for everything else there's a mass of high quality crates, its build system is actually competent and makes compiling on Windows or Linux trivial, plus many, many more quality of life features.

What a wonderfully enchanting exploration of Gorton.

I've had a soft spot for Gordon Modified for a long time, I use Signature Plastics keycaps on almost all my keyboards, with its wonderful rounded characters . There's just something about it, easy on the eyes, immediately legible at even small scales, it's a comfort font.

At what level? I get a student email from my college (outlook based) as do the professors, though communication is primarily through Canvas. So that's what I see most often in that context.

I think a lot of people have Gmail incidentally for things like YouTube and other Google account stuff, very few people know you can even bring your own mail.

I still see lots of different emails out there, outlook/hotmail is still huge, yahoo occasionally, icloud in the US.

Among my techy friend circle all of us have either our own self hosted mail, a 'privacy' company email, or something in the middle.

All to say, I don't think it's that uphill of a battle for the very large percentage of Internet users to accept the way federation works.

Regardless if it was the plan, it's the result.

I can't stand what it has become, especially when some of the most problematic subs have massive influence over the rest of the site, like wsb.

Yeah, I was starting to feel a bit crazy with how many were coming out of the woodwork with almost exactly that same wording, even in my city's sub.

I finally made the move to setting up an account here and wean my reddit usage.

It's getting so bad on there, so many bots, trolls, and paid agitators. Plus the uptick in fascist apologists. Smaller communities with higher bars to entry produce better conversation, in my experience.

In my experience these "containment" boards/servers/sections tend not to work.

Long term it basically just creates a place that attracts those you don't want, and becomes place for those ideologies to spread. Then it either gets bad enough they take over (you know the site) or they break off wholesale and form a new community dedicated to those worst impulses (pyrrhic victory at best).

The best policy is to actively moderate, and in the case of the fediverse, defederate, those groups and those that give them shelter.