• @CanadaPlus@lemmy.sdf.org
    link
    fedilink
    1
    edit-2
    2 years ago

    Doing it in a federated way.

    Specifically, when you tell your instance about another one, it should at least register the existence of every community on the other instance. Right now indexing is community-by-community from what I hear and that sucks.

    • Jamie
      link
      fedilink
      2
      edit-2
      2 years ago

      I can completely understand why that wouldn’t be, like imagine if an instance got big and had say, 1k communities. When a community is indexed, it loads 50 posts initially, then the target instance federates updates over once a person subscribes. Then, every time a new instance discovered them, they’d be sending 50k posts over and getting bogged down.

      I think the top 5/10 communities could be reasonable, though. This could also be accomplished with a bot either managed by an instance interested in pulling that data, or a user wanting to automate subscriptions a bit.

      • @CanadaPlus@lemmy.sdf.org
        link
        fedilink
        1
        edit-2
        2 years ago

        Last I checked there were 10k communities and a few 100 instances total, which is tiny in computer terms. As it grows larger maybe it would be an issue, but really even millions of instance names properly compressed shouldn’t be onerous for a one-time download.