Mold: A Massively Parallel Linker

(arxiv.org)

103 points | by matt_d 9 hours ago ago

15 comments

  • gabeochoa 8 hours ago

    Old tweet from Rui, but I saw it in a recent zig video and really liked the sentiment:

    (https://x.com/rui314/status/1560277403787997185)

    > my strategy is to increase the value of commons by, say, 100 and get 1 as a return, so bear with me. If you want to use mold for free, you can just do that. This is my open-source business strategy.

    Wishing the best for Mold and Rui

    • _jackdk_ 2 hours ago

      Given the passing of nitter, xcancel, etc., thank you for quoting the relevant text.

      • inigyou 6 minutes ago

        The nitter software still works and so do most of the servers except the most popular 2

  • canucker2016 an hour ago

    Here's a lwn.net link to Ian Lance Taylor's blog posts about his gold linker (his blog doesn't seem to have any table of contents or group the linker-related blog posts in one area/tag).

    see https://lwn.net/Articles/276782/

    GNU gold is deprecated and will probably be removed soon. ( https://www.phoronix.com/news/GNU-Gold-Linker-Deprecated )

    But back in the late 2000s, the blog posts were a combination of algorithm optimization class and software history since no one seemed to step up to cleanup the technical debt that GNU ld had accumulated over the decades.

  • dochtman 8 hours ago

    Wild is a decent bit faster than mold at this point:

    https://github.com/wild-linker/wild

    (Benchmarks in the README.)

    • anitil 6 hours ago

      I'm keen to follow along with Wild as their intent is to be incremental, and Zig recently announced incremental linking support. I'm also a fan as its cool to seen an Australian working full time on open source (I'm also Australian)

      Edit to add: I think David's talk on Wild [0] is an interesting summary of what a linker is and why its hard to make incremental

      [0] https://www.youtube.com/watch?v=WSHt3-gwVxc

    • vient 7 hours ago

      Rui mentioned today that he managed to speed up mold "about 1.5 times" while writing this paper https://x.com/rui314/status/2092486965186969699?s=20

      Seems that some optimizations went to mold 2.42 and others are not yet released. Wild benchmarked mold 2.40 or 2.41

      • elygre 6 hours ago

        I guess this sentence from the Wild readme is also relevant:

          Mold is already very fast, however it doesn't do incremental linking and the author has stated that they don't intend to.
    • peter_d_sherman 7 hours ago

      Excellent (pardon the pun!) link! :-)

  • omoikane 2 hours ago

    This is a wonderful paper that includes many optimization tricks that are generally applicable, including various optimizations that they retrofitted into lld. But I thought there was one meta optimization that was especially interesting (from page 2):

    > A new linker's early adopters knowingly accept such differences, which is one reason why drastic improvements tend to come from new linkers rather than existing ones

    This is true of many things, not just linkers. I think this is encouraging for people to (re)try things that have already been done, because newcomers are allowed to take risks that established things can't take.

    • matheusmoreira 23 minutes ago

      Mold's definitely innovating.

      I use mold a lot for code embedding in my lisp. I needed extra null PHT entries in the ELF so I could easily patch in custom segments into the interpreter after the link was done.

      GNU pretty much ignored the feature request and LLVM probably never even saw the issue, but Rui shipped the --spare-program-headers feature pretty much immediately after I requested it and it immediately restored my sanity.

      https://www.matheusmoreira.com/articles/self-contained-lone-...

      Current version of my patcher supports ld and lld, but it has to move the PHT to the end of the file in order to append the new segments. Mold is still the only way to avoid the ugly hole where the PHT used to be.

  • lrvick 6 hours ago

    We use mold as the default linker in the Stagex linux distribution. It shaved hours off our full tree build time.

  • mbrumlow 6 hours ago

    Would use this at a fairly large company if we had windows and Mac support, probably could get budget to pay for the features it’s missing.

    • ahartmetz 5 hours ago

      That sounds like you should get in contact with Rui Ueyama. If anybody asks, someone on HN said it seemed like a no-brainer.