• fartsparkles@sh.itjust.works
    link
    fedilink
    arrow-up
    15
    arrow-down
    4
    ·
    1 year ago

    I feel the issue with AI models isn’t their source not being open but the actual derived model itself not being transparent and auditable. The sheer number of ML experts who cannot explain how their model produces a given result is the biggest concern and requires a completely different approach to model architecture and visualisation to solve.

    • Jamie@jamie.moe
      link
      fedilink
      arrow-up
      7
      arrow-down
      1
      ·
      1 year ago

      No amount of ML expertise will let someone know how a model produced a result, exactly. Training the model from the data requires a lot of very delicate math being done uncountable times to get a model that results in something useful, and it simply isn’t possible to comprehend how the work inside is done in a meaningful way other than by doing guesswork.

    • DigitalJacobin@lemmy.ml
      link
      fedilink
      arrow-up
      3
      arrow-down
      1
      ·
      1 year ago

      We already know how these models fundamentally work. Why exactly does it matter how a model produced some result? /gen