• 1 Post
  • 114 Comments
Joined 2 years ago
cake
Cake day: August 2nd, 2023

help-circle
  • lily33@lemm.eetoOpen Source@lemmy.mlProton's biased article on Deepseek
    link
    fedilink
    arrow-up
    4
    arrow-down
    1
    ·
    edit-2
    4 days ago

    What makes these consumer-oriented models different is that that rather than being trained on raw data, they are trained on synthetic data from pre-existing models. That’s what the “Qwen” or “Llama” parts mean in the name. The 7B model is trained on synthetic data produced by Qwen, so it is effectively a compressed version of Qen. However, neither Qwen nor Llama can “reason,” they do not have an internal monologue.

    You got that backwards. They’re other models - qwen or llama - fine-tuned on synthetic data generated by Deepseek-R1. Specifically, reasoning data, so that they can learn some of its reasoning ability.

    But the base model - and so the base capability there - is that of the corresponding qwen or llama model. Calling them “Deepseek-R1-something” doesn’t change what they fundamentally are, it’s just marketing.













  • To add about the distro framgentation, and particularly:

    If I run into a software I need and it specifically indicates it’s for another flavor of Linux than the one I run, how likely is it that I can get it to work on another distro without any real trouble?

    You might have. Some software is distributed as a portable binary and can run on any distro. However, many installers are distro-specific (or distro family-specific, since they’re made for a specific package manager). For example, a software packaged for Ubuntu as a .deb file would install fine on Ubuntu or Mint, and probably install fine on Debian, but if you want to install it on Fedora or Arch you’ll have to manually re-package it.

    Most distro-specific software usually ships debian or ubuntu package - so you might go with that for that reason. Or Arch/Endeavor: while you’ll rarely see an official Arch package, most often someone will have already re-packaged it and put it on the AUR.

    That said, for the major distros, the desktop environment makes much more difference than the distro.