I suspected as much. The PSU was literally the only thing that came with the case (which is also a Blueberry). I just had no idea what could be the problem when it looks like it works fine (as in no noise, the fan is spinning normally etc). I guess I'll replace the PSU then, I hope that resolves the problem. But yeah, I should replace it either way.