There are several different questions here that run the gamut of security related questions, not just privacy.

If you want a lay persons answer, the gist of it is both are secure enough for the vast majority of situations. If you don't have nation states after you, use what is most convenient for your primary use case.

If you are worried about nation states... You need to do your own technical analysis, and if you are incapable of doing so... You should not be trusting random idiots on the web.

That said... The biggest difference is that signal is more secure by default, forcing end to end encryption on all communications but you have to trust a closed source private organization. Arguable the signal protocol is probably provably more secure with perfect forward secrecy (the double ratchet algorithm is legit).

Matrix has a significantly larger public surface area for non nation state level actors to observe and Messaging is arguably slower... But you have much more freedom with how much trust you give entities. Unfortunately, more of the security is up to you and your contacts which makes it less secure. (We on average are terrible at security). Matrix is probably also more resilient as a network.

Finally, Signal does not provide any anonymity whatsoever. I'm fact, it directly ties your messaging to other highly personal information. (But nobody other than you and the other participants can read any of the messages). Provide you know your contacts in real life, you can prove message authorship (you know for a fact that the message was written on their device and nobody other than the intended recipients read it).

Matrix does provide anonymous access. If this is something you need... This is the answer.