Problematic relationship with manager

There is a clear lack of trust and dislike towards me coming from my manager. I haven't received any negative feedback directly, but this is a clear sense that I'm getting. I work in a relatively small quant trading firm, and I don't think regular advice like managing up and being vulnerable in 1:1s applies here. There are also no promotions here and you just increase your bonus comp over time based on your impact.

I've tried confronting the manager and they didn't acknowledge a problem, mostly saying that I'm doing great. And me constantly asking what's wrong only makes me less trustworthy and makes them want to further avoid me. And I don't think I can hold them accountable to anything, there is a great relationship between my manager and the founder, and it's not clear what manager is incentivised to do with regards to the team. They can just avoid me and I can't do much about it.

I think in the big picture my performance is great, but there are some smaller things that I might be doing that make me not very likeable and/or trustworthy to management. Here are some of these things that could be the reason:

1. Being anxious - comes from my nature and makes me look less trustworthy.
2. Further from my anxiety can come increased emotionality, talking a bit loudly, being a bit negative.
3. Talking a bit too much, being self-absorbed, not being a good listener,etc.

From here, besides obviously doing less of the above, I see two options: try to improve relationship with manager that doesn't like me, or try to avoid them, which to your possible surprise, might be a solid option, because the organisation is flat and small, and I can try building relationships with other leaders and stakeholders, and provide value that is seen by founder and others.

What do you think? Should I try to improve the relationship? If so, how? This is my first job out of college so I'm a bit clueless. Any advice or insights from your stories would be very much appreciated!