I've now been playing saxophone for 52 years. For most of that I've played music that I don't really like. I still do. Tableaux de Provence anyone? (To be fair, it has some nice bits). I still like playing though but I like improvising best. Preferably without those nasty chord changes that one is supposed to adhere to. I've always found it inhibiting and you spend more time worrying about what is "correct" than constructing a decent melodic line. And yes, I know, practice makes it easier. But how much time do you want to put in practising stuff you don't really want to do? Of course, having taught sax for 30 odd years I've had to put some time in doing this stuff for the benefit of the less than 5% of students that actually want to play jazz.
Fortunately, improvisation doesn't just mean jazz. You can improvise in any style you want: folk, classical, baroque, serial, rap, dance, pop, rock, world, free, whatever. They don't all rely on a rigid chord structure that you have navigate your way round.
What you have to play depends on the group of musicians around you and point of the band's existence. You can only be totally free when you're on your own but you can always try to make the best of your situation.
I'm only rambling like this cos "Strictly" is on the tele.
I've given up the mainstream stuff these days and currently play in an improvising orchestra (Free Range Orchestra), a small group offshoot from that, a free improv duo with a drummer (Nutters Corner), a blues band that gigs very infrequently and a ritual humiliation of attempting the classical repertoire with a very good accompanist. It's a long way away from when I started.
Strictly's still going. Pet Shop Boys?! Good grief!