Does Force telekenesis/choke make an in-universe sound or is it only an auditory cue for the audience?

Partial answer: unclear, but it behaves like a sound in the room

I haven't found any sources that describe this sound in-universe, but when the sound does appear in canon sources, it's only audible when the camera is near the target of the Force power. It plays in this scene where Vader is choking Captain Needa while in the same room (0:28):

...but it doesn't play in this scene where Vader is remotely choking Admiral Ozzel, who we see on a viewscreen (0:52):

It does, however, play in these scenes where a hologram of a Force-user is choking or throwing around someone who's in the same room as the camera:

This implies that the sound is either diegetic and only occurs at the site of choking, or is non-diegetic but is only used for scenes where the target of the Force power is present.