Hi the phone socket is the leftmost on the top row. The interference sound is annoying but you can still hear who you're talking to.
Is the noise still there if you connect things up as shown below? Any extension wiring should be connected to that bottom removable section. If not, then your internal phone wiring is incorrect.
Then there must be something wrong with the phone, especailly as the corded phone works fine.