From the sounds of his behaviour connected with teh clicking it sounds like he's annoyed and is warning you. But don't give up, some humans are grumpier than others and my Stephen Patrick, bless him, was a very annoyed fella all his life.
If it feels you re going backwards don't be frustrated, he will come round again. I ve had Poppy for 7 months now and although she is getting better in general she sometimes has days as if we ve never met before. Just give him time and patience, he may feel your frustration with him and that won't help either. I am sure it will all turn out well with time