Support subdomain matching

[dsojevic]

• Fixes issue with domain matching in result links
  • Previously include? would be used to check but it would falsely match if the domain was anywhere in the URL, e.g. for the domain example.com, it would also match this URL: https://site.info/example.com or this URL: https://www.weareexample.com/
• Adds match_subdomain attribute to sites
• When toggled on, links from subdomains will also be considered a match for the site, when toggled off, only the exact domain (with www. prefixes also considered as matching) will be considered a match

[strzibny]

Thanks a lot David. This is good.

I think you missed the main place where we need to pass the match_subdomains which is here:

serptrail/app/jobs/keyword_check_job.rb

Line 34 in f309c1b

result = client.extract_position(results, target.site.domain)

I also left some small comments that would also be nice to address.

[dsojevic]

I think you missed the main place where we need to pass the match_subdomains which is here:
...
I also left some small comments that would also be nice to address.

Thanks @strzibny, I'd adjusted that line previously but I guess I missed committing it and clearly blew it away with another command 😅 -- added it back in now.

Have also addressed the other comments.

[strzibny]

Thanks David.