I have to give a political yes and no, respectfully, to cbp and others on this issue.
Yes, you cannot control who links to you, per se, hence, I don't believe you'll be penalized for that link. However, you could find your brand, image or message damaged, IMO, by prospects seeing a link in engines from site that's not in keeping with your own standards, ethics, etc. In that, you could send a tactfully stern request to them for removal.
Google Webmaster Facts state you cannot be harmed by a competitor and I'd guess they're cognizant and compassionate that you're not in control of others' actions. Only YOU can affect your ranking according to them.
However, Google also states that they are not happy with FFAs and similar linking schemes ... not all lists require confirmation or authorization, so it seems
possible that an undesireable link could influence according to their own standards ... gotta love that Google gobbledygook ...