57

When I type "Google", "Microsoft", "Norton", "Canon", "Lexmark", or any of several other company names into the Company Name field in the Career section of my Stack Overflow profile, most of the suggestions are advertisements for known scammers.

This seems bad.

  • 1
    Looks like SE has been hacked, in a way. That is clear spam, coming from SE server side. – Shadow The Dragon Wizard Jun 4 '16 at 5:37
  • @ShadowWizard I was wondering if it might be old spam companies on Careers which were soft-deleted, but this view doesn't filter them. – Jeremy Banks Jun 4 '16 at 7:30
  • No, the search is not limited to companies who got pages in Jobs. More likely that some external search SE use has been compromised. – Shadow The Dragon Wizard Jun 4 '16 at 7:43
  • @ShadowWizard Good point. I noticed a few entries for companies that shut down more than a few years ago, which might suggest that the data source has been polluted for a while. – Jeremy Banks Jun 4 '16 at 7:46
  • 6
    I am tagging this [status-reproduced] instead of [status-completed], since there is far more to do here. – Nick Craver Jun 4 '16 at 19:52
38

This is bad data coming from CrunchBase - I am working to address it now.


Update: I have done a huge amount of cleanup from the data source and just deployed a new Elastic indexing using it. Here's the old vs. new:

old

new

There's a x2 factor of replication, which means there were 59,494 entries removed from the index. Here's a current test:

test

Note there's still a crap entry there, so I did a good purge but far from perfect. We wanted to address this as soon as possible though, so a quick first pass it is. Hopefully this removed most of the immediate spam. Please feel free to comment here on additional finds and I'll take another pass Monday at cleaning this up further.

On a personal note: I pushed for this. I pushed to buy a clean data source to prevent duplication and have a good user experience with developer stories. This is not what we intended to do and I'm pissed. We also should have checked this further before indexing for developer story and that's on me - I failed here.

I'm sorry this ever showed up on our website. We'll be adding checks to, I sincerely hope, prevent this from ever happening again.

  • 5
    Nothing but pain so far from this dataset... :-/ that's totally not your fault. – Sklivvz Jun 4 '16 at 19:59
  • 3
    So CrunchBase was hacked? Or is it spammy by design and nobody except you care? – Shadow The Dragon Wizard Jun 4 '16 at 20:21
  • 1
    This appears to be related: Jobs company page spam. :( – hichris123 Jun 19 '16 at 19:05

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .