SO frowns on algorithm/analysis/design advice questions which are pre coding stage. Is there a low noise forum available to air these discussions ?
What is meta?
- Any Stack Exchange user can ask a question
- The community provides support, votes on ideas, and reports bugs
- Your voice helps shape the way Stack Exchange operates
Stack Overflow does frown on vaguely stated, airy or too open questions along the lines of "What's the easiest way to <do something genuinely hard>?" or "What data structure should I used to <some imprecise problem specification>?"
Step one is to not write that kind of question.
Give your audience some specifics. How big is the data set? Is this a one-off or production? What means are you considering to solve the problem?