I received the invitation to participate in the Comment Evaluator today. In the body of the email, there was a mention of:
How much time are you asking me to commit?
We're asking for participants to invest 1 hour, split into however many sessions you want. Don’t plan to work longer than 20 minutes on this task at one sitting. If you want to do more than one hour total you are encouraged to do so! If you do less than one hour, we may not be able to use your data.
I went on my way, thinking that perhaps there would be a point at which the system would stop me, let me take a breather, let me know that I could save progress, etc. Alas, by the time I realized the depth to which I had been absorbed in the process, I was well over the recommended time for one session.
I understand that in life, there aren't always directions, and I don't mind self-pacing myself, but at a minimum it would have been nice to have something that indicated my progress was being saved, or a means to explicitly do so, in case of a browser crash, etc.
I realize it's kind of a "bare bones"-type application (on the surface), and I'm certainly not suggesting it should be all snazzy or overengineered, but having some indicators on the screen would have certainly made it a more intuitive experience for me.
(It probably goes without saying, but I'll mention it anyway: I also realize that this potential change would not benefit me, but would hopefully be helpful to future cohorts of the Evaluator)