On Fri, May 31, 2019 at 09:42:52AM -0600, Shuah Khan wrote:

> Let me go over my vision for this time slot at the Maintainers Summit
> if we choose to add it. This isn't going to be a long deep dive session
> on the research. I asked Isabella to work with the following outline:

> - A short summary of Sentimine
> - A short survey of 2 or 3 emails. We do the survey - I can have her
>   share the survey format ahead of time. Based on my recollection of
>   the survey from OSLS presentation, it asks participants to identify
>   the tone of the email. Positive/negative/neutral.
> - Isabella compares these results to the tool's analysis. The goal
>   is to see how far off the tool's analysis from real developers
>   take on these emails.

Does that need to be done at the summit or could it be done offline with
the summit attendees (or with a list of people pulled from the active
developers stats or something for that matter)?  But then...

> In addition, I think the tool should also look at clarity of
> communication not just tone. To me this is the most useful part for
> us. My motivation and goal is to explore if we can take this opportunity
> to influence the direction of this research to look at what would be
> useful to us as a community.

...it does sound like a useful way of kicking off a discussion.  Perhaps
the survey could be done in advance and then the discussion jump
straight on to any differences in evaluation?  I do agree that clarity
is worth looking at, especially with regard to non-native English
speakers.