Skip to content
This repository has been archived by the owner on Jun 3, 2020. It is now read-only.

Looping subject queue #387

Open
VVH opened this issue Feb 20, 2019 · 3 comments
Open

Looping subject queue #387

VVH opened this issue Feb 20, 2019 · 3 comments

Comments

@VVH
Copy link
Contributor

VVH commented Feb 20, 2019

We've had long running reports from volunteers about repeating subjects, a particular problem for deeply engaged volunteers. Today I was looking at subject sets in PB to see how many total items have been in the project, and noticed this statement:

"The project has 6133 uploaded subjects. You have uploaded 63 subjects from an allowance of 10000. Your uploaded subject count is the tally of all subjects (including those deleted) that your account has uploaded through the project builder or Zooniverse API. Please contact us to request changes to your allowance."

I see that there are thousands of subjects in the project though. Does the PB distinguish between subjects that you as an individual have uploaded versus other people in your team? I.e. did Folger upload 6080 and I maybe did 63? I don't think that happened, but it's possible.

If not, has there been a problem with the upload that anyone can see. Would this be why subjects are looping? @camallen or @rogerhutchings?

@adammcmaster
Copy link
Contributor

I don't know about the repeating subjects, but the total for the project is the total that all users have uploaded, and I think the 63 is the total that you've uploaded to all projects rather than just this one. All in all those stats are probably more confusing than useful.

@camallen
Copy link
Contributor

We've had long running reports from volunteers about repeating subjects, a particular problem for deeply engaged volunteers.

I think this issue was helped by unlinking the old genres (subjects set) and now the interface only selects from newsletters.

Here are the talk links https://www.zooniverse.org/projects/zooniverse/shakespeares-world/talk/194/758116?comment=1314465

FWIW If a user has finished a 'set' (genre) and they don't select a new one they'll get the same repeating set of data to classify (i.e. show the user something to make the interface work). As it's a custom UI it doesn't handle this behaviour very well and could message that to the volunteer a lot better. Ideally this project should move to a Zooniverse.org project builder system vs a custom front end.

"The project has 6133 uploaded subjects. You have uploaded 63 subjects from an allowance of 10000. Your uploaded subject count is the tally of all subjects (including those deleted) that your account has uploaded through the project builder or Zooniverse API. Please contact us to request changes to your allowance."

How can we better structure the wording above to convey these facts?

  1. Upload limits are per user account not per project
  2. Projects like to know how many subjects are currently uploaded
  3. Users like to know how many more subjects they can upload before being blocked from doing so (hitting the limit).

I see that there are thousands of subjects in the project though. Does the PB distinguish between subjects that you as an individual have uploaded versus other people in your team? I.e. did Folger upload 6080 and I maybe did 63? I don't think that happened, but it's possible.

I think Roger / the team uploaded all the subjects that were in that project but i may be wrong.

If not, has there been a problem with the upload that anyone can see. Would this be why subjects are looping? @camallen or @rogerhutchings?

I think this has been fixed by removing the old genres (sets). We should assess if we need more data on the old sets (genres), perhaps a conversation for the research team / coleman / sam?

It seems some folks can't / wont select a genre as it's below the fold

I don't think I ever 'chose' a category to transcribe; I have always just had a go at whatever came up.

Default view on smaller viewports
screenshot 2019-02-21 at 07 52 20

Below the fold view some folks never see
screenshot 2019-02-21 at 07 52 29

@VVH
Copy link
Contributor Author

VVH commented Feb 22, 2019

Thanks for your detailed reply @camallen.

At the moment we only have newsletters. I guess it's possible some people have transcribed them all since April.

Re: additional genres and one day moving to the PB. For the moment colleagues at the Folger and I are not wanting to add additional material, and are considering taking a break after the newsletters are done. We might then one day move to the PB. If we did that, it would be great if we could preserve the old Talk space, but that's another conversation down the line.

V helpful to know about what that number means (total uploaded ever, not just on this project).

I think the existing language contains important information, but could be broken out in two separate places or at least two paragraphs (separated by a whole empty line)

This project has 6133 uploaded subjects.

Each researcher can upload a total of 10,000 subjects (including those deleted) through the project builder or Zooniverse API. You have upload a total of N/10,000 subjects across all of your Zooniverse projects. Please contact us to request changes to your allowance."

One of the things that would help us decide when to move to the PB is analytics on the cribsheet tool. Does anyone use it? We might just have to let it go either way as we don't have the resource to reconstruct something like it.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants