Analytics to get various statistics on Web IDE usage

[anton-trunov]

• Number of monthly active users
• Geography
• Which IDE features are most frequently used
• ???

[rahulyadav-57]

We are currently using MixPanel for analytics.

Tracked events:

1. Project Creation
2. Project Opening
3. Project Deployment
4. Test Case Execution

Would you like to add anything else?

[verytactical]

Current MixPanel setup is somewhat problematic

• There is no SQL support
• This is closed-source proprietary technology
• Queries of its ES3-based language identify users with some user id that isn't even unique for a user.
• Data are mixed from several dozen domains: nujan, web ide, beta versions, local dev servers, local html files and google translated versions of web ide. Nothing in MixPanel interface aids the user to filter and aggregate this kind of data.

While we can use MixPanel for our immediate needs, we should also have a plan to move on with a different tool.

[verytactical]

I'll report later with my proposal for analytics, it takes some planning.

[verytactical]

So basically we need exactly what Anton described:

• Calculate MAU in a way we can be completely sure the number is correct. Maybe MixPanel is fine for this purpose (we don't need anything else anyway), but we should ensure it's calculated only for production version of IDE, and doesn't count bots (at least search bots such as googlebot).
• Add two events show and click that can be used to track usage of IDE features, both to know if users actually use them, and to see graphs going down if they ever get broken. I think it's best to log these into wherever our Grafana gets data from.