Get the top missing domains script running

[Sancus]

https://svn.mozilla.org/mozillamessaging.com/sites/ispdb.mozillamessaging.com/trunk/tools/quickparse.py

This script used to run and pick up top missing domains based on apache logs, we should set this up on the new infrastructure.

[benbucksch]

yay! This would be incredibly helpful for ISBDB

[Sancus]

Status update: This is running right now but I'm pretty sure it takes forreevver to run on even a couple days worth of logs because of the mx lookups.

Is there anything wrong with us displaying these stats publicly? I'd rather stick 'em up on a webpage and put it in the autoconfig readme/wiki articles than set up emails to specific people. Then anyone who is interested can see what the top misses are.

[benbucksch]

Andrei Hajdukewycz wrote on 4/6/17 1:39 AM:

Status update: This is running right now

Thanks, Andrei!

Is there anything wrong with us displaying these stats publicly? I'd rather stick 'em up on a webpage and put it in the autoconfig readme/wiki articles than set up emails to specific people. Then anyone who is interested can see what the top misses are.

Yes, there've been a few bits that could identify individual users or companies. For example, I could see exactly when Oracle migrated to Thunderbird. oracle.com suddenly spiked. Then there's the error cases, which can be individuals etc.. I do think we should be liberal with giving these out, but not outright world public. Subscribe anybody who seriously contributes to the ISPDB. Ben