Skip to content

Commit

Permalink
Update dnstwist source
Browse files Browse the repository at this point in the history
  • Loading branch information
jarelllama authored Nov 9, 2024
1 parent 96912e4 commit a47dee8
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions scripts/retrieve_domains.sh
Original file line number Diff line number Diff line change
Expand Up @@ -506,11 +506,11 @@ source_dnstwist() {
# Install dnstwist
command -v dnstwist > /dev/null || pip install -q dnstwist

# Get the top 15 TLDs from the NRD feed
# Get the top 30 TLDs from the NRD feed
# Only 10,000 entries are sampled to save time while providing the same
# ranking as 100,000 entries and above.
tlds="$(shuf -n 10000 nrd.tmp | mawk -F '.' '{print $NF}' | sort | uniq -c \
| sort -nr | head -n 15 | mawk '{print $2}')"
| sort -nr | head -n 30 | mawk '{print $2}')"

# Remove duplicate targets from targets file
mawk -F ',' '!seen[$1]++' "$PHISHING_TARGETS" > temp
Expand Down

0 comments on commit a47dee8

Please sign in to comment.