deduplication

I have combined more than 50 databases into one text file, duplicate lines have been deleted. Note: this database also contains the crypto data set that I recently uploaded. This is good for any target, the countries are mixed and predominantly from the United States of America Lines : 98000000...