What is it?
The Website Crawler was a project we started in order to master regular expressions. We kept developing and eventually made an emailcrawler.
It's being designed with "the three level crawler" in mind. The three level crawler is a concept we invented to make sure the user can choose how deep he wants to crawl.
The basic emailcrawler is already finished, but we're waiting for some more optimalisations to release it.
Three Level Crawler?
The Three Level Crawler is a concept designed by Qkyrie. It is basically a way to choose how deep you want to crawl the internet for specific data. A level one crawler would only search on the given websites. Given for example that you have a big list of files. You can all add them to the program and the program will check those specific websites for information.
The level two crawler would search on the given webpage, as well as on all the webpages that are found as links on the first webpage. This will provide you with a deeper search, and will guarantee you some more emails. All of this happens concurrently, which means the speeds are nice, and everything can be followed live.
The level three crawler is a constant crawler. It keeps searching on the found webpages of a level 2 crawler, and keeps doing this until a certain amount is found, or until the user chooses to stop the process.
Free vs Paying?
Yes, fortunately for some of you poor students, there's also a free version!
Of course, to maintain our servers and programming a bit, we added some nice addons you really would love in the paying version.
There's a way to add an entire file containing webpages that can be crawled. Another add-on we have is an tool to maintain your emaillists. Dedoublers, categories, you think of it, we add it.
We also will add a way to search on the most famous searchengines (google/bing) for websites with your criteria.
Emails coming from those websites will be added.
Of course, to maintain our servers and programming a bit, we added some nice addons you really would love in the paying version.
There's a way to add an entire file containing webpages that can be crawled. Another add-on we have is an tool to maintain your emaillists. Dedoublers, categories, you think of it, we add it.
We also will add a way to search on the most famous searchengines (google/bing) for websites with your criteria.
Emails coming from those websites will be added.
Geen opmerkingen:
Een reactie posten