PHP-Crawler
From Infogalactic: the planetary knowledge core
| Developer(s) | Vlad Fedorkov [1] |
|---|---|
| Initial release | 9 January 2006 |
| Stable release | 0.8 / 25 July 2007 |
| Written in | PHP |
| Operating system | Cross-platform |
| Available in | English |
| License | BSD License |
| Website | http://astellar.com/php-crawler/ |
.svg){kind=logo}
PHP-Crawler is an open source crawling script based on PHP and MySQL. Created to implement simple as possible local website search it became popular for small websites on shared hosting. Script set is distributed under the terms of BSD License.
Features
- Full text search support via MySQL FT indexes
- As a general PHP script it allows running crawler manually from browser, requires no SSH access to the hosting.
- Crawling is limited by depth setting or amount
- Following "href=" links on web page, in HTML or JavaScripts
Requirements
External links
References
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
