Crawlers are everywhere. They move on and on to many webpages each second. The most biggest of them are Google’s. It already crawled almost 90% of the web and is still crawling. If you’re like me and want to create a more advanced crawler with options and features, this post will help you. DownloadDemo When I created my Search Engine test project, it needed an awesome crawler. I knew that developing one on my own will be hard especially when you have to follow robots.... [READ MORE]
Posts marked with "PHP" in categories
Create a localhost Website in Ubuntu 11.04 & Up
In a post, I told how to create a localhost website using Apache server in Ubuntu. It worked on all versions up to Ubuntu’s 10.10th version. But on Ubuntu versions 11.04 and the versions released after it, there were some changes to the Apache server. So, by this post I’m going to update the way to create a localhost hosted website in Ubuntu versions 11.04 and the versions that came after 11.... [READ MORE]
Identify Remote OS By IP Address In PHP
In the recent post, I gave the default TTL value of different devices. As you can see, when you ping a host you can roughly identify the operating system the remote server’s running. I saw a question on Stack Overflow about this. Sadly it was down voted and was removed later. I tested if it is possible and I found that it is possible. In this post, I will give a function that automatically pings the remote host and find out the possible Operating Systems the remote server is running.... [READ MORE]
Add Spell Check With PHP Using Google
If you google something that has spelling mistakes, Google will automatically correct it for you or if the bot isn’t sure, it will give the Did You Mean ? clause. If you’re developing a search engine for your site, this spell check will come in handy. If the user had made a mistake and he was shown a “No Results Found” page, user will be annoyed. So, it’s better to have a spell check for your site.... [READ MORE]
Create a Search Engine In PHP, MySQL | Part 3
This is the Part 3 of “How To Create A Search Engine In PHP”. In this part, We make additional adjustments and make the search engine more awesome and cool. DownloadDemo Bot Page Our crawler leaves a mark on every pages it visit. In other words a custom User Agent String goes with each requests to web pages. In the previous part, we set the user agent string as :... [READ MORE]
Create a Search Engine In PHP, MySQL | Part 2
This is the Part 2 of “How To Create A Search Engine In PHP”. In this part, We’ll add code to files that are being displayed to the users. We make the database and the table in this part. DownloadDemo index.php The main page of our Web Search is index.php. It has a simple design and is not very advanced as Yahoo or something else. <?include("inc/functions.php");?> <html> <head> <?head("", array("index"));?> </head> <body> <?... [READ MORE]
Create A Search Engine In PHP, MySQL | Part 1
When we all search on the web using Google, Yahoo or Bing, we are curious about how it works and how it gets all the information on the web. When us programmers started coding, we all wanted to create a search engine. I too attempted to create a search engine and I ultimately failed (3 years back). But now, I improved my coding skills, improved my knowledge and ideas. So, I decided to create a new search engine with automatic crawling, indexing and stuff.... [READ MORE]
Group Chat In PHP With Users’ Typing Status
I wrote a post on creating Group Chat in PHP. A comment was posted by Ravi asking if it was possible to include user’s typing status. It was a fascinating and a good idea to add user’s typing status. So, I worked on the code and knew it was possible. I’m going to tell you how to implement the display of users’ typing status on the Group Chat I created earlier.... [READ MORE]
Download Zip Files Dynamically in PHP
Zip file downloading is used by websites. The most important and popular of them is WordPress. They use Zip files for downloading plugins, themes and even their versions. They do it ofcourse, dynamically. You just provide the location of the file and PHP will download it to the user for you. Actually HTTP headers have the main role in the downloading. Demo We make the headers using header function in PHP and the browser will take care of the rest.... [READ MORE]
Log In With Username / E-Mail in PHP Login System
If your login system have both username and email parameter, then you can allow your users to log in with username or email. This is very easy for users, because if they forget their username, then they can log in with their email address. I will tell you an easy to way to set up log in with both username and email. It’s very easy. Demo A change in your SQL query can make this possible.... [READ MORE]