Abhishek Chatterjee Online

Most internet buffs like me are always in search of a free hosting solution where we can point our domain and host some stuff like a personal website.One of the coolest webspace offerings is by 000webhost.com which offers 1500MB of space and 100GB of monthly data transfer!! It's mind boggling... but hey there is a catch! its a scam.

While registering on the site, it makes you download a IP Address verification tool, which is A TROJAN! Please don't download it or else it may render your machine exploitable over the internet.

Also don't fall for its referal program. They never pay you. Do some research and you will get to know that.

Understanding the Search Engine concept

Think of an unorganized library, with all the books lying here and there. I tell you to find me a book that contains any description of Neural Networks. To make matter worse, all the books have their indexes ripped apart. All that helps you is the title of the book and the contents.

Now just imagine what searching for a topic would be like. Your first step will be to search by the title of the books. But its not surprising that many books have weird titles which may not convey what the book might be containing within.

So in this case having a index in each book would have helped a load. But still, since the library is unorganized and books are lying in a pile, you would have to search the books by picking them up one by one. In the worst case, the book you are finding might be at the last of the heap. In this case the algorithm time complexity is n, where n is the no. of books in the library.

Now what you do is sort the books in sections depending upon their core theme. A book on artificial neural networks shall actually be stashed in Computer Science section and not Neurology/Biology section.

Now further more, to make things even more fast, you introduce something called a frequently issued section, that contain only the books frequently issued. It happens that most of the books requested for issue come from the frequent section. Simply, now you end up making your algorithm faster.

Now remember that you categorized books in sections? Let's do one more thing. The books that appear the most in bibliography of other books reserve a seat for themselves in the top shelf, indicating that they are the most popular and reliable books. This, my dear friend is your introduction to page rank algorithm used by Google.

Why I gave this example is because the very first model described in para 1 can be made in 2 hours. The time required and programming skills needed subsequently increase.

Now lets talk about programming and requirements.
Hardware (you may also do with a single PC with a 160GB HDD):
> Loads of storage space (RAID)
> A well connected database
> Multiple Servers for load sharing

Programming:
> Web crawler (that fetches the web pages and puts them in the Data warehouse)
> Data organizer (that arranges the data so that it can be mined efficiently)
> Search Algorithm

You can read some good white papers regarding search engine technology and settle upon a time frame in which you can make a search engine.


11/27/2006 15:35

Recently I was intrigued by the discussion on Google web applications, and had looked into such existing products or services. I came across two most interesting cases.

1) www.Goowy.com (based on Macromedia Flex)
2) www.eyeOS.info (based on Ajax)

It is better that you guys get a first hand experience of both the webtops so that you can realize their pros and cons.
A webtop is a great concept, where you can have some handy tools on the internet and use them from anywhere in the world. You can set your own personalized wallpaper, themes as they suite you.
medium_eyeOS-1.JPG
With Goowy you also get a 1GB storage where you can store any type of file upto 10MB in size. I have already uploaded most of my important data and documents over there (Gmail is clumsy for file storage). Goowy also offers some cool handy widgets called minis. You can place your favourite RSS feeds onto the webtop, along with reminders etc. The most attractive feature of Goowy is its Flex environment which gives it a very smooth behaviour and neat outlook. So far so good. But Goowy seems to have a drawback of future upgradability. I don't anticipate that Goowy will upgrade the set of applications that come with it anytime soon, due to its rigid Flex based design.

Also as we had been discussing about online desktop with general applications webalized, that thing doesn't seem to happen with Goowy.

This is where eyeOS.info comes in. It is a brilliantly programmed Ajax webtop and offers powerful features. Try its application, eyeEdit, and I am sure that you will find it more powerful (in editing) than Writely (check table drawing feature).

Apart from the general theming features, check the list of eyeApps, and its amazing to find things as cool as an ftp client inbuilt. The way eyeOS has developed its framework, I am sure soon they will expand eyeApps to a stage when we can install 3rd party apps designed for eyeOS. For example, imagine an eyeOS port of Gmail (which is nothing but making Gmail run into the eyeOS windowing system) and similarly ports of Google Calender, Writely etc.

Things sound great. But however, I had a problem with both of them. They both ran inside a browser window. Bringing my browser to fullscreen mode relaxed me a bit as I was able to assume I am not on Windows but on some absolutely new OS.

But then again felt the urge to have it run in tandem with my other desktop applications. Basically I wanted no distinction between a local app and online app. I wanted both, the webtop and the desktop to merge into one powerful system. I accomplished that to some extent:

1) Right click your desktop and goto properties.
2) Click customize desktop
3) Click the Web tab
4) Click New and add both Goowy and eyeOS websites.
5) Make sure only one of them is checked, howsoever.
6) Now you will see a small IE window on your desktop (after you have completed the settings)
7) Hover to its top edge and the title bar should appear.
8) Click the small down arrow on the top left and select Cover Desktop

After having done this, you will realize that logically, the webtop is now your Desktop! You should be able to use the webtop apps and the local apps with equal ease.

Unfortunately, eyeOS has some trouble with integrating into your desktop (as you will notice once you do it).

Goowy however is perfect with its integration. Rather it feels fabulous to have Goowy on your desktop, and set a Goowy wallpaper of your choice, and set up the minis with the latest news!

But one problem remains unsolved even after all this, i.e. absolute integration of the two systems. To elaborate this, the problem is, that the webtop application windows have no integration with those of local applications. However acheiving that is definitely possible, the way GTalk inbuilt in Gmail achieves it. By default it runs in the same window but however it can popped out and converted into a standard window.

So what are your views on this? And what are the other improvements you think can be implemented?


09/20/2006 12:50