Need help in file search engine crawler, PHP Web Programming

Assignment Help:

Need help in File search engine crawler

Want a web crawler to gather data on an continuous basis from different file hosting services and filter it.

1) Data will be used to provide a files search engine to users. I don't want a clone of any similar kind website but infect something better than that one.

2) Process of data get-together will be a continuous process and will be running on the servers 24x7.

3) Data must be properly filtered to erase duplicate entries and new entries of the same data should merge.

I want the crawler itself part of the websites

It has to crawl multiple websites through given xml feed. Crawler must detect all links to files on rapidshare.com, 4shared, uploading as well as all other file sharing hosts. After detection it must add those links found to some kind of database (prefer MySQL) with addition information found about file Like Meta description, size, title, date if available.

Desired Skills are PHP5, cURL, MySQL Programming


Related Discussions:- Need help in file search engine crawler

We are in need of front end web developer and designer, We are in need of F...

We are in need of Front End Web Developer and Designer In search of someone who can convert my PSD files to HTML, HTML5, PHP. Who understands as well as works on websites, la

Pre tag, This tag is utilized to present the text precisely as written in t...

This tag is utilized to present the text precisely as written in the code, by including whitespace characters. This is terminated by a tag.  Take the example illustrat

I want a receipe app in php, I want a Receipe App in PHP We are seeking ...

I want a Receipe App in PHP We are seeking a highly talented PHP Coder for the development of a Recipe App for Cocktail. Need Strong Facebook Integration like General Signup

We are looking for local programmer for programming, We are looking for Loc...

We are looking for Local programmer for programming work in a start-up In search of a highly skilled programmer in html, css, sql etc to work apart of a Perth startup. If you ar

A bot for uploading purpose, A bot for uploading purpose Project Descrip...

A bot for uploading purpose Project Description: i'm seeking a good coder to code me a bot for uploading purpose must work on windows Skills required are C Programming, PH

I need inventory and stock, I need Inventory and Stock Project Descripti...

I need Inventory and Stock Project Description: I need a module of Stock & Inventory which will be integrated with our existing Accounts Module; Our existing module is prepar

Personal portfolio site, This site must include at least 5 pages - your Hom...

This site must include at least 5 pages - your Home page, an About Me page, a Projects page, a Services page, and a Contact Me page. 1.  Your Home page should include the followi

We need a website expert for website template, We need a Website expert ...

We need a Website expert We have a website template We want to have an English version and add our own content in English and ftp to a server Desired Skills are MySQL Admi

Java web base, whats the cost of doing a java web base project

whats the cost of doing a java web base project

Seeking for a javascript engineer, Looking for a JavaScript Engineer I a...

Looking for a JavaScript Engineer I am seeking for a JavaScript Engineer good at MeteorJS framework. I would like to have a prototype erected as below Users can register with

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd