Need help in file search engine crawler, PHP Web Programming

Assignment Help:

Need help in File search engine crawler

Want a web crawler to gather data on an continuous basis from different file hosting services and filter it.

1) Data will be used to provide a files search engine to users. I don't want a clone of any similar kind website but infect something better than that one.

2) Process of data get-together will be a continuous process and will be running on the servers 24x7.

3) Data must be properly filtered to erase duplicate entries and new entries of the same data should merge.

I want the crawler itself part of the websites

It has to crawl multiple websites through given xml feed. Crawler must detect all links to files on rapidshare.com, 4shared, uploading as well as all other file sharing hosts. After detection it must add those links found to some kind of database (prefer MySQL) with addition information found about file Like Meta description, size, title, date if available.

Desired Skills are PHP5, cURL, MySQL Programming


Related Discussions:- Need help in file search engine crawler

Distinguish between complex type and simple type elements, Question: (a...

Question: (a) Explain the concept of "mixed content" in an XML document. What restrictions are placed on the definition of elements with mixed content by Document Type Defini

Need help to make user registration a two-step process, Need help to Make u...

Need help to Make user registration a two-step process I have an partial Wordpress website that needs to be completed. There are about 15-20 things that want to be done however

Can someone help us implement geoip2 on our website, GeoIP2 installation as...

GeoIP2 installation assistance Can someone help us implement Geoip2 on our website? We have GeoIPlite working as we speak. We now need to update it. Desired Skills are PHP

Open system interconnection, An open system is a model which allows any two...

An open system is a model which allows any two distinct systems to communicate regardless of their underlying architecture. The reason of the OSI model is to open communication amo

I want help in woocommerce theme customization, Woocommerce Theme Customiza...

Woocommerce Theme Customization Hello you will be working on transforming this woocommerce theme Kindly let me know if you are able. You will require to discern woocommerce d

Macro to search patent information help needed, Macro to search patent info...

Macro to search patent information Objective To develop a macro that is accomplished to search through publicly available USPTO.gov database as well as count number of times fir

Test links in dreamweaver, In Dreamweaver you cannot test your links; you s...

In Dreamweaver you cannot test your links; you should check your links in a browser to make sure the pages operate as you expect. 1. Press F12 to preview the page in a brow

We need help to migrate wordpress website from one domain, We need help to ...

We need help to migrate Wordpress Website from One Domain to 25 Subdomains Wordpress programmer will be assignment with developing a tailored template for ease of use, interacti

Need help in event web based program using php, EVENT Web Based Program usi...

EVENT Web Based Program using PHP We are seeking someone who is qualified in using the PHP to develop an Event Management program which arrange of payments via systems like PayP

I need help to make drupal website for rent apartments, I have a website I ...

I have a website I build it with Drupal for Rent apartments and I have five buildings in different places and every building have different capacity of apartments and different apa

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd