Need help in file search engine crawler, PHP Web Programming

Assignment Help:

Need help in File search engine crawler

Want a web crawler to gather data on an continuous basis from different file hosting services and filter it.

1) Data will be used to provide a files search engine to users. I don't want a clone of any similar kind website but infect something better than that one.

2) Process of data get-together will be a continuous process and will be running on the servers 24x7.

3) Data must be properly filtered to erase duplicate entries and new entries of the same data should merge.

I want the crawler itself part of the websites

It has to crawl multiple websites through given xml feed. Crawler must detect all links to files on rapidshare.com, 4shared, uploading as well as all other file sharing hosts. After detection it must add those links found to some kind of database (prefer MySQL) with addition information found about file Like Meta description, size, title, date if available.

Desired Skills are PHP5, cURL, MySQL Programming


Related Discussions:- Need help in file search engine crawler

Convert a non-responsive wordpress theme to responsive theme, Convert a non...

Convert a non-responsive wordpress theme to responsive Twitter Bootstrap3 My website is a none responsive wordpress theme. I want to translate this theme into responsive theme u

Review business needs and completed designs, SEO skills are of paramount im...

SEO skills are of paramount important and expertise in HTML, CSS, Wordpress are critical. Our designs will be provided, we simply require a team to help code the site and employ th

Requirement for develop a web application, Project Goals To develop a r...

Project Goals To develop a reasonably large and enterprise-level Web application using PHP/ASP.NET/JSP, MySQL, and other Web site technologies that demonstrates the objectives

Require a expert ruby on rails developer for ios and android, Require a exp...

Require a experts in Ruby on Rails developer for iOS and Android API I have a mobile app on iOS as well as Android which runs on a Ruby on Rails API. I would like to make some e

Want a programmer to help update our website, Need a programmer to help upd...

Need a programmer to help update our website. Long-term work available I have an independent that worked on my website as well as has done a great job up until now. He has lost

Work in layout view, Dreamweaver contain two visual design views-Standard v...

Dreamweaver contain two visual design views-Standard view & Layout view. You'll begin by working in Layout view, which let you to draw layout cells or layout tables in which you ca

We need a analyst python programmer, We need a Analyst Programmer Our Es...

We need a Analyst Programmer Our Esteemed as well as Reputable Client is looking for an Analyst Programmer (Python) for their organization. The candidate is mandatory to perform

Networking models, There are two kinds of networking models obtainable: OSI...

There are two kinds of networking models obtainable: OSI reference Model & the TCP/IP Network Model for the design of computer network system. we shall look at these models in this

Need for building ecommerce website from scratch, Need for Building eCommer...

Need for Building eCommerce Website from Scratch We are seeking at starting a brand new online company and need an amazing website to match. Therefore far we have worked with

We need help in mobile punch card builder, We need help in Mobile Punch Car...

We need help in Mobile Punch Card Builder I have a mobile site builder platform which I would like users to as well be able to create mobile punch cards (punches) & Rewards poin

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd