Script to import content from a non-blog site, similar to the cache link on Google?

Question

I've been browsing a number of sites recently that have content I'd like to feature on my own site, but they don't have any sort of RSS or XML feeds on them because they aren't set up like blogs. I've noticed that the link on Google results to view the cached copy of a page (not necessarily the current content) features an actual snapshot of the site's layout, content and everything--it looks exactly like the original site although it may not be current. Is there a way to import pages from other sites similar to Google's cache feature? This would make it easier for me to feature updated content from various sites without having to import it manually or otherwise have to manually configure the content onto a page.

I won't use other sites' content without permission, Emma. And since I'd be importing content from various Christian sites to my own Christian site, most other webmasters of such sites are more than happy to distribute their content by whatever means possible. But I'm not putting anything out on the Internet by others without their permission. Check out http://jesus.net.nz for one of the articles by another author which I've published and attributed.

Answer 1

Well with PHP you can use the "Include pages"
is usually the way this goes, but the same code applies to an entire page, even off the internet



If you want to get fancy you can even setup the size parameters for the include using CSS or dare I say even "tables".

You can visit my site to see one of these.
http://ftwtexas.com/index.php?module=pagemaster&PAGE_user_op=view_page&PAGE_id=10

Like stated in the first answer, you do need to be VERY careful to stay within the copyrights of the original page, generally getting permission from the owner is all that is needed. A quick email to the author/owner will usually return a reply and either permission or denial. (KEEP THEM)

Scary simple isn't it.

Actually a few of the templates for several CMS systems have this built into them. PHPWEBSITE for instance has an 'Insert Page into block" function!

More complex but you can write code to read the page and write it out to an image on your own site but that I haven't found an easy automated system for as yet.

Answer 2

While there are ways to do it, you could very well be violating copyright laws. While in *most* cases it is assumed that content contained in an RSS feed is able to be syndicated. Taking content from another site without their permission and including it on your own violates most copyright laws. It sounds like it would far exceed the "fair use" doctrine as well.

Here are some resources that you might find helpful. -
The Copyright Debate and RSS - http://www.feedforall.com/rss-copyright-debate.htm

What is Fair Use -
http://www.feedforall.com/what-is-fair-use.htm

Copyrights and Trademarks - http://www.feedforall.com/copyrights-and-trademarks.htm