View previous topic :: View next topic |
Author |
Message |
Garavito Master Cheater
Reputation: 0
Joined: 21 Jun 2009 Posts: 387
|
Posted: Sat Aug 14, 2010 4:50 am Post subject: How can I archive a site? |
|
|
How can I archive a site? I want to use a script to archive an imageboard to my 500gb external hard drive. The computer will be on 24/7.
_________________
|
|
Back to top |
|
 |
AhMunRa Grandmaster Cheater Supreme
Reputation: 27
Joined: 06 Aug 2010 Posts: 1117
|
Posted: Sat Aug 14, 2010 11:44 am Post subject: |
|
|
Apache(.)org
Will get you a web server. You will still need a DNS host, something like DYNDNS. NOTE your ISP will most likely BLOCK PORT 80, in the apache.conf change PORT to 8080
Make sure it's open on your firewall/router what have you if you need outside access.
mysql(.)com
This will give you a database.
Don't forget to secure the root password and to not use it. Only create users with access to their own DB, will save alot of headaches if you run some half assed code that's vulnerable to sql injection.
php(dot)net
This will give you some type of server side interpreter for running server sided scripts. ( Code can and is vulnerable to injection techniques) USE AT OWN RISK.
All these programs will run under Linux or Windows (Most Versions).
There are plenty of howto's, from configuring one to getting them all working together.
I will not help you setup or config, but feel free to ask a question if you get stuck on something.
All of these will be configured to machine specific, I suggest you read up a bit about website security so you know what you are getting into.
_________________
<Wiccaan> Bah that was supposed to say 'not saying its dead' lol. Fixing >.> |
|
Back to top |
|
 |
Garavito Master Cheater
Reputation: 0
Joined: 21 Jun 2009 Posts: 387
|
Posted: Sat Aug 14, 2010 12:21 pm Post subject: |
|
|
Well I didn't want to use a public domain to do this, I wanted to run a local script without port forwarding something that went threw and saved all of the pictures/comments but unlike an Html version of the site I want to have the actual picture not just a thumb nail. I guess I could create a micro that opens a thread clicks the picture saves it and then it saves the html of the page and refreshes if anyone has another way I'd like to know.
_________________
|
|
Back to top |
|
 |
BOU Expert Cheater
Reputation: 0
Joined: 15 Apr 2009 Posts: 239 Location: Youtube watching Japanese Rock, and Korean Pop - Music Videos =)
|
|
Back to top |
|
 |
Garavito Master Cheater
Reputation: 0
Joined: 21 Jun 2009 Posts: 387
|
Posted: Sat Aug 14, 2010 12:48 pm Post subject: |
|
|
I guess that would be the general idea but let me get into it. I want to safe every page an imageboard ie: http://7chan.org/b/ You notice how there are multiply pages and pictures that are constantly being upload and changed? Well I want to save every page and picture of the site so I can A. Create an archive or B. Import them into my website.
_________________
|
|
Back to top |
|
 |
AhMunRa Grandmaster Cheater Supreme
Reputation: 27
Joined: 06 Aug 2010 Posts: 1117
|
Posted: Sat Aug 14, 2010 12:59 pm Post subject: |
|
|
You can either do it manually or you can do it with a CMS.
_________________
<Wiccaan> Bah that was supposed to say 'not saying its dead' lol. Fixing >.> |
|
Back to top |
|
 |
Garavito Master Cheater
Reputation: 0
Joined: 21 Jun 2009 Posts: 387
|
Posted: Sat Aug 14, 2010 1:05 pm Post subject: |
|
|
AhMunRa wrote: | You can either do it manually or you can do it with a CMS. |
Can someone just give a script?
_________________
|
|
Back to top |
|
 |
GG Grandmaster Cheater Supreme
Reputation: 4
Joined: 20 Jan 2008 Posts: 1589 Location: Australia
|
Posted: Sun Aug 15, 2010 1:01 am Post subject: |
|
|
That will use holy fuckloads of bandwidth.
Those imageboards can upload alot more, alot quicker than your consumer internet can download. You will get stuck.
|
|
Back to top |
|
 |
AhMunRa Grandmaster Cheater Supreme
Reputation: 27
Joined: 06 Aug 2010 Posts: 1117
|
Posted: Sun Aug 15, 2010 7:46 am Post subject: |
|
|
I'd run the webserver, you can blob the image into the database, you won't be able to browse it directly but with your webserver you could rebuild the image on view.
Would depend on how large the database stored your blobbed image, vs storing the image itself.
But it's a hell of a lot easier than writing something to index them and paginate em.
_________________
<Wiccaan> Bah that was supposed to say 'not saying its dead' lol. Fixing >.> |
|
Back to top |
|
 |
BOU Expert Cheater
Reputation: 0
Joined: 15 Apr 2009 Posts: 239 Location: Youtube watching Japanese Rock, and Korean Pop - Music Videos =)
|
|
Back to top |
|
 |
|