Cheat Engine Forum Index Cheat Engine
The Official Site of Cheat Engine
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 


How can I archive a site?

 
Post new topic   Reply to topic    Cheat Engine Forum Index -> Computer Talk
View previous topic :: View next topic  
Author Message
Garavito
Master Cheater
Reputation: 0

Joined: 21 Jun 2009
Posts: 387

PostPosted: Sat Aug 14, 2010 4:50 am    Post subject: How can I archive a site? Reply with quote

How can I archive a site? I want to use a script to archive an imageboard to my 500gb external hard drive. The computer will be on 24/7.
_________________
Back to top
View user's profile Send private message
AhMunRa
Grandmaster Cheater Supreme
Reputation: 27

Joined: 06 Aug 2010
Posts: 1117

PostPosted: Sat Aug 14, 2010 11:44 am    Post subject: Reply with quote

Apache(.)org

Will get you a web server. You will still need a DNS host, something like DYNDNS. NOTE your ISP will most likely BLOCK PORT 80, in the apache.conf change PORT to 8080

Make sure it's open on your firewall/router what have you if you need outside access.

mysql(.)com

This will give you a database.

Don't forget to secure the root password and to not use it. Only create users with access to their own DB, will save alot of headaches if you run some half assed code that's vulnerable to sql injection.


php(dot)net

This will give you some type of server side interpreter for running server sided scripts. ( Code can and is vulnerable to injection techniques) USE AT OWN RISK.

All these programs will run under Linux or Windows (Most Versions).

There are plenty of howto's, from configuring one to getting them all working together.

I will not help you setup or config, but feel free to ask a question if you get stuck on something.

All of these will be configured to machine specific, I suggest you read up a bit about website security so you know what you are getting into.

_________________
<Wiccaan> Bah that was supposed to say 'not saying its dead' lol. Fixing >.>
Back to top
View user's profile Send private message
Garavito
Master Cheater
Reputation: 0

Joined: 21 Jun 2009
Posts: 387

PostPosted: Sat Aug 14, 2010 12:21 pm    Post subject: Reply with quote

Well I didn't want to use a public domain to do this, I wanted to run a local script without port forwarding something that went threw and saved all of the pictures/comments but unlike an Html version of the site I want to have the actual picture not just a thumb nail. I guess I could create a micro that opens a thread clicks the picture saves it and then it saves the html of the page and refreshes if anyone has another way I'd like to know.
_________________
Back to top
View user's profile Send private message
BOU
Expert Cheater
Reputation: 0

Joined: 15 Apr 2009
Posts: 239
Location: Youtube watching Japanese Rock, and Korean Pop - Music Videos =)

PostPosted: Sat Aug 14, 2010 12:41 pm    Post subject: Reply with quote

Beekeeper Tim wrote:
I wanted to run a local script without port forwarding something...


With this, put something in as your computer name (Mine is JPU) so when you go somewhere in the same network, just type in \\(comp name)\ mine is \\JPU\

Beekeeper Tim wrote:
I guess I could create a micro that opens a thread clicks the picture saves it and then it saves the html of the page and refreshes if anyone has another way I'd like to know.

My site (JPU-CE) uses something like that... It saves an original image and a thumb when a picture is uploaded...
THUMB : http://jpu-ce.uphero.com/i/7PRVz7bETB68VXHCSUL98NaOEJVlJABP/thumb.jpg
IMAGE : http://jpu-ce.uphero.com/i/7PRVz7bETB68VXHCSUL98NaOEJVlJABP/image.jpg

_________________
Rawr
Back to top
View user's profile Send private message Visit poster's website AIM Address Yahoo Messenger
Garavito
Master Cheater
Reputation: 0

Joined: 21 Jun 2009
Posts: 387

PostPosted: Sat Aug 14, 2010 12:48 pm    Post subject: Reply with quote

BOU wrote:
Beekeeper Tim wrote:
I wanted to run a local script without port forwarding something...


With this, put something in as your computer name (Mine is JPU) so when you go somewhere in the same network, just type in \\(comp name)\ mine is \\JPU\

Beekeeper Tim wrote:
I guess I could create a micro that opens a thread clicks the picture saves it and then it saves the html of the page and refreshes if anyone has another way I'd like to know.

My site (JPU-CE) uses something like that... It saves an original image and a thumb when a picture is uploaded...
THUMB : http://jpu-ce.uphero.com/i/7PRVz7bETB68VXHCSUL98NaOEJVlJABP/thumb.jpg
IMAGE : http://jpu-ce.uphero.com/i/7PRVz7bETB68VXHCSUL98NaOEJVlJABP/image.jpg


I guess that would be the general idea but let me get into it. I want to safe every page an imageboard ie: http://7chan.org/b/ You notice how there are multiply pages and pictures that are constantly being upload and changed? Well I want to save every page and picture of the site so I can A. Create an archive or B. Import them into my website.

_________________
Back to top
View user's profile Send private message
AhMunRa
Grandmaster Cheater Supreme
Reputation: 27

Joined: 06 Aug 2010
Posts: 1117

PostPosted: Sat Aug 14, 2010 12:59 pm    Post subject: Reply with quote

You can either do it manually or you can do it with a CMS.
_________________
<Wiccaan> Bah that was supposed to say 'not saying its dead' lol. Fixing >.>
Back to top
View user's profile Send private message
Garavito
Master Cheater
Reputation: 0

Joined: 21 Jun 2009
Posts: 387

PostPosted: Sat Aug 14, 2010 1:05 pm    Post subject: Reply with quote

AhMunRa wrote:
You can either do it manually or you can do it with a CMS.


Can someone just give a script?

_________________
Back to top
View user's profile Send private message
GG
Grandmaster Cheater Supreme
Reputation: 4

Joined: 20 Jan 2008
Posts: 1589
Location: Australia

PostPosted: Sun Aug 15, 2010 1:01 am    Post subject: Reply with quote

That will use holy fuckloads of bandwidth.

Those imageboards can upload alot more, alot quicker than your consumer internet can download. You will get stuck.
Back to top
View user's profile Send private message Visit poster's website
AhMunRa
Grandmaster Cheater Supreme
Reputation: 27

Joined: 06 Aug 2010
Posts: 1117

PostPosted: Sun Aug 15, 2010 7:46 am    Post subject: Reply with quote

I'd run the webserver, you can blob the image into the database, you won't be able to browse it directly but with your webserver you could rebuild the image on view.

Would depend on how large the database stored your blobbed image, vs storing the image itself.

But it's a hell of a lot easier than writing something to index them and paginate em.

_________________
<Wiccaan> Bah that was supposed to say 'not saying its dead' lol. Fixing >.>
Back to top
View user's profile Send private message
BOU
Expert Cheater
Reputation: 0

Joined: 15 Apr 2009
Posts: 239
Location: Youtube watching Japanese Rock, and Korean Pop - Music Videos =)

PostPosted: Sun Aug 15, 2010 9:25 am    Post subject: Reply with quote

well, here is a quick code for it (note : I did not try the code out so there might be typos...)

Code:
<?php
//ARCHIVE_MY_JUNK.php
$zip=new ZipArchive();
if($zip->open('backup_file.zip',ZIPARCHIVE::CREATE )!==TRUE) {
 die('cannot open <$zip_name>');
}

$func_folder=opendir(getcwd());
$while(($file=readdir($func_folder))!=FALSE){
 if(!is_dir($file){
  $zip->addFile(getcwd().DS.$file,$file);
 }
}
?>


Well, that script will currently just archive all of the files (not directories) in the folder... it wil be saved as "backup_file.zip"

I'll finish the script sometime =) or you can use that and tweek it to make it work for your site

Also, I think this belongs in Web Development

On my site, I made it so that you can download both a normal file and a zipped file, here are an example.
Normal - | - Zipped
Zipped file has a problem that I am fixing....

_________________
Rawr
Back to top
View user's profile Send private message Visit poster's website AIM Address Yahoo Messenger
Display posts from previous:   
Post new topic   Reply to topic    Cheat Engine Forum Index -> Computer Talk All times are GMT - 6 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum


Powered by phpBB © 2001, 2005 phpBB Group

CE Wiki   IRC (#CEF)   Twitter
Third party websites