← back to the history
HELP!!! My server is getting overwhelmed with Bandwidth (Asian Tsunami Videos)
Thread #359270 · 644 posts · started 2005-01-01 04:50 PM · archived from webhostingtalk.com
DreamMaster · 2005-01-01 04:50 PM · #1
HELP!!! My server is getting overwhelmed with Bandwidth (Asian Tsunami Videos) My site just got linked from an extremely popular site and it cant take the load. I configured Mod_Throttle to cap the speed at 900 kBytes per second since I my server is only on a 10MB line. I put all videos on the /Videos directory, can I just throttle that directory? This is my mod_throttle code, is it correct? <IfModule mod_throttle.c> ThrottlePolicy Speed 900k 1s <Location /traffic> SetHandler throttle-me </Location> </IfModule> I don't want the html and pictures throttled is this code correct? BTW the site is: http://www.asiantsunamivideos.com
DreamMaster · 2005-01-01 09:41 PM · #1
Ehaanaes, Ok no problem just drop me a line when done.
cheyenne1212 · 2005-01-01 10:59 PM · #1
lol guess not just wait you'll get some.
SeeServers · 2005-01-02 03:02 AM · #1
UES Mirror system put up new cluster today, and Im on it, its very fast, http://wod.mirror.unitedemailsystems.com Just goto http://mirror.unitedemailsystems.com to get an account
lumbyjj · 2005-01-02 03:01 PM · #1
If you still need mirrors, let me know and I'll though it up on my server with a Gb/s connection and let it run for a while...
cheyenne1212 · 2005-01-02 04:12 PM · #1
I'm mirror 1 on the first one and Mirror 2 on the rest. Right now I'm going back and forth from 11.2 to 14.8 Mbps
lumbyjj · 2005-01-02 06:51 PM · #1
Yeah.. but i wanna get some bandwidth on it..
Dogtanian · 2005-01-03 09:46 AM · #1
but you cannot log a open dir can you?
Dogtanian · 2005-01-03 02:41 PM · #1
cool is WHT going to be famous lol
Dogtanian · 2005-01-03 03:29 PM · #1
can view my server stats here: http://67.111.205.10:255
lumbyjj · 2005-01-03 05:03 PM · #1
I've gone down to 39.4 Mb/s...
cheyenne1212 · 2005-01-03 06:35 PM · #1
Thanks. I only have a 30 day tria, but I think that'll be enough.
lumbyjj · 2005-01-04 01:56 AM · #1
LOL.. I LOVE that idea!!!!
topgun · 2005-01-04 11:42 AM · #1
how about moving this thread to the general webhosting forum. More people will see it and there will be more mirrors.
cheyenne1212 · 2005-01-04 05:26 PM · #1
What kind of a machine, you got running the DB part of it? I know I'll stick around as a mirror as long as it takes.
alex-davies · 2005-01-04 07:07 PM · #1
Sounds good to me. I mirrored waveofdestruction.org and pushed 80mb/sec over two days before I got close to my quota. Hence the reason I switched to cpu intensive/bandwidth low support (the loadbalancing script). Alex
kuremo · 2005-01-04 10:34 PM · #1
actually with awstats in cpanel, you can click a link at the top to generate stats instead of waiting until 2am. click the link and it'll take a while (15 minutes for me with all the traffic to my mirror). awstats is also nice and pretty Tony
cheyenne1212 · 2005-01-05 06:18 AM · #1
Not worried about the traffic. I just didn't wake up today till 12 noon. lol I can watch my bandwidth anyway from orbit. Besides seems like most traffics going to my unmetered box so I'm not worried about overages. Was just interested in allowing public visitors to my other sites B/W usage etc. I'll mess with MRTG after I wake up. Gotta take care of a few dependencies first. night/morning :p
Jakeh_uk · 2005-01-05 07:25 PM · #1
So thats no problem, as long as you're sorted and let all the others get killed had 27,000 hits in 48 hrs so far
Dogtanian · 2005-01-06 06:35 PM · #1
not anless you want to stay sane
vidahost · 2005-01-08 07:41 PM · #1
I peaked at 45 I think. Very strangely, I peaked at 43 when I was mirroring some downloads of NASA's WorldWind ( www.twobeds.com/nasa ). That was fun, I was pushing over 100Gb/day, whereas the NASA server was pushing a terabyte a day. eek!
DreamMaster · 2005-01-10 11:38 AM · #1
just slower or REALLY slow... I can hardly connect
Hadriel · 2005-01-10 06:18 PM · #1
Yeah same for me. Its just weird that I wasn't doing anything close to this traffic before.
Hadriel · 2005-01-10 07:43 PM · #1
Yeah so far I have sent 423. So crazy.
cheyenne1212 · 2005-01-11 03:53 PM · #1
90.7Mbps here. Dropped from the 218Mbps I was pushing earlier though. lol
Dogtanian · 2005-01-15 05:42 PM · #1
Sorry, My server is now dead from now on,
DreamMaster · 2005-01-01 04:56 PM · #2
Anyone familiar with Mod_throttle?
Georgecooldude · 2005-01-01 09:42 PM · #2
DreamMaster I have decided to give you the links to my mirror 2moro so I can monitor it closely. Its 1.30am so im off to bed. I will email you the links 2moro
Mooecow · 2005-01-01 11:00 PM · #2
heh is that a good or bad thing
DreamMaster · 2005-01-02 03:04 AM · #2
Isaac.Eiland-Hall, I am going to add your mirror soon. Tell me if you can handle the load. kuremo, I will also add your mirror. Thanks a lot for helping. And cheyenne1212 I am adding 4 new mirrors. I hope you can still take the load. If not just tell me.
DreamMaster · 2005-01-02 03:02 PM · #2
Ok I decided to take the adsense adds down because people might be tricked by links that look like charities and in fact arent. I will donate the total raised so far ($40.39 ) to the Red Cross.
Dogtanian · 2005-01-02 04:12 PM · #2
I would say rotate the mirror
cheyenne1212 · 2005-01-02 06:56 PM · #2
lol Mine had no B/W whatso ever till I started mirroring these files I went from 1.2GB expected usage for 1 month to 1100 GB expected usage.
fusioncroc · 2005-01-03 10:05 AM · #2
dream if you need another mirror i can set one up i've got 1TB of bandwidth to burn
cheyenne1212 · 2005-01-03 02:42 PM · #2
Hey i ordered a SM Unmetered box for the hell of it . Should have that up soon I think .lol
Mooecow · 2005-01-03 03:42 PM · #2
Cur: 30.3 Mbits/s o_O Something must be wrong. Either SM didnt downgrade me to a 10mbit port or orbit is screwing up
cheyenne1212 · 2005-01-03 05:03 PM · #2
I'm steeling it from you. lol
Dogtanian · 2005-01-03 06:39 PM · #2
yeh same with mine, ok thats better the downloads is set to 8mb
DreamMaster · 2005-01-04 04:01 AM · #2
Everybody, Your and my efforts are not in vain!!! I've been getting a lot of emails from visitors that are donating because of our efforts and it makes me feel extremely happy and proud of you guys. Check out this one from Pter Todd from the Marine Biology Laboratory, National University of Singapore: "Your website is very effective. Although we have donated and have been busy packing shipping containers bound for Sri Lanka, your site prompted to me give some more money." And there are a lot more like that, hell I even got contacted by Frank González, Tsunami Research Program Director, TIME Center NOAA/PMEL thanking me for the videos and he even linked to my site on http://www.pmel.noaa.gov/tsunami/ I told you I had alot of emails Just wanted to give you guys an idea of the response our contribution is getting from the public. This is to give you some encouragement and actual results of our efforts. We may never know how much we helped with this disaster but I can guarantee you that we are leaving our mark.
alex-davies · 2005-01-04 11:46 AM · #2
Good idea. It was originally in the "Dedicated Server" forum but a mod moved it to this frankly rather obscure location! Perhaps someone with a higher reputation than me here could ask a sympathetic mod to move it somewhere else? If people could try http://www.davz.net/mirror/torrent/files/videos.torrent and let me know (a) if it works, (b) is it fast. If, having downloaded the files, you could keep your connection going that would be really good. Thanks, Alex
alex-davies · 2005-01-04 05:30 PM · #2
Luckily I have access to a fast machine - Dual Xeon 2GHz - but it is already i/o bound due to the scripts that it is already running (which are not written by me - they load about 200mb of files into RAM each time they run and read through them from the top. Client assures me that it is a "search engine". I call it a text file!). Load is stable at 4 (usually 2) and I am not having a problem as long as I keep my tables small. I am running scripts to archive/delete data while at the same time not do too much SQL. Alex
cheyenne1212 · 2005-01-04 07:08 PM · #2
In no way would I view this as a competition. I just got the hostname to make it easier on linking etc. If you go to http://tsunamivideo.net you will see that I have no page up whatsoever that people can download from unless they know the /asian directory.
Isaac.Eiland-Hall · 2005-01-04 11:09 PM · #2
Yeah, it's pretty :-D But it doesn't show what I need right now, although that's a VERY VERY handy tip - I'll have to check that out when I have time... Exactly! :-D That's the only way I've really learned things -- and that'd part of the reason I went ahead and plunged in and got a dedicated - and so far I've been right -- ya can't learn except by doing... I've got MRTG installed, and my current "fun" is trying to figure out the config... but I'm not to the point of asking for help yet. But don't be surprised if I come back shortly and ask a couple of question... :-)
Quiky · 2005-01-05 07:58 AM · #2
Alex-Davies: It takes up to 48 hours to get that account setup from them.. I will post the video links as soon as I get the email.. only downside is we get 10mB space. Plesk reports 50gB used yesterday in only a few hours.. I will have Webalizer stats & mrtg up tonight.
cheyenne1212 · 2005-01-05 11:38 PM · #2
All day yesterday, and up to now today, I've had 149,321 hits.
cheyenne1212 · 2005-01-06 06:51 PM · #2
Who wants to be sane? What kind of fun is in being sane?
cheyenne1212 · 2005-01-08 07:41 PM · #2
What was your server IP dogtanian?
Hadriel · 2005-01-10 11:39 AM · #2
Loads after ~30 seconds for me.
cheyenne1212 · 2005-01-10 06:20 PM · #2
For the past few days my peak was about 73, and I stayed around 55-60Mbps then today i peaked to 90Mbps and am staying arund 75-84Mbps.
cheyenne1212 · 2005-01-10 07:44 PM · #2
I wonder what Sm would do If I started bursting to 500Mbps lol
Hadriel · 2005-01-11 03:54 PM · #2
I haven't added that newest vid because the download script hasn't been update. But I am debating on not even adding it with your 1gbit line.
cheyenne1212 · 2005-01-15 06:13 PM · #2
Ahhh... That explains the sudden drop from 30Mbps to 5. lol Well dreammaster I was glad I could help you with those videos. If you need help with anything that requires a lot of bandwidth, just let me know and I'll be more than happy to help you out.
Coolraul · 2005-01-01 05:03 PM · #3
Sorry I am not that familiar with it but are you worried about bandwith overage charges or just maxing out your line? Also don't you think posting the link here wont help any?
cheyenne1212 · 2005-01-01 09:50 PM · #3
For those of you interested, I'm mirroring files for him and I'm using 6.5Mbps right now.
DreamMaster · 2005-01-01 11:00 PM · #3
I'm still putting the links (takes time), I am adding one mirror at a time. Sorry for the delay if I still havent added yours. Ok back to updateing the site... I'ts amazing how good the webhosting community is :-)
cheyenne1212 · 2005-01-02 03:06 AM · #3
DreamMaster the load is not a problem. No worries here I can stay up at this current rate for quite a long time.
DreamMaster · 2005-01-02 03:04 PM · #3
Georgecooldude, I just got your links, will add them as soon as I can. Thanks a million !!
Weppel · 2005-01-02 04:13 PM · #3
I'm mirror #12 and i'm pusing 4mbps constantly (with peaks up to 8mbps
Isaac.Eiland-Hall · 2005-01-02 07:09 PM · #3
Heh. Just wait until Slashdot or Fark or similar get hold of it. :-) I submitted the main site to Fark, but they didn't greenlight it -- but there might be some TFers downloading -- except it was the middle of the night... I'll probably go submit my mirror here in a bit and put a link to the main site in the comments in a bit...
atchoooo · 2005-01-03 11:58 AM · #3
If it's still useful, I'll try to setup a mirror this afternoon, we can probably open a 100mbps port for the videos.
DreamMaster · 2005-01-03 02:45 PM · #3
cheyenne1212, Jesus!! You have done more than enough already. All you people have
Dogtanian · 2005-01-03 03:44 PM · #3
woah thats nice lol my server i cant connect to remote desktop (windows for ya) but I dont mind my stats udates every 30mins
Mooecow · 2005-01-03 05:03 PM · #3
still going at 30ish , im going to have to stop it in a few hours i think
cheyenne1212 · 2005-01-03 06:43 PM · #3
lol. That should let you RDC in now.
cheyenne1212 · 2005-01-04 04:49 AM · #3
Thats awesome. I think that and the idea of helping other people see the destruction of this disaster makes it all worth it.
Dogtanian · 2005-01-04 11:52 AM · #3
woah very nice, sleep then School and now this my day cant get any better or can it ?
Jakeh_uk · 2005-01-04 05:32 PM · #3
This is increible, the amount of downloads that are coming through. I added my mirrors last night with limits on the files, a few of them totally maxed out earlier, so i set them a bit higher, as soon as they were set higher, my connection peaked again. Check this: http://ike.jakeh.net/~jake/bandwidth.png Decent set of stats for my server here: http://ike.jakeh.net/~jake/html/usage Jake
Dogtanian · 2005-01-04 07:09 PM · #3
http://www.frozen-host.net:255 look there for my logs, nite
Isaac.Eiland-Hall · 2005-01-04 11:14 PM · #3
Actually, I just ran out of steam... The sample config roller is: cfgmaker --global 'WorkDir: /home/httpd/mrtg' --global 'Options[_]: bits,growright' --output /home/mrtg/cfg/mrtg.cfg community@router.abc.xyz The last item - "community@router.abc.xyz" refers to the address of my router... which I don't know. Any easy way to find out? Although googling for stuff often teaches me so much, it sure is frustrating when the terms are too common to find the info you need, and even worse, when you're not quite sure what terms to even LOOK for... heh. Oy.
alex-davies · 2005-01-05 08:04 AM · #3
Thats fine - if you can get two videos in I will send 60mb/sec or so just on those two videos Lets see how long that lasts! Alex
kuremo · 2005-01-06 01:31 AM · #3
alex, i can take more of a hit - kuremo.net actually has twice the bandwidth i thought (2.4 TB) and what's this about a new video?!
Quiky · 2005-01-06 11:13 PM · #3
No news from Adelphia yet.. their 48 hours are over.. I want to waste their bandwidth already!
cheyenne1212 · 2005-01-08 07:43 PM · #3
My highest peak so far for these videos has been aboutt 82.3Mbps Wow a terabyte a day, thats a lot of B/W? 100Mbit unmetered?
vidahost · 2005-01-10 01:19 PM · #3
Ouch, very slow, even from my machine in the same DC.
Hadriel · 2005-01-10 06:21 PM · #3
How long did SM say they were going to let you burst for?
Hadriel · 2005-01-10 07:47 PM · #3
They look like they have a couple hundred mbit free still on their MRTGs. I am thinking if you bursted to 500mbit they would have to do something, but I am thinking they will let you burst and use the connection untill its over.
vidahost · 2005-01-11 05:11 PM · #3
Cheyenne....PM Alex Davies to get all the videos on your server and the load distributed massively to you. The Planet are being nice
DreamMaster · 2005-01-15 06:30 PM · #3
cheyenne1212, You were one of the few left that could still handle the load Anyway like Alex Davies said, the frenzy is over and I don't want this thread to reach 50 pages lol. It's probably the largest thread in the history of WHT as it is Again, thank you and everyone that helped in anyway with this project.
DreamMaster · 2005-01-01 05:07 PM · #4
For now just maxing up the line.
DreamMaster · 2005-01-01 09:52 PM · #4
Georgecooldude, Ok contact me when you can.
Host1Nor · 2005-01-01 11:11 PM · #4
The cause is absolutely worth some $$ worth of bandwidth.
DreamMaster · 2005-01-02 03:08 AM · #4
Everyone: I just tarred all the videos to make it easier to download them http://www.asiantsunamivideos.com/tsunami_videos.tar or download them manually here: http://www.asiantsunamivideos.com/index2.html Contact me with the links if you decide to mirror. Looks like I woun't get any sleep tonight
Georgecooldude · 2005-01-02 03:08 PM · #4
Great! :-) How many hits is the site getting now to the index page? I am interested to know.
cheyenne1212 · 2005-01-02 04:17 PM · #4
I'm actually in the process of getting a SM Unmetered server for some other sites I'm hosting thats been getting some High Bandwidth, so once I have it up I can give you about a 15mbps Unmetered. Need to save the other 5 though.
DreamMaster · 2005-01-02 07:15 PM · #4
Isaac.Eiland-Hall, Please do so. Thanks to the members here there is more than enough bandwidth. I will keep adding more mirrors though just in case.
Georgecooldude · 2005-01-03 12:08 PM · #4
Judging from the ammount of traffic I had and am still having on the two smallest videos I'd say a few more mirrors are needed to reduce the load on the rest of the mirrors. I had to remove the 8 out of the 10 links as I used alot of bandwidth while I was sleeping. Just out of interested what sites are linking to asiantsunamivideos.com ?
cheyenne1212 · 2005-01-03 02:47 PM · #4
I always wanted to play with one so heres my chance. lol
Mooecow · 2005-01-03 03:47 PM · #4
can you tryin' rearange some of the mirrors or get more? im assuming in not the only one using 30 plus
cheyenne1212 · 2005-01-03 05:07 PM · #4
Just cap the bandwidth to that site.
Dogtanian · 2005-01-03 06:47 PM · #4
oh yeh its loads faster thanks for the advice
alex-davies · 2005-01-04 05:49 AM · #4
Hi Guys, There are two problems with it at the moment: some of the mirrors are not valid so I am going to write a script to check that the file actually exists on each of the servers. Secondly, it prevents people streaming it on some browsers. Am I better off using or using a header() call to redirect the user? Thanks, Alex
topgun · 2005-01-04 11:53 AM · #4
It is good to see someone supporting my ideas for once. I'm working on hooking you up with a dedicated (euro) 100mbit line for a few weeks but I need to run it past a few people first...can deffo get an answer before tomorrow morning.
cheyenne1212 · 2005-01-04 05:34 PM · #4
Yeah youd probably be screwed without a dual. well I'm pushing a steady 30Mbps on my unmetered now. Apparently thats ok with support. They say that will not affect my billing. lol
cheyenne1212 · 2005-01-04 07:09 PM · #4
If I came across as treating this as a competition I do apologize. My only goal in doing this is helping to get the videos out.
kuremo · 2005-01-04 11:20 PM · #4
getting router information isn't so easy for me, as i have a dedicated server on a massive network, so they could care less. i do, however, have 3 different choices in graph utilities from my provider, as well as anything cpanel spits out.
Quiky · 2005-01-05 08:52 AM · #4
Their server is probably on a 100mbit, so we might get some decent speeds out of it for a while.. And the webalizer stats(Not correct with bandwidth transfered, but close enough): http://devas.content.phyrenet.net/plesk-stat/webstat/ Patong Beach seems to be the most popular right now on my box; ~20gB for that one file alone.
cheyenne1212 · 2005-01-06 01:38 AM · #4
A new video?
cheyenne1212 · 2005-01-07 12:57 AM · #4
lol curious as to how long they'd let you push the kind of B/W we talking about.
vidahost · 2005-01-08 08:17 PM · #4
This is NASA we're talking about, so I couldn't possibly disclose their server specs [really tiny text] 1Gbit, 8Gb RAM, blah blah [/tiny text] (Mods note, this isn't actually secret NASA info, it's on their forums so you don't need to edit it out ^_^ ) 82mbps! I've hit 70 backing up to NAS, and around that when I downloaded SP2 to a server...Akamai rocks.
vidahost · 2005-01-10 01:26 PM · #4
The IP 193.95.44.212 has god knows how many requests for the same video going at the moment. More than any download accelerator would use. I'm blocking it.
cheyenne1212 · 2005-01-10 06:22 PM · #4
Don't know. I told the guy who let me do this, that it might be a couple weeks. So I guess we'll see cause I am pusing at least 65% of a 100Mbit port.
cheyenne1212 · 2005-01-10 07:49 PM · #4
Yeah probably. Guess will see. lol
cheyenne1212 · 2005-01-11 10:12 PM · #4
I've already pm'ed him and my load was doubled from it was it was 4 days ago. I PM'ed him 2 days ago and yesterday, but he hasn't replied yet. hes a busy guy. lol Dreammaster you dont have access to his script do you?
Dogtanian · 2005-01-15 06:31 PM · #4
No problem i did my best
DreamMaster · 2005-01-01 05:09 PM · #5
I dont want to have the "Service Temporarily Unavailable" error message for requests to the front page but for the videos only.
Mooecow · 2005-01-01 09:54 PM · #5
dreammaster, www.weirdboys.com/asia has all the vids in there
Isaac.Eiland-Hall · 2005-01-01 11:22 PM · #5
Is there still a need for another mirror? I'd be glad to mirror the files, although I would like to throttle the bandwidth (like Dreammaster, because I as well only have a 10Mbit line)... I think I did install mod_throttle, but I haven't even played with it yet... I can donate 750GB of bandwidth for the month if someone can step me through the mod_throttle process - I'll set up a subdomain to host the videos, which I just went and downloaded... So: 1. Would another mirror help, and 2. Can someone help step me through the mod_throttle setup?
cheyenne1212 · 2005-01-02 03:59 AM · #5
well I am going to get some sleep. lol see what B/W looks like after a few hours. I sure am suprised thought by the number of offers you've had from people to host mirrors. The more the better though.
DreamMaster · 2005-01-02 03:11 PM · #5
Georgecooldude, Right now about under 1000 uniques per hour but it's climbing fast. Luckely with all the mirrors that people have contributed the bandwidth woun't be a problem (I hope)
DreamMaster · 2005-01-02 04:18 PM · #5
cheyenne1212, I just shuffled the links. Tell me if the load goes down.
DreamMaster · 2005-01-02 07:34 PM · #5
That mirror has just been taken down. I am only alowing mirrors to the video files that allow the user to save-target as and download not take them to another page.
Dogtanian · 2005-01-03 12:09 PM · #5
I did a google search and found nothin but it seems then coming in tho google and yahoo under the word tsunami
DreamMaster · 2005-01-03 02:47 PM · #5
Just broke the 3000 uniques per hour mark !!! 15:00 - 15:59 3002 9.23% http://extremetracking.com/open;unique?login=asiantsu
Dogtanian · 2005-01-03 03:49 PM · #5
Umm dream try pming him he says he can mirror and also theres like to other people in this thread who said they can mirror
Mark L · 2005-01-03 05:11 PM · #5
That's insaine, 35578 unique just today @ 4:11 PM.
cheyenne1212 · 2005-01-03 06:51 PM · #5
No problem.
cheyenne1212 · 2005-01-04 05:53 AM · #5
I'd probably go with your javascript/PHP code up there, but thats just me.
Dogtanian · 2005-01-04 11:58 AM · #5
I add my mirrors into the script in a bit but lol is that all i used, Total Bandwidth 23.04 GB out of 500gb lol
Dogtanian · 2005-01-04 05:34 PM · #5
rofl :| lol well I am telling forums to use the random mirrors now
topgun · 2005-01-04 07:11 PM · #5
I would rather you didn't triple it unless you need to. I am using my ISP's free webspace + one of my own servers. based on the number of hits I estimate my ISP was taking 40mbit+ at peak and they havn't kicked up a fuss. No need to spend $200.
cheyenne1212 · 2005-01-04 11:24 PM · #5
try doing a tracert to your server the second to last hop should be the router I belive.
Dogtanian · 2005-01-05 11:55 AM · #5
so far i used, Total Bandwidth 47.06 GB and the Usa is the highest contury to download it lol
kuremo · 2005-01-06 02:17 AM · #5
read the news at the top of asiantsunamivideos.com
alex-davies · 2005-01-07 04:30 AM · #5
Just to let everyone know that the script was modified over 12 hours ago. The Dual Xeon running the mirror script will hold no probs. I reckon that it could cope with 800/min and we have not crossed 300/min for several days now. The script is a quick PHP/MySQL one but it works fine. It could easilly be loadbalanced using MYSQL replication but we dont need to for the mo. With best wishes, Alex
cheyenne1212 · 2005-01-08 08:20 PM · #5
lol I thought you meant you mirrored Nasa files on your server, didn't know you actually used a NASA server. lol
Hadriel · 2005-01-10 01:36 PM · #5
Anyone else having problems changing the download script? All the downloads are set to 6442450941 so I think its putting my site near the front of the load. I tried to drop in in thirds, but its not updating. Not concerned with the bandwidth, just the server is starting to chug.
Hadriel · 2005-01-10 06:23 PM · #5
Well hopefully they will let you burst for a while longer. I know I can't take anything more then I am doing right now. If I were to burst to 90mbit+ I would have to pull the plug. I hope it doesn't get that bad though.
vidahost · 2005-01-10 07:51 PM · #5
They've got about 800mbit free on the Cogent bandwidth. I guess they'd have to limit you though.
Quiky · 2005-01-11 10:27 PM · #5
Sorry, had to kill mine off.. I used as much bandwidth as I possibly could spare. Still waiting for the Adelphia account to be setup. 4 hours my ***.... So I am calling them up tomorrow to get the details.
DreamMaster · 2005-01-15 06:47 PM · #5
Dogtanian, I know you did, thank you I just noticed that I made more than 100 posts and am therefore a "WHT Addict"... I guess it's too late for me then... oh well ...what'ts the 12 step program for WHT addicts?
DreamMaster · 2005-01-01 05:20 PM · #6
Ok I setup a subdomain with the videos and am now throteling the subdomain. Seems to be working. Is this the best way to do it?
Host1Nor · 2005-01-01 09:56 PM · #6
Thanks Cheyenne1212. Just have to fix a couple small things before opening. Waiting for a PM from DreamMaster to get it up and running.
Mooecow · 2005-01-01 11:23 PM · #6
yes, it is, im up to 2.1 by the way
Isaac.Eiland-Hall · 2005-01-02 04:44 AM · #6
Hit me! :-) I've got it throttled to 800Kbits/sec, and I've got that subdomain set up for 750Gb of traffic, so have at it. :-) To clarify absolutely: It's up and ready to go.
DreamMaster · 2005-01-02 03:13 PM · #6
Wow just looked at the stats... A lot of blogs and forums are linking to me. I hope the mirrors hold.
Hudson Digital · 2005-01-02 04:20 PM · #6
I think someone mentioned using a link rotation script. It sounds like a good idea to evenly distribute the load between the mirrors.
eservicesu · 2005-01-02 07:38 PM · #6
So you dont need any more mirrors? Ive PMed you about it. - Eddy
cabalstudios · 2005-01-03 12:26 PM · #6
Very glad to see this response from members on WHT. Keep it up. If help is required PM me, we can host if required b/w wont be a problem.
Dogtanian · 2005-01-03 02:48 PM · #6
well this is my way of supporting the tusamia 16 and I cant donate which sucks edit: very nice indeed
DreamMaster · 2005-01-03 03:54 PM · #6
Dogtanian, I can hardly keep up with the workload. I´m getting a ton of emails and pm's, newspaper interviews, and manually setting and removing mirrors is a lot of work. I need to automate the adding a mirror process. Can someone help set up a script? Weppel was working on that but he can't anymore. I only got 5 hours of sleep yesterday (normally 9), I'm exhausted but I'll try to keep adding mirrors and rearange the links abit. Sorry for the delay.
Dogtanian · 2005-01-03 05:17 PM · #6
yeh I know lol it going up loads by the second lol i got you coved lets see what Managed servers can do hopfully it blow up but no
DreamMaster · 2005-01-03 06:51 PM · #6
4000+ Uniques per Hour now and increasing rapidly!!!!! http://extremetracking.com/open;unique?login=asiantsu Hold on guys, the script will be ready soon.
alex-davies · 2005-01-04 05:56 AM · #6
That is what I originally did but apparantly that stops streaming (not for me it doesent). Can people try the difference between http://www.davz.net/mirror/download....age=1&header=1 and http://www.davz.net/mirror/download.php?package=1 and see which they prefer (no prizes for which one uses the header() redirection ) I am writing a link checker as we speak. Many thanks, Alex
alex-davies · 2005-01-04 12:02 PM · #6
Does that mean you want more or less? If you email me your URL I can rig the weighting of your server. We have had 75,000 downloads in about 6 hours. Thats over 10,000 per hour. Alex
alex-davies · 2005-01-04 05:38 PM · #6
So you got an umlimited server for the cost of a 20mb one? Well its your gain; they probably dont realise that you are going to be pushing crazy amounts of bandwidth lots of time. Are you on a 100mb port? Can I send more traffic your way? (seems a pity not to use it ) Yes, the links are http://www.davz.net/mirror/download....age=1&header=1 (package=2 for video 2, etc.) If you prefer a javascript redirect to a Location header then remove header=1. With many thanks, Alex Davies
DreamMaster · 2005-01-04 07:43 PM · #6
Everyone !!! I´m back. Just needed a couple of hours sleep to remain sane I know all you guys are handling huge loads and are really struggling to keep up. We are doiing everything that we can to try to ease the load on your servers. cheyenne1212, thanks for adding that new server and I know you only want to help. To everyone that hasn't contriuted yet and wants to help out I am quoting a post I made some time earlier but got buried in the thread.
Isaac.Eiland-Hall · 2005-01-04 11:25 PM · #6
Heh. Well, I only have my local cPanel stats, which aren't so hot... Provider only gives ClientExec, and after poking around in there, there's just not much to it... So that sounds like it might be a question for my provider only? d'oh...
DreamMaster · 2005-01-05 01:44 PM · #6
Listen up guys!!! I have some interesting news. Firstly the site has broken the 10,000 uniques per hour mark and also reached 25,000 downloads per hour. The mirrors are still holding though and I can only thank you guys for that. I was also surprised to find myself in the Newspaper "La Republica" or The Republic. They wrote an article about my project and a little info about myself too. They also mentioned the help that the Webhostingtalk.com community has contributed. I insisted on that particular point Although it is in spanish you can still make out some keywords like Tsunami, Webhostingtalk, etc. Here is the link to the online version: http://www.diariolarepublica.com/v8/...=5®istro=22 And I also took a photo of the actuall paper: http://www.asiantsunamivideos.com/article.jpg Looks like the project is slowly creeping into the news.. PS:dont bi** about my photo because I took it at 4:00 AM and was extremely tired. Also note that on the screen is the site being edited with DreamWeaver.
Xkevinx · 2005-01-06 02:20 AM · #6
Just read all 31 pages of this thread. Really amazing. I just downloaded thru BitTorrent and have it open for others. Also How is the Coral network thing doing.
Weppel · 2005-01-07 06:08 AM · #6
http://harvester.rsvmedia.com/tsunam...an-Tourist.wmv is online and ready for traffic.
jheslop1 · 2005-01-08 08:21 PM · #6
... how old are you...?
vidahost · 2005-01-10 01:54 PM · #6
I've got ~100 - 300 concurrent requests going. Will drop to 50 after I've blocked that IP...it's still hammering away for some inexplicable reason.
cheyenne1212 · 2005-01-10 06:24 PM · #6
which company are you with?
DreamMaster · 2005-01-10 08:24 PM · #6
Ok just woke up. I increased the MaxRequests in apache to 450 now. Is the site loading faster?
vidahost · 2005-01-12 02:12 PM · #6
Theplanet have been absolutely splendid and allowed me an extra terabyte of bandwidth - so alex / dreamhost, feel free to increase the load to my server if needed. Don't forget cheyenne's 20mbps though!
Dogtanian · 2005-01-15 06:50 PM · #6
and the same post count lol me have 112 and you have 112
datums · 2005-01-01 05:22 PM · #7
Seems to be working, all videos are unavailable. "Seeing how a lot of sites can't keep up with the bandwidth requirements of hosting" How about you make them available to people who do contribute ? I am working on project with other volunteers to give donaters hi-res photos of one of the islands that no longer exist.
DreamMaster · 2005-01-01 09:59 PM · #7
Mooecow, Ok I'll add the links as soon as I can and thanks for your help.
DreamMaster · 2005-01-01 11:29 PM · #7
Ehaanaes, I just added your mirror links. Hope you can handle the bandwidth :-)
DreamMaster · 2005-01-02 04:44 AM · #7
Ok I'm off to bed too. There are more than 12 high bandwidth servers mirroring the files and more comming so the bandwidth should hold (I hope). I still want more mirrors just to be sure and in case I get slashdotted or Drudged Here are all the videos in one tar archive if you want to mirror them: http://www.asiantsunamivideos.com/tsunami_videos.tar
cheyenne1212 · 2005-01-02 03:15 PM · #7
I"ll hold. Been getting hit now around 14Mbps
Dogtanian · 2005-01-02 04:20 PM · #7
INstall a page counter see how many people you getting in a second :p
DreamMaster · 2005-01-02 07:46 PM · #7
sirgamesalot, Yes I still do need mirrors because I don't want to push the existing mirrors too much. You can either download a tar archive of all the videos: http://www.asiantsunamivideos.com/tsunami_videos.tar or download them manualy: http://www.asiantsunamivideos.com/index2.html I need individual links to each video that allow the user to save-target as to download. Contact me if you still want to go ahead with it.
lumbyjj · 2005-01-03 12:32 PM · #7
I've been averaging around 7.5 Mb/s. Not that much.. I can always take more without having to worry about anything..
jheslop1 · 2005-01-03 02:53 PM · #7
You really have a problem don't you? This isn't a competition on who can push the most bandwidth you know. If you want to make in into a competition; I'm hosting 2 mirrors my SM unmetered box is pushing 15Mbit and my NAC 2tb box is pushing 10Mbit, all in all thats 25Mbit of dedicated bandwidth from these videos. Now I suggest you really stop going "I can take it", "More, More" "I can hang in there" etc. As it's really doing my nut in. The whole lot of you that is thinking this is a contest, it isnt a contest these are real people, real people who might of died, are very ill or in a emotional shock state.
Dogtanian · 2005-01-03 03:55 PM · #7
I download it onto my server and I have a look to see what I can do
lumbyjj · 2005-01-03 05:19 PM · #7
Nice, I'm back up to 58.0 Mb/s
cheyenne1212 · 2005-01-03 06:58 PM · #7
No rush here.
cheyenne1212 · 2005-01-04 06:01 AM · #7
Well they both work good for me. Both links streamed the video instead of me having to click save. I guess I'd prefer the first one over the second one even though they both do the same thing really.
Dogtanian · 2005-01-04 12:03 PM · #7
I dont mind getting more atall right up to you
Quiky · 2005-01-04 05:41 PM · #7
Bandwidth graphs show 99% of the 10mbit pipe is used right now.. I mean, the server is being hammered. I have 114 apache requests for the files right now..
alex-davies · 2005-01-04 07:58 PM · #7
Won't do. Thanks so much for helping. Alex
cheyenne1212 · 2005-01-04 11:31 PM · #7
Wouldn't hurt. Put in a ticket asking what your router is.
Dogtanian · 2005-01-05 01:49 PM · #7
O_o very very nice my Mirror will be down from the middle of this month since managed gave it to me for free (After ripping me off first)
DreamMaster · 2005-01-06 03:11 AM · #7
Hi guys, Check out the site again because the update is only now finished. Yes, I have some pretty shocking video that I want to add so I need to be contacting you to upload it. It's 10 Mb in size and very good quality and long playback. Please if you can send me a PM or email telling me the IP or domain of your mirror because I am starting to loose track of them. Sorry if I havent been here too much the last couple of hours but my workload is very high at the moment. Xkevinx, Wow the whole 31 pages !!! Anyway thanks for helping out.
DreamMaster · 2005-01-07 06:40 AM · #7
Everyone, Please download the new file "Khao-Lak-by-German-Tourist.wmv" http://www.asiantsunamivideos.com/vi...an-Tourist.wmv And then go to http://www.davz.net/mirror/index.php and add it to the mirror script. I have already done a couple but it is really hard to keep track of of everyone. I want to release the video as soon as possible. Thank You. weppel, Thanx for adding the file. I added it to the mirror script.
DreamMaster · 2005-01-08 08:21 PM · #7
Hey everyone! I think that everyones bandwidth has decreased substantially because a lot more mirrors have been added. I have this guy helping me out that has added a lot of .edu mirrors and a lot are doing 100+ Gb per day. Yesterday for example we almost reached 83,000 Uniqes for that single day and I don't see the hits decreasing too rapidly. I optimized the site abit and it's now at number 9 in google for the search "tsunami videos". I could have done that before but was worried about the bandwidth constraints. Anyway I will be addint 3 new files: http://www.asiantsunamivideos.com/vi...e-Khao-Lak.wmv http://www.asiantsunamivideos.com/vi...unami-Wall.wmv http://www.asiantsunamivideos.com/vi...iland-Wave.wmv Please download them and I will add them to the script. Also someone PM'ed me saying that the domain has over 1,000 mentions in google. Looks like the site created quite a fuzz.
Hadriel · 2005-01-10 02:01 PM · #7
Yeah I am just getting hammered also. Time range: 1/10/2005 03:21:25 - 1/10/2005 11:38:35 Total Hits 49,399 Average Hits per Day 49,399 Average Hits per Visitor 4.23 Cached Requests 1,268 Visitors Total Visitors 11,667 Average Visitors per Day 11,667 Total Unique IPs 10,154 Bandwidth Total Bandwidth 235.46 GB Average Bandwidth per Day 235.46 GB Average Bandwidth per Hit 4.88 MB Average Bandwidth per Visitor 20.67 MB
Hadriel · 2005-01-10 06:26 PM · #7
EV1Servers
Hadriel · 2005-01-10 08:26 PM · #7
Yeah quite a bit, but still not as fast as it was Friday.
alex-davies · 2005-01-12 02:25 PM · #7
I would be interested to see what he is getting now. I have increased it further. Sorry if I am slow to respond; I have a very large number of exams this week ("A" Levels) and so am trying to revise for most of the time! Please bear with me and keep emailing me if I dont do something. Average hits/min is relatively static at 300/min for the previous week or so. With best wishes, Alex
cheyenne1212 · 2005-01-15 06:51 PM · #7
Uhmmm I don't think there is a program for WHT addicts. lol I have 4000 posts on another forum thats related to networking and security. One think I would like to say though dreammaster is I think theplanet/Servermatrix was one of the main reasons we were able to keep up with the load. Also, the acunett team helped me out a lot by tweaking my server be able to handle the constant 80+Mbps apache was serving. Thanks to TP/SM's kindess they uncapped my B/W on my unmetered server, and they also let another person have a extra TB of bandwidth. So big thanks to TP/SM for their kindness with this. And hopefully something like this terrible disaster will never happen again.
DreamMaster · 2005-01-01 05:31 PM · #8
datums, I want to make the videos available to as many people as possible so that they contribute. How can I check if they contributed or not? I need mirror site to distribute the videos. It's amazing how almost all the sites that are currently hosting the videos are bucking under the load.
Mooecow · 2005-01-01 10:00 PM · #8
now you can ignore my PM lol. and your welcome
Isaac.Eiland-Hall · 2005-01-01 11:34 PM · #8
I'm uploading to tsunami.eiland-hall.com -- but PLEASE DON'T link to that until/unless someone can help me throttle the bandwidth, per my previous message :-) I've only got a 10Mbit connection, but I've put 750 Gigs on the transfer...
DreamMaster · 2005-01-02 04:49 AM · #8
Isaac.Eiland-Hall, Your mirror is up on the page, you should be getting some requests already but I doubt it's taking too much bandwidth because of the time. Lets see what happens tomorrow :-P
DreamMaster · 2005-01-02 03:15 PM · #8
lumbyjj and stevey, Yes I still need mirrors because the load is climbing rapidly and I haven't even been spidered by google yet.
Georgecooldude · 2005-01-02 04:30 PM · #8
Maybe also put a note about right clicking and saving the link target. I suspect a few people probably download it twice by streaming the first time by accident. .. I just noticed googlebot has also indexed your page now
klcodec · 2005-01-02 07:50 PM · #8
As in my PM, I will mirror once my 100mbit servers are ready ^_^
DreamMaster · 2005-01-03 01:18 PM · #8
Ohh my god!!!!!! I just woke up and this is what I find: ***** The Planet Monitoring System: IPAlert DLLSTX4 ***** Notification Type: PROBLEM Service: PING Host: asiantsunamivideos.com Address: 67.19.97.122 State: CRITICAL Date/Time: Mon Jan 3 10:42:24 CST 2005 Additional Info: PING CRITICAL - Packet loss = 0%, RTA = 434.54 ms Getting more than 3,000 Uniques per Hour!!!!! I hope that the mirrors can handle the load.
Dogtanian · 2005-01-03 02:56 PM · #8
I am not, I am only trying to help the cause you dont see me boasting
alex-davies · 2005-01-03 03:56 PM · #8
Get people to add your site as a virtualhost and mirror the whole contents of your webtree. Then sign up for zoneedit.com (free account) and give a few trusted users the password. You can add/edit/remove servers on the go. Otherwise, a script like Info-Mac might help. Alex
Weppel · 2005-01-03 05:26 PM · #8
I suggest putting this guy up as "Main Download URL" and the others as mirrors below that. That should get him at his much wanted 100mbps
Dogtanian · 2005-01-03 07:00 PM · #8
No rush here, night i am going to bed hope everything works out
kuremo · 2005-01-04 06:42 AM · #8
Sorry, moving from asiantsunamivideos.com to davz.net messed up my hotlink protection at kuremo.net/content/tsunami, so for a little while it didn't work. Fixed it though
topgun · 2005-01-04 12:46 PM · #8
Adding some mirrors now but the British tourist link doesnt work. It's the one at the bottom.
alex-davies · 2005-01-04 05:42 PM · #8
URL to files? I will drop the number of requests to you (but not stop them which reducing your limit would do). Alex
topgun · 2005-01-04 08:02 PM · #8
Here is a little tip: Most ISPs offer their customers a small amount of webspace - this is the only real unlimited hosting you will find because: 1) Most ISPs have a lot of unused upload capacity 2) They don't expect a lot of traffic so they don't check for bw hoggs. try mirroring one or two files on their space and see how it goes. The worst they can do is remove them.
Isaac.Eiland-Hall · 2005-01-04 11:35 PM · #8
Heh... I just refreshed here after doing precisely that. :-) Well, it'll be another good test for TomSyer... it's late enough in the day that they may be there... heh...
kuremo · 2005-01-05 01:50 PM · #8
awesome! glad to see it _____ Tony Webster
kuremo · 2005-01-06 03:13 AM · #8
alex kept the coral links up and i've been messing around with it awhile. i don't know how coral can do it, not only the massive bandwidth that would be required to run that, but also the government, DMCA, RIAA, and MPAA and their recent history with file sharing. if i read correctly, it checks the server to make sure the file is still there every 5 minutes, but let's say you wanted to avoid the government, for example, finding that you have something potentially illegal on your site, you can make the content only viewable to the coral IP's. *shrug*, i'm shocked... almost as shocked as i was when i found yousendit.com ____ Tony Webster
Quiky · 2005-01-07 07:51 AM · #8
Added mine to it; http://devas.content.phyrenet.net/vi...an-Tourist.wmv
vidahost · 2005-01-08 08:29 PM · #8
Whoa, nice All those videos are on twobeds.com: www.twobeds.com/ [filename] for every one, please add away
cheyenne1212 · 2005-01-10 02:15 PM · #8
Woah I'm getting nailed only pushing 48Mbps on a 100Mbps port my server is slowwww.. http://tsunamivideo.net/asian If this keeps up I'm opening a ticket with Acunett to have them check and see whats happening. /edit yeah that IP: tcp 0 48181 70.85.13.218:80 193.95.44.212:38064 has hundreds of requests at my server. Gonna add a rule to apf. And their all in FIN_WAIT status.
vidahost · 2005-01-10 06:38 PM · #8
I'm currently @ 46mbit/sec. Hopefully more mirrors will add the new videos, because I'll have to pull the plug within a week at this rate. Maybe theplanet will ignore it though, as it's for the Tsunami. Could always give it a try
DreamMaster · 2005-01-10 08:27 PM · #8
It's getting like 50% more hits than friday lol Any other tweaks that I can do to increase speed?
sightz · 2005-01-12 03:07 PM · #8
YAY! Thumbs up for The Planet!!!! They rock! Any other datacenters care to match their contribution?
DreamMaster · 2005-01-15 07:03 PM · #8
Dogtanian, 113 and 113 posts lol cheyenne1212, You are right, The Planet really helped alot and rightfully deserve credit as you pointed out. I have nothing but praise for that company and have really enjoyed having my server hosted there the past couple of months. The acunett team really knows their stuff and I will recomend them to my friends and probably use them myself instead of burning my brain trying to figure out stuff by myslef. I hope that there arent any disasters like this one in the futere but sadly it's not a question of if but of when the next one will happen
2uantuM · 2005-01-01 05:44 PM · #9
like i said and your other thread... torrents.
DreamMaster · 2005-01-01 10:05 PM · #9
Wow I just want to say THANK YOU to everybody that is helping me mirror the files. I have been swamped with PM's and am absolutely overwhelmed :-)
Mooecow · 2005-01-01 11:36 PM · #9
i find that if your later in the list you dont get hit hard, im at 600k at the moment
VapoRub · 2005-01-02 04:49 AM · #9
Maybe we all can chip in and get a EZZI server? They seem to offer 4000 GB which is enough for a mirror (note: i haven't read their TOS yet).
DreamMaster · 2005-01-02 03:17 PM · #9
cheyenne1212, Damn I'm really sorry about that load. Will add as many mirrors as I can to ease the load. The traffic is climbing rapidly now, will work as fast as I can.
cheyenne1212 · 2005-01-02 04:32 PM · #9
dropped to about 8 Mbps. I can be where you need me to be thouhg. If you want to, once i get my unmetered server up I can dedicated all the bandwidth on it to hosting the files for a while (serveral weeks) until I get my other accounts transferred. Then that way I can kinda act as a buffer since I won't have a bandwidth limit.
lumbyjj · 2005-01-02 07:53 PM · #9
Feel free to push as much as possible through mine..
lumbyjj · 2005-01-03 01:22 PM · #9
Mine can..
DreamMaster · 2005-01-03 02:56 PM · #9
Dogtanian, Mirror added. Hope you can handle the load
Dogtanian · 2005-01-03 04:00 PM · #9
the php one looks good one I am testing it out now
cheyenne1212 · 2005-01-03 05:28 PM · #9
26 here now.
eservicesu · 2005-01-03 07:01 PM · #9
ok ive PMed you Dream good luck man. - Eddy
Jakeh_uk · 2005-01-04 06:47 AM · #9
My servers nearly maxing out the 10mbps line atm, (On 9.76mbps) How would i go about capping it to say 9mbps? (Redhat 9) and leave 1mbps for myself and other things Jake
alex-davies · 2005-01-04 02:13 PM · #9
It will be removed automatically if it does not give a 200 status code every 15 mins. I have just had someone pm me to say "I dont believe that you are using that much traffic". Here are the statistics: http://www.davz.net/mirror/stats/stats.php That is files 1 --> 10 and the total PER MINUTE for the last half hour or so (when I wrote the script). We are shifting up to 20,000 per hour at the mo (up to 350 per min) Alex
Quiky · 2005-01-04 05:45 PM · #9
http://devas.content.phyrenet.net/videos/ Hope that is what you mean.. And thanks for reducing the requests..
kuremo · 2005-01-04 08:25 PM · #9
Is anyone familiar with Coral ( http://www.scs.cs.nyu.edu/coral/ )? "Have you ever run a website, only to find that suddenly you get hit with a spike of thousands of requests, overloading your server and possibly causing high monthly bills? If so, Coral might be your free solution for these problems!" I don't know much about it, but if I'm reading correctly, you simply make a Coral URL, like http://www.kuremo.net.nyud.net:8090/...tong-beach.wmv - and it caches it?
cheyenne1212 · 2005-01-04 11:50 PM · #9
lol according to reviews I've been reading, they've been going down hill a bit.
DreamMaster · 2005-01-05 01:53 PM · #9
thanks guys I wonder if Drudge or CNN take notice. Even though I wount be able to handle the traffic it would be nice... hehe
cheyenne1212 · 2005-01-06 03:48 AM · #9
Definitely be glad to host that file dremmaster. Kuremo: yeah seems like they would need at least a couple unmetered gigabit lines to keep up with that.
Georgecooldude · 2005-01-07 10:38 AM · #9
alex-davies, Could you send me a copy of the script you modified? I would like to have play about with it for a project. :-)
cheyenne1212 · 2005-01-08 11:42 PM · #9
http://tsunamivideo.net/asian up with new links.
cheyenne1212 · 2005-01-10 02:41 PM · #9
I think this is the highest number I've seen apache handling requests so far. Current Time: Monday, 10-Jan-2005 12:39:43 CST Restart Time: Monday, 10-Jan-2005 11:05:31 CST Parent Server Generation: 0 Server uptime: 1 hour 34 minutes 12 seconds Total accesses: 43198 - Total Traffic: 38.5 GB CPU Usage: u41.08 s131.61 cu.13 cs.03 - 3.06% CPU load 7.64 requests/sec - 7.0 MB/second - 0.9 MB/request 150 requests currently being processed, 0 idle servers WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW WWWWWWWWWWWWWWWWWWWWWW.......................................... ................................................................ ................................................................ After looking at that, it appears that my apache server actually crashed a hour and a half ago.
cheyenne1212 · 2005-01-10 06:43 PM · #9
yeah I think a few mirrors went down. /edit Excuse my langauage but oh my god, I just burst to 180Mbps WTF?
cheyenne1212 · 2005-01-10 08:33 PM · #9
Whats your OS again dreammaster. And whats your system spec?
lumbyjj · 2005-01-12 03:23 PM · #9
Some already have..
cheyenne1212 · 2005-01-15 07:10 PM · #9
Wll now that the load is over guess I'm gonna start setting up nameservers and configuring WHM/Cpanel for this server.
wheimeng · 2005-01-01 08:21 PM · #10
Correct, BT is the best way to offset your bandwidth. In fact, it reaches more people that way
Host1Nor · 2005-01-01 10:28 PM · #10
Opened up mirroring now with some hotlink-protection and so on. Hope it helps
DreamMaster · 2005-01-01 11:45 PM · #10
Isaac.Eiland-Hall, Thanks for offering your help. Go here http://www.asiantsunamivideos.com/index2.html download the videos you want to mirror and send me the links. As for setting up Mod_throttle (good idea) here is an excellent tutorial: http://www.webhostgear.com/160.html (for cpanel)
DreamMaster · 2005-01-02 05:09 AM · #10
I added a link to this thread on my site. Hope it doesn't crash Webhostingtalk.com http://www.AsianTsunamiVideos.com
DigiCrime · 2005-01-02 03:17 PM · #10
I can mirror from a personal server of mine if you want, runs 100Mbps F-DX sure that will run through some bandwidth though but should help some
DreamMaster · 2005-01-02 04:36 PM · #10
I need to automate the process of adding mirrors because it's really time consuming Weppel is working on a mirroring script atm. Hope that helps
Mooecow · 2005-01-02 08:00 PM · #10
im at about 1.5mbit the whole time. Highest i ever saw was 4 lol.
Dogtanian · 2005-01-03 01:25 PM · #10
So can mine for a while read your emails or pm
cheyenne1212 · 2005-01-03 02:57 PM · #10
I know that, I just enjoy hosting the videos for people to get to. The more B/W going through the more people seeing the video. The longer I stay up the more people that see the video.
Mooecow · 2005-01-03 04:02 PM · #10
out curioustiy whats everyone pushing? 30ish here
alex-davies · 2005-01-03 05:28 PM · #10
I have written a quick mirror load balancing script. I have set it up for the first file: http://www.davz.net/general/mirror.php?id=0 To see the different files that it is sending you to, add &show=1 on the end: http://www.davz.net/general/mirror.php?id=0&show=1 This system is running on a MySQL database on a optimised, dual xeon machine with 4GB of RAM. If you wan't to link to this instead I can also add the ability for each mirror to be given a password which would let them remove their mirror or remove the number of files that they are mirroring. Please just email me (I have already sent you an email and pm but suspect you have a lot of emails in your inbox!) Alex alex@davz.net Edit: I am also able to adjust it so that it has different weights for each mirror, so one mirror can appear twice as often as another.
Mooecow · 2005-01-03 07:38 PM · #10
h/o
cheyenne1212 · 2005-01-04 06:51 AM · #10
Do you have a control panel?
Dogtanian · 2005-01-04 02:28 PM · #10
Very nice, my server is at 25.02 GB and I dont mind atall
cheyenne1212 · 2005-01-04 05:46 PM · #10
Alex: Sure you can send more my way on that second link I just added. http://tsunamivideo.net/asian is my link I talked to them on the phone and told them I'm pushing 38Mbps wih a spike to 49, and they said that I migh tuse less that 20 or I might use 30, either way they said It won't affect my bill. So lets have at it. lol
alex-davies · 2005-01-04 08:30 PM · #10
I will try to add one of the download URLs tommorow and then send a few requests at it and see how well it copes! Alex
eservicesu · 2005-01-05 12:06 AM · #10
I had a tomsyer box, 2 days later i told them not to bill me next month. Hardware was great, uptime was great network speeds were horrible. - Eddy
alex-davies · 2005-01-05 01:55 PM · #10
300/min, 2800/hr load at the moment. Nothing like yesterday which peaked at over 400/min. Alex
Weppel · 2005-01-06 05:23 AM · #10
Please post here where to get the file, i'll make sure it's up in no-time.
Hadriel · 2005-01-07 10:53 AM · #10
Mine is added
gilbert · 2005-01-08 11:52 PM · #10
if i where you id just get rid of those 10 MB ones temporarily and also use DNS to do a mirroring system
vidahost · 2005-01-10 02:49 PM · #10
Edit the Apache config to increase the number of servers! You've reached the default limit so you won't be able to handle any more connections! (See the 0 idle servers, plus I know Apache's default :p) PM me if you'd like me to edit it for you.
Hadriel · 2005-01-10 06:44 PM · #10
I would say. Between just the 3 of us thats atleast 200mbit/s average. Hmm think your TP machine has a GiGBit port?
vidahost · 2005-01-10 08:34 PM · #10
Depends, if you're hitting the Apache limit you should increase the maxservers. I've just put a link to here on Slashdot, so hopefully some people will help. Could you make sure the new videos are getting around the other mirrors too, I'm at a constant 45mbit/sec which, unless theplanet agree to help me out too, is more than I can handle for a few days. They appear to have uncapped cheyenne1212's server to the full gigabit, so could you perhaps direct more traffic to his server and less to twobeds.com please - thanks.
vidahost · 2005-01-12 04:10 PM · #10
Me too - A2 exams starting next week - Maths, Physics, Computing
vidahost · 2005-01-15 07:34 PM · #10
It was me TP allowed an extra Terabyte You could change the links to just our two servers, cheyenne has an uncapped server and I've nearly 2Tb left for this month. I'm always sceptical of Corel.
Georgecooldude · 2005-01-01 08:41 PM · #11
I downloaded my videos from bittorrent.
cheyenne1212 · 2005-01-01 10:29 PM · #11
11.4 Mbps on my end now.
cheyenne1212 · 2005-01-02 12:19 AM · #11
5.57 here. Slowed down some. If you have windows you can create a new site guys then limit the bandwidth going to that site.
Isaac.Eiland-Hall · 2005-01-02 05:12 AM · #11
I do see some, although it does look like a somewhat small amount so far, yup... I'm glad I stumbled across this thread - it's a worthy cause! And it makes me think -- maybe we ought to organize an informal community to facilitate projects like this in the future -- maybe have a forum or something so people can suggest resources of interest, and those that are interested in setting up mirrors could do so... (I'm just thinking that there might be multiple causes that might want to offer striking content of large sizes, and trying to think ahead how a server owner might wish to support/mirror one cause, but not another...) Judging by the number of people mirroring -- would there be any interest in something like that? I wouldn't mind acting as a facilitator to help organize such a thing, but I also wouldn't mind supporting someone else's efforts, either.
Georgecooldude · 2005-01-02 03:17 PM · #11
I could setup a simple bittorrent tracker on my server and we could provide a torrent for the more advanced users. Most would go with a http download but those of us who are familar with bittorrent could download it from that link. Or do you still prefer using http and not bittorrent?
jheslop1 · 2005-01-02 04:37 PM · #11
It can't take that long with a macro surely?
DreamMaster · 2005-01-02 08:08 PM · #11
klcodec, Just read your PM. Thanks for offering your help although I think the demand for this videos woun't last that long, but if does it's good to know that I can count on your help
DreamMaster · 2005-01-03 01:25 PM · #11
Dogtanian, Ok thanks will add it in a moment. Thank a lot.
Dogtanian · 2005-01-03 03:02 PM · #11
Dream me 2 good way to test my servers
Dogtanian · 2005-01-03 04:04 PM · #11
I am not sure how I can get that stats from windows 2003 but so far this is what i got Bandwidth Total Bandwidth 740.09 MB Average Bandwidth per Day 740.09 MB Average Bandwidth per Hit 1001.12 KB Average Bandwidth per Visitor 3.03 MB
Hadriel · 2005-01-03 05:33 PM · #11
Apologize for the length. I wasn't able to read all the pages, but I am helping out a couple of the other large blogs with this stuff. http://www.rpgfilms1.net/Aceh_Indonesia.wmv http://www.rpgfilms1.net/AcehIndonesiaLongLink.asx http://www.rpgfilms1.net/AndamanNicobarMap.jpg http://www.rpgfilms1.net/asian_earthquake_long.divx http://www.rpgfilms1.net/IndoFaultMap.jpg http://www.rpgfilms1.net/IndonesiaTsunami.asf http://www.rpgfilms1.net/KenyaTsunami.asf http://www.rpgfilms1.net/KohLanta.asf http://www.rpgfilms1.net/patong_beach.wmv http://www.rpgfilms1.net/PenangBeachWall.wmv http://www.rpgfilms1.net/propagation.mov http://www.rpgfilms1.net/readThis.html http://www.rpgfilms1.net/ReadThisFirst.html http://www.rpgfilms1.net/sea-spills.mp4 http://www.rpgfilms1.net/sri_lanka_resort.wmv http://www.rpgfilms1.net/sri_lanka_tsunami.wmv http://www.rpgfilms1.net/Thai_beach.wmv http://www.rpgfilms1.net/Thumbs.db http://www.rpgfilms1.net/Tsunami.gif http://www.rpgfilms1.net/tsunamiphuket.wmv http://www.rpgfilms1.net/Wikipedia_e..._animation.gif http://www.rpgfilms1.net/PhuketPhoto...com/index.html http://www.rpgfilms1.net/PhuketHighR...PHUKET1282.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1241.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1242.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1243.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1245.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1247.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1248.JPG http://www.rpgfilms1.net/PhuketHighR...netBangkok.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1250.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1251.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1252.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1253.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1255.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1257.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1258.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1259.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1260.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1261.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1263.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1264.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1265.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1266.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1267.JPG http://www.rpgfilms1.net/PhuketHighR...s/IMG_1269.JPG Thats everything I am mirroring at the moment. PM me if you use any.
cheyenne1212 · 2005-01-03 07:48 PM · #11
lol h/o??
Jakeh_uk · 2005-01-04 06:56 AM · #11
only webmin, i use the CLI for pretty much everything
Dogtanian · 2005-01-04 03:08 PM · #11
Yeh and i found this site, which links them http://www.4m.net/showthread.php?t=147822
alex-davies · 2005-01-04 06:46 PM · #11
Quiky you should have found that about an hour ago the number of requests hitting you reduced by 2/3. If you need a further reduction please let me know. Cheyenne1212 I have increased your requests by 400% - let me know if you want to try some more Alex
alex-davies · 2005-01-04 08:36 PM · #11
OK, I am adding http://64.125.115.75.nyud.net:8090/Tsunami1.asf Not sure how well this will work but lets see! Alex
cheyenne1212 · 2005-01-05 12:10 AM · #11
I've got 3 Boxes with TP/SM and couldn't be happier. Great network, and great uptime. Even though support may be a bit long in answering your ticket sometimes they're always friendly
Dogtanian · 2005-01-05 01:56 PM · #11
I fink its calmed down now, ... and plus I got some forums to change the links to the radnom mirrors
Dogtanian · 2005-01-06 09:30 AM · #11
Yeh same as well easy peasy to host let us know the link and it will be up in no time
Georgecooldude · 2005-01-07 11:31 AM · #11
Alex, I just sent in a new link for the German video. Please can you PM me if you DIDN't get it as I recieved no confirmation on your site. it would have been from a d3hq.com domain
Jakeh_uk · 2005-01-09 05:06 PM · #11
Sorry Chaps, I've had to take my mirror down, i shifted around 950gb over the last week or so, i'm within my bandwidth quota for my server atm. for if u need to remove it etc, Link was http://ike.jakeh.net/~tsunami All the best with the videos. Jake
Hadriel · 2005-01-10 02:49 PM · #11
Time range: 1/10/2005 03:21:25 - 1/10/2005 12:45:41 Total Hits 57,333 Average Hits per Day 57,333 Average Hits per Visitor 4.23 Cached Requests 1,502 Visitors Total Visitors 13,553 Average Visitors per Day 13,553 Total Unique IPs 11,659 Bandwidth Total Bandwidth 272.36 GB Average Bandwidth per Day 272.36 GB Average Bandwidth per Hit 4.86 MB Average Bandwidth per Visitor So...8k requests in an hour...wow. [edit] Did I do my projecting math correctly? If I pushed 272.36GB in 9 hours that would be about 70mbit average?
klcodec · 2005-01-10 06:44 PM · #11
My 100mbit boxes wont be up until the 15th now otherwise I would be mirroring yesterday Sorry about that all, will mirror asap once the boxes are up! Later Chris
cheyenne1212 · 2005-01-10 08:36 PM · #11
I wonder whats up with all the spiking to? I go to 130Mbps then down to 15, hen 106Mbps then back to 20. lol
cheyenne1212 · 2005-01-12 05:51 PM · #11
Pushing out 93Mbps a sec right now. And yes definitely a big thumbs up to TP/SM for being so generous.
cheyenne1212 · 2005-01-15 08:12 PM · #11
lol I think the biggest part of the load is gone. I think split evenely between us, it would be about 30-40Mbps peak both sides.
DreamMaster · 2005-01-01 08:47 PM · #12
Yes I know that torrents are awesome but for some reason less techie people dont like them too much (lasiness factor) and I want as many people to see the videos as possible to scare them into contributing to the charities :-) Also keep in mind that the filer are only a couple of megabytes in size. Alot of people from this forum are helping mirror the files and it looks like I might be able to keep up with the bandwidth after all. If you have some spare bandwidth on your server and want to help mirror some files please download the videos from http://www.asiantsunamivideos.com/index2.html and contact me with the links.
DreamMaster · 2005-01-01 10:33 PM · #12
cheyenne1212, I am just about to upload the new site with more mirrors. I will shuffle the links a bit so that the load on your server decreases. Sorry for the delay
Isaac.Eiland-Hall · 2005-01-02 12:35 AM · #12
Okay, I don't think I'm doing something right... Here's what I have: (((STUFF))) indicated something I'm obfuscating... <VirtualHost 209.(((IP))).74> (((various settings all set by cPanel, for tsunami.eiland-hall.com))) <IfModule mod_throttle.c> ThrottlePolicy Volume 800K 1s <Location /throttle-me> SetHandler throttle-me </Location> </IfModule> </VirtualHost> <VirtualHost 209.(((IP))).74> (((various settings all set by cPanel, for tsunami.eiland-hall.com))) <IfModule mod_throttle.c> ThrottlePolicy Volume 800K 1s </IfModule> <Location /throttle-me> SetHandler throttle-me </Location> </VirtualHost> I've tried both of these, and when I go to tsunami.eiland-hall.com/throttle-me, I'm getting a 404, which indicates that maybe something isn't right... Ideas? :-) Meanwhile, I've got all ten videos out there if someone wants to add me down in the list of mirrors, I'll take a chance on not killing me server for now :-)
RossMAN · 2005-01-02 05:21 AM · #12
Good question but there are two catches to that amazing offer 1) $219 setup fee if you want $39/mo --or-- $0 setup with $75/mo 2) 4000GB is split between 2000GB in and 2000GB out. Otherwise it seems like a cost effective way. Maybe consider a ServerMatrix.com unmetered server? But they start at $199/mo.
Weppel · 2005-01-02 03:18 PM · #12
Have you reviewed this free package? Would make mirroring much easier for all of us.
DreamMaster · 2005-01-02 04:47 PM · #12
jheslop1, I'm doint it all manually at the moment in Dreamweaver.
Quiky · 2005-01-02 09:43 PM · #12
Go ahead and link mine; http://devas.content.phyrenet.net/videos/12srilanka.wmv http://devas.content.phyrenet.net/videos/KATC.wmv http://devas.content.phyrenet.net/videos/Tsunami1.asf http://devas.content.phyrenet.net/vi...tong-beach.wmv http://devas.content.phyrenet.net/vi...ka_tsunami.wmv 10mBit box, and those are all I can link for now. No gurantees that it will stay up.
Mooecow · 2005-01-03 01:26 PM · #12
sorry for the dowtime on weirdboys, i forgot i had it set to 25 gigs bw. i unsuspended it
DreamMaster · 2005-01-03 03:04 PM · #12
Picture this headlines: Hosting community helps distribute Tsunami videos I wonder how long before more news sites get this storry... edit: Dogtanian and cheyenne1212, I know that and I am extremely gratefull for that
lumbyjj · 2005-01-03 04:04 PM · #12
I'm doing around 30 here.. Wanting more.. Wanna see what the server can handle. It's not even noticing it now.. Yes I know it's not really CPU intensive, but still tis nice to know how much it can push..
eservicesu · 2005-01-03 05:34 PM · #12
Sorry for the wait guys i just got to download the tar and ill get that mirror up soon. - Eddy
Mooecow · 2005-01-03 07:54 PM · #12
i was going to have him pull my links but it seems like for me im not getting hit as hard so i edited that out to see if it was going to stay low.
cheyenne1212 · 2005-01-04 07:01 AM · #12
hmmm I don't know much about webmin. heres a program fro apache thats suppose to throttle your bandwidth for you. http://www.cohprog.com/mod_bandwidth.html
alex-davies · 2005-01-04 03:22 PM · #12
The health check script has been modified to check that the page is not an HTML page. Peak traffic was over 400 requests in 1 minute - thats 24000 per hour. Alex
Dogtanian · 2005-01-04 06:50 PM · #12
You can increase mine a bit if you want mines hardly doing nothin
kuremo · 2005-01-04 08:39 PM · #12
seems to be going at about 180 KB/s, which isn't too bad considering it's public. i didn't think it would work on large files, but it looks like it does (for now). guess nobody knows about it!
Isaac.Eiland-Hall · 2005-01-05 12:39 AM · #12
You know, I'm really not prepared to have yet another TS debate. I'm not defending them, and I realize nobody here is telling me I'm stupid to go with them, but it was my choice, and I'm happy.
alex-davies · 2005-01-05 01:59 PM · #12
Yes, it has died down. Also we have 1200 people who have download via bittorrent, that saving the mirrors 12,000 downloads! Alex
Georgecooldude · 2005-01-06 10:05 AM · #12
When the link to the new video is up send me a PM please and I will add it to my mirror! :-)
alex-davies · 2005-01-07 06:02 PM · #12
Your site was added fine. BTW here are the stats for the previous few days: Code: Day Number of visits Pages Hits Bandwidth
01-Jan-05 255 565 678 1.03 GB
02-Jan-05 1482 2677 3311 5.73 GB
03-Jan-05 11068 21542 24612 45.10 GB
04-Jan-05 11938 37254 48109 50.83 GB
05-Jan-05 25255 144252 150420 24.62 GB
06-Jan-05 50654 293440 299456 16.68 GB This includes a few hits to the other sections of my site but most of that is the mirror script. Alex
cheyenne1212 · 2005-01-09 05:45 PM · #12
I've used 1,420 GB in the last 5 days on my unmetered server.
cheyenne1212 · 2005-01-10 03:06 PM · #12
What are you guys using to get those stats?
cheyenne1212 · 2005-01-10 06:46 PM · #12
I dont know. lol Maybe but I doubt it. Maybe its just one of those weird things? its down to 113Mbps now.
vidahost · 2005-01-10 08:59 PM · #12
Heh, probably to do with the main website not being able to handle the load, or the SM Cogent network being saturated. Edit: I can't access asiantsunamivideos.com right now....now I can.....seems Apache is hitting its maxserver rate. Oh...almost forgot, don't forget to increase MySQL's max connections too, or we'll start getting some ugly errors.
alex-davies · 2005-01-12 06:06 PM · #12
Good Luck - I have had Maths (M1 today, C1 Monday, S1 Friday, C2 week today), ICT (1&2 tommorow) and Economics (1 on Monday, 4 two weeks today). What is computing like? I *hate* ICT - I should have done Physics. I got 120/120 in the coursework for AS yet still got an B overall (hence retakes!) Alex
Hadriel · 2005-01-15 08:45 PM · #12
My stuff is still up too. But haven't been watching bandwidth. I just know it went way down.
Georgecooldude · 2005-01-01 08:57 PM · #13
DreamMaster how many hits is your site getting? I have some spare bandwidth but I don't want to go over 150gigs
Mooecow · 2005-01-01 10:33 PM · #13
when you going to add the rest of the mirrors? and wow 11.4 , course 3 days after i remove the 100 port on my server since i didnt need that much lol.
cheyenne1212 · 2005-01-02 12:38 AM · #13
I don't think you'll get overloaded. I'm staying between 5 and 8 Mbps. Whats your os?
Isaac.Eiland-Hall · 2005-01-02 06:21 AM · #13
The first major problem with this is not the issues others have raised. The first major problem with this is that I bet nearly all, if not all of the mirrors are donating unused bandwidth. That is, it's not actually costing anything to donate. I, for one, and poor at the moment. I can't afford to donate money, so I'm left with donating time and any other sorts of resources I can come up with -- so this is perfect for me. What I think would be more helpful would be for someone to write a mirroring script, so server owners could sign up and donate a particular amount of bandwidth and traffic, and the script would handle the round-robin of sending users to the mirrors to download. That would be handy. Then, we could make use of unused bandwidth for good causes -- like the SETI screensaver, only providing downloads... But back to the server -- better to have donating mirrors than try and purchase a server by comittee.. Discussions on what to get, who has admin and everything else would quickly devolve into arguments, I suspect. It's a great idea in theory, but I'm afraid I don't like the things I suspect would happen... My two cents
DreamMaster · 2005-01-02 03:20 PM · #13
Georgecooldude, I'm trying to keep using http only at the moment because there are a lot of torrents with the videos, but if the load gets too high I might consider using it.
Mooecow · 2005-01-02 04:52 PM · #13
put a counter on the bottom of the site, i want to see how fast it goes up
DreamMaster · 2005-01-02 10:58 PM · #13
Quiky, Mirrors added. Tell me when you can't take the bandwidth anymore so that I don't have any dead links. Thanks for your help
stevey · 2005-01-03 01:33 PM · #13
http://extremetracking.com/open;ref2?login=asiantsu scroll down and you will see 450 sites linking
Dogtanian · 2005-01-03 03:05 PM · #13
lol hope it gets on cnn skynews BBC lol
lumbyjj · 2005-01-03 04:07 PM · #13
As you were. I am up to 55.1 Mb/s now..
eservicesu · 2005-01-03 06:06 PM · #13
ok sorry for the double post ill be PMing you the links shortly. It seems like the demand for these videos is growing alot eh? - Eddy
alex-davies · 2005-01-03 08:15 PM · #13
Hi Guys, I have modified a script called Doppelganger to fit our needs I can present the "back end". Firstly, you will need a password. Agustin (DreamMaster) will email all the mirrors he knows about - please wait until you either get an email from him or he posts here to say "if you haven't had an email please email me". Then, visit http://www.davz.net/mirror/mymirror.php and enter the full URL to your mirrored file (the URL that down loaders are directed to) and select which file it is. That will tell you the number of hits your file has had today and also allow you to change the max. PLEASE NOTE that this system has not gone live yet and I have not added all the videos to the system. When I have done this and Agustin has emailed you all you will be able to change it. At the moment it is set so you have to log in for each file - I will change this so once you are logged in you can update all your files that are on the same domain. Please bear with me while I do this! With many thanks for your generosity with bandwidth, Alex Davies
kuremo · 2005-01-04 07:02 AM · #13
pfft, why would you need a whole meg to yourself? i could tell you how with WHM/cPanel, but not sure with webmin. i would suggest mod_throttle on apache snert.com/Software/mod_throttle/
Dogtanian · 2005-01-04 03:24 PM · #13
My server is rebooting i got your server is using to much memory crap so I am rebooting hold on
cheyenne1212 · 2005-01-04 06:53 PM · #13
LOL SM isn't gonna like this. 68Mbps on a 20Mbps unmetered. lol
cheyenne1212 · 2005-01-04 08:52 PM · #13
I maxxed out my 1.5Mbit DSL connection @ 155KB/s
Isaac.Eiland-Hall · 2005-01-05 12:40 AM · #13
*sigh* TomSyer doesn't know my "router community name"... Is that even the correct term for it?
cheyenne1212 · 2005-01-05 02:12 PM · #13
Yeah its slowed down some. I'm still pushing out 30Mbps though.
DreamMaster · 2005-01-06 10:13 AM · #13
This is the link: http://www.asiantsunamivideos.com/vi...an-Tourist.wmv I need alex-davies to update the script though so that it can be selected in the Add-mirror form. But you can download the file now.
cheyenne1212 · 2005-01-07 08:13 PM · #13
I'm suprised the demand for these videos hasn't gone down.
DreamMaster · 2005-01-09 06:10 PM · #13
cheyenne1212, Wow that's a lot!!! I will be adding the 3 new videos right now. Alex Daves made some changes to the script that make adding new files a lot easier. Ohh yea and how ServerMatrix upped your port speed on your unmetered server just shows what an awesome company it is. Jakeh_uk, Sorry to see you go but you can rest assured that you did more than your fare share to help distribute the tsunami videos.
vidahost · 2005-01-10 03:07 PM · #13
Looks like Urchin.
vidahost · 2005-01-10 06:46 PM · #13
Yeah, they use machines with gigabit ports. I guess they're feeling charitable or something.
cheyenne1212 · 2005-01-10 09:21 PM · #13
I think the SQL connection, is on Alexes end. Pretty sure all dreammaster has to worry about is Apaches maxclients configuration. Hey dream can you post what your current apache status is?
cheyenne1212 · 2005-01-12 07:03 PM · #13
I've done 800GB so far today. I have a few tests coming in next week. Have a Trig test, Accounting II test, and a Programming II test.
Qwerty_KB · 2005-01-16 11:09 PM · #13
With that kind of domain name, you expect many people to randomly type that in their web browsers I guess I can also mirror some of them on my P4 100mbit line. I have at least 1TB to burn in 15 days Are those most of the tsunami videos out there?? Wow, already 43 pages for this thread.
DreamMaster · 2005-01-01 09:10 PM · #14
My server is sending 3 Gigs per howr but a lot of requests are being denied because it's capped at 10 Mb/s. With the mirrors that I added the problem is being aleviated. If you don't have too much bandwidth to spare then you can just host 1 fille but unless you have your own dedicated server I do not suggest doing that.
cheyenne1212 · 2005-01-01 10:35 PM · #14
Oh I don't care about the bandwidth being used. Max I ever got anyway on that server as a few hundred Kb a sec. I wouldn't care running at 15 or 20 Mbps for a while.
Isaac.Eiland-Hall · 2005-01-02 12:41 AM · #14
*sigh* Correction, I'd read about mod_throttle, but cPanel had an option for **modbandwidth**, which would mean that settings for mod_throttle are going to do jack (expletive)... *sigh* okay, I suppose I ought to go install mod_throttle first :-D
futurahost · 2005-01-02 06:24 AM · #14
Hello We can contribute with some 20 or 30 Mbps if this is still needed. Contact me by PM or Email Regards
Dogtanian · 2005-01-02 03:21 PM · #14
If managed say what they just did then I will be able to mirror all in about 15mins *hopes*
Dogtanian · 2005-01-02 04:53 PM · #14
yeh same here,
Georgecooldude · 2005-01-03 05:56 AM · #14
DreamMaster, Can you remove a few of my links and only leave the files under 3mb for now. I've had quite a bit of traffic since.
Dogtanian · 2005-01-03 01:35 PM · #14
bloody hell :| 5517 25.23% http://www.waxy.org/archive/2004/12/28/amateur_.shtml
Georgecooldude · 2005-01-03 03:06 PM · #14
Just wait till CNN or BBC link to you. Big bandwidth then.
DreamMaster · 2005-01-03 04:09 PM · #14
lumbyjj, Ok get ready
cheyenne1212 · 2005-01-03 06:07 PM · #14
Seems like it. I've been doing a steady 20-25Mbps the last 2 hours.
alex-davies · 2005-01-03 08:17 PM · #14
BTW if anyone wants to add further mirrors please do it at http://www.davz.net/mirror/index.php Thanks, Alex
alex-davies · 2005-01-04 07:03 AM · #14
If anyone needs to tempoarily drop the traffic to their server, just deny access to 66.98.218.34 and within 15 minutes your server will be removed from the pool. Allow access and within 15 minutes you will be back again. You will still only be allowed to go up to your max as set at http://www.davz.net/mirror/mymirror.php. Alex
alex-davies · 2005-01-04 03:28 PM · #14
Do you want a reduction in traffic? I can try to reduce the load as well as the total bandwidth if you need. Alex
alex-davies · 2005-01-04 06:54 PM · #14
Can I have the URL to your mirror (I dont have a list of nicknames --> urls or access to the original pms/emails you sent asking to be a mirror). Be aware that the traffic has died down for tonight. It is now at about 180 requests per minute. Expect that in 12 hours time you will have at least twice (and probably more) requests than you have now. With best wishes, Alex Davies
Quiky · 2005-01-04 09:09 PM · #14
Bwwahaha? I am setting up a account on their servers to help with the load. Since I pay them $90/month, the least they can do is help mirror the files.
DreamMaster · 2005-01-05 01:02 AM · #14
Isaac.Eiland-Hall, To update your cpanel stats more frequently go to WHM, under "Server Setup" click on "Tweak Settings", scroll down to "Stats and Logs" and type ".1" next to "Number of days between processing log files and bandwidth usage ". That will update the stats and bandwidth usage 10 times as often as with the default value of 1. Hope this helps
alex-davies · 2005-01-05 02:20 PM · #14
Its rising again. . . now at 350/min. But we have more mirrors now so it should not hit that many people. If anyone needs a reduction in traffic please email me straight away. Alex
Dogtanian · 2005-01-06 10:31 AM · #14
downloading now
DreamMaster · 2005-01-07 09:00 PM · #14
Hey everyone!! Just wanted to check how you are doing As you can see I added the the new video to the page and aparently the servers are able to handle the added bandwidth. I finally got my much needed rest yesterday, slept like 10 hours straight. I feel like I have a hangover even though I don't drink lol Even though I get alot of emails from people saying that they have donated or donated more after seeing the videos I want to show you the following link from a forum that I found looking at the referers from the site. It's really adicting to read the forum postings that you can find looking at the site's referer logs. "...and I spent half the day watching it over and over. I still am in shock - it made me decide to double the small contribution I ..." http://messageboardoflove.com/eve/ub...3&m=5171011102 I got my hands on another pretty powerfull video showing a lone man in the beach being engulfed by a huge wave (to his death) and the cameraman desperately shouting at him to run but the man is aparently is too shocked to do anything and just stands there totally paralised by the event and disapears beneath the this huge wave. Pretty amazing footage to say the least.
cheyenne1212 · 2005-01-09 06:17 PM · #14
Yeah I really appreciate them allowing the port speed opened up more.
cheyenne1212 · 2005-01-10 03:10 PM · #14
I sent you a PM vidahost, but disregard it I got it.
cheyenne1212 · 2005-01-10 06:48 PM · #14
you serious? Gigabit ports on SM machines? Dropped down to 15Mbps now. lol /edit Broke 2000Gigs in 7 days.
DreamMaster · 2005-01-10 09:23 PM · #14
cheyenne1212, Redhat Enterprise 3, P4 2.4Ghz 1Gb Ram 10Mbit nick. There was a problem with the script that prevented me from adding mirrors for the new files but it has been fixed now so I will be adding as many mirrors as possible to ease the load on you guys.
vidahost · 2005-01-12 07:12 PM · #14
I did my M1 retake today ( ), and a physics retake (very easy). Comptuing AS is easy. You could switch now and get an A. Seriously, there's nothing to it. Computing A2 is much more technical and in-depth, and to be honest it's boring me, I'm not into assembly and how the CPU works and stuff. You get to do a nice in-depth project though, which I'm doing in PHP. You're doing the new L6 maths, meaning you've got a much easier A-level than me. They brought in a new syllabus, splitting your pure into 4 modules as opposed to 3. You slackers cheyenne....heh, that's more than I've put out in the last week. Currently I'm projected to use under 3Tb, so the current balance of our loads seems spot on.
klcodec · 2005-01-17 12:35 AM · #14
My new 100mbit box is up, do you still need a mirror?
Host1Nor · 2005-01-01 09:17 PM · #15
I'll mirror some.
Mooecow · 2005-01-01 10:37 PM · #15
how much b/w you given a month total?
Isaac.Eiland-Hall · 2005-01-02 12:44 AM · #15
RedHat 9, but I id'd the root of the issue :-D *smacks self on head* (Well, I tried to post this message, but did so less than 90 seconds after last post, so it didn't work. MEANWHILE, I got mod_throttle installed, and it's up and running.. d'oh!)
Weppel · 2005-01-02 08:48 AM · #15
http://www.hotscripts.com/Detailed/13894.html This might be what you're looking for:
DreamMaster · 2005-01-02 03:22 PM · #15
Weppel, Thanks for the tip but I am not sure how I could set that up. I'm not really very techie
DreamMaster · 2005-01-02 05:02 PM · #15
Ok counter added...
cheyenne1212 · 2005-01-03 05:59 AM · #15
If you need to dreammaster, you can move my mirror links back to the front again. Traffic wasn't really hurting anything on my end.
alex-davies · 2005-01-03 01:56 PM · #15
Hi Everyone, I offered to mirror waveofdestruction.org myself as I had quite a lot (about 2TB) of transfer free but I am currently pushing about 40mb/sec accross two servers. I have just added another server to the pool which should help but I am rapidly running out of servers with loads of free bandwidth! If anyone has spare bandwidth and is prepared to mirror waveofdestrucion.org please let me know. I will pass you the rsync command that you need to add to crontab and ideally the extra virtualhost that will allow me just to add you to my round robin DNS. The website has about 700mb of video available for direct download. Please pm or email alex at davz dot net. With many thanks, Alex Davies
cheyenne1212 · 2005-01-03 03:06 PM · #15
Never know might see this on foxnews or ABC. lol
Mooecow · 2005-01-03 04:11 PM · #15
the CPU on my server is at 0.01
DreamMaster · 2005-01-03 06:13 PM · #15
Automated mirror management script on it's way thanks to alex-davies . Hold on guys, don't take your links down just yet because the script will be able to let you configure how much load you can take. If you PM'ed me please wait because I have a large backlog of them and a huge number of emails to reply to. Sorry for the delay, I'm working as fast as I can to manage the load.
Hadriel · 2005-01-03 08:24 PM · #15
What do you want us to put if we have no daily max?
kuremo · 2005-01-04 07:11 AM · #15
How do I know my password?
Dogtanian · 2005-01-04 03:33 PM · #15
Nah its not the bandwidth it was cos I was running appz at the same time and plus it hadnt had a good reboot in ages
Dogtanian · 2005-01-04 06:55 PM · #15
oh ok then I leave that be ?
cheyenne1212 · 2005-01-04 09:10 PM · #15
lmao I think my provider would kill me if I put more than 2Mbps past them.
lumbyjj · 2005-01-05 03:57 AM · #15
Seing as how they don't own the router/switch, I wouldn't expect them too. They don't have access to the switches as they are resellers..
cheyenne1212 · 2005-01-05 03:02 PM · #15
Maybe we can email Fox, CNN and MSNBC and have them put links to your site on their web sites. lol On second thought better not though. lol Would be a site though.
vidahost · 2005-01-06 11:41 AM · #15
Hi guys....I'm yet another mirror (twobeds.com) recruited by someone. I'm only pushing 3mbit/sec so that can be increased a little if you need it to be. I've even killed all the NASA mirrors I'm running to prepare for extra demand
vidahost · 2005-01-07 09:36 PM · #15
Is twobeds.com on the mirrorlist? I've got the latest vid, and I'm only pushing out 1mbit/sec and that's with all my other traffic too. I can take much more if you need it And yes, it is fantastic to see that we can show people this and make thousands of people realise its full effects. It's just astounding. Congats to everyone in this thread!
vidahost · 2005-01-09 07:48 PM · #15
Heh, 23mbit/sec just popped up, so I came here to see and bingo, the new videos are up
Hadriel · 2005-01-10 03:33 PM · #15
I download the raw logs and run them through WebLog Expert. Its does a LOT of stuff, what I post here is just the summary page. If you want to view the rest of what it can do you can see it at: http://www.rpgfilms1.net/stats
vidahost · 2005-01-10 06:49 PM · #15
cheyenne1212...did you tell them this was for the Tsunami? I might put in a ticket, asking if they can "let me off" extra charges if we go over, if that was the case. I suppose they wouldn't mind a bit of publicity on the homepage of ATV.com, seeing as the main site + at least 2 mirrors are running from their wicked network. Edit: Yeah, at least my machine with TP has a gbit NIC, just limited to 100mbit at the router level. I'd guess it's pretty hard to find dual-CPU boards without 1/2 Gbit ports these days, if not impossible.
DreamMaster · 2005-01-10 09:27 PM · #15
22:26:06 up 10:36, 1 user, load average: 0.40, 0.62, 0.59 89 processes: 82 sleeping, 4 running, 2 zombie, 1 stopped CPU states: cpu user nice system irq softirq iowait idle total 4.8% 0.0% 8.2% 0.2% 1.0% 1.4% 84.4% Mem: 1027484k av, 1016348k used, 11136k free, 0k shrd, 124868k buff 758368k actv, 117024k in_d, 20432k in_c Swap: 2040212k av, 492k used, 2039720k free 770312k cached PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND 26276 root 24 0 4392 4392 3240 S 1.0 0.4 3:16 0 httpd 18969 root 20 0 2508 2508 1344 R 1.0 0.2 0:00 0 restartsrv_name 2324 named 15 0 2808 2808 1712 S 0.2 0.2 2:30 0 named 2326 named 15 0 2808 2808 1712 S 0.2 0.2 0:39 0 named 18957 nobody 25 0 4492 4492 3340 S 0.2 0.4 0:00 0 httpd 18975 nobody 25 0 0 0 0 Z 0.2 0.0 0:00 0 httpd <defunct> 18979 root 20 0 692 692 588 R 0.2 0.0 0:00 0 ps 1 root 15 0 508 504 448 S 0.0 0.0 0:04 0 init 2 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 keventd 3 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kapmd 4 root 34 19 0 0 0 SWN 0.0 0.0 0:00 0 ksoftirqd/0 7 root 25 0 0 0 0 SW 0.0 0.0 0:00 0 bdflush 5 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kswapd 6 root 15 0 0 0 0 SW 0.0 0.0 0:08 0 kscand 8 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kupdated 9 root 25 0 0 0 0 SW 0.0 0.0 0:00 0 mdrecoveryd 13 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald 552 root 25 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald 553 root 22 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald 554 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald 555 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald 556 root 15 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald 557 root 15 0 0 0 0 SW 0.0 0.0 0:01 0 kjournald this is the output from the "top" command. How do I check apache's status?
cheyenne1212 · 2005-01-12 07:24 PM · #15
Asembly is something I don't think I'd be interested in. lol I've had VB.net and am doing C++ right now, and also know my way around with SQL. I also know some PHP If I keep going the way I'm going according to orbit I'm gonn ause 10TB by the end of the month but it keep moving up about 500GB ever day so at that rate I'll be at 20-30TB by the end of the month.
cheyenne1212 · 2005-01-17 02:46 AM · #15
I actually think the demand for mirrors is down now. Dreammaster switched his URL's to the corel distribution network which completely takes I'd say 90% load off of his server. I've gone from 50+Mbps to 2Mbps
DreamMaster · 2005-01-01 09:21 PM · #16
Ehaanaes, Thanks a lot!! Go here http://www.asiantsunamivideos.com/index2.html download the videos you want to mirror and send me the links. Keep a close eye on your bandwidth though and tell me if you later want to remove them.
cheyenne1212 · 2005-01-01 10:40 PM · #16
I get 2000 Gigs before I started hosting this I was only gonna use about 1.5gigs. lol I've been thinking about getting a unmetered server though from SM for stuff like this.
Isaac.Eiland-Hall · 2005-01-02 12:47 AM · #16
I've got the 10 videos out there on tsunami.eiland-hall.com. I didn't change the names - got them from one of the mirrors in this thread. Do you have any preference for a raw dir vs. me grabbing your HTML from that page? I can do either :-) I've got it set at 800K/sec at the moment - I'll monitor the server and if I think I can devote a little extra, I will, but I also host the downloads for a freeware game (simutrans, for the curious), so I want to make sure they aren't totally slowed either... :-) I've set 750Gb/mo limit, and I can guarantee that won't drop for January. We'll take a look at how it goes after that - I imagine this'll go for a couple of weeks or so, so that should be okay... (I only get one terrabyte/mo... heh.)
Mooecow · 2005-01-02 12:07 PM · #16
im mirror 3 and im pushing a constant 2.4ish , whats everyone else pushin?
Dogtanian · 2005-01-02 03:23 PM · #16
its a php script so basiclly I fink all you need is php and mysql
Mooecow · 2005-01-02 05:41 PM · #16
wow thats alot
Omega-Mark · 2005-01-03 06:01 AM · #16
as said earlier in the thread bittorrent is a good way to go. also on the topic of bittorrent, does anyone know of a php script where you can actually seed from a website. which isnt webseed (as it doesnt work)
Weppel · 2005-01-03 02:16 PM · #16
I'm pushing a constant 10mbps right now (my maximum). I won't be able to install or configure any mirror script at this very moment as i have loads of other work to do first. If somebody else is prepared to install a mirror script, please do msg DreamMaster
DreamMaster · 2005-01-03 03:14 PM · #16
3267 uniques per hour now. Ohh boy !!! 16:00 - 16:59 3267 9.51% http://extremetracking.com/open;unique?login=asiantsu
Dogtanian · 2005-01-03 04:12 PM · #16
lol woah now that is nice well now remote desktop is refusing to serve me but that isnt going to stop me
Dogtanian · 2005-01-03 06:17 PM · #16
My server is maxing out on connections but it can it can easy take it
alex-davies · 2005-01-03 08:27 PM · #16
The default with be very very high (like 999,999,99) so you are welome just to leave it as effectively unlimited. This is only for those that need to "cap it". Thanks, Alex
alex-davies · 2005-01-04 07:13 AM · #16
Sent via email. Anyone else please send me an email, with your link URL to daviesalex at gmail.com or pm me. Alex
Dogtanian · 2005-01-04 03:43 PM · #16
note its backup now
alex-davies · 2005-01-04 06:56 PM · #16
They will get a lot more tommorow at peak time! Alex
Isaac.Eiland-Hall · 2005-01-04 09:15 PM · #16
Okay, I have a stupid question... I will show how much of a server n00b I am here... How do you see live traffic? cPanel doesn't process stats immediately - and that's different anyway... Just a pointer to the command is probably all I need... I've googled a little bit, but it's not readily apparent... heh.
cheyenne1212 · 2005-01-05 04:13 AM · #16
Maybe ask them in that ticket to have them open a ticket with savvis to get the router address? lol
Dogtanian · 2005-01-05 03:08 PM · #16
This forum would be famous lol lets do it
DreamMaster · 2005-01-06 11:54 AM · #16
vidahost, We need all the help that we can get! Expected peak uniques per hour for the site today are 15,000 and probably 30,000+ downloads per hour. And I haven't even posted the link to the new video wich is bound to generate some huge interest. One thing that worries me a bit is that I don't know how much the Dual Xeon 4GB RAM server running the mirror script can hold. We might need to load balance that too if we break 40,000 downloads per hour. Man are we pushing some extreme bandwidth or what !!! Thanks for staying aboard the boat with me :-)
cheyenne1212 · 2005-01-07 09:47 PM · #16
Are you gonna put up that video your talking about dreammaster? I think I saw that video your talking about on Foxnews the other night. I couldn't imagine what it would be like standing there watching a wave like that come in.
cheyenne1212 · 2005-01-09 08:02 PM · #16
Yeah I can tell. lol Currently pushing out 73Mbps
cheyenne1212 · 2005-01-10 04:25 PM · #16
Total Hits 1,328,307 Average Hits per Day 166,038 Average Hits per Visitor 6.80 Cached Requests 28,552 Visitors Total Visitors 195,213 Average Visitors per Day 24,401 Total Unique IPs 150,220 Bandwidth Total Bandwidth 1749.99 GB Average Bandwidth per Day 218.75 GB Average Bandwidth per Hit 1.35 MB Average Bandwidth per Visitor 9.18 MB
Hadriel · 2005-01-10 06:50 PM · #16
I think you can log into Orbit and check out the machine stats. In there it will list the network card I think.
cheyenne1212 · 2005-01-10 09:35 PM · #16
Do you have WHM/Cpanel?
sightz · 2005-01-12 07:24 PM · #16
I'm sure those following this interesting thread about a huge distributed-bandwidth project are thrilled to hear about everybody's exams. I bet there must be a way people can start their very own thread, perhaps in the lounge, and talk about exams and school as much as they want.
eservicesu · 2005-01-17 08:24 AM · #16
yeah ive only used like 200gb this month. It looks like they are slowly becoming "standard" videos and not ultra popular videos. ill keep mirroring them till you say i dont need to DreamMaster. - Eddy
Host1Nor · 2005-01-01 09:26 PM · #17
I will.. Just have to ssh to my server and setup a mirror on it. I'll PM you with the links when done. Worthy cause. I'll mirror them all. Got a load of bandwidth spare anyway. Will monitor it heavily though. How many visitors do you have at a time right now? And which site linked to you if i may ask?
DreamMaster · 2005-01-01 10:41 PM · #17
I have 1200Gb from a ServerMatrix server. Ok back to adding mirrors...
cheyenne1212 · 2005-01-02 01:01 AM · #17
If your worried about bandwidth this would be the time for servermatrix's matrixtreme unmetered servers. lol
jheslop1 · 2005-01-02 02:07 PM · #17
705 kb/s on my empty 2tb out NAC server and 4.76 from my unmetered 20Mbit server.
Weppel · 2005-01-02 03:27 PM · #17
As i've said in my PM i'd be willing to install and set it up on your server if you can't do it.
Dogtanian · 2005-01-02 05:46 PM · #17
Blimey thats gone up loads 807 :| theres more then my site ever done
cheyenne1212 · 2005-01-03 06:05 AM · #17
I see how bit torrent would be good for helping to keep bandwidth usage down, but I would never use bit torrent to download anything. It takes to long to get anything going with it. I tried downloading a 20MB file once that hat 347 seeds and it took me 30 minutes to get to 30KB a sec on my 1.5mbit connection at home.
Hudson Digital · 2005-01-03 02:27 PM · #17
Good Afternoon Everyone! Anyways, here's an update: Mirror #4 - Pushing 17.8 with peaks of 52
DreamMaster · 2005-01-03 03:17 PM · #17
This website is bringing me a huge number of hits: http://www.flabber.nl/ Can anyone tell me what language it's written in?
DreamMaster · 2005-01-03 04:21 PM · #17
Mooecow, I made some rearangements. Tell me if the load goes down.
cheyenne1212 · 2005-01-03 06:19 PM · #17
Anyone know of a good way to montor connections to a server thats running windows server 2003 standard edtion?
DreamMaster · 2005-01-03 08:37 PM · #17
Thanks for all your help alex-davies and to all those that are mirroring files. I will try finish the script admin stuff as soon as I can. I'm not ignoring your PM's and emails, I just have a huge queue of them...
alex-davies · 2005-01-04 09:32 AM · #17
I would imagine that you will rapidly see a spike in traffic - please let me know if you don't. I have "weighted" it so you get more traffic than the other mirrors. If you want more please pm me. Alex
kuremo · 2005-01-04 03:48 PM · #17
I might need a bit of a reduction. kuremo.net is getting about 5GB (3500 unique) per hour right now, and that's with some limits. For some people I'm sure that's nothing, but my server is horribly slow. I was looking for around 2 GB per hour if that's possible. I tried using mod_throttle but it doesn't do what I thought. Thanks!
topgun · 2005-01-04 06:56 PM · #17
my two have all gone right down from 30mbit each down to 5mbit. Cheyenne1212 must be taking it all himself. Cheyenne1212 dont you think it would have been wiser to donate that $250 rather than spend it on a server just for this which isnt really needed?
cheyenne1212 · 2005-01-04 09:19 PM · #17
Very crude way to do it is with netstat just type in netstat netstat -a or netstat -an or just plain netstat whill show you current connections to your box. However it will not show you Bandwidth going out etc.
alex-davies · 2005-01-05 05:21 AM · #17
What a silly boy. Lets prove him wrong - what is the URL to your files? As for MRTG, I use http://forum.ev1servers.net/showthre...highlight=MRTG to install it. I never could get it working following the instructions. The results can be seen at http://srv02.info-world.com/mrtg/. Alex
cheyenne1212 · 2005-01-05 03:23 PM · #17
lol if we got on a few big news sites like that I wouldn't be suprised if every single one of us got knocked down from the load. lol We'd be talking about millions of peole. lol
DreamMaster · 2005-01-06 11:56 AM · #17
Also if you type "tsunami videos" in yahoo you will find the site at number 10 !! and it's pretty high up in google too.
DreamMaster · 2005-01-07 10:30 PM · #17
cheyenne1212, Yes it's the same one they showed on foxnews. The quality is not very good though but it is worthwile to show nontheless.. http://www.asiantsunamivideos.com/vi...e-Khao-Lak.wmv
DreamMaster · 2005-01-09 11:09 PM · #17
Hehe, looks like I got your attention Can you guys handle the current load or do I need to seek more mirrors?
cheyenne1212 · 2005-01-10 05:06 PM · #17
Hmm somethings happening. My B/W has dropped from 70Mbps to 17Mbps
cheyenne1212 · 2005-01-10 06:51 PM · #17
Yeah I told thier VP of Network Engineering that I've been helping to distribute tsunamivideos and if he wouldn't mind uncapping my port a bit. He told me it would be possible to hit 100Mbps burst, but he never mentioned Gigabit speeds. lol This is unmetered so I'm not worried about overages. Looking in orbit but all it says about a port is 20Mbps unmetered nothing about gigabit ports.
DreamMaster · 2005-01-10 09:39 PM · #17
Yes. Ok here are the stats: Current Time: Monday, 10-Jan-2005 22:37:03 UYT Restart Time: Monday, 10-Jan-2005 21:30:20 UYT Parent Server Generation: 3 Server uptime: 1 hour 6 minutes 43 seconds Total accesses: 144 - Total Traffic: 49.8 MB CPU Usage: u.04 s.12 cu0 cs0 - .004% CPU load .036 requests/sec - 12.7 kB/second - 354.0 kB/request 24 requests currently being processed, 0 idle servers
cheyenne1212 · 2005-01-12 08:43 PM · #17
And maybe you could of started another thread to compalin about the current topic of this thread which probably has no connection to you whatsoever. But you decided to post here. Whatever floats your boat though.
Weppel · 2005-01-17 06:10 PM · #17
I will be removing all the files in 24 hours from my server (harvester.rsvmedia.com) as the mirror is no longer needed according to the traffic and hits i'm getting over the last few days. It's been fun guys, and it was my pleasure to host these videos. Click here for my traffic graph, I started mirroring halfway 2nd of January. Take care!
dkitchen · 2005-01-01 09:26 PM · #18
Just in case, if people are hotlinking to your videos and stealing your bandwidth, you might want to enable hotlink protection. Dan
Mooecow · 2005-01-01 10:42 PM · #18
i have a p4 from SM edit: orbit would show this type of traffic correctly right?
Isaac.Eiland-Hall · 2005-01-02 01:19 AM · #18
Well, even if I had an unmetered server, I'd still want to throttle the bandwidth so my other sites didn't go down if too many requests came in, so I think you're missing the point of it... :-) I have a 10Mbit connection, and if I throttle that to 8Mbit, then that guarantees 2Mbit for the rest of my sites... I think that's a good call, since I don't have much out there. :-) And as far as the unmetering goes, I believe that would refer to the monthly traffic, which I already set at 750Gb, which I think is rather a lot. :-P
DreamMaster · 2005-01-02 02:13 PM · #18
Hi Guys. I just added another mirror to help ease the load on you. Thanks to Weppel for this one. If your mirror is getting hammered too much just tell me and I can shuffle the links a bit to try to ease the load. Thanks again to all
DreamMaster · 2005-01-02 03:28 PM · #18
Dogtanian, I'll try to take a look at it but don't have much time. I'm answering a lot of emails and PM's and setting up mirrors. I only slept 5 hours yesterday, really tired...
Georgecooldude · 2005-01-02 05:59 PM · #18
When I click on that tracker thing at the bottom nothing happens. How are you guys seeing the hits?
Omega-Mark · 2005-01-03 06:11 AM · #18
that is pretty bad. yesterday has probably been my best when i took a 100mb and a 600mb i had them both within 2 hours. but yes it does take quite a while to build up speed. but it would be easy for him to monitor his usage.
Dogtanian · 2005-01-03 02:29 PM · #18
So far mines doing none I dont think dream added my mirror yet
Dogtanian · 2005-01-03 03:18 PM · #18
:| and my server has liked used 122mb www.darkfox.info/logs/ user: logs pass: dogs lol
cheyenne1212 · 2005-01-03 04:30 PM · #18
I'm at 6Mbps
Dogtanian · 2005-01-03 06:21 PM · #18
lol and thats what I am trying to find my server is web edition so far I get IIS to log the users etc.. and then I use WebEperxt to get somthing like this, http://67.111.205.10:255/
alex-davies · 2005-01-03 08:42 PM · #18
We are, as far as I am aware, ready to go. I have added all the current mirrors so all you need to do now is change the "Mirro" links to http://www.davz.net/mirror/download.php?package=1 for video 1 http://www.davz.net/mirror/download.php?package=2 for video 2 http://www.davz.net/mirror/download.php?package=3 for video 3 All you need to do is email all the mirror people with the password that I have just sent you so they can adjust their daily limit. The default is unlimited. With many thanks, Alex
Georgecooldude · 2005-01-04 10:16 AM · #18
alex-davies, I sent you a PM about my links. I would prefer not to use more than around 7mbit so maybe u could "weight" it against the other servers so its slightly down the priority list. thanks.
alex-davies · 2005-01-04 03:49 PM · #18
Please email me alex@davz.net if within an hour you have not fallen to around the 2GB mark. Thanks, Alex
Weppel · 2005-01-04 06:57 PM · #18
I'm pushing a constant 10mbps for 40% of the day now, check it out: http://www.rsvmedia.com/bw.png The dips in the downloads must be on your side, as this is the only traffic this machine gets (it normally uses 3gb of it's 1000gb allowed each month) Anyway, i've only burned 'bout 150-200gb, so keep it coming!
topgun · 2005-01-04 09:20 PM · #18
Only one way to find out . Seriously, what can they do apart from remove the files? It's also funny moving several TB on your personal webspace.
cheyenne1212 · 2005-01-05 05:47 AM · #18
Forbidden You don't have permission to access /mrtg/ on this server. thts what i get visiting the http://srv02.info site.
Dogtanian · 2005-01-05 03:25 PM · #18
and the amount people trying to ddos us
Hadriel · 2005-01-06 11:59 AM · #18
I am ready to mirror that new film. just let us know when the script is ready.
cheyenne1212 · 2005-01-07 10:36 PM · #18
Yeah thats it. Poor guy out there never had a chance. Guess he was just awestruck looking at that wave.
cheyenne1212 · 2005-01-09 11:57 PM · #18
I'm good here. Me peaks about 85, right now staying at 77, average is 42.7Mbps.
Hadriel · 2005-01-10 05:07 PM · #18
The main site is barely loading for me now. People probably can't get to the links.
vidahost · 2005-01-10 06:54 PM · #18
Log in to the server and poke around the NIC config....hmm, I thought Orbit has info on the motherboard etc too?
cheyenne1212 · 2005-01-10 09:43 PM · #18
hmmm Thats not a bad load only 24 requests. I'm doing 134 at the moment. You might increase your idleservers though in your .conf file
vidahost · 2005-01-12 08:54 PM · #18
It was only a few posts of friendly banter between people working hard to keep their websites up. Or have you not heard of quick mini-discussions? Sheeshkabob!
alex-davies · 2005-01-17 06:12 PM · #18
Thank-you very much for your help. Thats a nice graph you have - is that a custom version of MRTG or something else? With many thanks, Alex Davies
DreamMaster · 2005-01-01 09:32 PM · #19
Ehaanaes, I got linked from waxy.org. Check out the last post and you'll see my link there. That site is taking a huge amounts of traffic and had to take down the links to the videos after transfering 400Gb in one day. My site is getting about 2,000 hits per hour right now wich is not that much if it wasn't for the videos because they consume a lot of bandwidth.
Host1Nor · 2005-01-01 10:43 PM · #19
i have more than enough.
RossH · 2005-01-02 01:33 AM · #19
I put it on my 100mbit dual xeon server (no point in ever having a 10mbit connection) and it's not eating up to much bandwidth at all.
cheyenne1212 · 2005-01-02 02:17 PM · #19
I hit 12.8 for a while. lol I'm pushing 8.5 right now. Don't worry about moving me around though dreammaster. This old beast of a server can handle the load.
DreamMaster · 2005-01-02 03:30 PM · #19
Weppel, Ok I could really use some help, will contact you in a few.
Mooecow · 2005-01-02 06:12 PM · #19
click on summary
ethan · 2005-01-03 07:54 AM · #19
Hi, If you still need a mirror script, I've written one. It's available at: http://myfile.sent.com/mirror.php.gz It's pre-configured with the existing list of mirrors, but if you need help using it, just PM or email me.
DreamMaster · 2005-01-03 02:31 PM · #19
My site is starting to make it into the news. I just gave an interview for the biggest newspager in my country and they will be publishing the article shortly. I don't know how much longer the mirrors are going to hold if they are under such load. If the mirrors go down, the whole site looses it's purpose Weppel, no worries. I appreciate all the help you have provided me.
Dogtanian · 2005-01-03 03:20 PM · #19
that site is a blog written in php so as i see it
Hydrogen · 2005-01-03 04:33 PM · #19
Pushing a steady 9mbps atm
cheyenne1212 · 2005-01-03 06:23 PM · #19
Your sites not getting maxed out is it? cause it tooke me a couple minutes to load your page. lol
Hudson Digital · 2005-01-03 09:29 PM · #19
Hey Mirror 3. Check your links. They're redirecting to your homepage (weirdboys.com) without playing the video file. Perhaps you have an anti hot link configuration running that is blocking www.asiantsunamivideos.com site. Let us know if you need help.
alex-davies · 2005-01-04 10:22 AM · #19
It is done. I would be suprised if you got 7mbit; please let me know if you do. I can weight it but only if I am asked to increase/reduce load. With many thanks, Alex
Quiky · 2005-01-04 04:48 PM · #19
After killing the Dallas box, I got devas.content.phyrenet.net up on a new server.. I have set a limit on the transfer right now(210gB) to prevent it from overloading the box and making my other sites unavailible.
Dogtanian · 2005-01-04 06:59 PM · #19
I only burned out 30gb, but this server is only for this month only soz free managed server
Isaac.Eiland-Hall · 2005-01-04 09:34 PM · #19
Well, okay, then how do you guys know what's going out? :-D I've not had a real reason to need to know this until now, but Alex is asking how much I'm pushing right now so he can make sure I won't get creamed during the next peak... (I originally wrote "the next flow, in this ebb and flow" and then realized that might appear to be written in bad taste... but I also thought it was amusing enough to write about here, so what can I say?)
alex-davies · 2005-01-05 05:50 AM · #19
Sorry forogot I lock accecss down to my IP only Graphs: http://www.davz.net/general/temp/index-day.png http://www.davz.net/general/temp/index-week.png Alex
cheyenne1212 · 2005-01-05 03:33 PM · #19
lol Well I'm behind that Riverhead system or whatever it is. So I might get DDOS for a few minutes, but then that system kicks in and cleans the traffic
vidahost · 2005-01-06 11:59 AM · #19
I guess I shouldn't link to it from my Page rank 3/4/5 sites then The script....what exactly does it do? I'm sure me/others on here would help to finetune it. The latest video is on my server, or will be shortly...URL: www.twobeds.com/ [file name] - feel free to add it to the list. It's yet another TP server, they must be loving us
Dogtanian · 2005-01-08 08:41 AM · #19
and I think my server may be dead, lol I fink managed has repo it lol
DreamMaster · 2005-01-10 06:01 AM · #19
I got a new video that is making headlines around the world. It is even featured on the front page of cnn.com http://edition.cnn.com/2005/WORLD/as...ami/index.html I tried to host it with my own server and that was a big mistake because I nearly lost contact with it and had 30 minutes of downtime trying to get the load back down. If you can, please host the video so that I can put it on the site as soon as possible. http://videos.asiantsunamivideos.com/Indonesia-Roar.wmv
cheyenne1212 · 2005-01-10 05:12 PM · #19
I think hes having the same problem I had with to few servers available for apache for the number of requests he has coming in.
Hadriel · 2005-01-10 06:57 PM · #19
It should. Something like Server Hardware...or similar I remembering able to see the board info for sure.
Quiky · 2005-01-10 10:51 PM · #19
I cant really send out much more on my box.. I have no idea what the true usage of my server has been; Webalizer reports 220gB, while Plesk reports 190gB, then Mrtg reports "Pasta". Adelphia mirror might be up soon... Depends on how long their "instant setup" takes... And to quote the technicians from adelphia.. And I swear to god I am not making this up: And a screen-shot to prove it: http://quiky.phyrenet.com/pics/chatlogs/smart_techs
alex-davies · 2005-01-13 04:17 AM · #19
Same here. Got a value for mu that was greater than 1 for question 5 (Edexcel) and spent over 45 minutes doing it 6 times. I made the fatal assumption that a was constant when I actually should have used UVATS to find it. But other than that it was fine so I hope to be over 90%. Well not exactly. I did the "old" AS last year but we switched simply to save us having to do M2. C1 was the silliest exam I have ever done! Alex
Weppel · 2005-01-21 09:50 AM · #19
That's gbgraph, an add-on for MRTG. Check it out at http://gbgraph.menthenberg.nl/
pstation · 2005-01-01 09:32 PM · #20
i'll mirror too, http://67.19.189.84/tsunami/ if it uses over 1.3 TB of BW i will take it down however
TheTrance · 2005-01-01 10:44 PM · #20
interesting videos
cheyenne1212 · 2005-01-02 01:36 AM · #20
Yeah your right. I didn't think about if the pipes full that means none of the other sites on your server are accessible. I'd say that dreammaster definitely has a lot of mirrors now. lol I'm counting about 8. I'm still staying at a constant 5-7 mbps though. guess mirror #2 is kinda popular :p /edit Yeah RossH I have it on my dual xeon 100mbit server and I have plenty of room to go.
datums · 2005-01-02 02:39 PM · #20
This is great, the WHT community coming together. Are the adsense commission going to be part of your donation? With the amount of traffic you are getting I am sure some of those clicks to "charities" should have commission. I would suggest removing them, due to the amount of scams (email) that have been arising in relation to this tragedy. I really do hope visitors are making donations. The videos are a bit disturbing.
Dogtanian · 2005-01-02 03:30 PM · #20
Yeh i no, I am only mentiong it looks like php and mysql I should have a mirror in a meanwhile if I can get this server fixed
Georgecooldude · 2005-01-02 06:38 PM · #20
I've noticed an increase in my site traffic. http://www.d3hq.com/download.php?cat=28&ref=0&subref=0 The link has only been there for 40mins or so. Already quite a few downloads and it might be conicidence by I also have alot more users viewing my site.
Dogtanian · 2005-01-03 08:05 AM · #20
Dream do you still need mirrors I got 500gb to burn so let me know if you need a mirror, yeh and I dont really like it as well, lol at stats Daily Unique: Totals: Today 10107 / 03 Jan, Mon, 2005 Yesterday 4956 / 02 Jan, Sun, 2005 Average 7531 Visitors per Day Highest Day 10107 / 03 Jan, Mon, 2005 thats hugh
Dogtanian · 2005-01-03 02:35 PM · #20
yeh and get mine up, i see if I can get some friends up what paper did you get interviewed for ?
cheyenne1212 · 2005-01-03 03:20 PM · #20
Maybe German?
Dogtanian · 2005-01-03 04:41 PM · #20
How would I find out what i am pushing at? on windows 2003 so far i used 2gb of b/w
Dogtanian · 2005-01-03 06:25 PM · #20
well I keep getting Opatetion timed out lol oh well remote desktop is out for me
Jakeh_uk · 2005-01-03 09:43 PM · #20
Definately worth mirroring these for the cause All Files Mirrored at: http://ike.jakeh.net/~tsunami Jake
Hadriel · 2005-01-04 10:41 AM · #20
Can I get the password please?
eservicesu · 2005-01-04 05:09 PM · #20
hmm it seems like ive only used a few mb of bandwidth. If you need to have my Mirrors up there so it gets more hits, i have about 800-900GB of free bandwidth so please use it! - Eddy
Weppel · 2005-01-04 06:59 PM · #20
I'm not even sure how you do that, i just checked the Cogent lines in Orbit, all three are maxed out at 1gbps (something else that's on my mind, how the hell can everyone still be happy about those unmetered machines when they're on a network that's 100% maxed out?)
Isaac.Eiland-Hall · 2005-01-04 09:36 PM · #20
(If it makes a difference, I have RedHat9 - and am running cPanel, as it happens)
cheyenne1212 · 2005-01-05 06:01 AM · #20
So now when you installed these did you have to put in your community router? I tried installing mrtg earlier today on my SM box but couldn't cause SM said they don't provide anyway for me to have a public RTG graph on my website.
Dogtanian · 2005-01-05 03:34 PM · #20
well I am on windows 2003 web edition with out no firewall oh nos lol well my server is going at the end of the month thats what you get for shouting at managed
Dogtanian · 2005-01-06 12:06 PM · #20
woo,
Quiky · 2005-01-08 12:40 PM · #20
Statistics report for devas.content.phyrenet.net: Code: Day Hits Files Pages Visits Sites KBytes
4 5177 3933 34 12 1883 33,943,672 5 6932 5022 65 28 2287 43,629,639 6 4844 3357 28 17 1429 39,591,081
7 5600 3951 16 7 1721 39,778,371 Total KBytes 151,980,301 Yikes?
Weppel · 2005-01-10 06:35 AM · #20
Hey Guys, anyone know who this ip is? 213.255.230.129 He's requesting the file over a 75 times on my server, i'm not sure who or what he/it is, but it's pissing the hell out of me.
Hadriel · 2005-01-10 05:14 PM · #20
That could be it. I also noticed that the script wasn't updated to let me add the new movie to it. Is it being grabbed right from his site?
cheyenne1212 · 2005-01-10 07:00 PM · #20
It does but this is all it says
cheyenne1212 · 2005-01-10 11:00 PM · #20
lol he obviously has no idea what hes talking about.
vidahost · 2005-01-13 12:30 PM · #20
I did that too. To keep o/t, ummm, how's the sites/servers holding up?
Mooecow · 2005-01-01 09:33 PM · #21
ill do it , i have around a terabyte to burn. You have an AIM s/n? Id like to be able to IM you to have it pulled if your capping my line.
DreamMaster · 2005-01-01 10:47 PM · #21
Mooecow, Orbit should show the amount of traffic correctly, I'm using that to monitor mine. If you want to mirror files just go to http://www.asiantsunamivideos.com/index2.html download the files and contact me with the link to them so that I can add them on the site. The traffic to the site just keeps increasing and I don't know how long the mirrors are going to stand.
SeeServers · 2005-01-02 01:48 AM · #21
Try contacting UES Mirroring System, there hosting lots of Tsunami vids, http://source.candc.mirror.unitedemailsystems.com
DreamMaster · 2005-01-02 02:44 PM · #21
datums, The adsense commissions are going to the red cross, $40 raised so far. You are right though about the scams, I may take it down because that really does worry me.
Georgecooldude · 2005-01-02 03:32 PM · #21
Weppel I had a quick look at that php script. I only look breifly so Im not sure about this. But are you able to setup "catogories" for the links to go in? If not then I would probably need to be modified a little bit for all 10 videos
lumbyjj · 2005-01-02 06:45 PM · #21
I'm only getting around 8.6 Mb/s... I was hoping for more.. Wanted to try out this new dual opteron with AMD 64 bit...
Georgecooldude · 2005-01-03 08:58 AM · #21
Dogtanian, I am going to have to pull out soon. Maybe you could take my place?
DreamMaster · 2005-01-03 02:35 PM · #21
Dogtanian, Thanks for your help. I'm extremely bussy but I'm working on adding your mirrors right now.
topgun · 2005-01-03 03:21 PM · #21
the language is Dutch
Hydrogen · 2005-01-03 04:41 PM · #21
in a period of 10 hours: $ grep 'tsunami' access_log | wc -l 26469 o_O
cheyenne1212 · 2005-01-03 06:27 PM · #21
lol I foudn a nice program called surfstats that I'm playing with now. I can see which files have been requested the most, how many views, etc. So far I've had 13,173 Unique people downloading the files from my site.
Mooecow · 2005-01-03 09:44 PM · #21
wowa didnt notice that. Ill get on it
BiGWill · 2005-01-04 10:42 AM · #21
wow.... what a great response from all of you guys - i'll mirror some too to help as much as i can btw. great work alex-davies! very nice script!
cheyenne1212 · 2005-01-04 05:12 PM · #21
I just added my unmetered box to the list of mirrors. I have a ticket in with SM but currenly on my 20Mbps box I'm pushing 38Mbps. lol
cheyenne1212 · 2005-01-04 07:01 PM · #21
Topgun: It was only $200 for the server But I plan on starting to host a few accounts in a month or so and was planning on using a SM server for it. I never had any good experience with WHM/Cpanel so I though this would be a good time, to go ahead and get the server and play with it a bit before bringing in clients. This way gives me some time to learn about cpanel and what not.
cheyenne1212 · 2005-01-04 09:38 PM · #21
Well our provider who we rent our Dedicated servers from has MRTG graphs set up for each server so we look at those graphs and know. you could set up a MRTG on your computer. http://people.ee.ethz.ch/~oetiker/webtools/mrtg/ That would show you in and out. /edit Whos your Dedicated provider?
alex-davies · 2005-01-05 06:03 AM · #21
No. It just monitors my network card, cpu etc. Alex
cheyenne1212 · 2005-01-05 03:37 PM · #21
lol Get a server with TP or SM. I've been extremely happy with them.
DreamMaster · 2005-01-06 12:20 PM · #21
vidahost, Actually you should link to it because given the number of links it has now has reached "authority status" and actually benefits you if you link to it. That's why a lot of SEO's link to dmoz.org yahoo.com etc. The script is actually a modified version of Droploader (I think), nothing fancy but it does the job right. Hehe The Planet must really love us since we are probably forcing them to reschedule their planned network upgrades... hehe
cheyenne1212 · 2005-01-08 01:40 PM · #21
Code: Total Sessions 177,425.00 Total Pageviews 455,415.00 Total Hits 478,788.00 Total Bytes Transferred 727.97 GB Average Sessions Per Day 25,346.43 Average Pageviews Per Day 65,059.29 Average Hits Per Day 68,398.29 Average Bytes Transferred Per Day 104.00 GB Average Pageviews Per Session 2.57 Average Hits Per Session 2.70 Average Bytes Per Session 4.20 MB Average Length of Session 00:06:07
Weppel · 2005-01-10 06:38 AM · #21
Unless someone can explain to me who or what it is, i'm forced to start filtering this IP. Anyone else having problems with that specific IP?
cheyenne1212 · 2005-01-10 05:24 PM · #21
I belive that the script runs off of alexes sight which is dual xeon based. I think theres just an abnormla number of people looking for the video today, and he needs to increase the number of servers available to apache like I had to do.
cheyenne1212 · 2005-01-10 07:06 PM · #21
You guys are right gigabit connection
Hadriel · 2005-01-11 10:45 AM · #21
Let us know how that goes. How much space are they going to give you for files?
alex-davies · 2005-01-13 12:39 PM · #21
Down to about 200/min. Has not gone over 350 for several days now. Methinks the frenzy is over! Bad luck on the M1 exam but its only 3 marks and we should get follow-through marks so hopefully full marks for the rest of the question. Alex
DreamMaster · 2005-01-01 09:36 PM · #22
pstation, Ok thanks, if it uses too much bandwidht just take it down. Monitore it very carefully though.
cheyenne1212 · 2005-01-01 10:47 PM · #22
Yes it would. Just refesh the page to get the new stats. I think orbit updats the graphs every 2 minutes. My servers a Dual xeon from TP :p
pstation · 2005-01-02 02:34 AM · #22
their's doesnt seem to be much better, getting 1KB/sec from them
datums · 2005-01-02 02:50 PM · #22
Great, that's what I wanted to hear. Linking directly to the charity page would eliminate that possibility. "U.N. Says 1.8 Million Tsunami Victims Need Food" There is alot to be done.
Weppel · 2005-01-02 03:41 PM · #22
Georgecooldude, As far as i know you're able to setup certain "packages", thus different download links.
Georgecooldude · 2005-01-02 06:47 PM · #22
Well it is true that the first link gets the most hits. I just looked at my stats and the file with the most downloads is linked at the beginning of the mirrors while the rest have around 1/3 of the ammount of downloads.
Dogtanian · 2005-01-03 09:00 AM · #22
Yeh sure no problem I emailed dream the link
Dogtanian · 2005-01-03 02:37 PM · #22
Ok thanks alot I try to keep mine up as much as I can and i see if I can get a few friends on it as well
Georgecooldude · 2005-01-03 03:22 PM · #22
.nl is a dutch extention i think
jheslop1 · 2005-01-03 04:42 PM · #22
mrtg
Dogtanian · 2005-01-03 06:28 PM · #22
lol how come people find better stuff them me is it free? checked it out looks nice But i cant be bothed to mess about now to slow
cheyenne1212 · 2005-01-04 12:37 AM · #22
Hows the script coming dream?
alex-davies · 2005-01-04 10:50 AM · #22
Sent. If anyone else does want to mirror (or knows someone else who could mirror), please email me or pm me. The first video is getting most of the traffic so a few extra mirrors on that would be great. Even if you only have a few hundred gigs of b/w free - if you can just download the one file, upload it to your site, email me and let me know how much b/w you have. Thanks, Alex
alex-davies · 2005-01-04 05:14 PM · #22
What is the full URL to your mirror? Thanks, Alex
Weppel · 2005-01-04 07:01 PM · #22
I believe he needed it anyway, but decided to buy it one month early just so he can "play" with it a bit more
Isaac.Eiland-Hall · 2005-01-04 10:00 PM · #22
I'll check mrtg out... Meanwhile, TomSyer... :-)
cheyenne1212 · 2005-01-05 06:06 AM · #22
Ok. I do run Cpanel you think I'll get any conflicts. I read that they were gonna support cpanel, but didn't see where they mentioned it was ok with cpanel yet. Haven't read that far yet on those forums. lol
Dogtanian · 2005-01-05 03:40 PM · #22
aspect I only get 25 (GBP) a month of pocket money and somhow I cant seem to afford $200+ dam jobs in the UK i am going to get a woolworths job soon i hope also should we try hosting the files on soruceforge lol it may work for a bit lol
cheyenne1212 · 2005-01-06 12:31 PM · #22
http://tsunamivideo.net/asian is up with the new link. SM finally got my port capped after seeing my 68Mbps spikes on their 20mbit unmetered servers. lol However one of their engineers is nice enough to give me a little more speed on my port for just a little bit till this rush is over.
Hadriel · 2005-01-08 06:36 PM · #22
Total Hits 277,782 Average Hits per Day 25,252 Average Hits per Visitor 2.89 Cached Requests 6,739 Page Views Total Page Views 2,008 Average Page Views per Day 182 Average Page Views per Visitor 0.02 Visitors Total Visitors 96,131 Average Visitors per Day 8,739 Total Unique IPs 82,316 Bandwidth Total Bandwidth 824.07 GB Average Bandwidth per Day 74.92 GB Average Bandwidth per Hit 3.04 MB Average Bandwidth per Visitor 8.78 MB
vidahost · 2005-01-10 07:12 AM · #22
No sign of that IP here. If if keeps up, I'd block it with iptables. DreamMaster: That video's on twobeds.com in the usual location.
Hadriel · 2005-01-10 05:56 PM · #22
Time range: 1/10/2005 03:21:25 - 1/10/2005 15:48:10 Total Hits 78,238 Average Hits per Day 78,238 Average Hits per Visitor 4.22 Cached Requests 2,133 Visitors Total Visitors 18,537 Average Visitors per Day 18,537 Total Unique IPs 15,584 Bandwidth Total Bandwidth 370.71 GB Average Bandwidth per Day 370.71 GB Average Bandwidth per Hit 4.85 MB Average Bandwidth per Visitor Still getting the crap hammered out of me. Thats still 70mbit I think.
vidahost · 2005-01-10 07:17 PM · #22
Dell PowerEdge 400SC Server/Desktop - $395 ------------------------------------------- Intel P4 2.4 GHz @ 800 MHz FSB w/ Hyper-Threading Technology Intel 875P Chipset 512MB DDR Ram Gigabit Ethernet Network Adapter (10/100/1000 Mbps) Chaintech A-FX20 - GeForce FX5200 (128 MB, AGP 8x) Onboard Integrated Audio Sound Card 40 GB Hard Drive - 7200 RPM 48x CDRom 3.5" 1.44 MB Floopy Drive No Operating System 6x USB 2.0 Ports Keyboard and mouse included
cheyenne1212 · 2005-01-11 12:56 PM · #22
If I remember correctly I thin he said they give you 10MB.
Hadriel · 2005-01-13 01:29 PM · #22
Total Hits 737,020 Average Hits per Day 46,063 Average Hits per Visitor 3.56 Cached Requests 19,953 Visitors Total Visitors 207,282 Average Visitors per Day 12,955 Total Unique IPs 160,387 Bandwidth Total Bandwidth 2932.72 GB Average Bandwidth per Day 183.30 GB Average Bandwidth per Hit 4.07 MB Average Bandwidth per Visitor 14.49 MB
dkitchen · 2005-01-01 09:38 PM · #23
Perhaps some kind of random link system would be a good idea here, it's likely people will just click the first one... Dan
Mooecow · 2005-01-01 10:51 PM · #23
lucky. Last refresh i was pushing 128k lol
kuremo · 2005-01-02 02:40 AM · #23
kuremo.net/content/tsunami/
jheslop1 · 2005-01-02 02:52 PM · #23
This mirror makes me sick; http://www.freedomunderground.org/me...e/tsunami1.php Have AdSense and a donation button which goes to directly to his paypal account. Why not just link to http://www.google.com/tsunami_relief.html or link to a charity instead of your paypal account.
jheslop1 · 2005-01-02 03:46 PM · #23
Good idea, better than them increasing advertisers costs as well as frauds. But I do recommend that you have a donation/real link to a actual donation link other than the Google one you have, as people might look there and just close the browser. Something along the lines of "Google has great links here, or donate direct to <reputable charity here>" I also recommend you remove the downloads of your server, if you have not already so that it's only http so it's nice and fast
lumbyjj · 2005-01-02 06:48 PM · #23
Well, I'm at the top..
Georgecooldude · 2005-01-03 09:12 AM · #23
Cool. I PM'd DreamMaster to remove a few of my links. In around 12 hours I have had 35,000 downloads of the Tsunami videos. http://www.d3hq.com/download.php?cat=28&ref=0&subref=0 They are very very popular at the moment.
DreamMaster · 2005-01-03 02:38 PM · #23
It's called "El Pais" (the country) and it's the biggest newspaper here in Uruguay. http://www.diarioelpais.com/
jheslop1 · 2005-01-03 03:25 PM · #23
Correct details; user; logs pass; dog
lumbyjj · 2005-01-03 04:44 PM · #23
I'm waiting.. It's on a 100 Mb/s port right now, if you fill that up, I'll put it on a 1 Gb/s port.. It's going down.. spiked at 56.9 Mb/s and is now at 41.8 Mb/s......
cheyenne1212 · 2005-01-03 06:30 PM · #23
If I were you Dogtanian, I'd limit the bandwidth to your site to about 8.5Mbps if your on a 10Mbps port. That woudl leave you 1.5Mbps to log into RDC.
DreamMaster · 2005-01-04 01:11 AM · #23
cheyenne1212, There are a few bugs that need to be ironed out before I start using it. Alex Davies who is in charge of it is sleeping now so I guess it wount be up untill tomorrow. How is the load on your end? Can you still handle it?
DreamMaster · 2005-01-04 10:53 AM · #23
Ok guys things are getting desperate here... The traffic just keeps increasing and the mirrors are under a lot of strain. If this keeps getting worse then the whole project will go under If you haven't helped so far now is your time. Alex-Davies has put a lot of his time for this project and has setup the mirroring script wich BTW works extremely well so you can choose how many downloads you are willing to donate. I am sorry to have to tell you guys this but the demand just keeps increasing with no end in sight and if I can't get any more mirrors, it's all over. If you wannt to help, this is what you need to do: Download this 4.7 Mb file: http://www.asiantsunamivideos.com/videos/Tsunami1.asf Mirror it on your server then go here: http://www.davz.net/mirror/index.html Add the link and select the number of downloads that you can contribute. After that please PM me telling me that you have mirrored the file. The fate of the site is now in your hands
cheyenne1212 · 2005-01-04 05:18 PM · #23
THis is unbelievable. I just put up my second list of mirrors about 20 minutes ago and I've already had 604 downloads on 1 file.
alex-davies · 2005-01-04 07:01 PM · #23
The dip on the right is caused by me reducing the load on your server. Its about right now - able to handle twice the current value at a push. The dip in the middle of the day was experienced by everyone. topgun - what is the URL to your server? Shall I tripple your quantity so you get 30gb at peak (15 now)? Thanks everyone for your help. Alex
cheyenne1212 · 2005-01-04 10:03 PM · #23
Do they give you some sort of Panel you can log into for billing, tech support etc? If they, usually most companies I have seen have some sort of way for you to see your B/W being used.
alex-davies · 2005-01-05 06:08 AM · #23
Read the forum post. It is specifically how to do it on cpanel (hence the reason I sent you that link ). I should warn you that I dont do cpanel so have never tried it but lots of others seem to have tried it and got it working. Alex
cheyenne1212 · 2005-01-05 03:43 PM · #23
ahh that 25 a month might be a problem. So managed.com gave you your current server for free for the videos?
vidahost · 2005-01-06 12:44 PM · #23
Cool...links now up on vidahost.com and tlotr.com
Dogtanian · 2005-01-08 06:42 PM · #23
My server is gone, (I think) so I dont think I am mirroing anymore
cheyenne1212 · 2005-01-10 11:07 AM · #23
I'll look throgh my logs for that IP in my logs. and http://www.tsunamivideo.net/asian/Indonesia-Roar.wmv is up.
cheyenne1212 · 2005-01-10 06:13 PM · #23
Mines off and on. My peak today has been 90Mbps Avg about 74Mbps, but its been spiking right now. It'll drop to 17Mbps, then go to 70, the back to 17 again.
cheyenne1212 · 2005-01-10 07:21 PM · #23
Hmmm Mine has nothing like that. Wonder if their gonna be sorry that he uncapped my port? lol If I maintain 150Mbps I'll probbably pm him just to make sure I'm not gonna get like overcharged for going over 100Mbps.
Hadriel · 2005-01-11 12:58 PM · #23
Total Hits 553,440 Average Hits per Day 39,531 Average Hits per Visitor 3.40 Cached Requests 14,114 Visitors Total Visitors 162,948 Average Visitors per Day 11,639 Total Unique IPs 130,908 Bandwidth Total Bandwidth 2088.94 GB Average Bandwidth per Day 149.21 GB Average Bandwidth per Hit 3.87 MB Average Bandwidth per Visitor 13.13 MB So far this month.
cheyenne1212 · 2005-01-13 03:45 PM · #23
Hits Total Hits 2,722,315 Average Hits per Day 247,483 Average Hits per Visitor 8.20 Cached Requests 70,229 Failed Requests 71,205 Page Views Total Page Views 14,679 Average Page Views per Day 1,334 Average Page Views per Visitor 0.04 Visitors Total Visitors 331,804 Average Visitors per Day 30,164 Total Unique IPs 233,698 Bandwidth Total Bandwidth 3399.71 GB Average Bandwidth per Day 309.06 GB Average Bandwidth per Hit 1.28 MB Average Bandwidth per Visitor 10.49 MB
Host1Nor · 2005-01-01 09:38 PM · #24
mine will be a bit delayed i am sorry to say. Working on it though.
cheyenne1212 · 2005-01-01 10:54 PM · #24
I dropped to 8Mbps but am back to about 10.2 now again.
TheVoice · 2005-01-02 02:53 AM · #24
http://www.litespeedtech.com. I use Litespeed webserver to throttle some gamecube movie downloads. Works perfectly through its web interface and the throttling works down to the kb.
stevey · 2005-01-02 02:54 PM · #24
if you need another mirror send me a pm
eservicesu · 2005-01-02 03:49 PM · #24
Do you guys still need a Mirrror or two? - Eddy
jheslop1 · 2005-01-02 06:49 PM · #24
Whats a "new dual opteron with AMD 64bit" got to-do with anything? . It's a FILE not a CPU intensive script/program
Dogtanian · 2005-01-03 09:14 AM · #24
yeh and I am tyring to find a logging program for windows 2003 i got the link but I want to no who download etc.. but nice site
cheyenne1212 · 2005-01-03 02:38 PM · #24
Doing 7.25 right now. Keep it coming baby!! lol
Dogtanian · 2005-01-03 03:25 PM · #24
lol oops yeh nl = nevellands which is dutch yeh
Dogtanian · 2005-01-03 04:47 PM · #24
mrtg umm i never seen that before and since I cant access my server at the moment ikeep with my logging @ http://67.111.205.10:255/
cheyenne1212 · 2005-01-03 06:33 PM · #24
http://70.84.43.203/Report
cheyenne1212 · 2005-01-04 01:20 AM · #24
Oh yeah no problem here, Just wondering how the script was coming.
BiGWill · 2005-01-04 11:11 AM · #24
hey DreamMaster contact cabalstudios they'r running a big operation and as he said bandwidth is not a problem for him... he offered it - take advantage of it!
alex-davies · 2005-01-04 05:22 PM · #24
You can imagine what fun I am having running the server that is doing the PHP script (SQL SELECT and INSERT per download) as well as its "normal" job The load has actually peaked for today - it has dropped to about 250/min from 400/min. Even so we are going to have fun as lots of mirrors run out of their free allowances. I hope that providing such an easy to use add/edit mirror panel we can encourage others to join as the month goes on. Alex
Weppel · 2005-01-04 07:03 PM · #24
Thanks for that Alex, i actually rather push 3-4mbps for 1 month than 10mbps for 2 weeks.
Isaac.Eiland-Hall · 2005-01-04 10:27 PM · #24
Heh. ClientExec... Looks like I *am* getting what I pay for... hehehee... (Hey, it's still a good solution for me so far...) Looks like I'll be trying to isntall MRTG... Shouldn't be too bad -- with the help of some of the walkthrough threads, I not only did a bit of server hardening, I understood more than I didn't understand. :-)
cheyenne1212 · 2005-01-05 06:09 AM · #24
Ohh. lol Must of misread it. 4 a.m here havne't gone to bed yet. I'll give it a shot.
Dogtanian · 2005-01-05 03:47 PM · #24
we and a firned split 50:50 last month for a webhostng server (just cos we rushed and found out that there was no panels and plus my friend wanted it more then me) so we got it it was sooo tacky I shouted at managed for a refund or a another server we stopped paying but we got this server free lol its still quite bad but cant complain
DreamMaster · 2005-01-06 12:50 PM · #24
Guys, I will add the links as soon as I can but right now I can't contact Alex Davies to modify the script but I'm not in a huge hurry and I need some rest anyway.
vidahost · 2005-01-08 06:47 PM · #24
Twobeds.com is still up, but demand for the videos has gone way down. Only at 3 - 5mbit/sec now.
DreamMaster · 2005-01-10 11:34 AM · #24
can anyone tell me if my site is slow? http://www.asiantsunamivideos.com
Hadriel · 2005-01-10 06:16 PM · #24
I wonder if a bunch of mirrors didn't add to the site. I went there and it seems that I came up every third click, same with your site. This was just for the new movies. Sorry to add to the hammering briefly....
vidahost · 2005-01-10 07:24 PM · #24
I got that info from Google I've just put a ticket in Orbit, I'm sustaining 41mbit and have shifted 250Gb in the past day. (I'm on a Planet server, 2Tb uncapped)
cheyenne1212 · 2005-01-11 01:50 PM · #24
Successful requests: 2,349,704 Average successful requests per day: 347,567 Successful requests for pages: 10,736 Average successful requests for pages per day: 1,587 Failed requests: 76,492 Redirected requests: 857 Distinct files requested: 538 Distinct hosts served: 150,727 Data transferred: 3.312 terabytes Average data transferred per day: 501.790 gigabytes Got a spike up to 218Mbps earlier today.
cheyenne1212 · 2005-01-15 05:20 PM · #24
How much B/W you guys doing right now? Its dropped substantially for me now. My max is 60Mbps and I'm averaging 25Mbps down from the 50+Mbps I was averaging. And right now I'm pushing 5Mbps.
DreamMaster · 2005-01-01 09:39 PM · #25
Mooecow, I don't have AIM but I am always checking the PM's and my email (webmaster@asiantsunamivideos.com). If you use too much bandwidth just delete or rename the files to stop it immediately and then contact me.
Mooecow · 2005-01-01 10:56 PM · #25
wow i guess being mirror 3 means i dont get much traffic lol
cheyenne1212 · 2005-01-02 02:55 AM · #25
Out of curiosity, what are you guys puling off of me? http://70.84.43.203/tsunamiphuket.wmv Just right click it and do a save target as. Otherwise, its gonna stream.
Georgecooldude · 2005-01-02 02:56 PM · #25
DreamMaster I have PM'ed you my links. And I agree wit jheslop1. The paypal link may confuse some users into thinking that is a way of donating to the Tsunami when in fact it is not.
Hudson Digital · 2005-01-02 04:09 PM · #25
I'm mirror 4 and it's only pushing 2.4 as well. It looks like everyone is clicking the first two mirrors mostly.
cheyenne1212 · 2005-01-02 06:49 PM · #25
yeah now that I've been dropped down to the second line I'm off to about 4 - 6 Mbps. I can handle the front more :p
kelvinklay · 2005-01-03 09:23 AM · #25
if you know php then you can foreach and show how many times a file has been downloaded or you can search for a script on hotscripts!
DreamMaster · 2005-01-03 02:39 PM · #25
cheyenne1212, Thanks for hanging in there. I also told the reporter about all the help that I recieved from the Webhosting community (you guys).
stevey · 2005-01-03 03:26 PM · #25
netherlands and its in Dutch
cheyenne1212 · 2005-01-03 05:01 PM · #25
wow went from 6Mbps to 20 now.
Dogtanian · 2005-01-03 06:34 PM · #25
Good idea thanks for that I never throught about that btw nice stats
klcodec · 2005-01-04 01:46 AM · #25
HEY, I got an IDEA! GREAT ONE ALSO Lets get a few "Unlimited" Hosting accounts from ebay Kill 2 birds with one uh, 5 or so videos Get our "unlimited" bandwidth, as well as show the "unlimited everything" host that "unlimited" doesnt exist
Isaac.Eiland-Hall · 2005-01-04 11:17 AM · #25
I just posted this to totalfark.com, with a plea for anyone with spare bandwidth to step up. What I posted in the TF thread: Okay, here's the deal. There's a guy on WebHostingTalk.com who has set up a site with videos of the tsunami - amazing stuff. There's no ads on the site, and one link to a Google list of charities. The concept is to draw people in and get them to download the videos, and go donate money to help. From the emails that have been coming in, this is truly helping. A couple of days ago, he came to WHT seeking help, and several of us set up mirrors (myself included). Well, this is really starting to take off, and here's the latest message in the thread on WHT that I posted as the link: (((pasted text from message I quoted above))) If you have a server with some bandwidth to spare, please consider helping! This is a great use for bandwidth you might not need for the next couple of weeks, and this effort is helping to get more people to donate. If you have ANY questions for me, I can be reached at alexander[my nickname + .com], although I'm about to go take a nap (been up all night), so reading through that linked thread may also be helpful. Please, help if you can! ------------------------------------- Posted a followup in same thread: Just to reiterate: 1. None of us involved are making any sort of money from this. Most of us are donating bandwidth that we can spare (I've set 750GB monthly limit on my mirror, which is what I can spare of my resourced). 2. Originally, he'd put Google ads on the main site, with the intent to donate proceeds; however, there are some scams floating around on Google, so to be safe, he removed the advertising completely. The link to the Google list of charity links remains. 3. He has received many emails of support, and reports of many people who have donated (or donated more in addition to previous donations) because of the site. So sure, part of it is getting to see some "awesome videos", but it makes the disaster more real to many, reminding them of the humanity of it all. I'm not rich at the moment, but this is how I can help support the recovery efforts. I'm hoping this reaches some folks who can also help out. -------------------- Hopefully that'll catch the eye of some that can help.
alex-davies · 2005-01-04 05:26 PM · #25
Downloads today (since new script installed at about 11am GMT): 162749 Thats in 10.5hours, so that is an average of 260 per minute. The "peak" was over 400. The Bittorrent stream, by contrast, has shifted about 300 downloads in two hours. Alex
topgun · 2005-01-04 07:04 PM · #25
I'm sorry for jumping to conclusions but it seemed like you were treating this a bit like a competition...especially with the hostname you chose for for your server.
cheyenne1212 · 2005-01-04 10:31 PM · #25
lol Doing stuff like that helps you understand more about your computer sometimes.
alex-davies · 2005-01-05 06:11 AM · #25
Go to bed, mate. I can drop the traffic to you if you are worried about going over limit between now and the time you install mrtg. Alex
Hadriel · 2005-01-05 06:27 PM · #25
My mirror has taken 48k hits from 4am till 4pm just a bit over 190GB transfered today. Only averaging 30mbit, but it works. If you need to dump traffic to me all you need to do is PM me and let me know. You can check out my stats at: http://www.rpgfilms1.net/stats I only have the stats up for today so far.
cheyenne1212 · 2005-01-06 06:31 PM · #25
Rest? whats that? Rest is for sissies. lol
cheyenne1212 · 2005-01-08 07:36 PM · #25
About 44Mbps here, but I imagine there will be anohter spike in the traffic vida. What have you peaked at?
Hadriel · 2005-01-10 11:35 AM · #25
Yeah load time is slower then usual.
cheyenne1212 · 2005-01-10 06:17 PM · #25
yeah mine will come up a bit more than most peoples as I'm 100Mbit unmetered at the moment.
cheyenne1212 · 2005-01-10 07:25 PM · #25
Looking in WHM right now and its showing Apache to be failed, but the sites up. So far this day I've shifted about 380GB of data.
vidahost · 2005-01-11 02:01 PM · #25
I've just dropped to 4mbit/sec...I guess some more mirrors are online
DreamMaster · 2005-01-15 05:33 PM · #25
cheyenne1212 and Everyone, I changed all the links to the corel content distribution network. I did that because alot of mirrors have died and were redirecting to html pages etc and it was getting very hard to manage it all, plus most people have reached or exeeded their bandwidth limits. Having to add more mirrors and contacting existing ones to download new files in order to release new videos was very time consuming and I need to get back to work on my business projects which I had frozen because of the amount of time consumed by this project in the past 2 weeks. Also I want to hand out a big THANKS to everyone that helped in this project, it was touth keeping up with the incredible demand for this videos but in the end we were able to manage the load and probably shocked alot of people into donating and helping with the tsunami relief.