Quadranet downtown LA

My server in Quadranet downtown LA is down. The IPMI VPN is not working either which leads me to believe it's not just my server. Anyone else? Down about an hour now. Still waiting for them to respond to my ticket. Their status page doesn't show anything. https://status.quadranet.com/ UPDATE: Their status page was just updated and shows they are having a networking issue with downtown LA labelled as having a partial outage.

How do you know it's going in the right direction? I still don't see any response or any IP coming online.

My new block is a similar subnet. I tried reconfiguring my server but it doesn't seem to work, so they must not have set it up yet.

Kevin assigned me a new prefix at 11:30AM PST. I got lucky and was able to access all my stuff without the IP KVM, so I'm more or less back online (except for all my users with custom domain nameservers, which I can't do anything about...). I was going to ask for an RFO, but it seems pretty clear they sold their IP space and didn't bother to notify customers, so I'm not sure what kind of RFO could even begin to rationalize this. Absolutely insane.

They seem to have had a network issue sometime ago today (packet loss on certain routes) but it seems to have settled off/is normal/ok now.

Remember Cyberwings ?

ehm, is this a network maintenance ? or power maintenance that will bring down all of equipments

Mine too, still down. First, some of the servers down. Now, all of them.

They probably won't let anyone work on the weekend. Can't be paying anyone overtime, so it will have to wait till Monday. It would not surprise me.

how many datacenter do they have at LA ?

That is what I’ve been told as an explanation of that long downtime. They told they have to wait for an engineers as they are not available outside of business hours. Can’t confirm myself. Anyone local should visit to verify, I think. Also, after 3 weeks of partial downtime do you really think their management care to have all staff 24x7 to recover? They have some customers offline since Jan 6, another week is nothing on the way of the company closure 😉 Another thing confirming my information is that they no longer respond at nights. Did you receive any answers outside of business hours since the first event on Jan 6 happened? I’m not. Except some answers from Roman who is not in the US physically.

Are you connecting to the servers directly through your public IP or through private via QN VPN ? I'm unable to connect to either their VPN, so I assume it isn't working? Thanks for any info.

The information I have from their staff is that their previous owners sold both IPs and hardware. I don’t have any specific information though.

I was able to get a Quadranet employee on the phone in Denver and they had no information on what was happening.

But why are we down, as we are using our own IP/ASN?

1st ticket was submitted last friday and got closed after a day. i opened the same ticket and received a reply about the replacement within an hour.

It is completely inexplicable that they won't even say a word about it or if they've confirmed it is down. For the first 24 hours I don't think they realized it. One of the first replies to my ticket said it was working "according to the VPN engineer" or something. Since then I've been asking them to at least acknowledge that they confirmed an issue.

Backing up my data and running. This **** is crazy. Any suggestion for a provider in LAX?

Try asking to have it escalated to senior management. Has anyone tried reaching out to QuadraNet's CEO email they posted on the status page and hear back?

I'm not super familiar with IPMI (as we use external hardware based Raritan KVM over IP units). The KVM over IP units we use support virtual media (IE: remote mounting an ISO, or a USB key, or what have you, to allow for BIOS updates, OS installs, etc.). I any remotely current versions of IPMI have similar functionality ("virtual media" that is). Is it possible to mount a virtual media device, with read/write permissions, and then write to that media (IE: mounting a partition, path, or USB key say over IPMI)? For the KVM over IP gear, transfer speeds are pretty slow (as the KVM dongle negotiates at 100mbps to the KVM switch, and then the virtual media only gets a chunk of that), but pretty slow data extraction is a heck of a lot better than none.

Those clowns are now billing me for a server that is down for almost 1 week. They have no shame

I have a ticket explicitly for equipment removal and they keep closing it saying they are currently on site every day in the mornings (so wow, a whole other thing where 24x7 staffing is gone? ) and that I can come any day, bring ID etc. I separately have had my termination confirmed by accounting in another ticket, and they noted my equip removal ticket so that was nice. But then this Melissa is injecting into the situation and is unaware of termination and replied to that info to reconfirm I don't want my equip moved to the new location. So I reconfirmed on the equipment removal ticket and they said "as we said, for now there is someone on site every day in the morning" so come, bring photo ID. So they are telling you that you cannot come and grab your stuff? Or is it more that you are not ready and will not be ready before they move your servers so helpfully for you? Such a mess

Is this for colo or dedicated servers?

As I mentioned multiple times in the thread. These companies which roll up hosts through acquisition want one data center in each city, one that they own or control. Not 4 or 5 different businesses in multiple locations. They are going to move everything into one new place and kill off the rest.

We appreciate your feedback and understand the challenges that can arise during service migrations. As you know, not all transitions in this industry proceed seamlessly, and occasional setbacks are inevitable. While we acknowledge that aspects of this process could have been better planned, we sincerely apologize to those affected. That said, QuadraNet remains one of the longest-standing service providers in the industry, and we are fully committed to upholding the high standards of service that our customers expect and deserve.

Can I understand this as you handing over all your data centers except LAX to your partner company?

As I noted in my first post or two, I've found Quadranet to really be trying to be responsive in the transition period, after I got over my first frustration that they were weren't answering the phone the first few days and I just tried communicating electronically. Also, the communication that I've seen is that they really want to keep the brand and the business going forward, and this isn't a shut-down. It's clear it's a down-sizing though.

Have you contacted support this time? If so please share what they say.

I don't have services in Los Angeles with QN. I only have services with QN in Chicago, Miami, Dallas, and New Jersey. Dallas only has one cabinet. I have another data center in Dallas, but the two are very far apart, making migration quite troublesome. As long as QN doesn't change, there's no need for migration.

I called QN. Indeed, all of QN's data centers in Los Angeles will be shutting down, and the network could go down at any time starting today. For data centers in other cities, they said those are remotely operated and will not be affected. If there are any changes, they will notify me in advance.

Down for mine as well , since 12:30PM .

Nothing has changed yet as far as I can tell. Their internal private IP network still works and that is probably how a previous poster is able to access their server from another server on the same internal network. I can access my server on an IP6 address but that doesn't help me very much. I am currently configuring some of my back end stuff to use that instead of IP4 but it still doesn't address the elephant in the room.

My ticket has received the latest reply. The content is as follows：

Also 96.44.135.0/24

Well I called, was on hold for 15 minutes. I said a few words like "I'm having trouble connecting to my server" and got hung up on. Using a different subnet that was working a few hours ago, can't connect to my server from Cloudflare, office or home ISP. Can't access IPMI after connecting to VPN edit: got a hold of someone by phone but they said to just wait for the ticket

Given anything smaller than a /24 isn't normally routable (albeit by a global consensus of configuration/best practice/normal behaviour which has existed for for several decades now, not technical limitation), it's interesting bgp.he.net would show /29's and /28's and the like. It certainly wouldn't be expected to make it across any normal transit provider/actual external network.

The previous SLA has not been handled properly, and now a new failure has occurred...

Brother, I think you're right. Last time they even said in the ticket that Quadranet sold their IPs. This confuses me. Aren't they Quadranet? Who on earth is our service provider?

I also had 10 years with Quadranet. ==== Any budget alternative for Asia/China?

6 floors inside their downtown facility and another one facility (they call it century). People reported they lost one of the biggest customers last year and probably many others during the Jan events, so moving everyone to some smaller facility makes sense. Since they didn’t plan accordingly and it was with a few hours notice, it may also be related to some contracts. No official info on what is going on. Another thing is that their ubersmith instance is on HostPapa IP. It could be HostPapa facility now.

one of my servers is showing power up but their network is down. The server has been down for 38+ hours. still no solution. And more servers are fully down. which one showing power up it was fully down about 20 hours ago, so I am pretty sure that, now they are out of the office now for the weekend.

Haha. They claim there is a team onsite working. But wait Is team = 1 person?! That explains everything.

Previous owners(?) is that edge or the previous to edge.. or did it get sold again? previous to edge it was some investment company if I remember correctly .. something capital.. which ran it between 2022 and 2024(?)

they just posted an update: Update - Dear Customers, Thank you for your continued patience as we work through our maintenance in our Los Angeles facilities. The issues have affected multiple services at both locations. We are working 24/7 to resolve this, but as expected this is not enough to resolve all. Once your services are restored, please submit for an SLA credit via the Neo portal. For further escalations, you can contact our CEO and Owner Jon Eaves, directly at jon.eaves@quadranet.com . We apologize for the extended duration and any downtime you have experienced.

Is the Chicago issue related tot this LA ip nightmare or is it coincidence? They are playing it off like it’s an unrelated hardware issue. Trying to figure out how long I’m comfortable leaving my server there while I figure out an alternative.

My ticket response: "We are still working on this and should have it ready by EOD. Thank you for all the patience"

What did you do? Any suggestions?

Yes, they have finally provided new ip's but that's of not help because I don't know enough to reconfigure the server. I've asked cpanel and the new (whomever it is Quadranet now) support to help me. I'm back waiting again.

I did, but no solution yet from him.

try to post your server IP address. If some members here can ping your server, there is a good chance that you can scp with the help of wht member

We had the same thing happen to the Chicago server, which we ended up canceling anyway, but what I did was open a ticket with their Billing department and tell them to give you a free month credit for the upcoming cycle. Their billing department fairly quickly did that for us, but we ended up not needing it. This way you will at least not be charged and can potentially have another month to migrate elsewhere if you so choose. Hope this helps.

So it seems they moved out dedicated servers and now the same is going to happen to colocated equipment. Nice job, QuadraNet!

It's for colo

One more planning failure. I am wondering if they still have any skilled staff to plan such things accordingly.

But my experience is that you’re trying to sell everything. Now you’ve sold IPs to HostPapa and Seattle to *******—what’s next?

But it is uncommon in this industry to change vendor with no advance notice. You can’t say service stability is most important for you while migrating customers without even letting them know as you did on Jan 21 or so. It was never explained as well, even before I cancelled. To note, I’m not trying to blame you for all the decisions while it seems you’re one of the executives responsible for lack of communication and poor planning process. The biggest problem here is lack of transparency, and you are continuing to keep things in secret instead of explaining all the downtimes as much as you can.

They're trying, yes. That's obvious. Andrew is also working on improving how he communicates, which is great. This should be the start of something better, not the end. This industry is getting tougher, especially for companies with weak IT capabilities. They won’t choose bare metal, and the few big tech companies are just taking them away.

Just those generic chatgpt lines "We sincerely apologize for any inconvenience this may have caused to your operations" and "We are committed and working to bring your service back online asap" As if they don't know what to do or they really don't know what to do certified clownshow

They don’t have any staff in all the locations you mentioned. Considering how much time it took to solve the recent issues in the location they are fully staffed and how it ended up, it is too risky to keep services with them in those remote locations.

Any idea where their "HQ" is now? Like earlier 530W was their "HQ" too (registered address etc).

not all the subnets are down. Im worried as last month, they had to un-announce a huge subnet

Thanks for the tip. At least I'm able to access my server through IPV4 on the "Asian optimized subnet". https://bgp.tools/prefix/66.212.30.0/23

They told me the same thing. It's not like I have a choice.

I was able to spin up a new server, configure it, restore backups and have it up and running at my Vancouver datacenter before I even received the new IP. Service cancelled.

Server is up again. At least they got to the ticket before the end of the business day, but they didn't say what was the reason for network outage.

It's no surprise that company didn’t know their left hand from their right—even before the buyout. After the buyout, it only got worse. I was personally a QN colo customer for about three years. I signed up for a half rack and chose them specifically because they accepted Bitcoin as payment, which aligned with how we operated. For the first year, they were great. Then, they abruptly stopped accepting Bitcoin. I made it clear multiple times that I intended to continue paying in Bitcoin because that was our arrangement, but they wouldn’t budge. Unpaid invoices started piling up, and I had to pay late fees because they removed their BTC payment processor. Eventually, I managed to get Andrew’s personal crypto wallet details, and he accepted a few payments directly. Things kept ticking along and by this time we had ~30-40 baremetals with them + the half rack.. then their NEO billing platform went dead.. they lost their database or something .. When things came up again after weeks.. We ended up with invoices of "LAX" servers despite not having any LAX servers or space. We had Dallas + Miami. Trying to sort this paper trail mess was very hard as it was near impossible to talk in person to their accounts lady. I tried calling them hundreds of times to resolve the issue. Their “single” accountant was impossible to reach—never answered the phone. To this day, I’m 99% certain she was either working another job or barely working at all, maybe one or two hours a day. Meanwhile, I was painted as the bad guy for not paying, even though they had removed the payment method we initially agreed upon and I was trying to talk to them in person to go through the bills line by line after their billing system failed. But then, one January, they cut me off completely. That shutdown caused major downtime, and I lost all my customers. It was devastating for the business. If their accountant had simply answered the phone or worked with me to find a solution, it could’ve all been avoided. Instead, after the buyout, things spiraled further downhill—they sent debt collectors after us. In the end, I couldn’t afford to pay for the shipping to retrieve my servers, so I had to leave them behind after settling with the collector...

Exactly why everyone should move away from quadranet now. It's just a continuous event of downtime

Ever since quadranet was sold to edge centres this always happens now a lot of downtime

Fortunately I migrated 15 days ago, Unfortunately Quadranet is collapsing every day, trust was lost due to situations like the ones that are happening.

Where are you hearing this information? I find that highly unusual they will abandon both of their Los Angeles facilities. To me it sounds like QuadraNet is making room in their datacenter by migrating dedicated servers to a few rows vs having it all over the place. Same with some of their colo customers (colo customers who use less then a full rack).

My server is showing power as well, but the public and private eth ports are down Assuming we can trust the management interface that the server is indeed powered that means they havent recovered connectivity in the facility. Not working restoring a situation like this on a weekend is criminal... these people are in a mission critical business where things need to be monitored and attended 24/7!

The VPN is not working.

I don’t know who it was exactly. The only information I have is that all the issues are because IPs and dedicated servers were sold to HostPapa.

In Denver? As far I know they have no office or location in Denver. Was it tech? It most likely they are not allowed to provide any information, not “they had no information”.

Quadranet should have alot clients at LA dc because many people ever recommend them, But it seems not tons of people to report connection issue here or at colo forum ?

That's good news. Hope it happens. Was this for LA?

Still down. Any suggestions?

Does anyone have their IPv6 working yet?

Have you received any email from him? He never responded to my email, I emailed 4 days ago. Probably top management does not care at all.

The server IP is 216.45.59.202 It isn't accessible/ping from outside but If someone is hosted in the LA datacenter and can try.. that would be great

But after we asked for SLA Credit they charged our bill. After that we have canceled our service and asked for refund.

wasnt colo customers affected when it happens approx 2 weeks ago ?

I got email last week about it and agreed. BUT today I do not get any email advising the move was about to happen. They made a ticket, but never sent it as email. Server went offline 12 hours ago.

Maybe their DNS is down. They can still charge and send emails.

Please stop using ChatGPT to generate useless posts 😊 We all need real answers not what you posted here, your posts are nothing new and do not explain anything happened to QuadraNet. It seems you personally don’t understand the impact QuadraNet and your team especially performed very bad, just FYI.

No With the exception of Seattle which was our smallest footprint; our intention is to continue operating all of facilities as expected. While we did make some mistakes in this process internally, which I acknowledge of course - we're currently simply transitioning our Los Angeles footprint due to incompatibilities with our current Landlord. We have been an incredibly long standing tenant of the building and after the recent ownership - we decided internally that some changes needed to be made. While I do acknowledge our handling of certain notices to customers and also the handling of the situation was not adequate - for this, I can only offer any apology on behalf of QuadraNet and restructure our processes moving forward.

John -- above you requested I emailed you, which I did. You probably noticed PM doesn't work for me yet. I'm not sure if you still have any questions or anything for me. It looks like Andrew might have addressed your concerns .

It’s clear that they lost their biggest client, ColoCrossing, which was acquired by HostPapa and moved to another data center. This likely led directly to QuadraNet's financial collapse, and they chose to hand over their remaining clients to ColoCrossing. In other words, the former upstream provider now become their clients' customer.

I know they haven’t had their own employees in these places. However, I’ll use this time to make other preparations, such as the migration.

There is no news at the moment.

What was the reason?

Fortunately for us we only have one small subnet from them. From what I have been told, they lost control of IPs and they can't be recovered. A little investigating and its appears they lost all of 216.144.224.0/20. I'd guess that management made a mistake giving back the wrong IPs to ARIN. Ever since Edge Centres took over QuadraNet I've seen some bigger customers leaving them. Maybe they have unused IP space they don't need or want to pay fees on anymore which led to this. I wouldn't expect much communication on this. With all past outages and events I've never seen management get involved with communicating to customers what is happening until many days, even weeks after with a RFO. Even now with this issue their status page still says "We are currently experiencing a networking issue". Their helpdesk technicians only know that the IPs cannot be recovered and new ones need to be assigned. After this level of mistake though and them losing control of their website DNS for 3 days, I'd be worried this would happen again on the new IPs they are assigning. Hopefully they can get this resolved for all affected customers quickly.

We are still waiting for the IP range details, and so far, there has been no response. Our customers are very unhappy. Once they assign us the range, we will need to update many servers, websites, DNS settings, etc. This delay has caused significant disruption for all of us. I don't thin they care much

Here is a suggestion for everyone. If you have an LA server that is not disconnected, you can use this server to connect to the lost IP because their routes are on the same internal network. Based on the above information, we can first temporarily restore the service by using the reverse proxy method and change it back after quadranet reallocates the IP.

It seems you had some issue other than we are discussing here. You are lucky :-) As for the ongoing IPs issue - two days of waiting for IPs replacement and still counting...

Did they bring someone's server back online? Still offline after 7 days. Support is not providing any info as well. And, red flag... Seems they don't have support at night anymore.

I didn't get around to migrating yet. That was a mistake. Currently down for about 3 hours

VPN and port status still not working though.

It looks like they were planning to repeat the same circus act at their other LA datacenter today. I wonder if that's on hold now.

Wasn't it their plan to close the two data centers and move it all into one place? There is only one LA data center site advertised on their website and as per a 2024 article "Apr 8, 2024 — Edge Centres said it plans to merge QuadraNet's platform in Los Angeles with the facilities it acquired in its purchase of LA-based Multacom in July 2023" It would not make sense to have 3 facilities in one NFL city, when they can own one large facility and consolidate.

Hmm... How do you know the server is powered on? Do you have IPMI enabled and do see sensors data? PDU port will always show UP, it just means port is powered on. Leaving datacenter with no staff on weekends is very serious change. If true most likely they are going out of business?

sent you PM. thank you for your kind offer.

And where are you getting this information? You maid previous claims that they are LEAVING both their Downtown Los Angeles datacenter at 530 West 6th Street and their facility by the airport, LAX Century at 6171 W. Century Blvd. But when asked, you never provided proof or said what the new facility is Now you are claiming they are selling their dedicated servers / bare metal equipment to a 3rd party. These are very serious claims , if true. Please provide the WHT community more information then "an anonymous source" and "I can't disclose my source." These are not nuclear/government secrets. If you want people to believe you, you must provide the community something creditable with your claims.

PLEASE OPEN A VERY SPECIFIC TICKET! Not all customers use it or can access machines by it so it doesn't seem to be very high profile. I have been trying to get them to work on it for 2+ days now and it seems like they didn't even know it isn't working. They were asking me for my credentials and stuff and I'm like... no no no... the whole thing is down for everyone! So please make sure to raise this so they know it isn't just me.

My ticket was also closed with no response. I don’t think it is only about IPs as my server’s IPs are not under HostPapa ownership.

Yes LA @ 530

My guess is that things slow down overnight because people have to sleep at some point. Perhaps they have a huddle every morning to set priorities. Hopefully they will start a new day with some energy and there will be a flurry of activity and progress in the coming hours.

Didn't do anything. It just started working on its own.

Yes, respond to me, but no resolution yet. can just up one server by changing the IP by support ticket.

Code: [root@serv2 csf]# traceroute 216.45.59.202 traceroute to 216.45.59.202 (216.45.59.202), 30 hops max, 60 byte packets 1 66.63.177.113.static.quadranet.com (66.63.177.113) 1.667 ms 1.634 ms 1.618 ms 2 * * * 3 10.9.5.153 (10.9.5.153) 0.806 ms !N 10.9.4.37 (10.9.4.37) 0.544 ms !N 10.9.5.153 (10.9.5.153) 1.622 ms !N [root@serv2 csf]# ping 216.45.59.202 PING 216.45.59.202 (216.45.59.202) 56(84) bytes of data. From 10.9.5.153 icmp_seq=2 Destination Net Unreachable From 10.9.5.153 icmp_seq=5 Destination Net Unreachable From 10.9.5.153 icmp_seq=8 Destination Net Unreachable

Our situation was that the bill was coming up in maybe a week and I notified them prior. If you contacted them a day or two before and it was over the weekend, they may not have been able to get to it in time. Hopefully they will refund you, they certainly should. If they do not and won't budge, I'd recommend to maybe contact your credit card to see if they can help.

It seems some. Per their announcement only small portion was affected. They probably plan to move everyone out for now. If this is a planned move, why was not it announced and scheduled properly and what was the reason to move dedicated servers with less than a day notice. If this was not a planned move, it is interesting what is happening to them.

Are they telling the reason why they are moving servers? And why hostpapa? Not multacom or any edge centre owned datacenter?

Went to 530 w last night, trying to pick up my servers and they wouldn’t let anyone in without management approval. This company is a joke. Anyone knows their support line number? I need to pick up my servers and run.

Really? Seattle is being migrated too?

Although I’ve already migrated our Los Angeles racks, I still have orders in your central and eastern data centers. I’d prefer not to migrate them because it’s a hassle. It would be better if there were no more changes.

Helping to understand the downtime and transition needs... It was previously posted that the LAX landlord sued to evict Quadranet on 2/11/25 and that the DTLA one (530 W 6th) did 2 days later. Here is more data: in addition to the $376,643.68 the LAX landlord claimed in their suit, 530 W 6th claimed another $599,379 ($300k/month for Jan and Feb). On 2/5/2025 Quadranet sent out emails announcing it was moving out of the 530 W. 6th location. On 2/6/2025 the 530 W. 6th Landlord posted 3 day notices to quit at the premises. On 2/13/2025, the landlord sued to evict Quadranet. On 2/15/2025 - a blog posted copies of the complaint (including copies of the leases), which I just ran across a few minutes ago: lowendbox.com/blog/600000-in-overdue-rent-read-the-quadranet-eviction-complaints/ lowendbox.com/wp-content/uploads/2025/02/Complaint-530.pdf lowendbox.com/wp-content/uploads/2025/02/Complaint-530PH.pdf Additional links that reference the case: unicourt.com/case/ca-la24-case5f8e31a6a497b0-22172?init_S=ctup_ltst rellis.law/case/25stcv04010/530-6th-street-llc-a-california-limited-liability-company-vs-quadranet-inc-a-california-corporation-et-al NOTE: The rules say that I can't post clickable links until I have made 5 posts. Well this is my 11th and I still can't post the URLs as links. So you will need to copy/past them into your browser to visit. sorry. NOTE: At $300k/month for DTLA, plus staff, plus other costs... it doesn't sound like the data center business is easy without scale.

Now that is the first explanation that makes sense. Thank you.

Sounds good. The main concern here is that they have to request remote hands for anything, which is only possible in case they have enough staff to manage their helpdesk 24/7. Hope you find a good place for your hardware soon.

Obviously all others will be closed too, it is just matter of time. They told they are moving services to other LAX facilities to ensure its stability but after a few weeks they decided to close shop. Not sure how can you still trust these clowns.

It appears to be only with their own subnets. Subnets announced with them are working fine.

Yeah, I think ip6 is still working, as all the google mail (typically on ip6) seems to be getting delivered.

Talking to myself here: Using the HE looking glass and BGP summary The 104.129.0.0/18 net still points to ASN 8100 with one peered hop, while some of its subnets (x.x.3.0/24 and x.x.4.0/24 and .14.0/24 and .15.0/24), all lead away to ASN 1299 (Twelvenet) and ASN 36352 (ColoCrossing). That is 4 of the first 16 with extra announcements added. I did not check the other 48 nets of our /18. But is suggests that possibly, someone has made some bad BGP entries and generated a mess.

Still waiting here. No response to my support ticket. IPv6 is working. IPv4 is not. It's in 96.44.128.0/21, assigned to HostPapa..

We have a bunch of servers colo'd with them, and we've been down since Friday the 3rd. No response to tickets, no idea what is going on over there. This is pretty wild and unprofessional of them.

I prefer using the hawk tuah girl coin -

What seems to be happening currently is an issue with their cogent port it seems? which explains the partial connectivity where some routes for example routes over any2ix are working still

Looking at the DNS of the last hop, it appears to be HostPapa, who I have never heard of. Not sure if it was like that after I got the new IPs or if this is part of this server move and the announcement that I now belong to HostPapa is the next shoe to drop.

Does edge centres really have the expertise and do they know what they are doing? Can't see much info about the company

It certainly appears that is what they are doing. Should not take 2 days though. The scheduled downtime was no more than 6 hours.

I have a rack at their Century location, which shows up on the status page, but we have zero connectivity. I believe that location is routed via DTLA, so any connectivity issues in DTLA impact us as well. I've opened 911 cases without response and waited on hold for about an hour without an answer. Long-time client here, but that's obviously about to change. We have mission critical services off-line >1 day now and intermittent failures over the last month without explanation. Completely unacceptable. I would go now to grab a couple servers and move them but doubt I can even get in since I can't get them on the phone and wouldn't be able to access the building. Recommendations on where to move?

Do you mind to share if they are still occupying the same building but just less floors in the downtown ? Or they moved out to other building?

I can imagine selling the client base already hosted on dedicated and recurring billing but what would be the point of selling the hardware, which for a lot of clients isn't really new tech ?? In any event my dedicated is still not up and still no news .. now that we are back to daytime in LA hopefully they will continue bringing back the rest of clients online... lets be optimistic...

Is opening a ticket useful? I really hope we're still not down for Monday...

So what do you think? is we are down and rest of us are up?

What should have they ready by end of the day? Are you waiting for IP replacement?

What did you do? Any suggestions?

You are now qualified to be a network engineer at Quadranet.

Ah, okay. My email was solely about downtime explanation. Probably he does not want to share for now.

unfortunately it didnt work Code: root@backup:~ # traceroute 216.45.59.202 traceroute to 216.45.59.202 (216.45.59.202), 64 hops max, 40 byte packets 1 66.154.127.17.static.quadranet.com (66.154.127.17) 0.577 ms 1.219 ms 0.364 ms 2 64.188.0.242 (64.188.0.242) 0.234 ms 0.272 ms 0.239 ms 3 64.188.0.3.static.quadranet.com (64.188.0.3) 0.237 ms 0.277 ms 0.241 ms 4 64.188.0.36.static.quadranet.com (64.188.0.36) 0.867 ms 0.819 ms 7.844 ms 5 * * * 6 *^C

It's funny...they closed my ticket and wouldn't give me any straight answers. As soon as I cancelled my servers, I get an email asking what they can do to keep my business. LMAO!! I don't know, maybe not have downtime for a week and a half and lie about what's really going on?

Could they possibly be clearing out people for better customers? If there were cheap power, which I don't think there is, then I might suspect it was related to AI. But this location is premium for connectivity to One Wilshire so maybe that is the focus if it is a higher purpose shuffle. OTOH, it's hard to imagine that is is something smart and savvy after they got into a situation where IP space was yanked from them.

They said last week... "We are reaching out to inform you that colocation services at 530 West 6th Street are being replaced with a new state-of-the-art facility in DTLA. We will be relocating our systems, and all customers have the opportunity for QuadraNet to relocate their equipment to our new facility at no cost. " The real question still yet to be discovered. Will the networking be Quadranet or HostPapa? i.e. which ASN will it be located under? Will we still be in QN ASN? If instead its hostpapa, then the underlying truth is, they sold all our accounts to Colocrossing (HostPapa).

Here is (888) 578-2372

If you require further information, you are welcome to open a support ticket and address it to my attention. However, please note that it is not standard practice for businesses to disclose internal contractual obligations, nor is it necessary. As a privately held company, QuadraNet operates within its own strategic framework and policies.

Do you really trust your data to these guys after all? They can say nothing will be changed and then change their decision because of “aggressive negotiation”, as they did a few times already.

Probably the reason they are not going to provide any real explanation. It is much more easier to name everyone asked for details as a clown. Would two landlords sue them at the same time if it was strategic decision to move into better served facilities? Probably not. It is pretty clear they were in rush and none of the moves were planned or expected in any way. Most likely they were trying to keep customers data in safe so urgent move was required which is ok if informed in any way. As I said already, the problem here is lack of transparency, lack of communication and their attempts to hide real situation, even now. No one would blame them if they were as transparent as possible from the start. They could just email everyone on Jan 6 and explain what is going on, instead they decided to keep it in secret. It is almost 2 months passed since then, they never emailed about the downtime, never released any RFO or at least short explanation. Then another downtime happened and they acted the same way even despite the fact it lasted 1 week or more instead of 6 hours, no RFO released again.

COLO Crossing is not their largest client. I recall they had META on the 8th and 7th, and other large customers.

Thank you.

Just trying. Maybe gradually preparing for the migration.

probably best to check your ticket and ask for the RFO

Very disappointing and unprofessional. One can only speculate but it appears the IP ranges were sold to HostPapa. During acquisitions often the acquiring firm desires the subscribers but not the IP address assignments that come with it, which are often sold off or in some cases simply leased. Assuming there was a plan to sell off excess IP assets, two weeks time to renumber out of the old IP assignments could have simply been offered.

13 hours down and still counting what is happening to quadranet

They answered my ticket and I got some new assignments. Luckily I set up IPv6 access to the console a long time ago - never thought I'd need it, but here we are. Its pinging back now, so now to the fun part.. all them firewall rules.

I feel for the engineers and support team that has to resolve all the tickets coming to them because of the screw up of the top management that prioritizes profit and dosen't care about customer satisfaction

Still offline here too (well, online with IPv6 but not IPv4). No response to my support ticket, made 7 days ago. Also no response to my request to cancel service, made 4 days ago. Their billing system is still working, I've just been charged for the next month of service for my unreachable server.

I got to the NEO portal now, they have updated their status page too now -- https://status.quadranet.com/

Hi, you mean your new-assigned IP subnets seems to be lost again?

they seem to be Asia-pacific based .. indeed not much info including on their corporate site which looks nice but lacks any precise data ... from the acquisition press release everything should be beautiful : The edge data center company plans to integrate the QuadraNet platform with the Multacom facility, both of which are based in Los Angeles. This will result in more than 100,000 sq ft of white space in California. Edge Centres says this will boost its capacity to host IT infrastructure in the region. Kiarash Jahangiri, the CTO at Edge Centres and newly appointed CEO at QuadraNet, told Data Centre Dynamics, “Edge Centres’ bold series of acquisitions made over the last year will now be unified under the QuadraNet brand. Stepping into the role of CEO at one of the fastest growing companies in the US data center and server market is a great privilege.” The acquisition has a strategic significance because of Edge Centres’ Point of Presence (PoP) located at Coresite’s One Wilshire. This PoP is adjacent to QuadraNet’s Los Angeles data center, ensuring improved network connectivity and service reliability.

I can’t disclose the source. What I was told is that they are for sure moving equipment out (at least partially, all dedicated servers), but the destination is unknown for now. From my findings it is related to HostPapa. Remember they sold some of their IPs to them, same may happen to hardware.

They just posted an update: Looks like someone woke up and posted an update, disgusting. Any good company would have everyone online to help and answer, not that **** we all see. Please let us know how it goes. Ask building staff about QuadraNet if possible.

I'm wondering if the "Asia Optimized IP" will remain working after this disaster. It used to be the most reliable ping/bandwidth I could find.

Exactly, plus, why wouldn't they sell/transfer the IPv6 or provide new IPv6? They are already issuing new IPv4, from Quadranet IP space, not issuing new IPv4 from a different provider! Optimistically my assumption is that I believe Quadranet sold IP space they thought was free, but was not. Then they are consolidating their datacenter floor space by wanting to have large empty spaces in their datacenters vs pockets of free half racks, quarter racks, etc. This all required downtime but was poorly communicated.

Absolutely -- this isn't a normal outage where there is a single fix that everyone is waiting for. If you are self administered server you are going to have to change out IP's yourself. If you have managed or shared hosting maybe you will be OK but I'm not sure.

This obviously not true. Small outage will not cause support unavailability and such a long delays in correcting the issue every time. Maybe their customer base reduced significantly and there is not much single customers who really care

I only have one dedicated server and it hasn't been up, so I don't know what the issue is. But yeah I presume it's the IP. I have two IP ranges and neither work, while the Asian optimized range was fine during the last downtime.

Are you up now?

IPMI & VPN still not working and connections to other ISPs are still down

My server is down again i am getting frustrated now

@ allanw @ sosys Thanks a lot for trying this ! This confirms what I have been suspecting , ie. that the box is either not physically connected to the local network or that switching/routing isn't configured correctly. What I don't understand is in that case how come I am able to connect through IPMI .. if such routes are possible it cannot be that difficult for them to provide minimum connectivity?

What did they say to you? My server is still down am just waiting for it to be online and transfer to another provider

It makes no sense to keep customers offline to free up servers/spaces, they could just terminate with advance notice or raise prices. It most likely very bad management, so they sold out IP space (by mistake, confirmed) which was the first fault, then dedicated servers move to HostPapa in order to get customers on HostPapa’s IPs online which was the second fault, then colocation customers move with less than a week notice. They had large footprint in One Wilshire which is probably not needed anymore, so moving out completely makes sense. What is interesting is the reason for not planning anything. They are in rush for sure, but why?

My dedicated servers right now with them is using a hostpapa network

They don’t pick up the phone at all

Yup, I got an email about this from them.

I’ll try to trust them, but I’m prepared to migrate at any time. I understand that after major changes, people might not continue, but sometimes believing in them might help them recover from the crisis.

Andrew - I would appreciate your assistance with Ticket 15357552 We are relocated but are still experiencing serious networking issues on both subnets. They have identified the problem but I am still awaiting a viable solution!

We moved multiple cabs that we had with QuadraNet to the Digital Realty 600w facility, and I must say that I was impressed that the QN guys did not create any hurdles and that it went pretty smoothly. They have also been pretty responsive in the past few weeks leading up to this, and while the whole situation is unfortunate, this could have gone much worse. I wish them the best going forward. We've previously been with Colo@/TotalServerSolutions/Performive and Psychz, both of whom were borderline scamming us and both of whom broke their own contracts (TSS tried to extort $6k or threatened days of downtime - part of which we paid iirc, while breaking their own contract, etc, good old days) when we moved out of their facilities, so this was handled quite well comparatively. Could it have been handled better? Absolutely. Are the guys who compete with them in DTLA doing it much worse? Also absolutely. Hopefully people are moving to better companies.

They just gave me 2 month worth of credits for my server. How can they do that if they are having cash issues? And are they killing off colocation?

I got an email today saying I am now a ColoCrossing customer. Now I am supposed to go to portal.colocrossing.com. So QN is definitely toast, at least in LA for what I am doing which is bare metal lease. Is that a good thing? I know nothing about ColoCrossing or Hostpapa, which is apparently the parent company. Logging into their customer portal it looks like all they did was import my customer profile. None of my servers, IPs, billing history, credit etc is there. I am guessing that 2 month credit Quadranet gave me is not going to be migrated over either. Oh, and there is something weird going on with my IP routing now. Some IPs are not working for some routers/ISPs. What a gong show.

If you look up your services IP address/subnet on a website like bgp.tools, you'll probably see what's happened here.

I am on a different sub so it's not just the 216.x.x.x sub that is not working.

The VPN appears to be working now, so we should have access to the servers via their private network.

I finally got my new IPs, but I had to be a squeaky wheel to make it happen.

Today is the third day our servers have been down, and we still haven't received any communication or updates from the support team. This lack of response is causing significant frustration among our resellers and customers. We are running out of options to manage the situation. We are on an annual billing cycle and just paid for the full year last month. Has anyone else requested a refund?

My IP range disappeared yesterday. All they can tell me - repeatedly - is that someone's working on it.. Been with them since 2009. Service has deteriorated over the last few years, but this is definitely a new all-time low. Am I understanding correctly that only their LAX location is affected? I guess it's their biggest location, but would still expect an IP sale to also affect other locations.

For what it's worth, this does seem to have happened pretty much after Cogents maintenance they did yesterday/earlier today in Los Angeles, Not sure if any other providers cogent ports are affected in Los Angeles, but yeah the timeline is pretty close to after the Cogent maintenance and no other Quadranet location seems affected at least. https://ecogent.cogentco.com/network-status

At least your service has been restored. This is a good thing. Mine is still waiting to be restored and I don't know when it will be. The next thing to do is to migrate out of this bad service provider as soon as possible. I've had enough.

For the colo folks who are down -- make sure to open a ticket with them. I was just following along with the status updates, but finally opened a ticket asking for an ETA, and they just told us we need to re-IP again because certain subnets were now unusable. They wouldn't say why, and these subnets do appear to still be owned by them. The new subnet they assigned appears to be 100% Cogent, so it looks like they dropped Arelion/Telia & NTT.

Still down and same email received !

On weekends, at least in recent months, they don't always have someone staffing that location. There is no "building staff" other than QuadraNet staff. Each time we visit we have to call the DTLA location to gain access, and right now they won't answer the phone so we are SOL.

I don't understand if the server will be live, and you are worried about the IP?

My server < Los Angeles - 530 W 6th Street (HomeDevice ManagementDevice Details) shows a green light but it's dead to the world.

Given that connectivity is mostly not back in their datacenter I'm not surprised the VPN isn't working. They are obviously playing with you if they pretend that they don't know it isn't working.

If only few clients were affected, they wouldn't have a status page with such info. Plus it would be quick resolution. This is probably related but not just the same issues as lost/sold IP ranges we had 2 weeks ago; the disruptions are much more significant.

Seems the issue is completely different for some customers. Some received new IPs quickly while others are waiting. Hope they will provide detailed RFO for everyone.

Who are you asking? If you are talking to me, no I'm not up as I need the VPN.

Ha ha ha! You got that right!

After up, it's down again? what's the location?

The server is configured to reply to a ICMP (ping) - Yes? If not, then give us a running service / port number to telnet to, and see if it responds.

Just a quick update : Yesterday, after numerous replies turning in circles one of the techs finally got someone at the DC to check routings and they found it was some networking issues with the subnet of my primary IP... a couple of hours later they assigned me a larger subnet /28, which actually starts below and includes my original /29 range. I reconfigured the server routing configs with the new info through IPMI and the server was back online...

Maybe to maximize their investment on QN and save costs? The ceo of edge centres said that their purchase of QN was bigger than their entire business

do you get notify mail ? or reply within ticket ?

714 227 9596

As I have instructed you to do countless times since I replied, use the ticketing system

Your Central and Eastern service(s) will not be impacted. You are welcome to stay in touch with me directly also.

Below is my continued diligently documented first hand experience I'm going through with Quadranet. 1st email from Quadranet after I authorize moving to new facility: " Thank you for the quick response! We are happy to have you moving with us to the new location! I am certain you will be please with the new location. In the days leading up to the move we will email you our timeframe in which we anticipate your devices will be moved. We expect no less than two hours of downtime and hope for under three and a half hours. We will ask you to safely power down all devices and secure offsite backups so when we connect everything at the new address it can come back up as soon as its plugged in and powered on. " Just before the moving, the email from Quadranet 2 days ago: " Dear Customer, We are reaching out to inform you that your services are being relocated from QuadraNet’s own facility to QuadraNet hosted at MULTACOM’s facility in Los Angeles as part of our ongoing efforts to enhance service stability and infrastructure. To ensure a smooth transition with minimal downtime, we require your immediate assistance. Action Required: Provide Root Password & Remove IP Restrictions To facilitate the migration, please: - Provide your root password securely via the NEO Portal or an agreed secure method. " My reply: " Your Neo website is not accessible to create a new ticket. So I send my login details here: ....... " 1 day later, reply from Quadranet: " Your ticket has been submitted to the Support Department. We will begin investigating your issue immediately. This email serves as confirmation that your ticket has been received. To save time, please make sure that all information that we need to troubleshoot is included your in email. Information such as your company name, relevant passwords, IP addresses, traceroutes, ping tests, and anything you have done to reproduce the issue. If you have not done this, please reply to this email with that information. Ticket Number: 15362727 " Later another email from Quadranet: " Hello, NEO has been fixed please try again. " My reply: " I"ve just created a ticket. My server has been down for one day already. Please help! " The other ticket I mentioned in the email was a 911 ticket I created one day ago. In the past 2 days, I called Quadranet 3 times, the longest wait was 25 minutes. No one answered me. As of now, no further response from Quadrenet. Now their Neo.quadranet.com is down again. My server has been down for 2 days straight already. In summary, here are the expectation discrepancies : 1. Expected 3 and half hour downtime, now 2 days and even if Quadrnet now responded with new IP and KVM, I will still need to spend more time to configure it. Last time in Jan, my server was down for more than 1 week 2. When prompted me to input credentials to Neo website, Neo website was down 3. Since Neo was down, I directly sent my credentials through email. I expect someone will look at the email and provide new Ips and KVM. It didn't happen. 4. When I created 911 ticket, I expect someone will explain and respond in email in one or two hours. It is more than one day without response. 5. When I called up 3 times, the longest being 25 minutes. I expect someone will answer. No, no answers. 6. I'd like give out my 2 tickers numbers here by logging into Neo. Neo is down again.

Recd. this mail from Quadranet: Dear QuadraNet Customer, We are reaching out to inform you that colocation services at LAX1 - 530 West 6th Street will no longer be operated by QuadraNet. This will also affect Power and IP services at this location. Your Options for Relocation: 1. QuadraNet Recommended Partners: i) Colo Crossing ( www.colocrossing.com ) - 800-518-9716 | sales@colocrossing.com ii) Psychz Networks ( www.psychz.net ) - 800-933-1517 | sales@psychz.net iii) Multacom ( www.multacom.com ) - 800-618-4628 | sales@multacom.com Each partner will manage the planning, documentation, and physical relocation of your equipment. To proceed, please: a. Provide authorization for our team to access your systems. b. Designate a technical contact to coordinate the relocation. 2. Self-Relocation (In-Person Pickup) You may choose to retrieve your equipment and move it yourself. If so, please schedule a pickup time with our team to ensure a smooth handoff. 3. Remain at 530 West 6th Street You may choose to stay at 530 West 6th Street if you negotiate a new agreement directly with the landlord. Morlin Asset Management, LP Jock A. Ebner President (213) 239-8120 Business Phone Number (213) 622-6491 Direct Fax Number j.ebner@morlinmgmt.com Why Is This Move Necessary? Our current operations at 530 W 6th St can no longer be maintained and accordingly, your equipment needs to be relocated. Support During the Transition QuadraNet partners whose experienced teams will assist with: • Renumbering your IPs (if applicable) • Minimizing downtime during the transition Important Information Before the Move Backups: Customers are responsible for their own data backups. We strongly recommend securing copies of all critical data before relocation. Loss of Data: QuadraNet is liable for any data loss or corruption during the relocation. Equipment Functionality: Equipment will be transported and reinstalled in its current condition. While we will handle your equipment with care, we cannot guarantee that all systems will return to normal operating capacity post-move. Next Steps: Confirm Your Preference by March 7th 2025 at 12:00PM (PST) To avoid service disruption, please confirm your relocation option no later than: March 7, 2025, at 12:00 PM (PST) If we do not receive your response by this deadline, your equipment will be relocated to a new facility operated by one of our partners above. How to Confirm or Schedule Please open a support ticket in the NEO portal for: Authorizing QuadraNet to relocate your equipment Scheduling a self-relocation/pickup Submitting technical contact information No Penalty for Contract Termination We understand that this transition may cause inconvenience. Therefore, if you choose to terminate your services with QuadraNet, we will: Void the remainder of your contract Waive any penalties or fees for early termination We greatly appreciate your understanding and cooperation during this transition. Our goal is to minimize downtime and ensure a seamless relocation to the new facility. If you have any questions or concerns, please contact us directly through the NEO support portal. Thank you for choosing QuadraNet. -- Best, Melissa Pearl Director of Client Success

Quadranet has no financial problems, I think they must be restructuring, remember that it was acquired by Edge Centres

Good morning, We are contacting you to inform you that Quadranet will be ceasing operations as of March 30th, 2025, in Los Angeles, CA. This was not an easy decision, and we sincerely appreciate the trust you’ve placed in Quadranet over the years. Due to the closure of our Los Angeles operations, the InfraCloud environment will no longer exist and access to your data and the service will no longer be available after this date. We understand the inconvenience this may cause and sincerely apologize for the short notice. We encourage you to take immediate action and begin transferring any important data from the cloud service to ensure it is safely stored elsewhere before 30th March 2025. Unfortunately, after this date, we will no longer be able to retrieve or restore your data. Again, we apologize for any inconvenience this may cause. Got an email from colocrossing to but without any login details are they also botching this up

Down 4 hours so far... https://bgp.tools/prefix/216.144.236.0/23 AS is Hostpapa/Colocrossing? I dunno what it was before.

We cannot access internal network over VPN

thanks for the confirmation, yes, VPN is working but how can we access server public IP address? any idea? Note: we still didn't get the new IP range and still waiting

I got my IPs a few hours ago and this is also what I did as IPMI access is not working. Now I have to restart like 80+ services to reflect the new IP change. For some reasons its not picking up the new IP so more work for me So where are you moving now guys?

Has anyone noticed that the 216.144.236.xxrange has suddenly come online and started working? It's functioning for us now, but we haven't received any communication from QuadraNet about whether this change is temporary or permanent? We've updated only one server so far, but the gateway is not pingable on the new 191.161.xx.xxrange. We really wish QuadraNet could be more transparent about this.

Hmm... Do you see any service details in your NEO portal? I can't load any service details, devices data are not showing as well. Seems some internal systems/networks are not working properly.

Yea, I was having some routes not working off and on again this morning and now everything is offline. They have a couple announcements on their dashboard. One is of some problem with Cogent. There is also another announcement of some emergency maintenance that could take customers offline for up to 6 hours. Their status page shows a major outage in downtown LA which probably means the whole datacenter is offline. https://status.quadranet.com/

How many servers do you have on them guys?

Ask them about your hardware location. I heard they moved hardware out of its original location to some other facility which explains renumbering (probably they can't run original network in new location).

Just canned response. Maybe even automated. It appears they have no permission to say what is going on.

What if visit their main office? This will also let us know if they really working on the outage.

According to lowendtalk thread (https://lowendtalk.com/discussion/201740/quadranet-performing-bad-compared-before) about quadranet, they told Asia optimized will no longer work as previous owner dropped it. Not confirmed though, but there was a quote from their director.

It's bizarre they would start consolidating rack space without providing any notice. Just take everyone down for an estimated 6 hours which turns into 4+ days.

Connectivity is fine. This outage is only about addressing and maybe some routing. The connections are fine. Some of my IP's never went offline. A suddenly misconfigured network in a server/device is not a datacenter connectivity problem.

Why we are only some people here talking about this issue? others are sleeping?

They just closed my ticket without a response so I reopened it and asked for an explanation. They then deleted the ticket off my history.

5 days off and counting. Despicable

I'm finally up and running. Good luck everyone.

Downtown LA my server is down again. Maybe edge centres does not really know what they are doing

are you being given public IP address to access IPMI ? or are you being given KVM lantronix access ? for my case, i have to reconfigure eth0 with public IP address. Previously, eth0 was the private network, and eth1 was the public network.

They never really answered anything, just kept giving me the runaround. They kept saying that it's a network issue and the senior engineers are looking into it. That was it. One of my servers was changed to Hostpapa IPs. I noticed it in the panel. I never received any communication about any of it. Could never get the new range to work, and didn't try very hard, as a company who pulls nonsense like this is never going to keep my business.

at LA, with colo, do they have 530 West 6th and 6171 W Century Blvd ? or any extra ? which LA dataceter will be moved ?

I asked a few hours ago for an update. Got some nice reply, but no details. Of course it is night time now, and support probably don't work much on weekends either. I have a standby server elsewhere to fill the gap, so no big loss for me. But heck, what sh_1_t show QN has become.

Do you know who Chris is? Tried to call this number but Chris did not answer

Your ticket is already meaningless, and you haven’t told me the real situation. Now, no one is responding to my questions. It looks like more things will keep happening on your end.

Got your DM, thanks a lot

What we need to know is if quadranet is still going to survive. It is clearly not a transfer but an eviction from the building. You didn't pay rent so why did you decide not to pay rent? Why did you sell your IPs? And why did you sell yourselves to edge centres if you are not having cash difficulties?

Are dedicated customers already moved?

LOL! Then explain the 500+ K lease court case against them?

For logging into the Colocrossing customer portal, I used my QN email address as the login username. Their system then sent me a password reset email. I am assuming it's the same for everyone. They did reply to my ticket almost immediately saying that they need to manually port over my server details. They also said they will honor the QN credit applied.

Now they are telling me they can't get my IP's back!!!. Unbelievable!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Yes, their VPN is still not working either.

Public IP still down damn quadranet what is happening

tier.net, they gave me 2x 10TB HDD drives for free with the $279 Ryzen 9950X server while I'm paying $150/mo for that storage upgrade on a 8-year old server with only a small discount applied later. So they've made some good money off me being lazy to migrate

It seems like they will soon have some more spare IP ranges.

Yes. The NEO portal works fine for me.

just got on the phone, and they are performing server movement. The cogent issue has been resolved. This is beyond words

UPDATE: I spoke too soon. While my physical server and /29 is working. My /28s, which is what my customers are on, are not.

https://status.quadranet.com/incidents/tcc568rcc65r

Do they move dedicated servers only ?or include colo ?

Hello! We are all in one boat. What service will you recommend instead of Quadranet? We need server in California with a similar pricing, but server that works. Thank you for your advise.

Well, for me, lack of asia optimized routing is almost equal to dead server.

Same here. In the "bandwidth monitoring" subsection < "Port Monitoring" are your public & private ports showing red light ? and obviously no bandwidth graphs ?

A misconfiguration doesn't take 4 days to resolve. There is obviously more to it.

I have no idea ... none of this really makes sense .. in reality we really don't know how many customers they actually have at this stage

I receive this now so it looks like a real person this time. "Hello, Can you please try to not open multiple tickets as it is slowing down our process. We are working non stop to get these issues resolved, we have an extremely large amount of tickets and you putting in 10x tickets is not helping us sir. I promise you we know of all issues and are working on them. We thank you very very much for all the patience, we will update you in the original ticket once resolved. Regards, -- Minas Karagezyan Support Supervisor minas.karagezyan@quadranet.com | +1 (888) 578-2372 QuadraNet Enterprises, LLC. | Dedicated Servers, Colocation, Cloud "

We are online now! Only took 5 days. Recomend emailing the CEO directley. You can find his email address in the Quadranet DTLA Maintenance Status Update

I am online now too. Backing up everything and moving away to Reliablesite.

Is your IP under hostpapa ? or QN ?

To access IPMI they gave me a specific public IP, this IP is new and not related to the public IP ranges I had on the server. eth0 was reconfigured with my primary public IP ( 216....)

They attached my server to a kvm and lo and behold, my server is unplugged from the network and they are not doing anything

Maybe people on this board can get together to form a coop and rent out a wholesale space all together somewhere

Was it Alex’s reply?

Their employees.

I already told you the answer to your questions. We made a mistake during our planning process and we partnered with someone else. What are you not understanding about it? Let me know, I am happy to clarify. If you are expecting that I intend to divulge our strategic business plans on a forum, this is not something that is going to happen. Your answers have already been clarified regarding the difficulty with our migration initially and I have also clarified who our partner is. What else would you like to know?

You're welcome, please reach out if you have any issues!

So anyone know if there is still 24/7 onsite support?

This was a nice typo/slip up if this was actually word for word how the email was received :-).

Seems like MTheory named company is acquiring the colocation clients of QN.

Yes, mine was too (colo box sent to 1200w/hostpapa). The incoming traffic is via Quadranet ASN and goes out via ColoCrossing ASN. Because each has differences in their private peering to the big sites, my server was unable to reach, Google, Microsoft, Amazon S3, Cloudflare, and probably a few others. Users sent POST data to my site was also semi blocked. Solution. Transfer your account entirely to ColoCrossing and get new IP's from ColoCrossing. i.e. one ASN so one set of routing rules, not two.

So we should open a ticket about it?

The status page shows down now and nothing else, ridiculous but glad to see I am not the only one with servers down

We have also lost our IP addresses at Quadranet's LAX location, and their support desk is currently only able to offer replacements. This is an unfortunate way to conduct business, as no prior warning was provided to clients. To address this issue, we have ample capacity at our other LAX data center and are offering both new and existing users affected by this disruption a free 30-day migration period.

When quadranet assigns new ips they do subnetting or just from a pool of a /24?

The server went offline completely while waiting for IPs replacement. Not sure what is going on there, but QuadraNet is no longer reliable for sure. They were really nice some years ago and things got worse and worse after every sale.

So whatever happened with this? Was there any explanation? Last comment here was a week ago so is everyone back up now?

Why would they perform server movement what is wrong with them

There are a total of seven servers with them.

They posted this update. Anyone here back online? Update - Our team is making excellent progress in getting all bare metal customers back online. Some single colocation customers are still experiencing issues, and we have all hands on deck to restore service for everyone affected as quickly as possible. Jan 24, 2025 - 11:58 PST

My colo has not moved. Its IPv6 has kept running throughout. This is just a repeat of 3 weeks ago, where HostPapa take control of more subnets from within Quadranet. Of course, if the transfers mentioned above prove correct then this IP sale / movement is coordinated and deliberate.

Most of my time is dedicated to the Palisades Fire remediation effort, so I don't have time to go downtown just to see if they're working. If anyone else does, please do post info - I'd appreciate it.

Our server finally returned back. It took 42 hours to recover...

I am not sure if the took down rack or moved servers on other facilities. As far I saw yesterday was our servers on 530 W 6th on 9th and Penhouse's floor were not moved at all. Somehow quadranet lost these ip blocks 69.12.70.0/24, 69.12.69.0/24 so they had to assign new ips to colo clients. They only have one tech working on 530 and they don't answer phone or ticket so the only option is to drive down there tell them to assign new ip block and fix it yourself. Good luck guys.

A suddenly misconfigured network doesn't result in a 4 day outage. Why are you trying to make excuses for them?

Yeah. Someone mentioned there was only one tech on site, and this is during the major outage. They would probably have more staff per shift if they were big. One person per shift in the data centers world means normal work load is a small, so customer base is probably small now as well.

FWIW, I never made 10x the tickets either. Gave them the weekend to answer me. The way they are dealing with us all is appalling however I get the feeling they are very stressed.

Did you have to reassign the ips yourself or did they do this for you?

Is anyone getting any communication about this from them? They seem to be completely ignoring me now.

Was previously under the 67.x.x.x now it is 104.x.x.x which is under hostpapa

I've been reading this thread. This looks really bad. We also had some customers leasing QN IPS, they were all of a sudden sold out and derouted/assigned to another AS. We have been escalating this issue for weeks now. Nobody really cares.

Well that answers the riddle. A .200 is cannot be the base of an address with a /28 mask cidr 216.45.59.200/28 Input : 216.45.59.200/28 Low IP : 216.45.59.192 High IP: 216.45.59.207 mask IP: 255.255.255.240 IP's : 16

No rush, just want to move fast and have investors. I recall Switch and Data one time was in a similar situation. But what they did was sinister, they just told their landlords they were terminating the lease after they got their customers out, and then told their landlords "sue us". And no one sued them!

Told you so, they will move everything into one facility.

No luck. If you have any other numbers or suggestions, please share

I’m not asking you to tell me your plans. It seems like your responses are just copy-pasted and don’t address my concerns as your customer. Your business migration feels like you just sold us off to someone else, and we have no idea why you did it.

How dare you come here and talk to people like that after being completely silent while people have weeks of downtime, changed IP addresses without notice, techs. lying about what is actually going on, etc. What a bunch of clowns.

In short .... I don’t believe they do! I was in the process of scheduling a time and date to relocate with Melissa, and during the conversation our rack was, without warning, disconnected, our cabling thrown out, and everything relocated. That was Friday 14th Feb. I was given the same 2 to 3.5 hour promise. If I remember correctly 48+ hours later, (after a LOT of emails and tickets replies), they let me know they were racked at the new location. Quite a scary experience due to the lack of communication by Quadranet. However our rack was without uplinks for another day or so, (again going from memory – as like others have indicated Neo is not working). We next discovered they were patched completely wrong. It took so many requests to get this sorted - it was not cool. And latest issue – and I hope the final issue – they have some sort of routing issue with our subnets from the old location?? Still not resolved. The pattern I have observed from upwards of 40 replies and emails to the ticket is – someone at Quadranet is reasonably diligently online and responding. HOWEVER they simply forward my requests to another party at the new location and report back to me that they have. The other party doesn’t appear to reply after 7pm Pacific time – or before 7am Pacific time - and weekends – like today I still have had no response from Quadranet staff or their other party via Quadranet in over 24 hours……. So I guess Quadranet have staff online somewhere – but it certainly feels like there is no longer 24/7/365 onsite support. Maybe its due to the share quantity of fires they are fighting? Or this is the new normal for the LA DC? It’s now 8 days and I am still without a fully functioning network to my rack. And all this after ....... like many others on this tread we were also down for several days back toward the end of January due to our subnets being sold off ……… without notice. I have been a Quadranet colo customer since 2011 – and I have to say they have been awesome up until now.

Huge typo!

All locations or ?

We received an email from Colocrossing as well. It was a relief given the situation. We are using the ColoCorsing's Servers and IPs, since 2016 and never had any issue with them, their pricing, support and services are top notch so all will be in the safe hands. Subject: Important: Your Quadranet Account Has Been Transferred to ColoCrossing --------- Dear Host Namaste, We are pleased to inform you that your account has been successfully transferred from QuadraNet to ColoCrossing, a HostPapa company, effective immediately. We are excited to welcome you as a valued client. For nearly 20 years, ColoCrossing has been a trusted leader in the global hosting and data center industry, delivering reliable infrastructure solutions to businesses worldwide. At ColoCrossing, we are committed to delivering an enterprise-level experience, including 24/7 technical support, a dedicated account representative, fully redundant network infrastructure, and a scalable environment. We also have exciting plans to enhance our platform and services throughout 2025. Your equipment is already housed in our facility, and since the IP addresses are owned by ColoCrossing, this transition will not result in any downtime, migrations, or IP changes. Additionally, your current pricing will remain the same. Portal Access & Billing Information A portal access link with a password reset option has been emailed to you. If you have not received it, please visit https://portal.colocrossing.com/forgot/password and reset your password using your email address as the username. If you have any questions regarding portal access, please contact us at sales@colocrossing.com . For billing or sales inquiries, you may open a ticket in the portal or email sales@colocrossing.com . You can access our billing portal here: https://portal.colocrossing.com . Invoices will be issued by ColoCrossing starting April 1, 2025. Please do not pay any future invoices through QuadraNet’s NEO portal. Next Steps Your device(s) may not immediately appear in your account, but they will be added over the next few days. If you require technical assistance, our team is available and ready to help. We appreciate your trust in ColoCrossing and look forward to serving you. If you have any questions, please don’t hesitate to reach out. Sincerely, The ColoCrossing Team ---------

Never have I seen such incompetence in a provider where they actually lose my IPs. My customers are going to be thrilled when I tell them I need to change their IP addresses.

If they are going to sell their IPs why didn’t they give us time to renumber- even Verizon is more competent than this

What do they mean by this? Is it to migrate the server to another data center or just to change the IP address?

It's been almost 40 hours, and the servers are still down. While IPs have been issued, we can't set them up on the servers until remote hands are available. If anyone is considering proceeding with legal action against them, I am willing to join.

First goal is to find another suitable carrier to migrate to, and then I'll deal with that. Since they have all our equipment and are effectively non-responsive, that's the higher priority for now... I don't have any inside info, but based on ARIN and Looking Glasses, etc., they are announcing 216.144.236.0/23 even though it doesn't belong to them, which is usually a big no-no. They may have reached an agreement with the company they sold the IPs to that will let them route it for a short period of time, but I strongly suspect it's not a permanent thing.

It seems they are having connectivity issues right now?

Are you a colocation client or dedicated? Are you a colocation client or dedicated?

Well this is a double disaster. I got my IP's ripped from under me, 2 weeks ago (104.129.3.x). They gave me a new range in the 192.161.62.x, but these are all poisoned by scammers and spammers. They refused to put any effort into cleaning them up. 2 days ago, I got reassigned another range, this time 104.129.61.x. It lasted 1 full day, and now it looks to be ripped out from us again. Dear QuadraNet, I will be leaving ASAP.

not for mine dedicated server. getting pretty frustated

They probably moved dedicated servers and some of colo customers. It appears they made some arrangement to move into HostPapa to make IPs accessible again, which failed as well due to the mess and lack of the staff (no onsite staff outside of business hours). At least their ubersmith is on HostPapa network now. Probably it is a time to contact HostPapa to get some answers, they are indeed involved.

There doesn't seem to be much of anything going on since nobody here has come back online, even if it's just a sample size.

You are lucky 😛 Is it LA or Chicago? Are IPs the same?

eth0 LAX9.0.3.0.switch.priv:ge-0/0/3 eth1 LAX9.0.3.0.switch.pub:ge-0/0/3 Both Green

I opened another ticket saying my subnets were still offline because they closed my other tickets. They went and deleted it so now I am really starting to get pi**ed off.

I think they have more than one person on site in LA. I have had ticket updates by at least 3 people and now it is assigned to CTO.

And now this which was all I needed to hear. In a summary I asked them if they were going to leave us all in the dust and shut down. That I'm just a concerned and very worried client. This is their response. "I grantee you we are not going to shut down, if this is your worry you have nothing to worry about. We are working on many many tickets as to why our response time is very slow, apologies for that. We are hoping to have all issues resolved very soon. Thank you once again for all the patience from your end, once all is back to normal we will provide you a official RFO. Thanks, -- Minas Karagezyan Support Supervisor minas.karagezyan@quadranet.com | +1 (888) 578-2372 QuadraNet Enterprises, LLC. | Dedicated Servers, Colocation, Cloud "

Same IP for us on our dedicated server.

still waiting .... did anything change for you in the Neo interface when your server came back online ? Am referring to the "Port Monitoring" section of "device details" where you see the 2 eth ports; did these turn back to green?

even with the HostPapa IP address, you cant access your dedicated server ? check again with bgp tools, maybe the IP get reassigned again

is this the same IP prior to all of these incidents ? try to use the original IP address that you were assigned when you purchased the server. Or try other IP subnet that you were assigned in the past. I presume your gateway is 216.45.59.201, this is not pingable from outside I can ping this gateway IP from QN server,but not from my computer Code: root@backup:~ # ping 216.45.59.201 PING 216.45.59.201 (216.45.59.201): 56 data bytes 64 bytes from 216.45.59.201: icmp_seq=0 ttl=61 time=1.615 ms 64 bytes from 216.45.59.201: icmp_seq=1 ttl=61 time=1.372 ms 64 bytes from 216.45.59.201: icmp_seq=2 ttl=61 time=3.970 ms 64 bytes from 216.45.59.201: icmp_seq=3 ttl=61 time=2.518 ms Did you try to email Jon ? Probably he can help to direct you to his network engineer

Yeah, it seems like one hand doesn't know what the other one is doing. Too bad and sad to see.

Well, investors will never invest if business does not worth it. Most likely something went wrong after they acquired QuadraNet which leads all these things. Multacom is ok, so it is indeed about QuadraNet only. I suppose many customers left after such a long downtimes and they are trying to cut their costs as much as possible. No 24x7 on-site staff (they always had staff at LAX facilities 24x7), lack of staff in general (never happened before EdgeCenters came in), move out of their own infrastructure to leased space All these things mean they are trying to cut costs in very aggressive manner or maybe split parts of their business between other brands/companies.

What is interesting it is HostPapa facility, as I was told before all of these recent things happened. IPs sale may not be a human mistake as they said it. Most likely HostPapa very much involved and they are trying to hide the real plan.

These are all the numbers I know for them.

As noted countless times - It was clearly requested that you provide the ticket information and I can be helpful, you are just being belligerent and difficult intentionally. You are welcome to provide the information as requested and I will help you, otherwise I do not know what to tell you anymore.

understood.

It was predictable. None of their migrations went smooth and all of them took significantly more time than announced. Make sure to move everything out to another provider as soon as possible.

I copy and pasted what I recd. :-D

I didn't see what kind of company this is.

Do you guys remember some of my posts? In Jan I said I was told they sold dedicated servers to HostPapa. I was not able to proof it publicly as that info came from their employee directly, but we now see it was truth. So it seems the decision was made long time ago and their statement “this was not an easy decision” is another lie

Mine too. The link / path through CoreSite, seems to be down.

I am seeing a new IP4 address range added in my Quadranet customer portal.

The official explanation provided by support was "routing issues." However, the IP addresses are now under the control and ownership of HostPapa, leading us to believe this is a forced migration rather than an unforeseen routing issue. In light of these events, we have decided to discontinue using their services. We are actively working with affected clients to assist in migrating their infrastructure to our new data center. This situation has had a domino effect, and offering 30 days free is the least we can do.

Yeah, the new IP range 192.161.62.0/24 is poisoned. Blocked on a bunch of email lists.

It is bad for the actual techs there, but from what I've read and seen in other places, what they've done to very long term customers is despicable for a company their size. But this isn't super uncommon for datacenter/network providers who's owners sell out and toss a company away to the highest bidder for retirement. I truly feel sorry for everyone who is having the endless nights, who have thousands of customers in the dark, who have to manually reconfigure hundreds/thousands of IPs.

My server is fine now. There was no explanation. You may be experiencing what others were experiencing before you. My problem started days after this topic was opened, so the timing is not the same for everyone.

I am a dedicated client

There are millions of dollars in investment being used to buy all these data centers such as Quadranet. I think it is probably irrelevant to the purchasing investors if customers leave because a new marketing effort by the parent company will just net new customers over time, many of them large retail customers and enterprises. I could be wrong, but in my experience I don't believe so. One memory that comes to my mind is when many years ago Abovenet (now Digital Realty) had an entire FLOOR of retail customers at 111 8th Avenue New York City and kicked them out on the street with only 30 days warning. This was purely a business decision and they did not even have the decency to warn customers a while in advance. Contrast that to Verizon who is often considered to be the evil empire, recently closed their data centers and gave customers 180 days advanced notice. Abovenet's logic was that they wanted to "focus on wholesale customers" and only wanted 5-6 customers across their entire footprint, instead of managing dozens of smaller accounts . In the end they ended up with almost NO customers and lost all the revenue from the ones they booted, who ended up going to Equinix or left the state. They stole money and overcharged those customers who mostly never got their tens of thousands of dollars back even under threat of legal action. This was all going on while the CEO was out busy golfing in Katohah, Westchester. At the time we worked with many customers in those suites and spoke to Abovenet C-Suite directly warning them that their business plan will fail, and that retail customers are the future, but they did not listen. Sure enough their business started to fail and suddenly they suddenly pivoted back to retail colocation customers. All those customers kicked out for NO reason. Fast forward to today DRT is doing just fine. While I am not saying that is what is going on here, I am just providing some perspective that often customers are seen as a financial transaction when all is said and done, especially by those data centers who are glorified REITs. Redundancy is important, folks.

I'm a single unit dedicated server, not online yet. It's almost the end of the day anyway so no rush guys...

Interesting. I'm in Chicago where they have finally acked a problem on the status page but they are saying it's some kind of router thing.

Hard down over 2 days in their Chicago location. Can't raise anyone on the phone (endless ****** hold music) and they rarely respond to tickets and when they do it's useless drivel. Wondering now if we'll be able to physically get our equipment, assuming they are going under. Was going to replace that box soon anyway, but was planning to reclaim and reuse the storage, ugh. Anyone know anything about Sectorlink?

Is it Dedi service or Colo?

It is from their staff member. I can’t be more specific because of the private nature of the conversation. It is up to you believe me or not. If you would like to discuss please PM me. Really, I can’t disclose anything else publicly as I don’t want any troubles for the person. Thanks for understanding.

I'm not making excuses for anyone. I am just being specific because some people may not understand what is going on here. If someone thinks a cable is broken that is different than IP addresses that are no longer valid. Very different. Connectivity problems are generally solved without individual customer intervention. That is TOTALLY different than what we have going on here with IP addressing! And yes -- if your device is (now) misconfigured you are going to have a 4 day or whatever length of outage until they are fixed! So you are wrong about that.

Has anyone tried to access by IPv6? I am assuming that should work and if so you can change your IPv4 address out yourself if they've give them to you.

anyone has servers become accesible from the past 6 hours ago ?

I asked sales about Asia Optimized IP/routing and got this reply: It sounds like QuadraNet is giving up all its previous peering? (maybe for a cost down?)

Yes, ports are green now. So it seems network was not even connected all the days.

Yes even with the hostpapa ip address i cant access it did they change ip addresses again?

On 2nd thought, since i can reach your gateway, did you configure your subnet correctly ? maybe give your port as rosswht mentioned, hopefully there is a good chance some of WHT members can reach your server

Yes, and different people reply without actually taking time to read the facts and understand the situation. What's the point of having a sophisticated ticketing system?

Multacom/EdgeCenters are the same people, lol. They bought Quadranet but could not keep it running, yet they promote their syster company for better support. Why would anyone want to host at either company?

I was undecided about posting today, but in the end, I thought that if I was in a different position, that I would wish someone would tell me and give me the facts. In fact, when I got the email of the move, I did a Google search and found thread about the IP fiasco which took me down the road I'm noting below. Without this thread, I'd likely just have waited out the move, which for full rack colo clients as noted below may or may not turn out well. Quadranet is moving out of 530 W. 6th street. That's old news. I'm guessing its likely inevitable that they will move out of their West Los Angeles center very shortly too, if it hasn't been announced and started already. I did a Google search and it seems the reasons for the moves come down to money, or lack thereof: On February 11, 2025 (last Tuesday) 6171 Century (their west Los Angeles landlord) sued to evict for $377k in back rent: unicourt.com/case/ca-la24-case5fb02566bbc2bd-20021?init_S=ch_ftrd Two days later, on February 13, 2025, their landlord in downtown LA also sued to evict: trellis.law/case/25stcv04010/530-6th-street-llc-a-california-limited-liability-company-vs-quadranet-inc-a-california-corporation-et-al Since I haven't posted 5 times I guess I can't include a full link. add the htt... It seems these evictions take a minimum of 45 days, but maybe longer with court backlogs, or longer if Quadranet put up a fight. But in any case, Quadranet at least at 530 isn't waiting around to move, which is likely best for all. This isn't necessarily disaster for small clients (the most profitable ones for any hosting company), but everyone needs to make their own analysis of risk and make decisions accordingly. For small clients in particular, the move might bring you more reliability and be fine. For colo, I'd be more careful as I'll include in a follow up post.

NEO is back

You never instructed me to use ticketing system.

* The IP transition obviously gets a 'F' grade on execution and communication. * For customers not impacted by IP issues, they still had significant downtime from the Cogent experience (lack of backup BGP), and the transition still gets a ‘D’ grade as its been rough -- especially because people didn't know how bad the situation was or wasn't and the worst case is really scary... * As far as I can tell, HostPapa is trying to be as supportive as possible to Quadranet and Quadranet's customers. The fact that IPs sold to HostPapa are working at the moment while Quadranet and HostPapa try and get a 'state of the nation' internally is testament to this. * The 2 ways to communicate to Quadranet now seem to be the ticket system and responding to some of their announcement emails sent by mgt team members helping with the transition. The latter is maybe better for big picture questions, the former for well, specific needs. If you don’t get a response to a ticket I’d take Andrew up on his suggestion and post a ticket number here. For non-emergency tickets I’d try to give it a few hours at least -- I have to imagine the number of tickets hitting the system recently has been overwhelming. Andrew -- I think it would be less scary if there was some kind of regular communication that said something like "90% of internal servers in DTLA moved, 80% of hosted accounts and rented servers moved, and 70% of colo". From my perspective, some key worries I had were (1) was everything going to get moved out of 530 in time (and was the landlord there going to cause problems?), and (2) was there a place to go (HostPapa or otherwise) for everyone. As I mentioned before, I've sometimes found Quadranet far from responsive in the past, and currently it's amazing how dirty the 530 data center was in my recent visits, but I've actually found Quadrant to be responsive to my communications in February about specific issues (my account / my machines), but less so to the big picture questions asking what does all this mean (likely because they weren't sure how to manage the communications but largely likely because they were like everyone else trying to figure this all out in real time)?

One reason that I, and probably many others liked Quadranet DTLA, was its great network peering it had built up over the years. But this new home of ColoCrossing / HostPapa and its peering, is really 2nd rate at best. Also no IPv6, although they perpetually promise it for next week (it's BS). Andrew, last week I got email asking / saying we are moving again to Multacom? Is this move still on, and will it be to 707 Wilshire, or are you just rebranding of 1200 W 7th?

Still nothing about owing over half a million dollars in unpaid rent, and being evicted. Shame on them.

This applies to the LAX location.

I feel like you have a lot of resentment toward QN, as if they have hurt you quite a bit in the past. To be honest, any company can face problems. If it were you, and all your customers left when you ran into trouble, how would you feel?

The IPMI VPN still doesn't even work. So I cannot even access my server to reconfigure IPs. If they lost the range you would think they would have updated that with a new IP by now. Unbelievable!

I am looking on this page and still showing me our old IP range https://manage.quadranet.com/client/..._ip_groups.php do you have another link where you can see it?

I think @ PureVPS is saying their own clients (not Quadranet) will be migrated to a different datacenter. I don't think Quadranet will be migrating customer servers or equipment for free from downtown to their airport/century datacenter. The only quick remedy for Quadarnet customers is to accept the new IP addresses and reconfigure their equipment. Any long term plans to stay with Quadranet will need to be evaluated.

Anyone else seeing heavy packetloss to Cogent based routes right now? like 50%+ loss ?

I 100% agree. As a long time Quadranet colo customer with racks in both LA datacenters who recently migrated everything to CoreSite LA2, I feel grateful to dodge a bullet but also feel extremely bad for all the support staff. They are great people who are being lead by new leadership who is negatively effecting current customers. I know in December, the current Quadranet leadership monitored the following inbox: QNleadership@quadranetent.com (notice the "ent" domain). You can also try reaching out their CTO, Andrew Moore: andrew.moore@quadranet.com If anyone needs help or guidance, please feel free to direct/private message me and will do my best to help in anyway I can.

Still down for me, still no response to ticket. I did request cancellation of my service, so its not a big deal as long as they stop charging for it.

At least you know that their LAX location is not dualhomed.

Has anyone contacted EdgeCenters directly to ask what is going on, instead of Quadranet?

Still offline too. Not sure what progress they made

do you mean neo.quadranet.com 198.55.111.52 ?

Really do hope they will give some kind of compensation for this long downtime

this just came back online at this hour ? That means they are working around the clock to fix the issue ? Do you mind to share your prefix IP address ?

Yours may be getting a little closer to resolution hopefully. Mine on a different switch still red: eth0 LAX9.7.7.0.switch.priv:Gi1/25 eth1 LAX9.7.7.0.switch.pub:ge-0/0/1

To put it another way -- a data center connectivity problem is a problem with transmitting packets over a link, affecting everyone or all the packets that try to use it. That is a single problem. What we have going on here is like 1000 problems because every single device that has a (now) bad address has to be reconfigured. Each device needs resolution on a case by case basis. PS I hope you know you are going to have to fix your DNS and a bunch of other crap for this. It is 1 big problem vs 1000 little problems.

It is interesting you are receiving updates while others are waiting. May you share the names of the persons you got responses from? At least Roman is not on site person.

no... but it seems they may be working on something as my Ips are now tracerouting to Cogent (and dead-ending there) which wasn't the case yesterday

Still no progress as far as my dedicated server is concerned ...

That has been my supposition ... either not physically connected or respective switches off...

Something weird happened, I suddenly can't access network from my server but I can still connect via SSH and Cloudflare is serving up my pages fine? I turned off csf to test. I've been transferring 3TB+ out the server for the past few days. Code: [root@serv2 ~]# ping 8.8.4.4 PING 8.8.4.4 (8.8.4.4) 56(84) bytes of data. ^C --- 8.8.4.4 ping statistics --- 82 packets transmitted, 0 received, 100% packet loss, time 80999ms [root@serv2 ~]# traceroute 8.8.4.4 traceroute to 8.8.4.4 (8.8.4.4), 30 hops max, 60 byte packets 1 66.63.177.113 (66.63.177.113) 1.175 ms 1.133 ms 1.112 ms 2 * * * 3 10.9.5.153 (10.9.5.153) 0.337 ms 0.339 ms 0.396 ms 4 62.115.164.218 (62.115.164.218) 0.971 ms 62.115.162.226 (62.115.162.226) 0.955 ms 62.115.197.40 (62.115.197.40) 0.903 ms 5 62.115.112.246 (62.115.112.246) 0.672 ms 0.766 ms 0.890 ms 6 * * * 7 * * * 8 * * *

Thanks again for your help looking into this ! The fact you can ping the gateway is good news.. All standard ports should be running (80,443,22...); configuration was done by the QN tech to revert public on eth0, the IP is the original one... It seems there is a problem starting network services on the server. I get the following error : Failed to start LSB: Bring up/down networking So probably the tech misconfigured something, but everything looks normal (but I'm not a networking specialist, this server was supposedly "fully managed" )

Not sure what you mean by "base address." if you are talking about the gateway address, that can be any address that is not the network address or broadcast address. It could towards the start, end, middle, etc of the usable address space. Quadranet does not run VRRP (or things similar for high availability gateway). Given your IP address details your usable space should be: Network Address: 216.45.59.192 (can not use) Gateway Address: 216.45.59.193 (assuming this is the gateway, again, it can be anywhere) Usable: 216.45.59.194 - 216.45.59.206 Broadcast: 216.45.59.207 (can not use) Subnet: 255.255.255.240 or /28 If Quadranet is telling you the gateway address is 216.45.59.200 then that is what you would input as for your default route on your OS.

The same you can say about QuadraNet/EdgeCenters, they are the same people. They acquired Multacom before QuadraNet but we don’t see any complaints, downtime reports about Multacom. For the colo move announced recently, it does not seem they are moving to Multacom or any other EdgeCenters facilities, so it is quite different from “could not keep it running”. It makes no sense to open another (leased space) PoP in order to take QN brand down when some others PoPs already exist in the area.

According to multiple parties, including Quadranet staff, Quadranet has definitely been moving machines to HostPapa - it seems their own and some individual colo servers. So they are becoming a customer of who used to be their customer (and whom they sold many of their IPs to). I don't know how much of their own support they will provide there, but for what they can't provide, they can utilize Colocrossing/Host Papa support, and if needed they can utilize the Rising team (who owns the building and I've known for decades) who has their own qualified support (for a price). So assuming the transition for VMs, leased servers, and small colo clients goes smoothly, I'm guessing there is a good chance that reliability at Quadranet will significantly go up. Quadranet post move hopefully won't have the same financial and technical challenges that seem to have plagued them for a while. And it sounds like HostPapa will be more aggressive about protecting their IP space and punishing misuse (highly needed discipline). Now if Quadranet's fiscal whole is too deep (and it seems to be really deep), then maybe these clients will just become HostPapa clients and maybe Quadranet (or its creditors) one way or another will benefit from selling the book or getting some kind of commission. Neither Quadranet nor HostPapa has told me anything about this, so I'm just speculating. If I was a VM, leased sever, or small colo client this month, I'd make sure to be disciplined about off site backups (more so than usual). But again, it may all be non-eventful. I'm less confident how things are going to turn out for the full or half rack colo customers less profitable to a hosting company. We've been a customer in the 530 W 6th building for 20 or so years, something like 15 of them in Quadranet space. As of yesterday, we've taken our colo business elsewhere, even though we are paying substantially more than what Quadranet was charging us. The risks to us were simply too high. Too many issues...too many risks. Plus I didn't want to have to open a ticket with Quadranet just to have them open a ticket with someone else -- again more relevant for colo than more managed machines or hosting Quadranet offers. (We'll rather just pay more). * The IP fiasco or early January was scary - an unforced error that it was handled poorly. * Being down on January 23 was scary and also screamed of mismanagement. Yes, Cogent had a problem, but what happened to multi-home redundancy? It turns out they had another connection but it wasn't being announced via BGP. Late that day they fixed the issue and then Cogent came up so they went back to 2 connections instead of 0. At Colocrossing (aka Host Papa), Quadranet won't have to manage these things. On the plus side, I've actually found Quadranet to be fairly responsive this month, patient and responsive with my tough questions and providing answers to them the best they could (in a clearly difficult time). Some working on the transitions frankly have more people skills than techs sometimes have. They were professional and graceful in my departure. And they provided some support to quickly address an issue of concern even after they learned I moved out. It seems pretty clear they still want to run this business, and this move may help them restore viability to their business. So while HostPapa may be a good partner for Quadranet (and Quadranet's customers), I'm less confident for full rack colo customers in the short term. Many including I, have already left Quadranet. The options for affordable full-rack colo is becoming short-term squeezed. In the last week, I've talked to maybe 20 hosting companies in 7 or 8 local buildings, and toured several of them. At a single rack, I'm not big enough or corporate enough to make becoming a Coresite customer economically feasible. I'm found options (all more expensive than Quadranet), and noticed that they are all gaining customers pretty fast right now (including from Quadranet customers) and their availability is shrinking. When I toured the new space, it seemed to be pretty full already. More cabinets can always be provisioned, but in the next two weeks? One fear I had was that there wouldn't actually be space for me when it came time to move. My only communication on the subject was with Quadranet, and I'm not convinced they know (this is happening for everyone quickly, including for them). If you stay with Quadranet and they have space, it's likely cheaper (possibly significantly) than becoming a CC/HP customer. I'm not sure this is all settled and maybe time will tell if this remains true. When asked, Quadranet said they weren't planning any price increases at this time. So if I was a full or half rack colo Quadranet customer, I'd ask to move now, and have backup plan if I wasn't able to.

NEO is back

You guys need to learn how to read...

I don't. I cancelled after almost 15 years of business with you guys. You don't treat clients that way.

depends, are you still in Ukraine.. i can post screenshots ..

What is the relationship between Psychz and QN? I added a few Psychz servers in feb and now I become uneasy again.

Did edge centres acquired quadranet just to sell its assets? Really love those private equities doing anything for a quick profit. They have removed posts about quadranet on their linkedin pages. Even their ceo stopped posting about quadranet too. Or did they ran into financial problems when they acquired quadranet? Is it bad decision on their part?

No I don’t. I was a happy customer since 2010 or so. They didn’t run into troubles, they created troubles themselves by selling multiple critical assets, not being transparent and so on. They never provided any information of what happened and basically the only thing they did perfectly is lying. So no they didn’t hurt me, they only did everything in their hands to get rid of every customer. I understand you are still giving them a chance for some reason, it is up to you of course.

They stopped answering my ticket and nobody is answering the phone. Been listening to elevator music for about 20 minutes now. Anyone know how to get a human on the phone? I selected the bare metal customer option.

It may be different for you or they haven't added yours yet. For me, I go to Devices > View Devices then click on the relevant server for details. In there is an IP Assignments tab. I click on that. In that link you gave I see it under "Default IP group" Public Network IP Range --New 01/06/2025 x.x.x.x/28. They haven't updated my ticket so it's probably not completely set up yet.

It has been 8 hours since i have opened a ticket and still no single reply nice support quadranet

If you have other servers with them you can use the old IP to connect or if your server is listening on the Private network you could also use that. I messed up my config and got myself locked out but good thing ssh is listening on the private network so I managed to connect again. I will miss their private network as my current host right now doesn't want to setup a private network for me right now.

Appreciate the two emails, lets see if anyone responds. I've also tried emailing the new "owners" at edgecentres.com and they're also all quiet.

I initially had servers with QuadraNet in Texas. On December 6th, we were down for 24 hours, the third 24-hour or longer outage of the year. We got tired of it. We requested compensation for the December outage and received an 80% discount on the invoice for that month’s services. We took advantage of it, looked for a new provider, migrated, and now we're at peace. Unfortunately, QuadraNet is offering disappointing service.

https://status.quadranet.com/

From COGENT: https://ecogent.cogentco.com/network-status Cogent Network Status Last Updated 2025-01-24 09:10:06 AM UTC Status Normal Network Status Welcome to the Cogent Communications status page. Customers located at 600 WEST 7TH STREET in the Los Angeles, CA have been impacted by an emergency maintenance NC774-0-1 scheduled from 0300 - 0700 EST. The master case is HD304619492. Some customers in the BIRMINGHAM, ALABAMA area may be experiencing loss of network connectivity. Our 3rd party fiber vendor is still onsite working to resolve their fiber cable issues. Cogent has escalated this outage event to the highest level with our 3rd party vendor. Cogent has dispatched one of our local Field Engineers to assist our 3rd party vendor. There is no ETR at this time. The master case is HD304602640. Customers located at 1775 SHERMAN STREET in the Denver area may be experiencing a down circuit. The engineer is currently dispatching. The current ETR is 1 hour. The master case is HD304608235.

Still off-line as well.

Neo is just front end built on ubersmith API. Ubersmith is manage.quadranet.com which is on 204.152.194.27.

i had to drive down to there datacenter and get the ips changed. This is a ****ing nightmare. Tech said that they sold or lost some ips so colo clients will be assigned new ips...what a joke

Dedicated server in LA. The IP is an old one. Their panel, btw, shows the server as offline, but in reality, it’s working. Still looking for a new service... Appreciate your recommendations

How do we get our data off Quadranet's servers? Has anyone actually been granted access to the building?

Let me make sure you understand -- your subnets are likely no longer your subnets. You are getting NEW subnets if you are like the rest of us. So perhaps that is what is missing here.

I am getting updates from someone new but it could just be a shift change. They can't get my /28 working and are now trying to say it's something on my end. I am almost certain it's not because I didn't have this problem the last time they changed my /28 a few weeks ago. Maybe someone here can help. Their customer control panel still shows my server primary IP address as my old address that no longer works after they lost it a few weeks ago. They never bothered to update that on their end. When they assign a new subnet on their end do they have to configure it for my new server IP address or do they just point the subnet at my server ID or switch port and don't need to know what my server IP is?

They can't seem to get my /28 working and are now in denial mode claiming it's a problem on my end. No amount of explaining that it all worked before they moved the server and that nothing has changed with my configuration will sway them. My tickets were all closed and it's all new guys answering them so I have to go through the same explanations again.

It sounds like previous/current owner did everything in their hands to kill QuadraNet. Multacom was acquired by previous owner though, but it seems AON worked a week ago?

Public and private ports still red but I can access my server but only my other quadranet server can't communicate with it wth

i always wonder since the IP is now under hostpapa, how do they manage the RDNS request. It's this a sign of something else that we have not foreseen yet

Yeah something is really strange with the VPN situation. They won't say a word about resolving it. And it's also strange that it went down at all because I don't think these IP's should have been affected. At least one of the two endpoints should have continued working, and if it was IP related that would be an easy fix that they surely would have done by now. I wonder if they did something really stupid like repurposed the machines... or sold them off or never acquired them in the recent dealings. Yeah, it would be impossible to trust them enough to put critical, non-redundant services there, overseen by the team that let this ridiculousness happen. This greatly reduces the value so I am terminating. Such a spectacular implosion for a once great data center.

this circus is continuing! LOL just gotta laugh at this point.... "We are reaching out to inform you that colocation services at 530 West 6th Street are being replaced with a new state-of-the-art facility in DTLA. We will be relocating our systems, and all customers have the opportunity for QuadraNet to relocate their equipment to our new facility at no cost. Date Center Information: WEST7CENTER" 1200 W

Pulled my server today -- well someone did for me. On facetime, it seemed like a lot of equipment has been pulled and/or moved from the room I'm in. Many empty racks and others are sparse. The hot/cold rows are basically non-functional at this point.

My server came back up 10 hours ago. Same IPv4, same rdns, same BGP. No IPv6. ColoCrossing does not have it. Inbound path is same but with one extra hop via colocrossing. Outbound is different and all via colocrossing paths - which is not a good as before. So reading above posts, if QN can't pay its bills for the basics, then the collapse of QN would seem to be inevitable and perhaps a deliberate choice on the part of its owner.

I don't understand your question... Quadranet? I just moved out a dev server and non-essential supplies one week, and then on the day I moved out, I just moved the bulk of my stuff out. The discussion of insurance never came up. Did someone ask you for insurance? Building ownership or something? It doesn't sound like Quadranet... Usually at the 530 front desk they just call upstairs and then you are told to go to their office upstairs. In the past few years, usually I was sent upstairs immediately or within 10 minutes (if they didn't answer the phone immediately) but once I had to wait almost an hour because I think the only person available that night happened to be driving in from their other location (thankfully). When you showed up, maybe someone wasn't available? As mentioned above, I'm suddenly not a Quadranet customer anymore but earlier this month they were responding to tech tickets. Also, the migration emails you likely received were from individual people who did answer within a six hours typically when I sent an email. So maybe you need to make an appointment, and maybe you could be more successful during normal work hours (though it may not be convenient for you). When I went down to pick up the a server and some other items earlier this month, I opened a ticket first or finally got someone on the phone (I forget which) -- I stated I wanted to come within the hour and they said 'fine'. I showed up and no-problem. When I finally decided to move all my production machines, I called someone I knew and they happened to be in the building already and they moved my stuff for me. I just opened a ticket authorizing someone else to remove my machines (which I shut down remotely). I imagine as they have been moving hardware and well into that process that they might not have someone onsite at 530 all the time. Trying to make an appointment or being able to show up on short notice if you get ahold of them might be the answer.

I’m not trying to pressure anyone. Please understand that as your customer, I chose not to provide the ticket number because I was waiting for a more genuine response from you. But now, I don’t even know what to say. No matter what happens, I don’t want things to go badly for you. I’m also a small business owner, so I understand your situation—but at the same time, I’m also a consumer.

You had a lot of time to explain things privately which never happened. And here is only one clown this time who can’t even communicate after all the issues he and his team created. Seems you don’t even understand you are responsible for weeks of downtime so we have full rights to ask you for answers. I personally expected you will clear things up and make QuadraNet good and trustable again, but you only made it clear QuadraNet can’t be trusted anymore with such executives.

Well I think there will be incompatibilities with your current landlord if you do not want to pay them lol

Sorry, I am not sure. Actually, we moved all our racks about 3 years ago from Quadranet.... but as we had account there, we still receive some important mails from them.

I'm a colo customer of 10 years in LAX QN. They moved me into ColoCrossing/Hostpapa site. Now it seems that QN has become a customer of HostPapa for its colo clients (me at least). Well now, who is going to support the thing? If it worked perfect, it would not matter but.... They left my IP's inside the QN ASN, for inbound, but outbound goes via Hostpapa ASN. See the issue? The peering to the major sites is different in each ASN. My server can't contact with Amzn, Google, MS, cloudflare. Probably the mismatch in peering and paths at fault. To solve, I moved my account to HostPapa proper (and saved $20 a month).

So it means edge centres is a hot garbage data center company? They bought QN to sell it off for a profit and they didn't care an ounce for its customers

we are also stuck in the same boat on hold for last 50 minutes and no one is answering calls or responding tickets even ;(

Complain here to the boss https://www.linkedin.com/in/jonathan-eaves If enough people demand answers we may get some

Also in the same boat - colo customer for 10+ years, they offered me a new IP range yesterday, still have not received one. This looks very much like QN sold a huge amount of IP space and decided not to let customers know. Insanely unprofessional. This impacts a *lot* of their IP space: 66.212.24.0/22 69.12.90.0/23 96.44.174.0/23 104.223.0.0/19 107.150.0.0/21 173.254.192.0/24 173.254.218.0/23 204.152.192.0/21 For the folks waiting on a KVM -- you're going to be waiting a while, since they're probably going to have to physically re-IP them all first. Best bet to get to your equipment is to use IPv6. I sent out several quote requests to nearby providers to see who can accommodate us on short notice...

Yeap, losing access from lots of location. Hopefully just a temporary and not a new surprises.

This is the only thing Andrew responded with: We are dealing with some adjustments due to recent IP sales, we are working through it. Nothing else of substance, or response to my follow up email asking for more detials.

Does anyone of you having connectivity problems with them right now? Website of quadranet is not accessible and it seems they are having problems with cloudflare?

They do have NTT too from what I see on bgp.tools but it didn't seem to fail-over correctly for some reason, I suspect the cogent issue was so weird that they were getting "to" cogent (eg BGP etc was up) but perhaps not passing traffic "out of" cogent(?).. either way very very strange.. and all these issues compounding/happening at the same time isn't helpful either. I do hope they share a RFO at least for this networking thing.. it would help settle a lot of doubts/concerns really.

Well, it makes no sense as EdgeCenters is responsible for all ongoing issues. From what I was able to find, they are short-staffed which causes multiple issues as there are no qualified staff to fix things. They don't have 24x7 on-site staff in LA anymore which causes delays as well. Cogent's issue has already been solved, the current downtime is because of the servers move to another data center and they are facing network issue they can't solve for now.

My dedicated boxes are offline too.

Traceroutes to my dedicated server IPs stop answering at XXXXX.ip.twelve99.net while traceroutes to quadranet working sites go through XXXX. .atlas.cogentco.com so link with Cogent is definitely working fine and they are doing weird stuff to IP blocks of their dedicated clients.. I really hope they are not actually moving the physical boxes and that this ends up being just a huge misconfiguration and we can get sites back up very soon. Really none of this makes sense.

New ip working ?

Probably that is because physical location was changed and they didn’t care about data update. Or internal network is still off causing no access to switches and PDUs.

We can confirm our developer was denied acces to the building on Saturday morning.

What is with this fly buzzing around here. Someone actually responded to my ticket reporting that my /29 is working when the title of the ticket is that my /28 is not working. Like having 5 usable IPs solves my problem of needing 18. Not to mention the expectation that I should change IPs again. Like it's no big deal and customers won't mind having to go through that a second time in less than a month. Totally professional and cool. If anyone wants to send the CEO an email his address is jon.eaves@quadranet.com which has been publicly posted at status.quadranet.com

You are receiving some real responses from techs at least... For me they keep saying team is working, nothing else. From what I can see private network is offline as well which should not happen if the issue is about public IPs only.

So the /28 that they assigned on Jan06 is working again even though I was told they can't get that back. It has also been deleted from my IP assignments list. However, none of the /28s that ARE listed in my IP assignments list are working. Swamped or not, no excuse for not having this sorted by now. VPN still not working either. That should have been one of the first things restored imo.

AON was working at the day LA DC breakdown. Given that MultaCom is said to have AO network 'just rebuilt', I would make a malicious speculation that the owner let MultaCom took over QuadraNet network peering contracts, and leave QuadraNet brand/customers rot in the field.

Anyone else seeing progress toward resolution?

Dedicated server is down but its cloud service seems unaffected. Maybe they are really selling bare metal? And retaining cloud?

this means some configuration could be missing (like DEFROUTE). Do you want to paste your eth1 config to eth0 ? just see if there is network property that should be there. I guess once your network is up, you should be able to connect to the internet. as you are now having eth0 which also sharing with IPMI, i wonder why the IPMI works (for sure QN assigned a public IP) but when start the network it failed. Try a manual ifdown eth0; ifup eth0 Otherwise, you can post your ifcfg-eth0, ifcfg-eth1, and /etc/sysconfig/network in here. There are tons of experts watching this thread and willing to help you to get UP

Any idea of when they are relocating? And what about dedicated servers?

do you colo ? or dedicated with them? which datacanter do you use ?

I got credited 2 months of service for my unmanaged baremetal. Will see if they actually last that long.

It sounds like you've had a lot easier time. Do you mind emailing me at john@soladrive.com or if you have Skype, our ID is soladrive

Let's keep this simple moving forward, because clearly the community has lost some IQ points since the last time I was around. 1.) If you have an actual problem - share the ticket ID - happy to help 2.) If you're just here to troll, maybe don't - it's a waste of resources and you are actually creating more delays for customer's who might need real help and it's kind of a terrible thing to do. Kosher?

It is also unclear to me why you are even commenting considering you are not a customer and this is a provider outage thread

If the issues are related to his location please do.

None! A lot of people in DTLA know each other from the Rackspace days.

AFAIK QuadraNet outsourced its hardware maintenance to ColoCrossing engineers before they acquired (previously, ColoCrossing LAX was hosted in QuadraNet but later moved out). Therefore, customers who moved to ColoCrossing are essentially receiving services from the same team that originally worked for QuadraNet.

I have always doubted the financial transparency of Edge Centre. There is very little information about them across the internet.

It's middle of a business day well after the holidays. At least it was when this first happened, so no excuse why nothing seems to be happening. If they lost the IP range they should have at least updated the IPMI VPN IP by now. That way I can at least have access to my server through their private IP network.

Here is some background / research I did on the IP space a user provided in this forum post. On December 14, 2015 QuadraNet acquired 216.144.224.0 - 216.144.239.255 (216.144.224.0/20) from ARIN and was using exclusively within their network. On December 13, 2024 QuadraNet no longer held control of the /20 and instead broke it up. On December 13, 2024 the IPv4 Space: 216.144.228.0 - 216.144.235.255 (216.144.228.0/22, 216.144.232.0/22) was acquired by ColoCrossing / HostPapa. QuadraNet still had control over 216.144.236.0/22 On January 2nd, 2025 the IPv4 space: 216.144.236.0 - 216.144.237.255 (216.144.236.0/23) was acquired by ColoCrossing / HostPapa. The remaining IP space 216.144.224.0 - 216.144.227.255 (216.144.224.0/22) and 216.144.238.0/23 (216.144.238.0 - 216.144.239.255) are still in control by QuadraNet. ColoCrossing / HostPapa was a long time PacificRack / QuadraNet customer and in Q3/Q4 of 2024 they moved out of QuadraNet's Downtown Los Angeles facility (530 West 6th Street). They are now in the West 7 center datacenter at 1200 West 7th in Los Angeles. The facility has other companies in their like LeaseWeb. The facility use to host Equinix (LA5) before they moved out. I believe 1200 West 7th use to have horrible power issues before they went underwent renovations in the last 10 years -- I am going off memory on the power issues so take that with a grain of salt. We can only assume / guess that when ColoCrossing / HostPapa moved out from QuadraNet they bought IP space from QuadraNet -- 2,560 IPv4s. If we use IPv4.global / Hilco as a benchmark for the going market rate of IPv4 its around $34/IPv4 or roughly $87,040. If you had servers directly from QuadraNet that was in the IP space acquired by ColoCrossing / HostPapa then you know why things are on longer working. All this information was compiled by public and historical data from ARIN as well as my extensive knowledge of the datacenter market in Southern California.

We did get a KVM and a few support responses although no new ranges. I do second the suggestion of use the IPv6 address (it's working, with some latency/packet loss, but better than nothing) to get access to your systems and will make it easier to reip when/if you get the new range. If you are looking for a provider check out webnx ( sales@webnx.com ) they provided us a couple of temporary servers already and will be who we move the remaining quadra colo servers to. Been using them for over a decade and they are by a country mile the best provider we work with, sometimes take them for granted just how easy they are to work with, it's nice speaking to actual competent humans and not bots.

Glad we left quadranet years ago after non stop outages and issues. I think it's gotten even worse since they sold. Hopefully everyone is able to get back online and migrate their data elsewhere.

That's quite bad if the outage is due to a sale of IP's O_o

Yes, I am facing the same issue now, quadranet's site and neo portal is also not accessible, plus all the servers and IPs are down, seems their whole network is down at this time.

They haven't even resolved our issue from earlier this month. We've been down for 3+ weeks now. This is wildly unprofessional. No explanation, no resolution.

my server is back online now

Dedicated box also still down Those updates are beyond vague and phone line is on permanent hold so...

I'm done with them. Terrible company now.

yes new ips are working

My shite in chicago just started pinging again more than 2 days later. ****wads.

Is anyone back online yet?

Why would you need 18 IP addresses at Quadranet? Be thankful you have connectivity so you can migrate off ASAP.

Technically, subnet should be routed to the server's port the same way they usually do, that's it. NEO portal data is just data, so old data means nothing. You have to reconfigure primary server IP on the server to get it accessible over the Internet.

Just to help and make sure you are not missing anything. From the /28 they gave you, can you ping the gateway IP address from your server? If you perform an ARP request, can you see the mac address of any other machines - like the gateway? Does the OS report the interface as UP or DOWN? What speed did the interface auto negotiate at? Can you access other devices across their network. E.g.: http://lax-noc.com/ (Quadranet runs this within DTLA) Ask Quadranet to do their same on their end from one of their core routes to your device's IP address. If you can't ping the gateway and if you do an ARP request and can't see your gateway, typically its an issue with the network (layer 1 issue, port blocked on the switch, etc.). However if you can ping the gateway and you see the mac address of the gateway, then its most likely something on your end (firewall, etc.) However, it can still be an external routing issue. That is why you want to test routing inside and outside their network as well from your end.

Just now they provide a new IP for one of my servers. trying to set it.

Still no vpn and ipmi access

I think they just transferred another block of ip's to hostpapa

My ports are eno1 and eno2 ... eno2 config has been blanked out with # at each line eno1 looks like this # Public 216.45.59.200/29 DEVICE=eno1 BOOTPROTO=static HWADDR=AC:1F:6B:7B:E6:46 ONBOOT=yes NM_CONTROLLED=no NOZEROCONF=yes IPADDR= 216.45.59.202 NETMASK=255.255.255.248 GATEWAY= 216.45.59.201 DNS1=8.8.8.8 The port HWADDR is correct . other settings look like the old ones on eno2 ethtool eno1 shows the port is active link detected full-duplex etc (not the case with eno2 which QN disconnected) /etc/sysconfig/network is a blank file

are your server planed to migrate ? or had be migrated ?

A few days passed with no updates. Is everyone online now?

Why did edge centres the parent company of QN did not pay their rent dues? What are they thinking?

No, Andrew Moore sold your IPv4 or used the clean IPs for new clients... Beware! glassdoor.co.in/Reviews/Employee-Review-QuadraNet-California-E584246-RVW93359835.htm

Omg. It seems you are the reason for everything. CTO who can’t communicate after the headache he and his team created. Shame on you Andrew. Hope people learn from this story to never host at QuadraNet.

I agree with you.

LOL! Exactly! Don't pay your bills, of course; I'll be incompatible.

None really, I think given the timelines, I guess just these 3 locations were able to accommodate users in ASAP. While there are other options like CoreSite LA2 near-ish and a Cogent Datacenter in the same 530W building, I don't think the lead times are quick enough to get moving over (I may be wrong, but last I recall it did take a few days just to get the quotes).

That is not true. Sidebar : Mtheory is only taking over Century AFAIK. Not sure about 530w.

As per person I talked to, it was Edge Centers decision to sell assets and to cease QN operations afterwards. So we can probably blame them for everything happened. Since there is no information about them, as previously mentioned, it is pretty clear they are for profit, not to serve and accommodate customers needs.

I can ping and see below IPs are pointing to unassigned.quadranet.com and working 216.144.236.121 216.144.236.122 216.144.236.123 216.144.236.124 216.144.236.125 216.144.236.126

This begs the question again why didn't they just renumber everyone before selling off the IPs. Why would they sell IPs? One would think not selling them is a way to keep your customer from moving.

We have not yet been assigned any replacement IPs. Your best option is to try accessing your servers via IPv6 and migrate to a new platform as soon as possible. This process will likely be faster than waiting for Quadranet support.

They do standard subnetting for each service. Yep...SpamHaus has been blacklisted all IPs originating from QN's ASN for quite some time now. After looking at all the snowshoe PTR records, I can't say I blame them either.... <<snipped>> I'm thinking about moving to another provider in the same building, but they only offer half cabs, which is unfortunately overkill for me.

From my experience, Andrew has never been responsive and things always take days, weeks, months when it depends on him. QuadraNet was really nice place to host before it was sold and new team came in, including Andrew. Hope the issue will be resolved shortly, but... for now no response to any issue-related tickets :-( I got some responses this night, but nothing detailed about the issue. What is really bad is that no explanation is provided after 3 days of downtime. So we all are waiting for something with no ETA, no explanation, nothing. They also said the network issue has been resolved, but most of affected customers are still offline... Not sure how was it resolved then.

Same here, network is partially offline. It is accessible from some locations though (probably one of upstreams is up).

No advance notice whatsoever and during a major network outage. This is unbelievable. I don't know whether to laugh or cry. I am still down btw. So almost 6 hours now. They said it would be max 6 hours and I am not holding my breath.

Still down 22 hours and counting this is madness

My servers are down from Century DC, it's almost 16 hours, is there anyone who faced down from Century DC location?

Some of my server IPs still respond to ping but can't connect to them by HTTP or SSH. So maybe they're someone else's server now? I can't seem to connect to IPv6 either. My newly assigned public IP seems to be announced by both HostPapa and Quadranet, did they screw this up? https://bgp.tools/prefix/69.12.70.0/24 My "Asia optimized" IP which was always working before is also HostPapa but my smaller range is within Quadranet, but it says announced by both: https://bgp.tools/prefix/66.212.30.0/23#connectivity

Sounds like the IPs are being sold off not lost.

Many, many hours after updating my ticket I received a response that they will update me soon "with the way forward." I see in the portal that my IPs have changed. What a friggin nightmare.

Monitoring - Our team has been able to restore service connectivity to 90% of effected customers. We hope to have this finalized by end of day, per Quadranet Chicago Network Outage Status Can anyone cofirm this is true?

Yeah maybe he doesn't realize how screwed up this is so if we let him know he'll make some calls or something LOL

Ok that's what I though. I changed the server IP a few weeks ago and that is still working fine after the move. It's the move that is the problem, so they must be trying to assign the subnet to the wrong switch/port using old or incorrectly updated information.

One server came up for me with same (old) IPs. Others are still offline.

I'm wondering if they are taking VPN away like AON. They have not said a single word that suggests resolution/return is forthcoming despite me asking repeatedly to even confirm the issue.

nothing here still ... not like they even care to update the status page ..

Indeed, my block is moved

and yes, why IPMI works is beyond my understanding. They were very quick to supply me with IPMI credentials and a specific IP to login. Maybe this IPMI connection goes through some sort of separate module they plugged in the server ? Otherwise shouldn't I be able to hack that IP to reach the server somehow?

"To avoid service disruption, please confirm your preferred option no later than 12th February 2025. If we do not receive your response by this date, your equipment will be relocated to the new facility. " While this notice is specific to colo, in the original lead in message quadranet does say "We will be relocating **OUR** systems" (emphasis added) before it offers to move cust owned boxes. I am pulling my colo equipment.

We've been back up but our tickets for Chicago have been super delayed. It's obvious there is no one physically at the facility most of the time. I guess we are going to have to move elsewhere.

This could be a plan. Such debts don’t happen unexpectedly. So keeping move/sale/transition in secret is what usually happens when it comes to money.

I don't get it, is IPv4 really more valuable than having long-term customers who are still paying $200+/month for 5 year old hardware

You and your team forced many customers to be offline for a week or more with no explanation. Why did you come in here if you are not ready to explain things.

Cancelled after almost 18 years of hosting there. Andrew does not treat us that way for sure as he clearly said I don’t deserve a right to waste his time since I decided to not wait for weeks and cancelled. What a shame

QN Seattle is getting migrated/acquired by ServerStadium/WR(colo). You should have received an email from both QN and myself. I am heading this project if you have any questions on the continuity of your service in Seattle.

Cogent is out of space/power at 530 W 6th from what they told me. Cogent does have space/power available in Pasadena, but that's not DTLA. Cogent is also lights out, meaning no remote hands, so that might be a problem depending on your requirements.

They acquired QuadraNet and their clients, some big customers left last year, this may led to capital chain rupture.

Anyway, the funding for Edge Centres seems somewhat unclear. Based on available information, their capital may come from Ch*na and some questionable organizations.

My IP's are not in that range and still not pingable.

This is great information, but my question is: how can they handle it so poorly?

how can I assign IPv6 when I can't access anything? VPN is working but I can't access my servers which are on public IP address

I'm not sure if its allowed to ask publicly (or in this thread?), but I'm not aware of any other provider offering colo (public offering?) in the same building?

Why would they sell IPs? Are they downsizing? Or removing IPs that are blacklisted? Either way management is unprofessional for not telling customers that they are selling ip

seems like an issue with their cogent port while the NTT one is up(??)

https://status.quadranet.com/

Our servers and IPs are still down. It is around 7:30 EST now but still down.

Welcome to the party.

Did they sell quadranet to host papa or is it the other way around? Edge centres have been aggresively buying datacenters

Me in the same boat too. 2nd months into Quadranet. After 2 days of downtime, got an email about new IPs replacing old Ip subnets. But without KVM, I can't do anything. Emailed and called multiple times, no answers.

What was your ticket ID?

Is anyone surprised that there isn't a lot more people commenting here? You'd think there would be hundreds?

Already migrated some things. It's very difficult to migrate customers for what I am doing. Not something I can just throw together last minute. They finally assigned me a new new /28 and (shocker) it doesn't appear to be working.

So you have partial access by some IPs, right? Mine were working all the time even on Jan 6 event and after, but not now. Those went offline on Jan 6 have never been replaced or fixed.

I was never able to ping the gateway from my server. I never tried any of the other things you mentioned. The support guy said that because he could ping the gateway from worldwide public IPs, and that because their core router couldn't see my server, that it must be a configuration problem on my end. He never elaborated on why the core router couldn't see my server when it, and the /29 it is using, were working just fine. Sounds like the guy was using incorrect info about my server because was and still is working just fine inside their datacenter, so their core router must be able to see it. Latest info I got from different guy today was that they changed the connection on my server (whatever that means) so that the /28 they assigned on Jan06 would work again, and it does. So I am back up 100% to where I was before the move as far as I can tell. At least for now. VPN still doesn't work so I still don't have access to my IPMI.

This is absurd.. vpn is somewhat a basic infrastructure for such a datacenter.. not like it "costs" to maintain

This company is **** now. I'm very glad I'm back online but what a terrible company now. To treat customers like this is a sign of the times, if you ask me. I had to get assertive to get my "new" ip's. And, there was no support to help me figure it out afterwards. They just said here they are and off they went. So... I suspect they are scrambling along with very little staff trying to deal with everyone like this. My bought and paid for server is in a building somewhere while I am thousands of km away. I don't think I will ever go bare metal again.

Over a week now and they still don't have the VPN working. No new updates on the status page for a few days now.

is it due to the extra space in your IPADDR and GATEWAY ? try this: Code: ip addr add 216.45.59.202/29 dev eno1 ip route add default via 216.45.59.201 If still does not work, share this output: Code: ip a show eno1 ip route systemctl status network journalctl -xe | tail -50

It looks like this is across the 110 which isn't too far from interchanges but any distance away is certainly a downgrade from the current setup, being directly adjacent to One Wilshire with essentially zero risk of a cable getting cut in the street between QN and exchanges. But since I'm leaving... whatever.

Servers are back online now but still having anxiety that it may go down again

And now this week, we are moving from ColoCrossing/HostPapa, over to MULTACOM.

Only if Andrew Moore is double-dipping, pocketing the cash and the company doesn't know, it's time to swap IPs.

Happy to take responsibility internally for any mistake I made in this process, but it is currently more preferable that this community is used to embolden the customer and as far as I am concerned, you appear to be the opposite of what is needed

I agree with you.

Do you mean they sold you their customers in Seattle? Would you take care of all the customers after migration, right?

In Miami at this moment there is an abrupt network drop Last month with Quadranet, in April I move to Hivelocity

That could be true, however, the support was still on QN Payroll, until yesterday.

I cannot removed credit card information on quadranet and colocrossing said to not pay to them anymore but yesterday my card was automatically charged. Hopefully quadranet still have someone monitoring their support and can refund and remove my credit card info.

My IP6 sub also doesn't appear to be working but not sure about that one as I wasn't using it for anything.

Was the IPv4 QuadraNet giving you now owned by ColoCrossing / HostPapa? Or is the IP space still owned by QuadraNet?

I think ill be moving away from them if they will not give some kind of compensation for the downtime they have caused

This is an outage thread, so it's not about anything other than that outage directly. Please help keep it on topic.

That's one of the concerns. Based on what we know (that the company was sold last year, that they just sold off a bunch of IP space, that they're not particularly concerned with customer service anymore, etc.), this strongly tends to indicate that the company is being sold off in pieces. IPv4 space is likely their most valuable "owned" asset. (There's a reason Ford and Mercedes haven't given up their 16-million address /8 subnets each, and that DoD is hoarding more than 12x /8s). Assuming the buyer got a great deal because the IPs are super blacklisted (let's say $20/IP), by my count they sold at least 15000 IPs (see the list in my previous post), so that's in the neighborhood of $300k. That's not a huge amount for a company of their size, but that's all the more reason to sound the alarm bells. They could have very easily handled this like any other company would (sent out notifications, assigned new IPs in advance, allowed customers a couple weeks to migrate, done a soft shutdown, etc.) It's definitely not that they're removing blacklisted IPs, because literally all of their IP space is blacklisted by virtue of it being announced from their ASN. See: the many, lengthy spamhaus write-ups for more info. I've had a ticket open with them for months begging them to try to resolve this.

im honestly hoping not around of IP change again

Moving servers during business hours is unprecedented. We are redefining the server hosting industry by thinking outside the box. --The idiot running this company, probably.

Quadranet is also having a wide outage in Chicago now since early last evening with an issue with their core Juniper router. Still has not been resolved. Not sure if it's somehow related to what's going on in LA or just a bad coincidence. We have one server affected in Chicago. Too bad this is happening to them, have never had an issue with their services before.

what a ****** service....servers have been down for day with no responses...can't call them. I am about to drive down to their office. This is frustrating.

They indeed moving/moved physical boxes. That is what their announcement says.

Nothing about IPs this time. I'm getting the standard network issues from their staff. Been with them for 12 years. That's changing by month's end.

Checked my portal and they went and closed my ticket even though I am still offline.

Update: I was able to gain access to the Century location, courtesy a friendly tech. It's taken several hours and our key systems are back online, but there's a lot more to do. They changed all of our IPs without notice, so while the hardware may have been online since Friday, they didn't tell me what was going on nor the new IPs until ~5:30am today. I'm beyond furious. The word negligence comes to mind, but IANAL. I am now actively searching for a new provider for my rack of equipment, and QuadraNet can kiss my ass goodbye. Best of luck to the rest of you. Suggestions on a new home are welcome!

So you're actually getting a response from them? OK I opened a ticket and I hope they can get me online before Monday...

this is worrying sign. i asked whether i need to change my IP, and they confirmed not required. I'm still hard down and not able to access the server. However, i can ping my IP gateway

omg I'm able to SSH into my server now Uptime is 8 hours

Probably VPN server is one of the affected servers as they have to recover it as well as other servers. There is no any reason to remove VPN as they need it as well to access some infrastructure things.

My thought are that 1) they sold/moved some servers to HostPapa which explains why some of us received HostPapa’s IP after recent maintenance, 2) some servers are still with QuadraNet but they had to rebuild networking and some cabinets which explains why they got it online with no IPs replacement. These things probably started on Jan 6 when they lost their IPs and they then arranged some sell/move in order to keep everyone online, but something went wrong.

It is better to cancel with a partial refund and move everything off their network. For me it is clear their services will never improve. Do you have any critical data you still need to backup?

no just a typo in pasting here try this: Code: ip addr add 216.45.59.202/29 dev eno1 ip route add default via 216.45.59.201 added both and did some cleanups but not working Code: [root@172-16-4-195 network-scripts]# ip a show eno12: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mg state UP group default qlen 1000 link/ether ac:1f:6b:7b:e6:46 brd ff:ff:ff:ff:ff:ff inet 216.45.59.202/29 brd 216.45.59.207 scope global eno1 valid_lft forever preferred_lft forever inet 216.45.59.202/32 scope global eno1 valid_lft forever preferred_lft forever inet 216.45.59.203/29 brd 216.45.59.207 scope global secondary eno1:1 valid_lft forever preferred_lft forever inet 216.45.59.204/29 brd 216.45.59.207 scope global secondary eno1:2 valid_lft forever preferred_lft forever inet 216.45.59.205/29 brd 216.45.59.207 scope global secondary eno1:3 valid_lft forever preferred_lft forever inet 216.45.59.206/29 brd 216.45.59.207 scope global secondary eno1:4 valid_lft forever preferred_lft forever inet6 fe80::ae1f:6bff:fe7b:e646/64 scope link valid_lft forever preferred_lft forever [root@172-16-4-195 network-scripts]# Code: [root@172-16-4-195 network-scripts]# ip route default via 216.45.59.201 dev eno1 192.161.62.0/28 dev eno2 proto kernel scope link src 192.161.62.1 192.161.62.1 dev eno2 scope link src 192.161.62.1 192.161.62.2 dev eno2 scope link src 192.161.62.2 192.161.62.3 dev eno2 scope link src 192.161.62.3 192.161.62.4 dev eno2 scope link src 192.161.62.4 192.161.62.5 dev eno2 scope link src 192.161.62.5 192.161.62.6 dev eno2 scope link src 192.161.62.6 192.161.62.7 dev eno2 scope link src 192.161.62.7 192.161.62.8 dev eno2 scope link src 192.161.62.8 192.161.62.9 dev eno2 scope link src 192.161.62.9 192.161.62.10 dev eno2 scope link src 192.161.62.10 192.161.62.11 dev eno2 scope link src 192.161.62.11 192.161.62.12 dev eno2 scope link src 192.161.62.12 192.161.62.13 dev eno2 scope link src 192.161.62.13 192.161.62.14 dev eno2 scope link src 192.161.62.14 216.45.59.200/29 dev eno1 proto kernel scope link src 216.45.59.202 [root@172-16-4-195 network-scripts]# Code: [root@172-16-4-195 network-scripts]# systemctl status network ● network.service - LSB: Bring up/down networking Loaded: loaded (/etc/rc.d/init.d/network; bad; vendor preset: disabled) Active: failed (Result: exit-code) since Sat 28:100:29.2038:37:46 PDT; 16min ago Docs: man:systemd-sysv-generator(8) Process: 5425 ExecStart=/etc/rc.d/init.d/network start (code=exited, status=1/FAILURE) Sep 29 08:37:46 172-16-4-195.cprapid.com network[5425]: RTNETLINK answers: File exists Sep 29 08:37:46 172-16-4-195.cprapid.com network[5425]: RTNETLINK answers: File exists Sep 29 08:37:46 172-16-4-195.cprapid.com network[5425]: RTNETLINK answers: File exists Sep 29 08:37:46 172-16-4-195.cprapid.com network[5425]: RTNETLINK answers: File exists Sep 29 08:37:46 172-16-4-195.cprapid.com network[5425]: RTNETLINK answers: File exists Sep 29 08:37:46 172-16-4-195.cprapid.com systemd[1]: network.service: control process exited, code=exited status=1 Sep 29 08:37:46 172-16-4-195.cprapid.com systemd[1]: Failed to start LSB: Bring up/down networking. Sep 29 08:37:46 172-16-4-195.cprapid.com systemd[1]: Unit network.service entered failed state. Sep 29 08:37:46 172-16-4-195.cprapid.com systemd[1]: network.service failed. [root@172-16-4-195 network-scripts]#

That phrase is quite something !

Time to start using the uptime to migrate before the lights are turned off.

Is it dedicated servers move this time?

Yes! Leasing a /24 subnet costs over $200 per month, so a /16 or /15 is way more profitable and cost less than hosting servers.

Andrew please stop. You can’t act this way being their CTO, this is the shame. And we both know you will not discuss internally so I don’t want to start the private discussion. My ticket waiting for you and RFO was closed once I’m cancelled after a week of downtime, so it is pretty clear for me none wants to explain anything if cancelled. And, after a few years hosting at QuadraNet, I must note you have always been a person who answer maybe once a month, even for ongoing issues.

I have sent you the same information I gave Normaninvh in your messages now. You are welcome to communicate with me directly also. Edit: I tried to send but I don't think you can get direct messages due to your post level

I've already contacted woow rack, and the quote they gave me is higher than HostPapa's.

What's the mail's point ? QN will cancel the colo service and we need search new datacenter to colo(includeing the three providers) ? or ?

Changed my wording. I only know a period of time before they were acquired.

Just add Two hours ago, QN just sold New Jersey to InterServer.

Still no response from Quadranet, and no one is answering phone calls, including sales, billing, and enterprise support. This is very disappointing

Good summary of the likely cause but there are many other subnets in this too, since 67.215.224.0/19 is also affected. The following are all showing as hostpapa now , 67.215.233.0/24 , 67.215.234.0/24 , 67.215.235.0/24 , 67.215.236.0/24 , 67.215.237.0/24 , 67.215.238.0/24 , 67.215.239.0/24 , 67.215.250.0/24 , 67.215.251.0/24 , 67.215.252.0/24 , 67.215.253.0/24 , 67.215.254.0/24 , 67.215.255.0/24 We used to have multiple /25's in a couple of those blocks but luckily moved most things due to constant power issues in 530 W 6th Street , so now only have a few servers remaining and they are affected by this. Got a response early on from quadranet that they lost control of the blocks and will need to get new IPs , but have not heard anything back since. The reply from the staff sounded like this caught them by surprise so who knows what's going on over there.

Can you access the servers IPMI or IDRAC interface to bring up the on-board keyboard, video and mouse console?

I believe that WebNX has a data center in the same building as QuadraNet and offers Colocation services.

These people seem to have gone insane. After selling my IP out from under me they insisted I had to change my IP range. I did so and when I reloaded my Ethernet configuration I lost contact with my server. I asked them to verify the route and fix it or reboot my server. 24 hours later I get a message asking me to confirm I am back online with my original IPs. I have submitted a request for them to ship my server back to me.

I don't think so -- I was looking up things on bgp.tools and many things which are single homed to Cogent on their side are down in LAX.

Moving servers during business hours is ok when scheduled in advance. In the case they don't even notify their customers. Well, six-hours downtime is nothing after a few weeks people were offline, probably that was the reason to not notify :-D

LA Downtown dedicated server still down as well (no IP connectivity). Close to 24 hours of downtime... Has anyone been able to logion to their VPN ? Neither MIA or LAX seem to work.

Why is it taking so long? Are they transfering the WHOLE datacenter?

I don't think you can say merging platform is code for abandoning and merging datacenter space. QuadraNet and Multacom have their own separate billing, support, management and network. That is what the article means by platform. Again, not defending Quadranet but that is a far stretch / leap to make that they are exiting the datacenter facilities. Multacom occupies floors in the Anon building in DTLA and has a smaller footprint then Quadranet Quadranet has the entire basement in LAX Century (the only floor in the building for datacenter space). Quadranet has a few floors in 530 West 6th Street. This is way more believable and realistic. I don't think they had 6 floors in 530 West 6th Street. Last time I was on-site about a year ago the on-site staff they had made comments they are realistically only two and half floors with pockets of space in others. The contracts business have are not month-to-month when you occupy floors in a commercial building. They are multi-year contracts that written by lawyers with specific clauses on how to exit a building. I am assuming any physical move in 530 West 6th street is them consolidating their footprint so customers are not spread out on their datacenter floors. This will help them replace their old and out dated 36in depth cabinets (like they are doing in LAX Century) and replace any gray space equipment. I am assuming they are peering directly with HostPapa/ColoCrossing to regain temporary access to the IPs they sold/transferred to them as a stop gap to give Quadranet time to renumber applications on their side. It would not make sense to sell/transfer IPs to HostPapa/ColoCrossing only for Quadranet to merge with them as people in this thread are assuming. You can look at Multacom IP space as an example where that has not happened. Why can't you disclose your source? We are not dealing with nuclear secrets here. Was it your dog who told you? A technician you spoke with in person? A member of their c-suite?

yah they won't answer phone so the only way is to get remote hand or go to the datacenter. There is only 1 tech working in LA.......good luck guys. This is a **** show from quadradnet

Sorry, why would I share that publicly? I just received an email with new IPs. What a PITA.

Should be more, right. Ping prefixes announced from their AS, you would see many are offline. Even some prefixes owned by their customers. No outage info from those companies though.

Pretty fast ticket response but not much use: "Our networking are working on the issue, and keep you posted,"

It is interesting what the issue is then. It is pretty easy to bring everything online if IPs remains the same.

can i check, that all of you whom servers are back online today, didn't perform any IP change ? i was told to change to another IP range (which i used to have, but now is under HostPapa), and still didnt work.

Yes I am hoping that the fact that a number of customers are using VPN that this guarantees that they are fixing it. But it concerns me that despite my begging them to say SOMETHING -- to even confirm the problem and that it is on the list of things to fix -- and they have not. Why? Further, they seemed to not even know it was down for the first day or two. This makes me think only a small number of customers use it so they are considering it to be not a big deal.

Looking at this as an outsider eating the popcorn, this would make me suspect one of two things: #1 - Is Quadranet going under? After all, you don't sell your IP space, with active paying customers on it, without moving them -- unless you don't care about 'em. This would be the equivalent of a host selling the hard drives from their server, just pulled directly out of active use without any backups made, under the argument "yeah, it's normal" -- It's not. You don't trade your bread and butter recurring revenue for a one time payment under normal operating conditions, unless the recurring revenue isn't worthwhile in comparison to the one time payment. #2 - Is this a fire sale scenario where they're on the verge of getting shutdown, and Hostpapa is buying 'em, pulling the food straight out of the fire, where things are so far gone, equipment needs to be moved with zero notice (the old WHT "midnight move"), and Hostpapa doesn't want to eat the negative PR for what's not their fault. Will this turn into a "we've been acquired by, or we've sold X to" scenario in a few months, letting the old brand take the heat so the new one does not? Either way, anyone still "down" from this, who is operating any sort of business, obviously has zero contingency plans, and is part of the problem. The whole thread is a lesson in why off-site backups, contingency plans, redundancies, etc. are important.

I have a question related to this situation that maybe someone here can help me with : My server is still not connected to the public network and the primary IP is one that just got migrated to hostpapa.. However I am able to access the server through the IPMI credentials and iKVM interface and was able to perform some backups. My question is how can I easily get these tar.gz files transferred to my local computer or to some other server? When I attempt so use ssh or ftp I get a "no routes" error as the server isn't connected to the public network ... Since I am connected through IPMI from my local computer, I imagine there must be a possibility to somehow download the files directly ? Any assistance would be greatly appreciated .

im not sure why you have this entry: Code: inet 216.45.59.202/32 scope global eno1 valid_lft forever preferred_lft forever Maybe restart again the eno1: Code: ifdown eno1; ifup eno1 Then add again the IP address via ip addr and ip route add

"01-25-25, 03:27 AM#229mr fixit mr fixit is online now Wasn't it their plan to close the two data centers and move it all into one place? There is only one LA data center site advertised on their website and as per a 2024 article "Apr 8, 2024 — Edge Centres said it plans to merge QuadraNet's platform in Los Angeles with the facilities it acquired in its purchase of LA-based Multacom in July 2023" It would not make sense to have 3 facilities in one NFL city, when they can own one large facility and consolidate." I told you so!

Yes, I did colo.... server was DTLA

This is epic, then to another ****** dc

Hello Everyone, It has been some time since I last engaged with this community, primarily due to time constraints. I’ve noticed that this thread has shifted in my direction without clear justification, so I’d like to provide some clarity on the situation. The recent shift in IP addresses was a business decision made by the new owner and was not within my control. While my team and I are committed to ensuring business continuity, these decisions are ultimately made at a higher level. That said, I completely understand the community’s concerns and frustrations regarding these changes. Please rest assured that we are actively working with our new partner, HostPapa, in Los Angeles to resolve any outstanding issues related to the recent data center migration. Additionally, I want to acknowledge that HostPapa and their team have been as supportive as possible throughout this process. If you are still experiencing difficulties with your service, please feel free to share your ticket information in this thread, and I will do my best to assist in prioritizing your requests. Thank you for your patience and understanding. Best regards, Andrew

So why are you wasting my time if you canceled the service?

Because I was your customer and you made everything possible to get my services cancelled. It is not just cancellation it is cancellation while servers were offline, I didn’t even get one online after a week of waiting with no response so cancelled. Your team never provided any updates for days so I have a full right to ask you for explanation. And I still have a lot of sla credits. Will order something one day to have a right to communicate with you to get answers, okay. It is pretty clear you are not going to answer questions in any other ways.

This is a very small footprint of only a handful of clients that have been reached out to. We did not purchase the clients but can offer continuity of service on the same hardware if migrated. I'm not sure what you mean, this is only for Seattle that we are involved in.

Those are recommendations that can help migrate equipment without having to pay expedited and remote hands—what most DC charge to migrate equipment. -

So what happened yesterday?

I see this is why you didn't want to answer my call. Two hours ago, you just sold New Jersey to InterServer.

Correction, my IP6 sub is working, so I can connect to my server via that now. Unfortunately, most of my stuff on this server is still using IP4

My apologies, we are not a customer of theirs. Just weighing in my thoughts This calamity is quite the odd case.

Good luck with the compensation, been with them for like 13 to 14 years and I cant remember if they've given me any compensation for all the downtimes that they have caused. Their service was nice back at the start but then their service started to go downhill. I've already moved most of my services to a different host a few years ago because of their horrible service and I guess this is the last straw and I will completely move away from them now. I suggest any prospecting client to stay away from them as well. Their service really went downhill starting when one of my favorite sales agent from them moved away and then I'm not sure if they got acquired by someone else a few years back but that's when I noticed that the quality of service started to go down with multiple network issues that could have been prevented. So goodbye Quadranet.

No, we left 530 more than a decade ago.

From my understanding, they sold the IPs to HostPapa/ColoCrossing when they left QuadraNet back in December. Edge Centres just bought QuadraNet in early 2024 so it doesn't make sense that they would be stripping it down and selling it off by pieces. They got your original IPs back online?

Their status's subdomain "https://status.quadranet.com/" is opening though.

It's about 10 hours now. Business hours over, might as well take another 12 hours.

My server and /29 have been working for the past 12 hours or so but my /28s still don't work VPN still not working either.

There is no update from their end, so I can't understand the main case. No ticket reply, No mail reply, phone call under hold.

Which announcement are you referring to?

30 mins ago, I got an email with a new IP range. 104.223.6.x. Surprisingly, this one is clean. Hope they get to all of you as well too soon.

Server is up now too but when i tried to traceroute it had added 6 hops and the pings got higher WTH quadranet

Were you able to speak to him to find out something about the situation?

Some of us have a rack or more of equipment at QuadraNet.

Is anyone back online yet?

Is their Management Portal Also down now? manage(.)quadrant?

They must use another VPN or access method otherwise it would already be fixed.

Sounds spot on if ya ask me.

You can't change ipmi firmware, so if the ipmi firmware doesn't provide such a function, there is no way to download files directly. IMO the only standard 'output' feature is screen capture and/or serial console, which could be used to transfer data, but utterly convoluted and slow.

@ sosys It's not working unfortunately. Stil many thanks for the trouble trying to help me out! I think you are very close with the specific configs you told me to look at, but there is something beyond our control that probably only Quadranet would be able to sort out, if they finally got to it. Will see tomorrow if they recover from the weekend and will keep people here posted. In the meantime, wishing you a good evening/night !

"There are millions of dollars in investment being used to buy all these data centers such as Quadranet. I think it is probably irrelevant to the purchasing investors if customers leave because a new marketing effort by the parent company will just net new customers over time, many of them large retail customers and enterprises. I could be wrong, but in my experience I don't believe so." THIS.

As mentioned in a post earlier, I was back online (dedicated server) so to speak last Wednesday. This specific 2 week disruption was clearly due to some network configuration (or lack thereof) issues within the datacenter rather than specific to my server configs; even though they tried as much as possible to place the burden on me when the issues were clearly outside the scope of my individual server management... reading here , lots of other in similar situations.. same runarounds, lack of answers, lack of anything logical with lost Ips, etc... It's obviously something to do with (mis)management and I'm sure the limited staff still working there isn't to blame and probably doing "what they can" ... in any event it's not possible to speculate. And when you see that the status page hasn't been updated since Jan 26, they obviously don't care what people/clients think and are no longer even trying to pretend... All this to say that anyone lucky to be back up should make sure they get everything backed up off site and a plan b. I personally cancelled and moved to an alternative provider.

Yeah. They can’t be trusted anymore. Though it seems they are merging customer bases into single brand now.

If you require urgent assistance please provide a ticket number and I can reach out to you directly This is not a QuadraNet employee - please follow the above instructions. We are in the process of moving our internal services -- again I understand the frustration involved by all members here - I am more than happy to assist accordingly if you provide the ticket information. Thanks,

To be fair, you did a good job before, but ever since you were acquired last year, it’s been really hard to reach your sales team. It seems like a lot of people have left. Now, you’re no longer QN. What really happened after the acquisition? The way you’re handling things makes me feel like I’m being deceived. Morning, your ticket update only mentioned changes in LAX, but by the afternoon, you told me Seattle was being moved to Woow rack.

SUGGESTED CORPORATE SPEAK Instead of saying "If you are expecting that I intend to divulge our strategic business plans on a forum, this is not something that is going to happen.", how about something like: "Quadranet continues to care deeply about your businesses and deeply apologizes for any service experiences lately that were below both your and our expectations. We've been the largest tenant at 530 W. 6th for a quarter century, however due to advanced in server density over the years, we currently occupied more floors than we needed in DTLA (and more space in other centers too). Despite our expectations, discussions for a new lease moving forward were ultimately unsuccessful. That caught us by surprise, and if we had better anticipated this outcome, we would have started migration planning earlier and more fully -- giving every one plenty of notice and providing all of us an extended time to plan. As it turns out, a short calendar turned out to bring with it some disruptions for some and communication that was imperfect. For practical and fiscal reasons however, change was inevitable.". Everyone knows that you are moving, that its been disruptive, and that Quadranet has had money and landlord problems. The above just sort of addresses it all. Along the money lines, it's obvious to many (especially on this forum) that Quadranet is struggling. Without any communication about same its hard to tell everyone "We have a plan and it's all going to be ok". So the above suggested corp speak isn't likely enough for those that worry if their servers are going to answer requests tomorrow. I was worried Quadranet owed $1m to its LA landlords and that it might get locked out and not have access to my servers, or that I'd get abandoned in a transition -- that's where the reassurance was needed.

I mean the price

Deciding to stay, you would get relocated to their sister company, multacom.

We’ve moved our rack to Xfernet, and it feels wonderful to return to a professional, clean, secure, and supportive provider!

Well, it was clear we can’t trust that guy Andrew. Let’s see how long will it take to get all other locations sold.

They are probably quite busy right now. At least I hope so.

What's more annoying is that as soon as there's a problem, they stop replying to tickets. If I hadn't come to WebHostingTalk, I wouldn't even have known there was a problem with their IP addresses.

We have two systems, with multiple subnets some of them working. We called this AM and got a tech on the phone and he changed our iDRAC to a working IP which allowed us to restore service on the "working" IPs. Great tech he was fast, thank you sir. The other system also has a working subnet, but they have not changed the non-working IP to a working one yet. Pretty frustrating as I know that if they make a simple IP change in our NIC, all services will be restored for us, a process that takes 2 minutes which would avoided a 2 day outage. As the VPN is down we cannot make the change ourselves via console..

Understood & many many apologies, just replying to this next one since I know the answer to it, I believe they are in Equinix as per their latest offering. We're trying to get a quote from them as well.

That was implied when they asked me to confirm I had my original IPs back. I can;t confirm it. My server was already configured for the new IPs which also were not working. I'm strictly a hobby web host, all of my domains were designed to not make money. I'm 76 years old and don't have the patience to deal with these idiots.

Has anyone been able to reach out via their support phone# ?

Yup, I'm still offline.

The outage has lasted for more than 24 hours. Could it last for more than 48 hours again this time?

Probably poor planning and not enough people with the technical skills required to reprovision things.

They are doing cabinets restructuring as per their status page. Simple hardware move can’t take so long, it is obviously something more complex than simple cabinet to cabinet move within the same infrastructure.

Why doesn't IPv6 work though?

Sorry for asking publicly. I actually wanted to see if this was before the ticket number I opened. You can also give it to me in a private message if you want.

Do you know why their VPN is still not working?

Do you have a private uplink and VPN access? If so I assume it is also down for you. It would be great if others can help get them to realize that fixing it will help us help ourselves. Right now I can't even get an acknowledgement that they have confirmed an outage with it.

Has anyone been able to go in and physically remove their data?

Is there anyone who can access the Los Angeles - 6171 W Century Blvd servers?

It may be working inside the LA network 😉 We already know their IPs are all working if access locally.

Chrome complains that neo.quadranet.com is not secure because the certificate expired. Great job.

Try setting up IPv6. I believe their IPv6 is still working.

Still down i dont know why support not replying anymore

But if they don't care about the customers and don't care about specific facilities.... what else are they buying? Well I guess the brand but they are destroying that. That's basically all there is, one of those things. The infrastructure is all being rebuilt for these changes so why not just build new capacity and fill it over time as you say with new clients? It would only make sense to buy existing data centers like QN if you thought you could keep the customers, or bought them at such huge discount that they factored in losing many. And the sad thing is this is also a downgrade from effectively being "at One Wilshire" since only a wall was separating them so super easy for a direct connection.

do you mind pm me ?

What requirements did they give you to get your racks? Did you have to give proof of their 530w building on your insurance?

Hey John, I found your email and have approved your access to the facility to retrieve your equipment, please just coordinate with our staff member that I attached to the email with you and he will make sure that you are escorted to retrieve your equipment

I completely understand your frustration actually - we have had some communication gaps internally and I respect what you are saying here. My intention is simply to try and assist the customer's who have an actual problem and I can not really do this without a ticket ID.

Do you perhaps have an ongoing ticket ID that I can address? Happy to help if so.

If you have an existing service, you can reach out through the channels provided on how to continue it. HostPapa is not in our facility in Seattle, and we are only continuing existing services. This is the last response I will make in this thread, I do not want it to get offtopic, there was mention of the Seattle services being moved also and I just wanted to provide a little information.

The problems started in Miami with Quadranet, they are having many DDoS attacks that leave the network down for several minutes and they are not interested in solving the problem. The most serious thing is that they admitted to me that they do not have a system to mitigate DDoS in the Miami Data Center. I requested a refund for the server I paid for two days ago. I hope they return it. I am already migrating to Hivelocity in Miami.

We've also moved our rack out, but ended up going with Linksecured.net They were quick on getting our cabinet setup and are super flexible with anything we needed. They even helped me move our equipment since I'm not local. Highly Recommend

Yup. QN is over.

I'm in the same situation. There's no reply to the ticket and the server hasn't been restored either. The last time their domain name incident occurred, it was the same. Could it be that all the people in their company went to deal with the fault problem, so there was no response?

That has been our experience ever since EdgeCentre's acquired QuadraNet in early 2024. We were a colocation customer with our own racks in both of their Los Angeles locations (530 West 6th and 6171 West Century). As soon as things started slipping (all of their sales staff laid off, network and power issues, chiller failure, no more 24/7 on site support, management issues, etc.) we moved out. We now have multiple racks at CoreSite in Los Angeles and experience has been night and day - power, network and service are all far better. Even our downstream customers of VM and bare metal services are happier. Lucky for us, we own our IP space. However the real issue is not that customers have to re-ip their servers, it is the fact that their was no advanced notice when clearly Quadranet knew ahead of time this was going to happen but for what ever reason did not tell customers. I hope the current QuadraNet leadership makes this right with customers. Gaining the IP space back is not possible at this point.

I just got notified by IOzoom that we have to transition the IP of one of our VPS's. This will be fun as our client is out of country on holidays until the end of the month and I need a 2FA code from them to access their nameservers...

My server just went down and can't access by this subnet now, or the new subnet they assigned. Cannot access IPMI either (although I haven't tested this in a while)

They said it should be back online with original IPs, can't confirm as the server itself is disconnected on their side for some reason. It seems they started to announce small blocks like /29, /28. Bgp.he.net shows multiple networks like 72.11.134.40/29. Not sure what is going on. They probably got some IPs back as all inaccessible IPs are in their prefixes again (according to bgp.he.net).

Their website and neo portal is now accessible.

Last time, it was the servers in some IP segments that broke down. Now, all the servers in LA are disconnected. The problem has lasted for more than 12 hours so far and still hasn't been handled properly.

On the bright side, the weekend is coming up...

Chicago still down too.

They are giving very obscure and misleading information on their status pages: on the Neo interface it only mentions "Urgent Update: Service Disruption in LAX Facilities Due to Cogent Network Issue , Thursday, January 23rd, 2025"This is obviously no longer the case as their customer sites are up and running and those go through Cogent. On status.quadranet.com they do mention on Jan 23, 2025 - 11:20 PST : We are still undergoing our network and cabinet restructuring at our Los Angeles facility and will provide additional updates as they become available. However more recent updates mention connectivity issues ... And no update today, maybe they don't work on weekends???

Chicago Network Outage

What subnet are the new IPs in?

If it weren't that big of a problem for us it would be funny: the IP mentioned for one to test on the beautiful LOS ANGELES Downtown Datacenter page of the quadranet.com website 69.12.66.26 is actually owned by HostPapa since January 2: NetRange: 69.12.64.0 - 69.12.66.255 CIDR: 69.12.66.0/24, 69.12.64.0/23 NetName: HOSTP-7 NetHandle: NET-69-12-64-0-1 Parent: NET69 (NET-69-0-0-0-0) NetType: Direct Allocation OriginAS: Organization: HostPapa (HOSTP-7) RegDate: 2025-01-02 Updated: 2025-01-02 How can a company featuring over 60,000 square feet of privately-owned and operated datacenter space in central LA end up in such a mess?

I don't use their VPN.

18 hours ago. "Update - Dear Customers, Thank you for your continued patience as we work through our maintenance in our Los Angeles facilities. The issues have affected multiple services at both locations. We are working 24/7 to resolve this, but as expected this is not enough to resolve all. Once your services are restored, please submit for an SLA credit via the Neo portal. For further escalations, you can contact our CEO and Owner Jon Eaves, directly at jon.eaves@quadranet.com . We apologize for the extended duration and any downtime you have experienced. Jan 26, 2025 - 12:56 PST "

I am now up (at downtown location) with the same IPs. No update from support yet.

I've been assigned new ips but I have no idea how to configure the IPv6 range. This was all done for me when I originally had quadranet setup my server. I have WHM/cpanel but so far I think I will do more harm than good. I've reconfigured my cpanel licence ip so I can login to the server now but have no idea how to add the IPv6 range. Any help would appreciated. How do you know what your IPv6 range are.

All those who want to change to another provider LA @ fiberstate are an excellent company and can handle the migration, they have a point in UTAH/LA https://deals.fiberstate.com

I don't think things are routed at all unfortunately .. will ask if they can supply an IPv6 but all this depends on them to setup...

IPMI runs on a standalone micro controller. If IPMI shares the port with server, the nic is probably configured with two mac address.

I also received the same email on Wednesday night. I'm glad I haven't had the IP troubles others have had, at least not yet. Though the 1/23/25 Cogent down adventure because QN didn't have their multi-homing BGP configured correctly was hard (and an unforced error on their part) and not the first major down event we've experienced in recent years. I had a -really- bad adventure with QN moving some of my equipment previously where they hid the fact they moved my equipment from me even though I had open down tickets (they mis-wired equipment after moving it so networking didn't work, and also the move permanently destroyed 2 motherboards). So I have zero interest in them moving my equipment now. QN said they aren't ready for me to start moving anything yet, but that it must be completed by the end of the month. And they write: "Due to the scale of the move, we cannot accommodate individual scheduling preferences, but we will ensure you have sufficient notice to plan accordingly." uh? That single sentence led to this post. I have a bad feeling about all this. And the less-than-30-days-notice from them isn't convenient, and if I can't even get into their new space easily, well, maybe I should get serious about looking at my options. Maybe this is off topic but I'd appreciate any advice, at least by pm: If I moved within a week I'd avoid another month of charges. I'd love a place in downtown that is reliable, easy access/parking if possible, and with onsite 24/7 support. BTW, their main phone numbers (888 & 213) are down currently. For about a year, I'd need to lease a delegated /24 from the center or from someone else. WebNX, Psychz, Racknerd, etc., etc. -- I have no idea what the quality options are. Does West 7 Center offer space + connectivity direct? Should I look at any of these options or others? It's hard to evaluate these companies without a bunch of online research and then doing site visits. I've thought about moving to CoreSite LA2, but I'd have to pay for the space, then pay for connectivity from someone else, then lease the IPs, and then not really have onsite remote hands support apparently (I typically handle my own hardware repairs and OS issues, but if I was ever travelling...). They lack of real help in case of an emergency isn't ideal. It seems they are more suited to a customer that has more than just a single rack... It seems this would end up costing me 3-4x what I'm paying at QN. At least the parking is better. Are their other companies that can help with a very infrequent remote hands service at LA2 without huge service retainers? I'm fine paying a few hundred dollars a month more than what I'm paying QN if needed, but I'd really prefer not to end up paying 3x or 4x. I haven't looked around too much recently, but in the past there seems to be the expensive corporate grade providers geared towards companies with larger staffing and larger needs, and low end companies with cheap pricing (and maybe you get what you pay for). And some that were priced in the middle, but not necessarily providing anything more than the $600-$700 colo rack companies provide. Do providers in the middle really exist? I guess the bar is low though if I'm still at QN. -- We are on the ARIN IPv4 waitlist with a solid year to go. We've been at 530 now for over 20 years (someplace else before) and should have grabbed our own IPs 30, 25, 20, 15 or even 10 years ago when we had ample opportunity, rather than be stuck using QN's dirty ones now. We haven't had routing issues with our IPs recently, but I see the ones we use (between a /24 and /25 currently) are part of 198.55.96.0/19 they transferred to HostPapa. That's not reassuring based on what I read in this thread.

They are moving lots of racks today to HostPapa, anyone have any experiences with that yet?

quadranet.com seems to have evaporated. No more dns or ns or mx or a records. I wonder if it was deliberate?

Don’t you mind to share how is HostPapa involved and what was the reason to perform multiple hardware migrations? Migration you performed in the end of Jan was not even scheduled. The whole situation was not explained in any way yet.

Because you’re a person in charge for 2 weeks of downtime? The fact I cancelled only means I had no chance to wait longer to get things online and you are still responsible for providing me and anyone affected detailed explanation which is not happening in any way for some reason.

In reality customers just want clear explanations, just like I did before. When you tell us what we want to know, we’ll have more confidence in you.

Bunch of retards their cloud service is down right now without warning again

Has anyone of you decided to stay with them?

Got an email from them telling me that they are closing down los angeles operations and killing of their cloud effective march 30

Btw, are you sure Andrew is still there? Since they don’t want to continue their operations they may no longer need any CTO as there is nothing to manage. May you please also share if they still have the same guys in the support?

My server is still down but i can access my server thru another internal server which is not down

How is it even possible to make such a colossal error? What's even worse is their follow up. Twelve hours now and not a peep other that "uh, looks like we lost your IPs bro".

Who is still waiting for IPs to be assigned to them? You would think they would assign IPs to their clients immediately if they already know that they cannot recover their old IP. They don't need to wait for the client for their confirmation because we don't really have any other option. They should have ask for confirmation if we want to change IP before not after when we no longer have a choice. Still waiting for new IP range on mine so I'm still down until now.

If you are doing colo and thinking about moving out of 530, may I suggest looking at CoreSite LA2 campus? Its about a mile away from DTLA, free on-site parking, a building designed/redesigned for datacenter needs, etc. Most of the datacenters in DTLA are old office buildings converted to datacenters. Because of this, they have very specific weight limits of how much gear you can store in each rack along with limited power and cooling. Some buildings are better then others. Other options are Equinix in their LA3 and LA4 campus. I would avoid LA7 due to small on-net carriers. Their is also Digital Reality, Cyxtera and Evoque facilities. in the same area as LA3/LA4. I mention this because Los Angeles is full of other providers that you could possible use to leverage Quadranet for any sort of discount, credit, leverage, etc. Plenty of providers in the Colo Hosting Offers and Dedicated Hosting Offers section that are based out in Los Angeles that are not in 530.

The net I was on 104.129.0.0/18, and in particular 104.129.3.x, has only partially been reassigned. The x..3.0/24 and x.x.4.0/24 have been reassigned, but the x..1.0/24 and x..2.0/24 have not. And this pattern of random /24's is present in all the nets seen so far. So who sells a /24 out of the middle /18 ?? Makes no sense. Also this 104.129.0.0/18 was / is clean for spam. And 10 years ago, when I first got assigned this address, the net was leased from someone in Seattle.

And still they chose not to update customers on what could have happened

My server just came back online. Total downtime was 13 hours if you don't include the problems with Cogent. I was planning to move away from them over the next few months but may need to accelerate that timeline. My guess is they lost a bunch of customers over the IP debacle and wanted to quickly downsize to reduce their rackspace costs. They don't seem to care about keeping their remaining customers happy. Not informing me about a planned server move, and doing it during business hours, probably to try save more pennies, is not acceptable to me in any way shape or form. Clearly it wasn't very well planned either. No server move should take 12 hours. Even if it's moving to a different datacenter, which at this point I am still not sure of.

I think all those people responsible for the good service in the past are long gone. It appears they don't have any qualified technical people around anymore who know how to configure/fix this stuff.

Ticket response: Thank you for your email reply. Our team is currently handling an unusually high number of tickets and is working through them in the order they were received. I apologize for the delay in addressing your concerns. We are working around the clock to meet everyone's needs and will get back to you as soon as possible. If your issue has resolved, please let me know and we will close your ticket. -- Best, Director of Client Success

One of their staff members told me they no longer have anyone onsite outside of business hours, so probably weekends too. Colocation customers may visit to verify

Is there anyone who can access your server in LA Century?

Subnet /24 and is being announced by hostpapa i don't understand why hostpapa is involved here did they sold the dedicated servers to hostpapa?

Yes, agree.

One of my dedicated is online with unchanged IP but now announced by HostPapa. But its Asia Optimized IP (also announced by HostPapa now) cannot be connected. Another dedicated with IPs announced by QuadraNet is still down.

Been a colo customer for more than 7yrs. one subnet was down and got replaced. "Dear Client, There was a routing issue with the old IP range and we were unable to restore it. We have assigned you a new IP range as a replacement & got it routed on your device. Please help us migrate your IP to this new IP range. Thank you for your understanding and patience!"

Is everyone's server back up? Cuz none of mine are

Did you gain back access just now? Any communication from them until this point?

My port still not showing active. As someone else said their SSL certificate is now expired on their web portal, but don't worry, they have 'all hands' working on it. The right one, and the left one.

Normally SCP should do the trick but I get "no route to host" errors

Just cancelled all my servers with them. These clowns are ridiculous.

Indeed .. All this makes no business sense and when you see how they managed everything that was going on these past few weeks, there's a total lack of professionalism as most of what we suffered could have easily been mitigated .. Seemed like the staff on site had no experience of their networking setup and was improvising all the way. Seriously has anyone been able to figure and actual facts about Edge Centres? When you visit their site, it's a very nice brochure but there is actually very little information about the specific locations..

Where did you get this information? And transition to HostPapa is what I mentioned some time ago. Someone here said I must provide a proof when saying such things.

It feels like something is going to happen again..

QuadraNet has officially partnered with HostPapa as our new service provider in Los Angeles, replacing our previous landlord. As a company with a 25-year legacy, we continuously adapt to evolving business needs and industry conditions. We understand that the transition may have been unexpected, and we sincerely appreciate your patience. Rest assured, we are working diligently with our new partners to ensure a seamless experience and continued excellence in service.

Can you DM me whether you’re planning to migrate all your data centers to another company? If you’re not comfortable, I’ll keep your DM confidential.

I'm not sure what you were trying to send me, but thank you for reaching out. As noted above, I found help through the ticket system (and responding to some email I sent by Quadranet mgt helping with the transition). So I don't need anything at the moment. I was mostly agreeing with you and suggesting that people at least try and use ticket system. I like everyone else has had tickets opened in the not-so-far past that don't seem to get proper attention, but in the last few weeks, I've gotten what I've needed. I mostly post in the hope that someone here finds it helpful, and also as a way to decompress -- it was hard to get a notice that a migration was helping on short notice, and then be told that my colo machines would have to go onto different server racks (later I was told that wasn't going to be the case). And as mentioned above I was worried that the migration might not be successful. post level -- I guess I need to have posted 10 times to receive PMs and I'm not quite there yet. Thanks again for trying.

is the last date on 530 location is 28 February or 13th march ? @ Andrew M - QuadraNet

I think I will.

Lol. Is it about their operations they moved to HostPapa and MultaCom?

Recently, aside from the NOC, they seem to no longer have their previous employees.

It seems that things are developing in a good direction. Next, it depends on when the service can be restored.

This is odd. I'm in 104.129.3.0/24, which is advertised as 104.129.0.0/18. I did a Zenmap of 104.129.0.0/18, and most /24 nets all return something up and running in Quadranet. But nothing in my x.x.3.0/24. How could the little /24 I'm in be dead, while the broader /18 is alive?

I am still waiting.

No one else had their server go down in the last 2 hours? Their ticket response time is 8+ hours so I called them.

Indeed, we are experiencing the same thing, our server and IPs are down since 05/01/2025, and they have affirmed that their old owner has revoked many IPv4 subnets so they can not recover it, rather they will allocate the different subnets. Last at 08/01/2025 they said, it will be fixed by tonight and if not can contact them again, but still it is not resolved and our servers and IPs are down until now. They are most probably working from the backend I assume.

I can see the the following on thier neo portal: Emergency Maintenance Notification Wednesday, January 22nd, 2025 We want to inform you of an emergency maintenance window at our DTLA facility on Thursday, January 23, 2025, from 00:00 to 23:59. Additionally, there will be another emergency maintenance window at our Century facility on Friday, January 24, 2025, from 00:00 to 23:59. Please note that this maintenance window is an approximation and does not indicate an all-day outage. Each affected client should experience downtime of no more than six hours. This will primarily impact bare metal clients and a few colocation clients. This urgent maintenance is necessary, and we will keep our status page updated throughout the process. Thank you for your patience and understanding with this short notice. Please check our status page for updates and avoid submitting multiple tickets for updates, as this may cause delays in our staff's ability to provide timely information.

Mine still hasn't been restored.

The is so unacceptable. 10 years with this company. Terrible service and support now.

Seems so. I heard they are abandoning both downtown and century facilities. Not confirmed officially though. But considering the urgency and renumbering

Surely in emergency situation with everyone down for 2 days they'll be working weekends to fix it?

There *might* be an easy solution. Because the now invalid subnets are still listed in QuadraNets bgp, and the nodes are still numbered with the old IP's, then two Quadra clients should be able to talk to each other at the old IP. The traffic should stay within QN. I know I can still ping my old neighbors in the old /24 I was on. Send me a PM with an IP that should ping, and we will see.

I don't think they would've sold the dedicated servers, because I think thats where the majority of profit is for a datacenter owner, for example, if they sell rack space for $1k-1.5k/month, in the same space they could instead make at least $2-4k with dedicated servers depending on the server configuration etc of course. What I think instead could be that the IPs are leased/sold, but then some subnets are being routed back to Quadranet so that customers can have their access to their servers, or something. The situation seems such that even after reading these past 12 pages, It's tough to figure out anything without any communication from their end, everything was humming along nicely all these years till the 5/6th of January 2025 when the initial subnets went down, and they had 20 odd days (so far..) to send out a email saying what's going on/what could happen/what will happen.. etc. If they had just communicated even a little bit, a email a week or even a single email all these 20 days, I think most customers would've been accommodative at least.

Thanks for the info.

Basically this is a repeat of what happened 3 weeks ago: Suddenly, HostPapa takes ownership of chunks of the IP space from Quadranet. If you are unlucky to be in that particular subnet, then you loose the connection, until new IP's are assigned. They are not taking nice little sequential /20's or /21's. No instead, they are cherry picking /24's out of the middle of bigger /17's. This current second round of losses, is taking more of the /24's from the same /17's. So that suggests, Quadra is eventually going to loose the whole /17 block. The IP's I was give 3 weeks ago, also vanished in the second round of chaos. I expect there will be a round three, and round four of this IP chaos to come, until there is not enough IP space remaining. Was Quada sold and this transition was poorly planned? Or is it some hostile takeover and the victor is just being nice to only take the IP space in gradual amounts? We are missing the bigger story here.

How long did it take for you to receive the new IPs? It is very interesting some got it quickly while some are waiting for days with no response.

2 out of 3 dedicated is up, with same ip.

i gained back my server access. Surprisingly, im now running under old IP address that is now assigned to HostPapa.. im completely puzzled. Anyone else have server online but with IP under HostPapa ?

I wrote to HostPapa support, asking why they are taking over the IP space The reply: Thank you for reaching out to HostPapa support. We strongly suggest to reach out to Quadranet for any questions or concerns regarding ther servers or data center. -- Regards, Patrick F. Customer Support HostPapa Inc.

None works if no access to the internet. You will need someone’s to access your server via their network.

If they can supply a public IP to run IPMI (and it is working), it shouldn't be much trouble to supply and configure an ip to access the server directly? Isn't it pretty much a question of taking 5-10 minutes to configure this or am I missing something?

My server is back online now but what irks me most is the reason for downtime is they plugged on the wrong network port and it took a week to resolve. Me thinks that the support staff are newbies who do not know what they are doing

I received an email yesterday saying they are moving servers. I assumed it was happening today but the date was missing in the email. So far it hasn't been moved.

Are they moving colocation or dedicated servers? I didn't receive any email about a server move again Their neo portal is also down so no means to open a ticket or contact them nice strategy move

Looks like nice words trying to sound true. QuadraNet would not keep this in secret if this was real scenario. When the first downtime happened no one even explained, when the second downtime happened no one even mentioned HostPapa in any way. Considering the things we all saw it seems you were forced to migrate with no chance to plan, so it seems changes were not expected at all. I think the community and your customers here deserve to know the truth not nice words.

I am happy to share this publicly - that we are simply transitioning our Los Angeles service provider. It is important to remember that we are and have always been the largest tenant attached to the 530 W Telecom center, however after recent changes with our leadership and aggressive negotiation processes - it simply made more sense to change our approach and seek alternative vendors. It is not uncommon in this industry for these types of things to occur, sometimes a change is quite necessary and it is appropriate.

It's not clear to me from the above whether LAX is being consolidated into the HostPapa space too or not. Andrew notes "incompatibilities with our current Landlord" but downtown LA is different than LAX. As noted 100 posts back, things aren't going smoothly with the LAX landlord apparently. The west LA landlord filed suit to evict 2 days before the DTLA one did. As of 2/11/25, the landlord claimed $376,643.68 in monies due: unicourt.com/case/ca-la24-case5fb02566bbc2bd-20021?init_S=ch_ftrd

Their cloud infra is down for almost 24 hours now what a joke of a company

You didn't get the email that they are no longer providing colocation services? I thought they already sold their dedicated server customers to HostPapa? Do you mind me asking what is keeping you there instead of moving to a different provider?

Just services located in "Los Angeles" right? Can you share the email please?

The last guys I’ve seen there were Minas, Alexander and Mohsen. Alexander was new and useless in most cases but Minas and Mohsen were working there for years.