Technical Issues - TPU Main Site & Forum (2024)

[W1zzard]

I ported all my shit from cent to Ubuntu during the big shift. It has been a great experience.

Yeah, I did bet on Fedora for a bunch of boxes, but now I'm installing everything on Ubuntu and quite happy with it. No proper mini.iso sucks though when installing over IPMI, so I install 20.04 from mini ISO and upgrade 2x to 22.04 and then to 24.04 ... zero issues .. something unthinkable on CentOS

 

[chrcoluk]

I have done a fair few edits, edits typically triggered it a lot, and so far so good.

 

[Macro Device]

Just had a 502 for a minute or two. I assume you're reinstalling stuff.

 

[W1zzard]

Second reinstall completed, things are chugging along nicely now

 

[de.das.dude]

Second reinstall completed, things are chugging along nicely now

they are indeed. It's quite snappy now

 

[RJARRRPCGP]

Seems that it's fixed!

 

[de.das.dude]

getting an intermittent error while adding attachments:

this MAY be from my wireless 5G mobile network, but i doubt it. Its pretty ok latency and i am yet to have noticed packet loss.

 

[lexluthermiester]

getting an intermittent error while adding attachments:

View attachment 364101

this MAY be from my wireless 5G mobile network, but i doubt it. Its pretty ok latency and i am yet to have noticed packet loss.

Never seen that one before, IIRC..

 

[de.das.dude]

Never seen that one before, IIRC..

i got it twice in a row. And it disappeared as easily as it arrived. I think the browser couldn't parse the server response?

 

[Nuckles56]

I just got a couple of 502's going into the forum and it was taking ages to load anything. Seems to have resolved itself now and TPU is back to its usual, snappy self.

 

[W1zzard]

I just got a couple of 502's going into the forum and it was taking ages to load anything. Seems to have resolved itself now and TPU is back to its usual, snappy self.

Confirmed, not 100% sure yet what happened. No reason to worry though, site is running pretty good atm

 

[Divide Overflow]

Getting a lot of 502s here just now.

 

[lexluthermiester]

Getting a lot of 502s here just now.

Didn't see that here, but did notice a comment taking a few moments to finish posting.

 

[Count von Schwalbe]

Nevermind, it fixed itself.

 

[nomdeplume]

Large outage.
Hope all is well at TPU HQ.

 

[W1zzard]

Large outage.
Hope all is well at TPU HQ.

Everything worked fine for two weeks, i left for holiday 8 hours ago, first night in a hotel bed and things fall apart at 4 am :/ fml

 

[trparky]

Everything worked fine for two weeks, i left for holiday 8 hours ago, first night in a hotel bed and things fall apart at 4 am :/ fml

Huh?

 

[Solaris17]

Everything worked fine for two weeks, i left for holiday 8 hours ago, first night in a hotel bed and things fall apart at 4 am :/ fml

I always buy refundable tickets so I can fake out fate after infra changes.

 

[Launcestonian]

Had 502 errors several times after each refresh an hour back.

 

[lexluthermiester]

Large outage.
Hope all is well at TPU HQ.

Huh?

Yeah, I missed it too.

Everything worked fine for two weeks, i left for holiday 8 hours ago, first night in a hotel bed and things fall apart at 4 am :/ fml

W1z, you seem to have a curse!

 

[W1zzard]

Knock on wood, no problems tonight.

Seems the outage was caused by some momentary loss of connection on our upstream switch, which caused the internal network to lose connectivity on all nodes at the same time, so quorum on mysql group replication was gone and the instances all went into fail mode, why they didn’t reconnect afterwards i don’t know. Will try to repro and fix this next week when back from long weekend

 

[Solaris17]

It’s always about outages but I wanted to mention since switching to Ubuntu TPU has been running great again. Haven’t really ran into any problems and it’s pretty snappy.

Also not sure if you changed things recently (recently being subjective since I notice things in blocks of months lol) but in regards to the DBs it has been running pretty quick, searches specifically be it the forums or the reviews come back even when I put in some pretty ambiguous terms. It used to hesitate quite a bit when iv used it in the past.

Nice job.

 

[lexluthermiester]

Haven’t really ran into any problems and it’s pretty snappy.

It does tend to hang a bit when posting comments in the forums but otherwise I agree, very snappy!

 

[W1zzard]

since switching to Ubuntu TPU has been running great again. Haven’t really ran into any problems and it’s pretty snappy.

Indeed, I'm quite happy, too. We're still running one primary server on Fedora, because not everything is migrated 100% perfectly and battle-tested enough, so far so good though. This migration is Pacemaker+Docker+manual scripts -> Kubernetes

Also not sure if you changed things recently

There's always changes going on in the background that you never hear about I'm slowly trabnsitioning our custom codebase from monolithic PHP to microservices with .NET. In my "free" time, or to relax/clear my mind off content-related work.

This migration won't affect the forums though, these will remain on PHP forever, because that's what XenForo uses.

it has been running pretty quick, searches specifically be it the forums or the reviews come back even when I put in some pretty ambiguous terms. It used to hesitate quite a bit when iv used it in the past.

Nothing has changed for those. The main DB instance does have a bit more memory allocated to it, because using tcmalloc now, which has much more predictable memory usage

Search what you need to search, dont hold back

 

[Macro Device]

Had a serious lag spike right now. No issues on my side so I guess DDoS, or some other kinda failure..?