Server Project

[TopHatProductions115]

Welp, here are the major changes for the project thus far:

• YouPHPTube is probably getting jettisoned, in favour of using LBRY instead
• YaCy Grid is going to be a long-term experiment, and has to be built from source
• xBrowserSync is officially part of the project now - and it's got more on the way!
• PleX has Movie and Music streaming, but doesn't have external LDAP integration
  • added Trakt.tv plugin (scrobbler) for additional functionality
• Would like to add eBooks management to Nextcloud, but may need a new container instead
• Azure Active Directory was added, to enable possible MFA in the future
• The majority of the server project is complete - looking into 24/7 testing soon...

 

[TopHatProductions115]

Why couldn't drive cloning be easy

https://www.reddit.com/r/HomeDataCenter/comments/s6idjv

 

[TopHatProductions115]

The task list has been updated:

• https://linustechtips.com/status/314520/

 

[TopHatProductions115]

Okay, you guys may get a laugh from this. I was remoted into the Windows 10 Enterprise VM (equipped with a Titan Xp). I installed 3DMark, thinking I was gonna do some benchmark runs today. Instead, the entire ESXi host rebooted. All of the VMs went offline, and I'm waiting to see if the server comes back from this in one piece. Hoping this also doesn't rule out just gaming in general. If the power draw from the Titan Xp is too much, I may have to consider other options...

 

[TopHatProductions115]

Hmm...

Questions About SanDisk Fusion IoScale 3.2TB PCIe SSD (F11-002-3T20-CS-0001)

As the title suggests, I have a few questions about the Fusion IoScale 3.2TB SSD: Is this device supported in ESXi 6.5u3 and/or 6.7u3 ? Will this device work without installing additional drivers ? If not, where should I go to download the required drivers ? What level of performance should I...

forums.servethehome.com

 

[TopHatProductions115]

The job is never finished:

• https://linustechtips.com/status/314805/

I march onward...

 

[TopHatProductions115]

Imma stop here for now...

• https://linustechtips.com/status/314861/

That's a lot :|

 

[TopHatProductions115]

What I've managed to get done thus far:

• install a 2nd PCIe SSD
• install a USB adapter card
• plug in a 2nd PSU
• buy 128GB of RAM
• decommission Threadripper

Off to a rough week. Still looking for a good PCIe enclosure...

 

[TopHatProductions115]

First benchmarks!

My first successful benchmark run - a…

My first successful benchmark run - and the server didn't reboot during the run!

linustechtips.com

 

[TopHatProductions115]

Just purchased a Magma EB7-X8G2-RAS-F (7-slot PCIe 2.0 expansion enclosure), with what appears to be a two x8 ports on its expansion interface. I will most likely need to acquire the following next:

• x16 interface card
• x16 host adapter
• x16 PCIe cable

This is going to be a long one...

 

[TopHatProductions115]

The PCIe x16 Host adapter and PCIe x16 cable arrived today! Pictures in a few...

EDIT: There's 128GB more RAM on the way as well. And guess what's going in the enclosure?...

 

[TopHatProductions115]

It's finally starting to warm up where I'm at. But that also means I can't run F@H anymore, due to thermal reasonsUntil next Autumn, the folding will be paused.

 

[TopHatProductions115]

Okay, things have changed. From what I've learned recently, the enclosure I have is only officially compatible with an x8 Interface card. The hardware for x16 is way more expensive, and I don't know if I wanna buy it, only to find out the enclosure itself was only wired for x8. So, I've decided to go x8 for the time being. Here's what I have so far:

• Magma EB7-X8G2-RAS-F
• Magma PEHIFX8G2
• Molex iPass 74546-0801
• OSS-PCIe-HIB25-x8

Other parts, that will work with an x16 enclosure:

• Molex iPass 46K3726
• OSS-PCIe-HIB25-x16

Still need to find the P/N's for the PSU cables, since the Titan V uses 8-pin and 6-pin power connectors iirc...

 

[TopHatProductions115]

The spec sheet for the server has changed, in anticipation of the PCIe enclosure that arrived recently. Still waiting for a few more components to arrive in the mail, but this is the way for ward from here. Some parts have been moved from the DL580 G7, to the enclosure, to free up space and reduce power draw. Certain parts that don't receive regular use don't need to be in the DL580 G7 necessarily. Optional parts will be in the enclosure instead. The server has received a RAM upgrade as well, from 128GB to 256GB. The SAS HDD-to-SSD cloning operation will occur after the migration from ESXi 6.5 to 6.7. If you have any questions, feel free to ask!

 

[dogwitch]

The spec sheet for the server has changed, in anticipation of the PCIe enclosure that arrived recently. Still waiting for a few more components to arrive in the mail, but this is the way for ward from here. Some parts have been moved from the DL580 G7, to the enclosure, to free up space and reduce power draw. Certain parts that don't receive regular use don't need to be in the DL580 G7 necessarily. Optional parts will be in the enclosure instead. The server has received a RAM upgrade as well, from 128GB to 256GB. The SAS HDD-to-SSD cloning operation will occur after the migration from ESXi 6.5 to 6.7. If you have any questions, feel free to ask!

what power draw? and what was it before?

 

[TopHatProductions115]

what power draw? and what was it before?

The PCIe SSDs were the primary concern, but I doubt the resulting change will be that big. The server idled anywhere between 500 and 600W without F@H running. While folding, power sat at 650-750W (medium folding power). Will have to measure the metrics again later today.

Also had to make some major changes, due to a Linux update - Folding@Home is off the table for the foreseeable future:

The last pacman -Syu kinda blew out t…

The last pacman -Syu kinda blew out the legacy drivers for the Titan Z, something to do with GCC and plugins. Only issue is, I don't have a backup for before the update, and it's the only thing that stopped working. In general, this VM has been meh handling GPU support. So, I'm tempted to just pu...

linustechtips.com

 

[dogwitch]

The PCIe SSDs were the primary concern, but I doubt the resulting change will be that big. The server idled anywhere between 500 and 600W without F@H running. While folding, power sat at 650-750W (medium folding power). Will have to measure the metrics again later today.

Also had to make some major changes, due to a Linux update - Folding@Home is off the table for the foreseeable future:

The last pacman -Syu kinda blew out t…

The last pacman -Syu kinda blew out the legacy drivers for the Titan Z, something to do with GCC and plugins. Only issue is, I don't have a backup for before the update, and it's the only thing that stopped working. In general, this VM has been meh handling GPU support. So, I'm tempted to just pu...

linustechtips.com

dam my 32 core(in profile spec) idle at 250 to 300. folding its north of 800

 

[TopHatProductions115]

dam my 32 core(in profile spec) idle at 250 to 300. folding its north of 800

I almost had a Threadripper as well, but that dream ended when ESXi didn't play well on it. Ended up cancelling that part and sticking to my current server

 

[dogwitch]

I almost had a Threadripper as well, but that dream ended when ESXi didn't play well on it. Ended up cancelling that part and sticking to my current server

ah. yeah am using more basic vm software. have to re learn it all. due to older hardware i had. i spent way to much and asus screw me over it...

 

[TopHatProductions115]

I've been forced to hold off on the OpenStreetMaps backend (routing) container. This was due to the insane memory usage, which appears to have been what crashed my once-stable Linux VM. I'd need to move beyond 32GB RAM for that one VM, which would be pretty crazy. The ESXi host only has 256GB RAM, with all slots filled (4GB sticks). To move beyond that would cost me a fortune, buying 8GB and 16GB sticks off the used market. The current market does not lend itself to that errand too easily. I'll focus on just YaCy Grid for the time being.

 

[TopHatProductions115]

The PCIe enclosure is being removed from the project. Unable to get it working, and OEM/ODM won't communicate to assist with troubleshooting. No way to justify keeping it in the rack at this point.

 

[TopHatProductions115]

The current ToDo list:

**Current ToDo's:**
- Windows Server 2016:
        - UNIX/POSIX attributes in AD
                - <https://github.com/wruppelx/win2016setuid>
- Artix OpenRC:
        - Docker container: YaCy Grid
                - <https://blog.fossasia.org/creating-a-dockerfile-for-yacy-grid-mcp/>
                - <https://github.com/yacy/yacy_grid_mcp/blob/master/docker/all-in-one/docker-compose.yml>
                - initiate web crawl
- Windows 10 Enterprise:
        - Gaming VM troubleshooting (<https://www.reddit.com/r/VFIO/>)

**Upcoming ToDo's:**
- Server/Networking:
        - migrate from ESXi 6.5 to 6.7 **

**Long-term ToDo's:**
- Server/Networking:
        - clone HDDs to SAS SSDs
                - Acronis True Image
        - VDI host when?
                - pushed to 2023, due to performance requirements
        - DL580 Gen8/9 planning...

 

[TopHatProductions115]

I've finally managed to setup wireless Time Machine backups for the MacBook. Next will be the EliteBook, if I can figure out how to do so. In addition to the other tasks I have in front of me...

• https://512pixels.net/2018/08/how-to-set-up-time-machine-server/

 

[TopHatProductions115]

Current ToDo's:
 - Windows Server 2016:
        - UNIX/POSIX attributes in AD
                - https://github.com/wruppelx/win2016setuid
 - Windows 10 Enterprise:
        - Gaming VM troubleshooting (https://www.reddit.com/r/VFIO/)

Upcoming ToDo's:
 - Server/Networking:
        - purchase/activate EaseUS ToDo Backup Center
        - purchase/activate OnlyOffice server license
        - migrate from ESXi 6.5 to 6.7 **

Long-term ToDo's:
 - Server/Networking:
        - clone HDDs to SAS SSDs
                - Acronis True Image
        - get a GitHub point-of-contact
        - VDI host when?
                - pushed to 2023, due to performance requirements
        - DL580 Gen8/9 planning...
 - Artix OpenRC:
        - Docker container: YaCy Grid
                - https://blog.fossasia.org/creating-a-dockerfile-for-yacy-grid-mcp/
                - https://github.com/yacy/yacy_grid_mcp/blob/master/docker/all-in-one/docker-compose.yml
                - initiate web crawl

 

[Solaris17]

- purchase/activate EaseUS ToDo Backup Center

Love these products in general, have had a lot of success with their recovery soft too.