Well I decided it was time to replace my ageing second hand server machine I purchased for £45.00 over 2 years ago and has served me well running ESXi 3.5 allowing me to learn a little about Vmware.
My current setup :-
- Power Hungry
- HP Proliant ML530 G2
- 12 Gb Ram
- ESXI 3.5
- 7 Vms
- 12 * 72.9Gb Drives (Raid 5)
- hilo
My target machine in order of priority:-
- Substantially lower power consumption
- Budget
- Data security
- Storage expandability
- Hardware raid
- NAS in same box
- System perfomance upgrade
- Quieter operation
- Reasonable spec machine
- Hilo or similiar
Well my first thought was to buy a second hand HP Proliant DL380 G5/G6, reason being that when I put ESXi 3.5 on my old server it just worked out of the box, so I reasoned that ESXi 5 might do the same and it would give me most of my target list , but when started looking around at what I could get for my money it did not get me 4,8 and 9 of my target list so I ruled out this option.
I then started looking and new HP servers, ML110,330 range and the NL36/40 micro server range of machines, but buying one of these machines either blew my budget or in the case of the micro server I did not give me item 4 on my target list.
So I decided to have a look at putting together a white box and started Googling, what I found was there is loads of information around but not so much regarding white boxes and ESXi5 anyway after many hours I finally decided that hardware raid would have to go as each time I looked at adding hardware raid it blew my budget, sure there are second hand raid cards out there but only being a budding computer geek I was not confident I could make it all work. So after many hours more I finally decided hardware raid would have to go and I decided on ZFS instead.
My hardware list is as follows: -
- Supermicro X9SCM-F-0 Motherboard
- 16Gb Ram Kingston KVR1333D3E9S/4GEC-4GB DDR3-1333
- Intel BX80623E31230 XEON E3-1230 3.2Ghz Processor
- Antec VSK200 Mid Tower Case
- Power Supply TR-450PCUK 450 watts
- 2 1TB Segate ST1000DM003 Sata3 Hard Drives
- 1 Western Digital 500gb Sata 3 Hard Drive + (1 as Upgrade)
- 2 Akasa AF-FN057 120mm Case Fans
- 4gb Usb Memory sticks.
- Intel 8 Port SAS Controller SASUC8I
First thing I did was set up ESXi on the USB stick using another PC by using workstation, create a new vm, then assign the usb stick to your new vm, then in the vm cd/dvd map it to the ESXi 5 iso image, and install ESXi5 to the USB stick.
All the parts arrived and after building up the machine fired it up, with the usb stick plugged into the on board USB port, I entered bios set up, set the USB stick as the boot drive, and setup the other bios settings as this 7.2 Set needed Bios settings left all the other bios settings as default, rebooted machine.
I now have a working ESXi 5 server however one of the 1TB Segate ST1000DM003 hard drives was DOA so that had to go back, other issue is that the Intel 82579LM Nic is not recognized by ESXi 5
but apart from that all seems good to go.
Configuration
I planned to use the 500gb drive running on one of the Sata III headers on the MB for all for the VM's and the 1TB Segate ST1000DM003 hard drives will supply data storage for all the VM's using a freenas 8 (ZFS) VM to present ISCSI to the all the other Vm's for data storage.
I thought before I put this together that I might be able to install ESXI5 on a USB Stick and Freenas 8 on second USB stick, and then pass through the MB Sata Drive controller to Freenas which would allow me to run a couple of 500gb HD in ZFS mirrored configuration for the VM's to give me some redundancy, but so far I have not be able to figure out how to install ESXI and Freenas as VM on a USB stick as ESXI does not appear to see USB sticks as storage devices.
Well as things turned out I have been forced to put my new server in to operation earlier than planned as just as I had got it built and running even before I got the DOA hard drive replaced, my old server started giving me paritiy errors.
As I don't need high availability I am happy to back up my VM's and re install them in the event the 500Gb hard drive fails, In addition I run a nightly back up routine to an external NAS of all the data, and my important data is backed up when it changes within 10 mins of a change.
Conclusion
Well how did I get on with my targets ?
- Power consumption:- OLD: 425 watts - NEW: 55 watts

- Budget:- Slightly under budget

- Data Security:- when ZFS is running should be okay jury is out at the moment

- Storage Expansion:- 4 additional drives possible and ZFS should allow easy expansion

- Hardware Raid:- Not achieved due to budget constraint

- Nas in same box:- Yes

- System Perfomance:- Yes much better very noticeable
- Quieter Operation:- Old: a load roar - New: Yeah ultra quiet

- Reasonable spec machine:- Yes happy with the spec

- Hilo or similiar:- Yes Super Micro IPMI

In conclusion I am very happy at the moment, I have achieved most of what I wanted, when I have my DOA hard drive replaced and then I can fit the Intel 8 Port SAS Controller SASUC8I and set up ZFS for the data drives, I hope that this will then give me the data security I am looking for.
Looking to the near future when I have ZFS set up on the data drives I will look at how I might achieve redundancy on the ESXi install hard drive's.
Upgrades would be a SSD cache drive for ESXI plus 32gb ram instead of the current 16gb, and a hot spare data drive and that should keep me going for a while.
Comments and suggestions welcome