Quantcast
Channel: StableBit DrivePool
Viewing all 864 articles
Browse latest View live
↧

Ideal Specs for Offloading Pool to Dedicated System

July 15, 2017, 12:17 pm
$
0
0

Hey Guys - 

 

Over the past few years, the size of my pool has grown dramatically in size where I'm getting to the point where upgrading requires going from 4tb disks to 8tb ones instead of adding a new disk.  The pool is in my primary PC (specs below) which I use for everything you can imagine including work, gaming, VMs, personal web hosting, scripting, and more.  

 

I'd really like to have the pool offloaded from this PC to another device.  Unfortunately, I'd probably have to sell my truck to afford an 11 disk NAS or similar enterprise-level device. As I still have another case, I'm instead considering purchasing an inexpensive motherboard, CPU, etc then migrating the pool (disks + RocketRAID card) over to it to build my own dedicated pool device.  Given that, I have 2 questions, please:

 

1. If you had to build a dedicated system like this, what hardware / OS would you use that you would consider the most stable yet still offer same features?

 

2. Given my pool, what are the minimum specs I would need to do this?  I'm not trying to be cheap, but have some slightly older workstations around here and would be great if I could use their guts and possibly do this all for free!

 

Thanks!!!

 

Disk Pool PC Stats

- Windows 10 x64 Creator's Update

- Intel 3770k CPU OC'd to 4.0Ghz

- 32 GB RAM

- 44tb Drive Pool

- Samsung 850 Pro SSD for OS & primary apps (not in pool)

- 1tb Hybrid drive for App Caches & VMs (not in pool)

- 256gb SSD for VR Gaming Installations (not in pool)

- RocketRAID 2720 SAS Controller

- Nvidia GeForce 970 GTX

- Oculus Rift (3 sensors + 2 touch controllers)

- x3 monitors

- Huge tower with much cooling

- Many other devices & accessories

 

Disk Pool Stats

- StableBit DrivePool 2.2.0.651 Beta + SSD Optimizer Plugin

- 43.9TB Total / 42.9 unduplicated / 69kb duplicated / 50.7gb other

- RocketRAID 2720 SAS Controller connects 7 of the disks with remaining connected to motherboard / 6Gbps used where possible but 1-2 have 3Gbps

- 11 disks (10 Standard / 1 SSD)

- Balances immediately every 2 hours unless 25gb+ needs moving

- All 4 options for performance enabled (Lots of network I/O)

↧
Search

REFS causes memleak?

July 16, 2017, 7:39 am
$
0
0

Drashna, as you know I've been struggling with the memleak issue so much that I considered switching to Storage Spaces.  

 

However, that product is quite confusing so I asked on the datahoarder subreddit and a user (that sounds knowledgeable) suggested that REFS might be the leak.

 

And...this did start happening on/about the same time I converted to REFS.

 

I'm going to remove each REFS drive individually and then readd as NTFS drives and report back to see if that's the issue.

 

Here's the link.

 

https://www.reddit.com/r/DataHoarder/comments/6nlzwr/how_to_setup_up_windows_10_storage_spaces_118tb/

 

 

↧
↧

SSD Optimizer Plug-in not working with latest Beta builds

July 16, 2017, 12:24 pm
$
0
0

Cannot install SSD Optimizer plug-in on build v2.2.0.773, says DrivePool 2.x needs to be installed.  Trying to install v1.0.4.11 of the plug-in.

↧

REFS format question

July 16, 2017, 1:44 pm
$
0
0

I have two pools set up on my Win Server 2016 using REFS formatted drives. I wanted to add the NFS server feature so I have more stable connections to my MAC. So I do some testing and I'm happy. When I go to set up my real NFS share I get an error. I find out that NFS and REFS don't work together. So I look at my storage pools. One is marked as a REFS drive and the other as NTFS. I don't remember doing anything to make one REFS and the other NTFS. Any idea what I did and can the REFS pool be non-destructively changed to NTFS? If so, is there a reason I shouldn't?

↧

Windows Insider Build 16232 - can not format ReFS

July 16, 2017, 3:26 pm
$
0
0

Just a heads up - My PC upgraded to Windows Insider Build 16232 and I can no longer format HDD as ReFS (both in the GUI and in PowerShell - comes back as unsupported).  I've seen some posts saying there are issues with ReFS / Storage Spaces with 16232.  I'm trying to get 16241 to see if that works.

↧
↧

DP-Event log errors

July 18, 2017, 8:37 am
$
0
0

Was just checking my event log - as you do :)

 

and spotted that on server reboot i get two errors from DP and two from scanner see below

Error report file saved to:

C:\ProgramData\StableBit DrivePool\Service\ErrorReports\ErrorReport_2017_07_18-03_50_46.8.saencryptedreport

Exception:

System.Net.Sockets.SocketException (0x80004005): Only one usage of each socket address (protocol/network address/port) is normally permitted
   at System.Net.Sockets.Socket.DoBind(EndPoint endPointSnapshot, SocketAddress socketAddress)
   at System.Net.Sockets.Socket.Bind(EndPoint localEP)
   at #lwd.#nwd..ctor()
   at #lwd.#owd.#v9e()
   at CoveUtil.ReportingAction.Run(Action TheDangerousAction, Func`2 ErrorReportExceptionFilter)

and

Exception:

CoveTroubleshooting.Reporter+ReporterLogException: {reporter_exception}
   at CoveTroubleshooting.Reporter.ThrowLogReportN(Exception TheException, Object[] TheParams)
   at CoveUtil.ErrorReporting..(Exception )

for scanner

Error report file saved to:

C:\ProgramData\StableBit Scanner\Service\ErrorReports\ErrorReport_2017_07_18-03_51_32.1.saencryptedreport

Exception:

CoveTroubleshooting.Reporter+ReporterLogException: {reporter_exception}
   at CoveTroubleshooting.Reporter.ThrowLogReportN(Exception TheException, Object[] TheParams)
   at CoveUtil.ErrorReporting..(Exception )

and

Error report file saved to:

C:\ProgramData\StableBit Scanner\Service\ErrorReports\ErrorReport_2017_07_18-03_51_31.9.saencryptedreport

Exception:

System.Net.Sockets.SocketException (0x80004005): Only one usage of each socket address (protocol/network address/port) is normally permitted
   at System.Net.Sockets.Socket.DoBind(EndPoint endPointSnapshot, SocketAddress socketAddress)
   at System.Net.Sockets.Socket.Bind(EndPoint localEP)
   at #J5d.#nwd..ctor()
   at #J5d.#owd.#Bpf()
   at CoveUtil.ReportingAction.Run(Action TheDangerousAction, Func`2 ErrorReportExceptionFilter)

anything to worry about? would this stop any error reporting?

 

win 2012r2E and as of today DP 773 beta

↧

Issues migration to ESXI

July 18, 2017, 1:08 pm
$
0
0

Hello,

 

Today I migrated my Drive Pool from Windows Server 2012 to Windows Server 2016 (ESXI).

 

I have some problems with re-adding my disks. I have linked all my hard drives to a .vmdk file using this article from VMware: https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1017530.

On my Server 2012 configration I had 5 drives (8TB) added to the drive pool. When I add those drives as a SCSI drive (Virtual Device Node) the drives will show up as RAW and I cannot open them.

 

I tried to change the Virtual Device Node to IDE controller, they will show up normally and are automtically added to the pool. I can only setup 2 drives with an IDE controller (master and slave).

Does anyone have experience with this? I'm afraid of losing the data stored on the disks.

 

Disks that where not part of the drive pool before can all be added on de SCSI controller.

 

Thanks!

↧

Whats the procedure to migrate DrivePool from one machine to another?

July 18, 2017, 7:28 pm
$
0
0

I need to move my server to the another. Current one is running windows 8.1, the new one is windows 10.

 

What is the best way to move drive pool and all the settings (if possible) to the new machine?

 

The ideal situation would be to have exact same DrivePool setup on the new machine as the old one, so all the programs, that use the pool could be easily transferred by simply exporting settings, reinstalling on the new machine and importing settings...

 

How do I transfer the license?

 

The same situation for Scanner. Whats the best way to migrate to the new machine?

↧
Search

10 BSODs with Beta v763

July 19, 2017, 9:15 am
$
0
0

Hi,

 

it seems since updating to 763 I got 10 of BSODs in the last 20 Days.

 

All are IRQL_NOT_LESS_OR_EQUAL and with ntoskrnl.exe as the Adress in Stack.

 

I also just opened a minidump file with WinDBG and used !thread, here covefs is mentioned a few time (with not much else). I recently transfered some data (1-2TB) from another drivepool to a an older one.

 

I just updated my drivepool to 773, but I figured you guys maybe want to to look into it? Should I upload my .DMP files? If yes, where to (it's 741KB big)?

 

 

↧
↧

HP P212 Raid card and Drivepool

July 21, 2017, 8:06 pm
$
0
0

Hi all,

 

I am considering using a HP server which I have had laying around! It has a raid card in it, is it ok to create a raid drive (Raid 0 or 1) and then use drivepool over the top?

 

Does drivepool/scanner just see it as a normal hard drive? It shows up as 'HP Logical Volume SCSI Device'

Or could it screw up?

 

cheers

↧

Write Performance Question (multi pool vs. file placement)

July 23, 2017, 1:40 pm
$
0
0

Happy Drivepool user here.  Have 40TB raw.  Currently Drivepool is my home "production".

 

Drivepool is about to become backup for Freenas.  I"m looking for ways to increase the throughput moving data from Freenas to Drivepool across 10GbE.

 

Consider these two hypothetical scenarios. Will either of these allow two copy jobs in parallel to write at the speed of two disks?  Assuming a single disk will sequential write at 150MB, I'm looking to write at 300MB.

 

SCENARIO 1 - single pool with two folders

------------------------------------------------------------------------------

Pool Z with 4 disks

File placement options set for /ISO folder to use disk 1,2

File placement options set for /MKV folder to use disk 3,4.

 

 

SCENARIO 2 - two pools each having 1 folder

------------------------------------------------------------------------------

Pool Y with 2 disks storing /ISO

Pool Z with 2 disks storing /MKV

↧

Ordered File Placement - Not enough room to copy issue (but Pool has heaps)

July 23, 2017, 2:56 pm
$
0
0

With the 8TB Archive Drives, I like the Ordered File Placement balancer, fill them up and move to the next.  One issue is that when copying to the pool you get a Not Enough Room to copy a file where:

- The file to copy is larger than the space on the drive being filled even;

- When there is a second empty drive

 

Eg, I have 7GB free on one drive and 8TB free on another.  When I try to copy a 15GB file to the pool windows fails reporting not enough disk space.  The Ordered File Placement balancer does not seem "smart" enough to move onto the next drive.  This happens both when just trying to copy files to the pool or remove a HDD from the pool.  

 

Thanks

Nathan

↧

getting rid of duplication

July 23, 2017, 3:55 pm
$
0
0

I currently have a pool with duplication in light of the fact i now have a local backup and a remote backup i'd like to get rid of duplication and clear up some space.  how do i do this without messing up do i just undo the duplication in settings and run balancing or what?  remeasuring the pool doesn't seem to do it

↧
↧

Thoughts on backup of drives?

July 29, 2017, 9:39 am
$
0
0

Hi,

 

I'm setting up a new home server and I just downloaded the DrivePool and Scanner apps to test out.  I am trying to figure out the best setup to maximize my storage space but also have solid "real" backups and not just duplicated files.  Duplication of files is great but isn't a real backup, since if I accidentally delete a file the duplicate is also automatically deleted.  Duplication also doesn't allow for file versioning.

 

I have six 8TB drives and I was thinking of creating two 24TB drive pools: a "Data" pool for live storage and a "Backup" pool to store backups of everything on the Data pool.  I was also thinking of using the free version of CrashPlan to handle the backups.

 

My question is this, would it be better to have CrashPlan back up the individual drives in the Data pool, or just have it back up the the entire shared Data pool as a whole?

 

My thinking was that if I backed up the individual drives separately, if one of the drives in the Data pool failed, I could just replace it with a new drive and restore the backup of the old drive onto it to reconstitute the Data pool.  However, not knowing all the technical details on how DrivePool works, I wasn't sure if that would actually work?

 

Any thoughts or comments on this?

↧

SSD Optimizer and first time questions

July 29, 2017, 11:51 pm
$
0
0
Hi
 
1. I'm running Beta 754. Is this the most stable version to use?
 
Have just signed up and replaced by WHS v1 with an old PC with six connected USB drives. The PC only supports USB 2, so I installed an SSD into the PC to take advantage of the SSD Optimizer.
 
I see now from my reading, that I should actually have two SSDs, but that is not possible because this (Slimline HP) only has a single SATA connector. But the second SSD drive is only needed for real time duplication. This is not something I need (delayed duplication is fine for me, after all the drivepool is for backup files, so the duplicate is actually the third copy).
 
2. So is the method to disable realtime duplication, still to set FileDuplication_AlwaysRunImmediate to False? (and then restart)?  Because the entry FileDuplication_AlwaysRunImmediate does not exist in DrivePool.Service.exe.default.config.
 
 
3. It would be cool if I could make DrivePool Balance and Duplicate as the end of the day, and then automatically put the PC to sleep. I assume that is not possible?
↧
Search

Copy (replace) over old files

July 31, 2017, 5:14 am
$
0
0

Using .773 beta

 

I am seeing a "Ensure file duplication consistency on Pool X" when i copy some updated files to the pool - i.e. over write - its not every time but this task has run 5 times in the last 24hrs????

 

e.g. video file (old) replaced with a new file (by name) - but it will be much smaller file

 

So it might go from 15GB down to 5GB

 

Also it appears that the new file is copied to the pool directly rather than via the ssd cache - is that expected behaviour?

 

Just copied a 5GB file to the pool and watched the performance info and you can see it being copied to the HDD rather than the SSD's

 

I have no file placement rules set

↧

Optimal settings for dedicated file server

August 1, 2017, 9:22 pm
$
0
0

So I have created a dedicated file server out of an old HP computer, and added DrivePool, DriveScanner and CloudPool. It is going well :-)

Because it's an older PC, I'd like to optimize the performance of DrivePool.

(As I have an SSD, I have already installed SSD Optimizer, disabled real time-duplication, and confirmed that it is working correctly).


What do you think of these settings:

FileBalance_BackgroundIO: FALSE
FileDuplication_BackgroundIO: FALSE
DrivePool_BackgroundTasksPriority: 10

Network I/O Boost: Enabled
Balance immediately, but not more than every 2 hours

 

Any other performance tweaks?


Thanks

↧
↧

Disk space equalizer not working?

August 2, 2017, 12:16 am
$
0
0

Hi,

I'm trying to get all of my drives spinning while I restore 18tb of data to my pool, however I can't seem to get it to use all drives for writing. I am using rclone to do the transfer.

I've got rclone set to do 10 concurrent transfers and even stopping and restarting rclone doesn't change the file placement.
I'm using only the drive space equalizer plugin and equalizing by percentage. All others are disabled.
There are 4 6tb drives and 1 8tb drive. So far it has written ~300gb to the 8tb drive only. 

Are there other settings required for this plugin to work?


My goal is to simply have it round-robin write files to all disks without regard to free space remaining. 

DrivePool: 2.2.0.651 and 

diskspace Equalizer Plugin 1.0.2.4

↧

Files not distributing to new drive

August 2, 2017, 10:24 pm
$
0
0
I've added a new drive to my pool and I'd like to spread the files in the pool over to the new drive. I realize this isn't the default behaviour so I've added the "Disk Space Equilizer" balancer into my system. At the moment it's the only balancer I have enabled and the system STILL isn't moving the files (and therefore balancing the space).

Any idea what I'm doing wrong? Is there a log or something that I can check to see why it's ignoring the only balancer present?
↧

Help! - Deleted all .mkvs (must recover)

August 3, 2017, 9:27 am
$
0
0

I fat fingered something and the directory deleted.

 

I have lost 1000 25gb+ .mkvs on a duplicated pool. 

 

I've stopped teh balancing but I need to recover these files.  Any help please!

 

I've looked at EASUS recover and piroforum's Recuvva but there not picking up anything bigger than 4gb.

↧
Viewing all 864 articles
Browse latest View live
Search