SOLVED: Files not replicating

Kung
Posts: 4
Joined: Mon Apr 08, 2013 7:14 pm

SOLVED: Files not replicating

Postby Kung » Thu Apr 18, 2013 4:08 pm

It doesn't appear that my files are replicating from drive1 to drive2 on my server. Here's the metric butt-ton of information; my apologies if this isn't the right place.

Version of Samba/Greyhole:
3.5.0-23-generic
package samba is not installed
package hda-greyhole is not installed
pastebinit /etc/samba/smb.conf:
pastebinit /etc/greyhole.conf
mount:
/dev/sdc1 on / type ext4 (rw,errors=remount-ro)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
none on /sys/fs/fuse/connections type fusectl (rw)
none on /sys/kernel/debug type debugfs (rw)
none on /sys/kernel/security type securityfs (rw)
udev on /dev type devtmpfs (rw,mode=0755)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=0620)
tmpfs on /run type tmpfs (rw,noexec,nosuid,size=10%,mode=0755)
none on /run/lock type tmpfs (rw,noexec,nosuid,nodev,size=5242880)
none on /run/shm type tmpfs (rw,nosuid,nodev)
/dev/sda1 on /var/hda/files/drives/drive1 type ext4 (rw)
/dev/sdb1 on /var/hda/files/drives/drive2 type ext4 (rw)
gvfs-fuse-daemon on /var/lib/lightdm/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=lightdm)
gvfs-fuse-daemon on /home/****/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=****)
fdisk -l:
WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk doesn't support GPT. Use GNU Parted.

Disk /dev/sda: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x356f1306

Device Boot Start End Blocks Id System
/dev/sda1 1 3907029167 1953514583+ ee GPT
Partition 1 does not start on physical sector boundary.

WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk doesn't support GPT. Use GNU Parted.

Disk /dev/sdb: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x2ac8b468

Device Boot Start End Blocks Id System
/dev/sdb1 1 3907029167 1953514583+ ee GPT

Disk /dev/sdc: 100.0 GB, 100030242816 bytes
255 heads, 63 sectors/track, 12161 cylinders, total 195371568 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x0006db5e

Device Boot Start End Blocks Id System
/dev/sdc1 * 2048 179204095 89601024 83 Linux
/dev/sdc2 179206142 195371007 8082433 5 Extended
/dev/sdc5 179206144 195371007 8082432 82 Linux swap / Solaris
df -h:
Filesystem Size Used Avail Use% Mounted on
/dev/sdc1 85G 11G 70G 13% /
udev 3.8G 12K 3.8G 1% /dev
tmpfs 1.6G 7.7M 1.5G 1% /run
none 5.0M 0 5.0M 0% /run/lock
none 3.8G 220K 3.8G 1% /run/shm
/dev/sda1 1.8T 110G 1.6T 7% /var/hda/files/drives/drive1
/dev/sdb1 1.8T 196M 1.7T 1% /var/hda/files/drives/drive2
Greyhole Statistics
Total - Used = Free + Trash = Possible
/var/hda/files/drives/drive1/gh: 1834G - 110G = 1631G + 0G = 1631G
/var/hda/files/drives/drive2/gh: 1834G - 0G = 1740G + 0G = 1740G
==========================================
Total: 3668G - 110G = 3372G + 0G = 3372G

List of drives in storage pool:
+----+------------------------------+--------------+---------------------+---------------------+
| id | path | minimum_free | created_at | updated_at |
+----+------------------------------+--------------+---------------------+---------------------+
| 1 | /var/hda/files/drives/drive1 | 10 | 2013-04-06 20:42:21 | 2013-04-06 20:42:21 |
| 2 | /var/hda/files/drives/drive2 | 10 | 2013-04-06 20:42:23 | 2013-04-06 20:42:23 |
+----+------------------------------+--------------+---------------------+---------------------+
"​mysql -u root -phda -e "select concat(path, '/gh') from disk_pool_partitions" hda_production | grep -v 'concat(' | xargs ls -la | fpaste​" keeps returning the following error:
No command 'fpaste' found, did you mean:
Command 'paste' from package 'coreutils' (main)
fpaste: command not found
greyhole --view-queue:
Variables (--variable-name=value)
and boolean options {FALSE|TRUE} Value (after reading options)
--------------------------------- ----------------------------------------
auto-rehash TRUE
auto-vertical-output FALSE
character-sets-dir (No default value)
column-type-info FALSE
comments FALSE
compress FALSE
debug-check FALSE
debug-info FALSE
database (No default value)
default-character-set auto
delimiter ;
enable-cleartext-plugin FALSE
vertical FALSE
force FALSE
named-commands FALSE
ignore-spaces FALSE
init-command (No default value)
local-infile FALSE
no-beep FALSE
host (No default value)
html FALSE
xml FALSE
line-numbers TRUE
unbuffered FALSE
column-names TRUE
sigint-ignore FALSE
port 3306
prompt mysql>
quick FALSE
raw FALSE
reconnect FALSE
socket /var/run/mysqld/mysqld.sock
ssl FALSE
ssl-ca (No default value)
ssl-capath (No default value)
ssl-cert (No default value)
ssl-cipher (No default value)
ssl-key (No default value)
ssl-verify-server-cert FALSE
table FALSE
user root
safe-updates FALSE
i-am-a-dummy FALSE
connect-timeout 0
max-allowed-packet 16777216
net-buffer-length 16384
select-limit 1000
max-join-size 1000000
secure-auth FALSE
show-warnings FALSE
plugin-dir (No default value)
default-auth (No default value)

Write Delete Rename Check
CBU 0 0 0 0
Docs 0 0 0 0
KBU 38,336 0 1 0
===========================================
Total 38,336 0 1 0
Write Delete Rename Check

The following is the number of pending operations that the Greyhole daemon still needs to parse.
Until it does, the nature of those operations is unknown.
Spooled operations that have been parsed will be listed above and disappear from the count below.

Spooled 0
tail /var/log/greyhole.log:

It returns a bunch of errors that /var/files/hda/KBU no longer exists. I had changed the location of my KBU share to /var/hda/files/drives/drive1/KBU; it was writing most everything to the first drive (the root drive), which is only 100Gb. I want it to write to drive1 (sda1) and drive2 (sda2).

User avatar
bigfoot65
Project Manager
Posts: 11924
Joined: Mon May 25, 2009 4:31 pm

Re: Files not replicating

Postby bigfoot65 » Sat Apr 20, 2013 7:35 am

Have you tried doing as root user:

Code: Select all

greyhole -f
Also looking at the info, I see where you have 3 shares configured to do 1 copy. If there are more shares or more copies of files you want kept, each share has to be configured individually via the dashboard shares tab to do so.

Unfortunately it looks like a lot of the data you provided was using Fedora commands, so that is why many of them did not yield the correct results. The Greyhole version installed in Ubuntu is greyhole and not hda-greyhole.

I am sure we can sort this out, just need to check those few things I mentioned to start. Also look at the /var/logs/greyhole.log file after you have done these things and post a link to some of it where errors are reflected.
ßîgƒσστ65
Applications Manager

My HDA: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz on MSI board, 16GB RAM, 1TBx1+2TBx2+4TBx2

Kung
Posts: 4
Joined: Mon Apr 08, 2013 7:14 pm

Re: Files not replicating

Postby Kung » Tue Apr 23, 2013 3:03 pm

Actually....it seems to have sorted itself out. *confused*

All of a sudden it's replicating to both drives. *shrug* Hey, so long as it's working. :)

User avatar
bigfoot65
Project Manager
Posts: 11924
Joined: Mon May 25, 2009 4:31 pm

Re: SOLVED: Files not replicating

Postby bigfoot65 » Tue Apr 23, 2013 5:40 pm

Good to hear, guess it just needed time.
ßîgƒσστ65
Applications Manager

My HDA: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz on MSI board, 16GB RAM, 1TBx1+2TBx2+4TBx2

Who is online

Users browsing this forum: No registered users and 19 guests