SOLVED: Questions about moving shares and locating files

luco
Posts: 47
Joined: Sat Oct 17, 2015 8:09 am

SOLVED: Questions about moving shares and locating files

Postby luco » Mon Feb 22, 2016 10:36 am

I thought I had this figured out, but I'm stumped...
Here's my system info.

I have recently added two HDDs. I have followed the "Adding a second hard drive..." tutorial. I have successfully partitioned the disks, then I used the Disk Wizard to mount them and verified they are showing properly and that there are proper entries in fstab file.
I then created a new share in the Dashboard and used command line to move that share to one of my new disks. I then updated the path in Dashboard. Thinking that all is well, I moved a few GBs of data to that new share from one of my client PCs.
Then I went to my Dashboard and I was really puzzled when I saw that my OS drive's / partition (/dev/sda3) filled up with data instead of /dev/sdb1 where I expected the new share to be.

When I went to the Location under the new share (/var/hda/files/drives/DATA/newshare) and clicked on 'Get the Size' I got an error that the path is invalid. That was strange because using command line, I could list all my new files under that location. So, I thought perhaps something needs to be updated, so I rebooted.
Now, I'm back and that same share location does not give me an error anymore when I click 'Get the Size', BUT the size is 4KB - i.e. it's empty!

When I go to Disks > Partitions, I can clearly see that there's data in /dev/sda3 based on its size. How do I find that data, so I can move it to the proper share on the new disk?
I have tried the find command from command line to see if I can locate the actual directory where it is and move the whole folder to the share on the new disk, but I cannot find anything. I have tried this as I know I have a few folders with name containing '2012'.

Code: Select all

[root@localhost ~]# find / -type d -iname '*2012*' -ls
But I got nothing. :(

Thanks for any help.

luco
Posts: 47
Joined: Sat Oct 17, 2015 8:09 am

Re: Questions about moving shares and locating files

Postby luco » Mon Feb 22, 2016 12:47 pm

When I go to Disk Wizard, I can see under 'Disks Currently in Use' that there's a 4th "disk" or mounting point: /var/tmp
That is identical in reported size as my root partition. So, it sounds like that's where those files I copied over are hiding.
But when I go check what's in /var/tmp, I only get back two files that show names containing mariadb.service and httpd.service.

Basically, I don't need the files I copied earlier as I have another copy of them, so how do I purge this directory and reclaim the 77GB of space they are taking up?

User avatar
bigfoot65
Project Manager
Posts: 11924
Joined: Mon May 25, 2009 4:31 pm

Re: Questions about moving shares and locating files

Postby bigfoot65 » Mon Feb 22, 2016 2:16 pm

Remove them from the share you copied them to is the best way.

If you copied them somewhere else, then remove them from that location.
ßîgƒσστ65
Applications Manager

My HDA: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz on MSI board, 16GB RAM, 1TBx1+2TBx2+4TBx2

luco
Posts: 47
Joined: Sat Oct 17, 2015 8:09 am

Re: Questions about moving shares and locating files

Postby luco » Mon Feb 22, 2016 4:22 pm

Remove them from the share you copied them to is the best way.

If you copied them somewhere else, then remove them from that location.
That is actually what I'm trying to do, but my problem is that the share I copied them into yesterday is empty. And that share now correctly appears to be located on the second hard drive as I just tested it with a large 4.3GB file and it shows that usage on my /dev/sdb1.

I cannot find the location where those files are right now, but I know they are still on the OS drive since /dev/sda3 partition still shows 77GB used. That was approximately the size of those files. How can I find them? Am I correct to use the find command in the root partition?

Thank you.

User avatar
bigfoot65
Project Manager
Posts: 11924
Joined: Mon May 25, 2009 4:31 pm

Re: Questions about moving shares and locating files

Postby bigfoot65 » Mon Feb 22, 2016 4:45 pm

By default shares are located in /var/hda/files. Did you check there?
ßîgƒσστ65
Applications Manager

My HDA: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz on MSI board, 16GB RAM, 1TBx1+2TBx2+4TBx2

luco
Posts: 47
Joined: Sat Oct 17, 2015 8:09 am

Re: Questions about moving shares and locating files

Postby luco » Tue Feb 23, 2016 5:58 am

By default shares are located in /var/hda/files. Did you check there?
Yep. Here's what I have:

Code: Select all

[root@localhost ~]# df -h Filesystem Size Used Avail Use% Mounted on devtmpfs 2.0G 0 2.0G 0% /dev tmpfs 2.0G 0 2.0G 0% /dev/shm tmpfs 2.0G 380K 2.0G 1% /run tmpfs 2.0G 0 2.0G 0% /sys/fs/cgroup /dev/sda3 913G 77G 790G 9% / tmpfs 2.0G 36K 2.0G 1% /tmp /dev/sdc1 1.8T 4.5G 1.7T 1% /var/hda/files/drives/OTHER /dev/sdb1 1.8T 4.5G 1.7T 1% /var/hda/files/drives/DATA /dev/sda1 477M 71M 377M 16% /boot tmpfs 391M 0 391M 0% /run/user/0 [root@localhost ~]# du -sh /var/hda/files 8.8G /var/hda/files
That 77GB showing in sda3 is not in /var/hda/files. But I did drop those files into /var/hda/files/drives/DATA previously.
Essentially, I was having the exact same situation as this poster here. When I put in the path "/var/hda/files/drives/DATA/newshare" under a newshare I created in Dashboard, it said that the path is invalid. That was after I put 77GB of files into that very share from a Windows client. Then I rebooted, went back to the Dashboard and magically, the path is now working. Except there's nothing in it as you can see from my output above. Yet, my sda3 still shows 77GB.

For example, I know that many of my picture files are DSC...JPG, so I have tried this:

Code: Select all

[root@localhost files]# find -name DSC0 [root@localhost files]# locate DSC [root@localhost /]# find / -iname "*.JPG" /var/hda/web-apps/pydio/html/plugins/editor.codemirror/CodeMirror/css/people.jpg /var/hda/web-apps/pydio/html/plugins/action.share/res/hi-res/02.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/orbit/images/hires-photos/05.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/orbit/images/hires-photos/02.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/orbit/images/hires-photos/03.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/orbit/images/hires-photos/01.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/orbit/images/hires-photos/06.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/orbit/images/hires-photos/04.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/orbit/images/hires-photos/03-mobile.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/orbit/css/modal.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/orbit/css/tabs.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/vision/css/modal.jpg /var/hda/web-apps/pydio/html/plugins/gui.ajax/res/themes/vision/css/tabs.jpg /var/hda/platform/html/app/assets/themes/default/images/nav-sep.jpg /var/hda/platform/html/app/assets/images/body_bg.jpg /usr/share/hda-ctl/web-installer/public/images/body_bg.jpg /usr/share/hda-ctl/web-installer/public/images/box_gradient.jpg /usr/share/hda-ctl/web-installer/public/images/progress-bar.jpg /usr/share/hda-ctl/web-installer/public/images/progress_bar.jpg [root@localhost /]#
As you can see with no results (just the Pydio jpegs). Why?

User avatar
bigfoot65
Project Manager
Posts: 11924
Joined: Mon May 25, 2009 4:31 pm

Re: Questions about moving shares and locating files

Postby bigfoot65 » Tue Feb 23, 2016 2:43 pm

That 77GB showing in sda3 is not in /var/hda/files. But I did drop those files into /var/hda/files/drives/DATA previously.
The locations both are part of the / partition which is sda3.

Did you check permissions?

There is a permissions reset on the Shares Tab for each share. That might help.
As you can see with no results (just the Pydio jpegs). Why?
If you are using pydio App, it appears your files have been put in the app directory vs a share.

When you do a find, try as root user:

Code: Select all

find / -name *.jpg
That should yield different results.
ßîgƒσστ65
Applications Manager

My HDA: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz on MSI board, 16GB RAM, 1TBx1+2TBx2+4TBx2

luco
Posts: 47
Joined: Sat Oct 17, 2015 8:09 am

Re: Questions about moving shares and locating files

Postby luco » Tue Feb 23, 2016 3:09 pm

That 77GB showing in sda3 is not in /var/hda/files. But I did drop those files into /var/hda/files/drives/DATA previously.
The locations both are part of the / partition which is sda3.

Did you check permissions?

There is a permissions reset on the Shares Tab for each share. That might help.
As you can see with no results (just the Pydio jpegs). Why?
If you are using pydio App, it appears your files have been put in the app directory vs a share.

When you do a find, try as root user:

Code: Select all

find / -name *.jpg
That should yield different results.
I ran all of the commands above as root user as shown in my code. I tried yours with the same results: getting only jpegs from Pydio directories.
I have only installed Pydio after running into this problem in the hopes of using it to help me locate the files somewhere.
I have just reset permissions on that share and still cannot find anything besides the test files I just copied there. :(

luco
Posts: 47
Joined: Sat Oct 17, 2015 8:09 am

Re: Questions about moving shares and locating files

Postby luco » Tue Feb 23, 2016 4:12 pm

This is my disks snapshot from the Disk Wizard:
disks.PNG
disks.PNG (44.32 KiB) Viewed 4692 times
When I navigate to /var/tmp and run du command, I get 4 files with 20KB total. I am running this as root, so it shouldn't matter that they may belong to a different user etc., correct?

Now, I'm hesitant moving other files to the server as I need to understand what is going on with this first. I've learned a great deal about linux commands throughout this and tried every imaginable search for large files, directories, etc. and nothing!

See here... root user searching in / directory for the top 10 largest directories and I get this:

Code: Select all

[root@localhost tmp]# cd / [root@localhost /]# du -hsx * | sort -rh | head -10 du: cannot access ‘proc/2211/task/2211/fd/4’: No such file or directory du: cannot access ‘proc/2211/task/2211/fdinfo/4’: No such file or directory du: cannot access ‘proc/2211/fd/4’: No such file or directory du: cannot access ‘proc/2211/fdinfo/4’: No such file or directory 941M usr 625M var 69M boot 22M etc 376K run 100K home 96K root 32K tmp 16K lost+found 4.0K srv [root@localhost /]#
Where are those 77GB hiding?

User avatar
bigfoot65
Project Manager
Posts: 11924
Joined: Mon May 25, 2009 4:31 pm

Re: Questions about moving shares and locating files

Postby bigfoot65 » Tue Feb 23, 2016 4:28 pm

Have you tried changing into the directory where you originally loaded them?

Code: Select all

cd /var/hda/files/drives/DATA
Then check for files.

I am unsure what you have done to get stuck in this mess. I have never heard of anyone having this issue.

Is it worth starting over if you cannot find them?
ßîgƒσστ65
Applications Manager

My HDA: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz on MSI board, 16GB RAM, 1TBx1+2TBx2+4TBx2

Who is online

Users browsing this forum: No registered users and 15 guests