From the to-do list: MPA V1.0: Import/ local / Offline
❏ Sync with local content
(Karim Alabtakh)
Comments
Pierre henri Seylan on July 31, 2019:
It seems that the current method for indexing local files could be problematic for users when they have a lot of files, or when they frequently modify their files structure on the HD.
For example:
Loosing local marks: If a user changes the location or the name of a folder that is tracked by the app, the files are unmarked as local. -> locations should be tracked
Deleting from cloud: If the user cleans up his HD and deletes files which have been stored in the Soundslates cloud, he needs to do the same work in the cloud via the app. -> sync option should be available
1. Tracking locations and names: Similar work has been done for projects folders. The idea is to use the file tracker to keep track of registred folders and files in the MPA.
The wished behavior is that the following actions can be tracked automatically:
a. names changes: If a local file or folder's name is changing on the HD, it is reflected in the MPA sound library.
b. locations/path changes: If a local file or folder's location is changing on the HD, it is reflected in the MPA sound library.
2. Synching:
a. Adding files: If files are added to a tracked folder, then those files should also be added to the app and uploaded to the server.
For now, the uploading occurs only if the option "sound library uploads" is enabled
b. Removing files: When files are removed locally, we should also remove them from the cloud. However, for that case it is necessary to ask the user.
If registred files/folders are beeing deleted from the HD, the app should display an alert window:
XXX files have been deleted from the hard drive, delete from cloud?
Ok / No
For now let's make this modal widnows very simple, we will improve it later on.
Pierre henri Seylan on August 30, 2019:
Feedback:
1. Path tracking for folders: When changing the path of singles files, those seems to be tracked well. However, when doing the same for folders, the folder is no lonnger tracked by the app.
Test case:
Create a folder in the finder
Drag and drop to personal library
change the folder path
it is no longer tracked
2. Path tracking in sub folders: This functionality usually works well, but there is a case where the app labels a file as deleted instead of moved to a new location.
This happens when i move a file to the "screenshot" folder inside the dropbox folder. The app then shows the alert window about deleted files.
When moving the file to another sub folder in dropbox, the issue doesn't occur. The "screenshot" sub folder is auto-generated by dropbox app.
2.b Another similar issue and test case:
i preferences set import option to "always import as plain files"
deactivate sound library uploads
drag a folder containing files to the personal library
in the finder move this folder inside another folder
the files are now untracked (no longer marked as local)
3. Local mark: When the files are moved to a new location, the local marks disapears briefly. It is needed to scroll and reload the view in order for the local mark to re-appear. See if this can be improved
4. Ignore files: When files are deleted locally, the app displays the alert window about deleting from the cloud. The issue is that this window keeps appearing if the user chooses "NO" or "cancel"
Let's Fix the "no" case: If the use selects "no", the window shouldn't re-appear, the file is no indexed locally anymore (because deleted), but is kept in the cloud
Pierre henri Seylan on October 3, 2019:
Feedback:
The cases 1,2 and 3 of the previous feedback seem not fixed. please check again
Pierre henri Seylan on October 11, 2019:
Feedback:
1. Path tracking for folders: For this issue there is still a case where it doesn't seem to work correctly. Try the following:
Place a folder on your destkop
Drag and drop this folder the personal library (tracked)
In the finder create a new folder and move the tracked folder inside
the tracked folder is now no longer tracked
Karim Alabtakh on October 11, 2019:
I've tested this case, and it works well on my side. Please give me more details, or maybe screen record.
Pierre henri Seylan on October 23, 2019:
Feedback:
1. Path tracking for folders: (Fixed) I have made a video showing this issue: The "testfolder" is moved to several folders inside the directory. Everytime the folder is moved, both the files and the folder are then marked as not local.
The root folder is also included below if you want to test with the same structure
2. Folder update: (Fixed) When i create a new folder or add new files via the finder, the folder is not updated in the app. This is visible in the second part of the video attached above
3. Update local mark: (Fixed) In the video above, the local mark is updated only when reloading the view
4. Deleting local file in app: When deleting local content via the app, the bbehavior seems to be buggy. The files always reappear after a while.
Test:
Import a folder with files (drag and drop to the app)
remove the files via "delete" in the app
re-open the folder page, or restart the app
-> the files will be displayed again, although they should be untracked now.
5. Import duplicates: If you re-import files which are already tracked in the library, they are displayed twice.
After hashing the file, the file should not be displayed again if they are already present in the library.
test:
Import a folder with files (drag and drop to the app)
drag and drop the files again on the folders details page
-> the files will be displayed twice
Karim Alabtakh on October 25, 2019:
about this point "4. Deleting local file in app" we have logic issue in this case because in point 2 "2. Folder update:" the folder should sync the local content by checking for new files. So as I see, you want to implement an untracked files list to support this functionality, right?
about "5. Import duplicates:" you want to check existing files only for concrete folder or to check whole local files which indexed by client?
Pierre henri Seylan on October 25, 2019:
About point 4: Yes, we should have a list of flagged / untracked files, which can be ignored.
About 5: Check the entire file system might take too much time, especially if it's done at evry file import. So let's check only the given folder /collection for now
Pierre henri Seylan on October 25, 2019:
4. Deleting local file in app: Here the files still reapear when the app is closed and restarted.
Comments
Pierre henri Seylan on July 31, 2019:
For example:
Loosing local marks:
If a user changes the location or the name of a folder that is tracked by the app, the files are unmarked as local.
-> locations should be tracked
Deleting from cloud:
If the user cleans up his HD and deletes files which have been stored in the Soundslates cloud, he needs to do the same work in the cloud via the app.
-> sync option should be available
1. Tracking locations and names:
Similar work has been done for projects folders.
The idea is to use the file tracker to keep track of registred folders and files in the MPA.
The wished behavior is that the following actions can be tracked automatically:
a. names changes:
If a local file or folder's name is changing on the HD, it is reflected in the MPA sound library.
b. locations/path changes:
If a local file or folder's location is changing on the HD, it is reflected in the MPA sound library.
2. Synching:
a. Adding files:
If files are added to a tracked folder, then those files should also be added to the app and uploaded to the server.
b. Removing files:
When files are removed locally, we should also remove them from the cloud.
However, for that case it is necessary to ask the user.
If registred files/folders are beeing deleted from the HD, the app should display an alert window:
- XXX files have been deleted from the hard drive, delete from cloud?
- Ok / No
For now let's make this modal widnows very simple, we will improve it later on.Pierre henri Seylan on August 30, 2019:
1. Path tracking for folders:
When changing the path of singles files, those seems to be tracked well.
However, when doing the same for folders, the folder is no lonnger tracked by the app.
Test case:
2. Path tracking in sub folders:
This functionality usually works well, but there is a case where the app labels a file as deleted instead of moved to a new location.
This happens when i move a file to the "screenshot" folder inside the dropbox folder.
The app then shows the alert window about deleted files.
When moving the file to another sub folder in dropbox, the issue doesn't occur.
The "screenshot" sub folder is auto-generated by dropbox app.
2.b
Another similar issue and test case:
3. Local mark:
When the files are moved to a new location, the local marks disapears briefly.
It is needed to scroll and reload the view in order for the local mark to re-appear.
See if this can be improved
4. Ignore files:
When files are deleted locally, the app displays the alert window about deleting from the cloud.
The issue is that this window keeps appearing if the user chooses "NO" or "cancel"
Let's Fix the "no" case:
If the use selects "no", the window shouldn't re-appear, the file is no indexed locally anymore (because deleted), but is kept in the cloud
Pierre henri Seylan on October 3, 2019:
The cases 1,2 and 3 of the previous feedback seem not fixed.
please check again
Pierre henri Seylan on October 11, 2019:
1. Path tracking for folders:
For this issue there is still a case where it doesn't seem to work correctly.
Try the following:
Karim Alabtakh on October 11, 2019:
Please give me more details, or maybe screen record.
Pierre henri Seylan on October 23, 2019:
1. Path tracking for folders: (Fixed)
I have made a video showing this issue:
The "testfolder" is moved to several folders inside the directory.
Everytime the folder is moved, both the files and the folder are then marked as not local.
The root folder is also included below if you want to test with the same structure
Video:
https://www.dropbox.com/s/04fc1gci2bi1lzk/path%20tracking%20issues.mov?dl=0
Root Folder:
https://www.dropbox.com/s/vgv7jtp74tx4vuk/path%20test.zip?dl=0
2. Folder update: (Fixed)
When i create a new folder or add new files via the finder, the folder is not updated in the app.
This is visible in the second part of the video attached above
3. Update local mark: (Fixed)
In the video above, the local mark is updated only when reloading the view
4. Deleting local file in app:
When deleting local content via the app, the bbehavior seems to be buggy.
The files always reappear after a while.
Test:
- Import a folder with files (drag and drop to the app)
- remove the files via "delete" in the app
- re-open the folder page, or restart the app
-> the files will be displayed again, although they should be untracked now.5. Import duplicates:
If you re-import files which are already tracked in the library, they are displayed twice.
After hashing the file, the file should not be displayed again if they are already present in the library.
test:
- Import a folder with files (drag and drop to the app)
- drag and drop the files again on the folders details page
-> the files will be displayed twiceKarim Alabtakh on October 25, 2019:
we have logic issue in this case because in point 2 "2. Folder update:" the folder should sync the local content by checking for new files.
So as I see, you want to implement an untracked files list to support this functionality, right?
about "5. Import duplicates:"
you want to check existing files only for concrete folder or to check whole local files which indexed by client?
Pierre henri Seylan on October 25, 2019:
Yes, we should have a list of flagged / untracked files, which can be ignored.
About 5:
Check the entire file system might take too much time, especially if it's done at evry file import.
So let's check only the given folder /collection for now
Pierre henri Seylan on October 25, 2019:
Here the files still reapear when the app is closed and restarted.
Karim Alabtakh on October 25, 2019: