I've been testing the Onedrive on alteryx for a week and I am new to this. I was able to sync my onedrive folder into the d drive and select 'always keep on this device' option so that the folder always stays there.
Onedrive input and output tools need to be authenticated the moment you open a scripts containing those said tools so I couldn't use them in scheduling. As for Client/Secret/Tenant authentication, my request is still pending approval (it's been almost 1 month) and according to the it team, they have no idea who approves it. so I utilized the ayx output data tool and entered the onedrive folder directory into the blank space.
I've also read articles regarding the structure of the folder which are related mostly to workflow dependencies and applied them but everytime I save the script through gallery, the directory will change to externals folder. I figured this is because ayx server assumes the d drive is personal although im not sure.
Because of this, I edited the security of the synced onedrive folder and added everyone as username.I made sure that all of the permissions are enable so that they can fully access the folder.
A couple things here and I think it will work. First, while your local machine knows what the D drive is, the server will not (D is a mapped drive). So you need to update your connection string in your output tool to be "full UNC". You can either go in and type it yourself (on all inputs/outputs that read/write to/from a non C-drive location), or you can do it in one fell swoop by going to Options, Advanced, Workflow Dependencies. And click "All UNC". That will change your D-drive to wherever it is on the servers (for example from D:\MyOneDriveFolder to \\servername\dept_sh\MyOneDriveFolder).
Once that's done, and you verify that your server the Gallery is on also has access to that location, then you can push it to the Gallery. When you do that, in the pop up window, look for "manage assets". Make sure you UNCHECK the one drive input/output tools. That will tell Alteryx to reach out to the source. If it's checked instead, what it does is package up a copy at the time and use that (hence it changes the name to 'externals').
Here's a couple screenshots of how to uncheck it as an asset:
I had recently purchased the 1TB storage plan but onedrive.live.com was still showing me as limited to the 5GB free plan. It appears to take 10s of minutes until your purchased storage shows up. I confirmed this with a Microsoft chat agent.
It should work that way, because Duplicati runs in an non-browser process, meaning that it does not have access to any of the browser tokens. If they would end up crossing, it would be a problem with Microsoft.
Note that rclone runs a webserver on your local machine to collect thetoken as returned from Microsoft. This only runs from the moment itopens your browser to the moment you get back the verificationcode. This is on :53682/ and this it may requireyou to unblock it temporarily if you are running a host firewall.
Now the application is complete. Run rclone config to create or edit a OneDrive remote.Supply the app ID and password as Client ID and Secret, respectively. rclone will walk you through the remaining steps.
The Sites.Read.All permission is required if you need to search SharePoint sites when configuring the remote. However, if that permission is not assigned, you need to exclude Sites.Read.All from your access scopes or set disable_site_permission option to true in the advanced options.
Starting from July 2023 SHA1 support is being phased out in OnedrivePersonal in favour of QuickXorHash. If necessary the--onedrive-hash-type flag (or hash_type config option) can be usedto select SHA1 during the transition period if this is importantyour workflow.
It does this by using the delta listing facilities of OneDrive whichreturns all the files in the remote very efficiently. This is muchmore efficient than listing directories recursively and is Microsoft'srecommended way of reading all the file information from a drive.
The API used for the recursive listing (ListR) only supports listingfrom the root of the drive. This will become increasingly inefficientthe further away you get from the root as rclone will have to discardfiles outside of the directory you are using.
Any files you delete with rclone will end up in the trash. Microsoftdoesn't provide an API to permanently delete files, nor to empty thetrash, so you will have to do that with one of Microsoft's apps or viathe OneDrive website.
If set to true, you will no longer be able to search for a SharePoint site whenconfiguring drive ID, because rclone will not request Sites.Read.All permission.Set it to true if your organization didn't assign Sites.Read.All permission to theapplication, and your organization disallows users to consent app permissionrequest on their own.
By default, rclone will hide OneNote files in directory listings becauseoperations like "Open" and "Update" won't work on them. But thisbehaviour may also prevent you from deleting them. If you want todelete OneNote files or otherwise want them to show up in directorylisting, set this option.
This will work if you are copying between two OneDrive Personal drives AND the files tocopy are already shared between them. Additionally, it should also function for a user whohas access permissions both between Onedrive for business and SharePoint under the sametenant, and between SharePoint and another SharePoint under the same tenant. In othercases, rclone will fall back to normal copy (which will be slightly slower).
Before rclone 1.62 an SHA1 hash was used by default for OnedrivePersonal. For 1.62 and later the default is to use a QuickXorHash forall onedrive types. If an SHA1 hash is desired then set this optionaccordingly.
However the delta listing API only works at the root of thedrive. If you use it not at the root then it recurses from the rootand discards all the data that is not under the directory you askedfor. So it will be correct but may not be very efficient.
As a rule of thumb if nearly all of your data is under rclone's rootdirectory (the root/directory in onedrive:root/directory) thenusing this flag will be be a big performance win. If your data ismostly not under the root then using this flag will be a bigperformance loss.
OneDrive supports System Metadata (not User Metadata, as of this writing) forboth files and directories. Much of the metadata is read-only, and there are somedifferences between OneDrive Personal and Business (see table below fordetails).
Permissions are also supported, if --onedrive-metadata-permissions is set. Theaccepted values for --onedrive-metadata-permissions are "read", "write","read,write", and "off" (the default). "write" supports adding new permissions,updating the "role" of existing permissions, and removing permissions. Updatingand removing require the Permission ID to be known, so it is recommended to use"read,write" instead of "write" if you wish to update/remove permissions.
When adding permissions, an email address can be provided in the User.ID orDisplayName properties of grantedTo or grantedToIdentities. Alternatively,an ObjectID can be provided in User.ID. At least one valid recipient must beprovided in order to add a permission for a user. Creating a Public Link is alsosupported, if Link.Scope is set to "anonymous".
If you don't use rclone for 90 days the refresh token willexpire. This will result in authorization problems. This is easy tofix by running the rclone config reconnect remote: command to get anew token and refresh token.
There are quite a few characters that can't be in OneDrive filenames. These can't occur on Windows platforms, but on non-Windowsplatforms they are common. Rclone will map these names to and from anidentical looking unicode equivalent. For example if a file has a ?in it will be mapped to instead.
The entire path, including the file name, must contain fewer than 400 characters for OneDrive, OneDrive for Business and SharePoint Online. If you are encrypting file and folder names with rclone, you may want to pay attention to this limitation because the encrypted names are typically longer than the original ones.
Every change in a file OneDrive causes the service to create a newversion of the file. This counts against a users quota. Forexample changing the modification time of a file creates a secondversion, so the file apparently uses twice the space.
Note At the time of writing Onedrive Personal creates versions(but not for setting the modification time) but the API for removingthem returns "API not found" so cleanup and no_versions should notbe used on Onedrive Personal.
Starting October 2018, users will no longer be able todisable versioning by default. This is because Microsoft has broughtanupdateto the mechanism. To change this new default setting, a PowerShellcommand is required to be run by a SharePoint admin. If you are anadmin, you can run these commands in PowerShell to change thatsetting:
OneDrive supports rclone cleanup which causes rclone to look throughevery file under the path supplied and delete all version but thecurrent version. Because this involves traversing all the files, thenquerying each file for versions it can be quite slow. Rclone does--checkers tests in parallel. The command also supports --interactive/ior --dry-run which is a great way to see what it would do.
It is aknownissue that Sharepoint (not OneDrive or OneDrive for Business) silently modifiesuploaded files, mainly Office files (.docx, .xlsx, etc.), causing file size andhash checks to fail. There are also other situations that will cause OneDrive toreport inconsistent file sizes. To use rclone with suchaffected files on Sharepoint, youmay disable these checks with the following command line arguments:
Alternatively, if you have write access to the OneDrive files, it may be possibleto fix this problem for certain files, by attempting the steps below.Open the web interface for OneDrive and find theaffected files (which will be in the error messages/log for rclone). Simply click oneach of these files, causing OneDrive to open them on the web. This will cause eachfile to be converted in place to a format that is functionally equivalentbut which will no longer trigger the size discrepancy. Once all problematic filesare converted you will no longer need the ignore options above.
c80f0f1006