Hi team,
Please consider adding a new that's similar to rsync. That is, to sync all files under two paths.
Sometime, I need to copy all files from another system into unity catalog using databricks fs cp local_path uc_path --recursive. Occasionally, the connection would be interrupted for reasons I do not fully understand. It's a pain to figure out what have been copied and what have not.
Hi team,
Please consider adding a new that's similar to
rsync. That is, to sync all files under two paths.Sometime, I need to copy all files from another system into unity catalog using
databricks fs cp local_path uc_path --recursive. Occasionally, the connection would be interrupted for reasons I do not fully understand. It's a pain to figure out what have been copied and what have not.